2024-05-27T06:11:58.600 INFO:root:teuthology version: 0.0.1.dev291+ge7ae758 2024-05-27T06:11:58.600 DEBUG:teuthology.run:Teuthology command: teuthology --name vshankar-2024-05-27_05:52:49-fs-wip-vshankar-testing-20240521.063558-debug-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/pool-perm} --verbose --archive /home/teuthworker/archive/vshankar-2024-05-27_05:52:49-fs-wip-vshankar-testing-20240521.063558-debug-testing-default-smithi/7727605 --owner scheduled_vshankar@teuthology -- /home/teuthworker/archive/vshankar-2024-05-27_05:52:49-fs-wip-vshankar-testing-20240521.063558-debug-testing-default-smithi/7727605/orig.config.yaml 2024-05-27T06:11:58.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-27T06:11:58.728 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-05-27_05:52:49-fs-wip-vshankar-testing-20240521.063558-debug-testing-default-smithi/7727605 branch: wip-vshankar-testing-20240521.063558-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/pool-perm} email: vshankar@redhat.com first_in_suite: false job_id: '7727605' kernel: flavor: default kdb: 1 sha1: b9459a26b0888785d05c47deb35abc9d0354ab93 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: vshankar-2024-05-27_05:52:49-fs-wip-vshankar-testing-20240521.063558-debug-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-vshankar-testing-20240521.063558-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 38f9d900c83c63799fbdbe61acc9a11b0d3554a6 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 38f9d900c83c63799fbdbe61acc9a11b0d3554a6 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240521.063558-debug sha1: 38f9d900c83c63799fbdbe61acc9a11b0d3554a6 owner: scheduled_vshankar@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 2499 sha1: 38f9d900c83c63799fbdbe61acc9a11b0d3554a6 sleep_before_teardown: 0 subset: 573/1024 suite: fs suite_branch: wip-vshankar-testing-20240521.063558-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_38f9d900c83c63799fbdbe61acc9a11b0d3554a6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 38f9d900c83c63799fbdbe61acc9a11b0d3554a6 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi087.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJbukeYSjVtTr5Q+0l6edl9id0cmP/M/Srjwdg2OqY8HHoLFYnseZ00vYsVs76i0sYz+AFJd4HGZozswGVOm7d4= smithi149.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDgI/iRWa6+Aj5bQXkyFu1rIY38vkrI/8NwUInDOdaAMoLX0fNqYIUBcgnPz7oMMB0xESpjSaMBcCueIm7lbPxI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_pool_perm teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: e7ae7580c417d6ab27fda98fecadca5d9f85d63e timestamp: 2024-05-27_05:52:49 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-05-27T06:11:58.728 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_38f9d900c83c63799fbdbe61acc9a11b0d3554a6/qa; will attempt to use it 2024-05-27T06:11:58.729 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_38f9d900c83c63799fbdbe61acc9a11b0d3554a6/qa/tasks 2024-05-27T06:11:58.729 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-27T06:11:58.730 INFO:teuthology.task.internal:Checking packages... 2024-05-27T06:11:58.750 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '38f9d900c83c63799fbdbe61acc9a11b0d3554a6' 2024-05-27T06:11:58.750 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-27T06:11:58.750 INFO:teuthology.packaging:ref: None 2024-05-27T06:11:58.750 INFO:teuthology.packaging:tag: None 2024-05-27T06:11:58.750 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240521.063558-debug 2024-05-27T06:11:58.750 INFO:teuthology.packaging:sha1: 38f9d900c83c63799fbdbe61acc9a11b0d3554a6 2024-05-27T06:11:58.750 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-vshankar-testing-20240521.063558-debug 2024-05-27T06:11:58.897 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3872-g38f9d900-1jammy 2024-05-27T06:11:58.898 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-27T06:11:58.909 INFO:teuthology.task.internal:no buildpackages task found 2024-05-27T06:11:58.909 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-27T06:11:58.917 INFO:teuthology.task.internal:Saving configuration 2024-05-27T06:11:58.933 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-27T06:11:58.940 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-27T06:11:58.965 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-27_05:52:49-fs-wip-vshankar-testing-20240521.063558-debug-testing-default-smithi/7727605', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-27 06:06:26.391547', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFgNPElzNeVImlQg/KZbB6VWmKvU8UvTPVvK7jSmIA/6'} 2024-05-27T06:11:58.989 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-27_05:52:49-fs-wip-vshankar-testing-20240521.063558-debug-testing-default-smithi/7727605', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-27 06:06:26.389597', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIA2bCQ/1UzBYSA7AS/+uJjoloox38JsGrh2k4WXngMhs'} 2024-05-27T06:11:58.989 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-27T06:11:58.995 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-05-27T06:11:58.995 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-05-27T06:11:58.996 INFO:teuthology.run_tasks:Running task console_log... 2024-05-27T06:11:59.056 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fda6c287ac0>, signals=[15]) 2024-05-27T06:11:59.056 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-27T06:11:59.063 INFO:teuthology.task.internal:Opening connections... 2024-05-27T06:11:59.063 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi087.front.sepia.ceph.com 2024-05-27T06:11:59.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T06:11:59.146 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi149.front.sepia.ceph.com 2024-05-27T06:11:59.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T06:11:59.223 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-27T06:11:59.229 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2024-05-27T06:11:59.235 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2024-05-27T06:11:59.235 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2024-05-27T06:11:59.287 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-27T06:11:59.287 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="Ubuntu" 2024-05-27T06:11:59.287 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="22.04" 2024-05-27T06:11:59.287 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-27T06:11:59.288 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_CODENAME=jammy 2024-05-27T06:11:59.288 INFO:teuthology.orchestra.run.smithi087.stdout:ID=ubuntu 2024-05-27T06:11:59.288 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE=debian 2024-05-27T06:11:59.288 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-27T06:11:59.288 INFO:teuthology.orchestra.run.smithi087.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-27T06:11:59.288 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-27T06:11:59.288 INFO:teuthology.orchestra.run.smithi087.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-27T06:11:59.288 INFO:teuthology.orchestra.run.smithi087.stdout:UBUNTU_CODENAME=jammy 2024-05-27T06:11:59.289 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2024-05-27T06:11:59.318 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2024-05-27T06:11:59.323 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2024-05-27T06:11:59.324 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2024-05-27T06:11:59.371 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-27T06:11:59.371 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Ubuntu" 2024-05-27T06:11:59.372 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="22.04" 2024-05-27T06:11:59.372 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-27T06:11:59.372 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_CODENAME=jammy 2024-05-27T06:11:59.372 INFO:teuthology.orchestra.run.smithi149.stdout:ID=ubuntu 2024-05-27T06:11:59.372 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE=debian 2024-05-27T06:11:59.372 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-27T06:11:59.372 INFO:teuthology.orchestra.run.smithi149.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-27T06:11:59.372 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-27T06:11:59.372 INFO:teuthology.orchestra.run.smithi149.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-27T06:11:59.372 INFO:teuthology.orchestra.run.smithi149.stdout:UBUNTU_CODENAME=jammy 2024-05-27T06:11:59.372 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2024-05-27T06:11:59.401 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-27T06:11:59.410 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-27T06:11:59.416 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-27T06:11:59.416 DEBUG:teuthology.orchestra.run.smithi087:> test '!' -e /home/ubuntu/cephtest 2024-05-27T06:11:59.419 DEBUG:teuthology.orchestra.run.smithi149:> test '!' -e /home/ubuntu/cephtest 2024-05-27T06:11:59.423 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-27T06:11:59.429 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-27T06:11:59.429 DEBUG:teuthology.orchestra.run.smithi087:> test -z $(ls -A /var/lib/ceph) 2024-05-27T06:11:59.465 DEBUG:teuthology.orchestra.run.smithi149:> test -z $(ls -A /var/lib/ceph) 2024-05-27T06:11:59.482 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-27T06:11:59.539 INFO:teuthology.run_tasks:Running task kernel... 2024-05-27T06:11:59.553 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'} 2024-05-27T06:11:59.553 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'}, 'mon.b': {'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'}}, timeout 300 2024-05-27T06:11:59.553 DEBUG:teuthology.orchestra.run.smithi087:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-27T06:11:59.554 DEBUG:teuthology.orchestra.run.smithi149:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-27T06:11:59.558 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T06:11:59.558 DEBUG:teuthology.task.kernel:sha1 for mon.a is b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-27T06:11:59.559 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "b9459a26b0888785d05c47deb35abc9d0354ab93"... 2024-05-27T06:11:59.559 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-05-27T06:11:59.559 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T06:11:59.560 DEBUG:teuthology.task.kernel:sha1 for mon.b is b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-27T06:11:59.560 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "b9459a26b0888785d05c47deb35abc9d0354ab93"... 2024-05-27T06:11:59.560 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-05-27T06:11:59.604 INFO:teuthology.orchestra.run.smithi087.stdout:5.15.0-56-generic 2024-05-27T06:11:59.604 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-27T06:11:59.604 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-27T06:11:59.604 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-27T06:11:59.612 INFO:teuthology.orchestra.run.smithi149.stdout:5.15.0-56-generic 2024-05-27T06:11:59.612 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-27T06:11:59.612 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-27T06:11:59.612 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-27T06:11:59.750 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2024-05-27T06:11:59.750 DEBUG:teuthology.orchestra.run.smithi087:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-05-27T06:11:59.754 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2024-05-27T06:11:59.754 DEBUG:teuthology.orchestra.run.smithi149:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-05-27T06:11:59.769 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-05-27T06:11:59.772 INFO:teuthology.orchestra.run.smithi087.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-05-27T06:11:59.895 INFO:teuthology.orchestra.run.smithi087.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-05-27T06:11:59.895 INFO:teuthology.orchestra.run.smithi087.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-05-27T06:11:59.895 INFO:teuthology.orchestra.run.smithi087.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-05-27T06:11:59.895 INFO:teuthology.orchestra.run.smithi087.stderr:hint: 2024-05-27T06:11:59.895 INFO:teuthology.orchestra.run.smithi087.stderr:hint: git config --global init.defaultBranch 2024-05-27T06:11:59.896 INFO:teuthology.orchestra.run.smithi087.stderr:hint: 2024-05-27T06:11:59.896 INFO:teuthology.orchestra.run.smithi087.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-05-27T06:11:59.896 INFO:teuthology.orchestra.run.smithi087.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-05-27T06:11:59.896 INFO:teuthology.orchestra.run.smithi087.stderr:hint: 2024-05-27T06:11:59.896 INFO:teuthology.orchestra.run.smithi087.stderr:hint: git branch -m 2024-05-27T06:11:59.898 INFO:teuthology.orchestra.run.smithi087.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-05-27T06:11:59.899 DEBUG:teuthology.orchestra.run.smithi087:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-05-27T06:11:59.925 INFO:teuthology.orchestra.run.smithi149.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-05-27T06:11:59.926 INFO:teuthology.orchestra.run.smithi149.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-05-27T06:11:59.926 INFO:teuthology.orchestra.run.smithi149.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-05-27T06:11:59.926 INFO:teuthology.orchestra.run.smithi149.stderr:hint: 2024-05-27T06:11:59.926 INFO:teuthology.orchestra.run.smithi149.stderr:hint: git config --global init.defaultBranch 2024-05-27T06:11:59.926 INFO:teuthology.orchestra.run.smithi149.stderr:hint: 2024-05-27T06:11:59.926 INFO:teuthology.orchestra.run.smithi149.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-05-27T06:11:59.926 INFO:teuthology.orchestra.run.smithi149.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-05-27T06:11:59.926 INFO:teuthology.orchestra.run.smithi149.stderr:hint: 2024-05-27T06:11:59.926 INFO:teuthology.orchestra.run.smithi149.stderr:hint: git branch -m 2024-05-27T06:11:59.927 INFO:teuthology.orchestra.run.smithi149.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-05-27T06:11:59.929 DEBUG:teuthology.orchestra.run.smithi149:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-05-27T06:11:59.964 DEBUG:teuthology.orchestra.run.smithi087:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-05-27T06:11:59.994 DEBUG:teuthology.orchestra.run.smithi149:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-05-27T06:12:00.024 DEBUG:teuthology.orchestra.run.smithi087:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-05-27T06:12:00.052 DEBUG:teuthology.orchestra.run.smithi149:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-05-27T06:13:15.329 INFO:teuthology.orchestra.run.smithi149.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-05-27T06:13:15.330 INFO:teuthology.orchestra.run.smithi149.stderr: * [new branch] main -> origin/main 2024-05-27T06:13:15.363 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20190312 -> 20190312 2024-05-27T06:13:15.363 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20190416 -> 20190416 2024-05-27T06:13:15.363 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20190514 -> 20190514 2024-05-27T06:13:15.363 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20190618 -> 20190618 2024-05-27T06:13:15.363 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20190717 -> 20190717 2024-05-27T06:13:15.364 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20190815 -> 20190815 2024-05-27T06:13:15.365 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20190923 -> 20190923 2024-05-27T06:13:15.366 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20191022 -> 20191022 2024-05-27T06:13:15.366 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20191215 -> 20191215 2024-05-27T06:13:15.366 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20200122 -> 20200122 2024-05-27T06:13:15.366 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20200316 -> 20200316 2024-05-27T06:13:15.366 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20200421 -> 20200421 2024-05-27T06:13:15.366 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20200519 -> 20200519 2024-05-27T06:13:15.366 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20200619 -> 20200619 2024-05-27T06:13:15.366 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20200721 -> 20200721 2024-05-27T06:13:15.366 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20200817 -> 20200817 2024-05-27T06:13:15.366 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20200918 -> 20200918 2024-05-27T06:13:15.366 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20201022 -> 20201022 2024-05-27T06:13:15.366 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20201118 -> 20201118 2024-05-27T06:13:15.367 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20201218 -> 20201218 2024-05-27T06:13:15.367 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20210208 -> 20210208 2024-05-27T06:13:15.367 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20210315 -> 20210315 2024-05-27T06:13:15.369 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20210511 -> 20210511 2024-05-27T06:13:15.369 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20210716 -> 20210716 2024-05-27T06:13:15.369 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20210818 -> 20210818 2024-05-27T06:13:15.369 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20210919 -> 20210919 2024-05-27T06:13:15.369 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20211027 -> 20211027 2024-05-27T06:13:15.369 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20211216 -> 20211216 2024-05-27T06:13:15.369 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20220209 -> 20220209 2024-05-27T06:13:15.370 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20220310 -> 20220310 2024-05-27T06:13:15.370 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20220411 -> 20220411 2024-05-27T06:13:15.370 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20220509 -> 20220509 2024-05-27T06:13:15.370 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20220610 -> 20220610 2024-05-27T06:13:15.370 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20220708 -> 20220708 2024-05-27T06:13:15.370 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20220815 -> 20220815 2024-05-27T06:13:15.370 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20220913 -> 20220913 2024-05-27T06:13:15.370 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20221012 -> 20221012 2024-05-27T06:13:15.370 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20221109 -> 20221109 2024-05-27T06:13:15.370 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20221214 -> 20221214 2024-05-27T06:13:15.370 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20230117 -> 20230117 2024-05-27T06:13:15.370 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20230210 -> 20230210 2024-05-27T06:13:15.370 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20230310 -> 20230310 2024-05-27T06:13:15.370 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20230404 -> 20230404 2024-05-27T06:13:15.371 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20230515 -> 20230515 2024-05-27T06:13:15.372 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20230625 -> 20230625 2024-05-27T06:13:15.372 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20230804 -> 20230804 2024-05-27T06:13:15.372 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20230919 -> 20230919 2024-05-27T06:13:15.372 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20231030 -> 20231030 2024-05-27T06:13:15.372 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20231111 -> 20231111 2024-05-27T06:13:15.372 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20231211 -> 20231211 2024-05-27T06:13:15.372 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20240115 -> 20240115 2024-05-27T06:13:15.372 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20240220 -> 20240220 2024-05-27T06:13:15.372 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20240312 -> 20240312 2024-05-27T06:13:15.373 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20240410 -> 20240410 2024-05-27T06:13:15.373 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20240513 -> 20240513 2024-05-27T06:13:18.993 INFO:teuthology.orchestra.run.smithi087.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-05-27T06:13:18.993 INFO:teuthology.orchestra.run.smithi087.stderr: * [new branch] main -> origin/main 2024-05-27T06:13:19.020 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20190312 -> 20190312 2024-05-27T06:13:19.020 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20190416 -> 20190416 2024-05-27T06:13:19.020 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20190514 -> 20190514 2024-05-27T06:13:19.020 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20190618 -> 20190618 2024-05-27T06:13:19.020 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20190717 -> 20190717 2024-05-27T06:13:19.021 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20190815 -> 20190815 2024-05-27T06:13:19.021 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20190923 -> 20190923 2024-05-27T06:13:19.021 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20191022 -> 20191022 2024-05-27T06:13:19.021 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20191215 -> 20191215 2024-05-27T06:13:19.028 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20200122 -> 20200122 2024-05-27T06:13:19.028 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20200316 -> 20200316 2024-05-27T06:13:19.028 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20200421 -> 20200421 2024-05-27T06:13:19.028 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20200519 -> 20200519 2024-05-27T06:13:19.028 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20200619 -> 20200619 2024-05-27T06:13:19.028 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20200721 -> 20200721 2024-05-27T06:13:19.028 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20200817 -> 20200817 2024-05-27T06:13:19.029 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20200918 -> 20200918 2024-05-27T06:13:19.029 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20201022 -> 20201022 2024-05-27T06:13:19.029 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20201118 -> 20201118 2024-05-27T06:13:19.029 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20201218 -> 20201218 2024-05-27T06:13:19.029 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20210208 -> 20210208 2024-05-27T06:13:19.029 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20210315 -> 20210315 2024-05-27T06:13:19.029 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20210511 -> 20210511 2024-05-27T06:13:19.029 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20210716 -> 20210716 2024-05-27T06:13:19.029 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20210818 -> 20210818 2024-05-27T06:13:19.029 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20210919 -> 20210919 2024-05-27T06:13:19.029 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20211027 -> 20211027 2024-05-27T06:13:19.029 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20211216 -> 20211216 2024-05-27T06:13:19.029 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20220209 -> 20220209 2024-05-27T06:13:19.030 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20220310 -> 20220310 2024-05-27T06:13:19.030 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20220411 -> 20220411 2024-05-27T06:13:19.030 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20220509 -> 20220509 2024-05-27T06:13:19.030 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20220610 -> 20220610 2024-05-27T06:13:19.030 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20220708 -> 20220708 2024-05-27T06:13:19.030 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20220815 -> 20220815 2024-05-27T06:13:19.030 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20220913 -> 20220913 2024-05-27T06:13:19.030 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20221012 -> 20221012 2024-05-27T06:13:19.030 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20221109 -> 20221109 2024-05-27T06:13:19.030 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20221214 -> 20221214 2024-05-27T06:13:19.031 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20230117 -> 20230117 2024-05-27T06:13:19.031 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20230210 -> 20230210 2024-05-27T06:13:19.031 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20230310 -> 20230310 2024-05-27T06:13:19.031 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20230404 -> 20230404 2024-05-27T06:13:19.031 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20230515 -> 20230515 2024-05-27T06:13:19.031 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20230625 -> 20230625 2024-05-27T06:13:19.031 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20230804 -> 20230804 2024-05-27T06:13:19.031 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20230919 -> 20230919 2024-05-27T06:13:19.031 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20231030 -> 20231030 2024-05-27T06:13:19.031 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20231111 -> 20231111 2024-05-27T06:13:19.031 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20231211 -> 20231211 2024-05-27T06:13:19.031 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20240115 -> 20240115 2024-05-27T06:13:19.031 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20240220 -> 20240220 2024-05-27T06:13:19.032 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20240312 -> 20240312 2024-05-27T06:13:19.032 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20240410 -> 20240410 2024-05-27T06:13:19.032 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20240513 -> 20240513 2024-05-27T06:13:19.721 INFO:teuthology.orchestra.run.smithi149.stderr:Updating files: 44% (1539/3421) Updating files: 45% (1540/3421) Updating files: 46% (1574/3421) Updating files: 47% (1608/3421) Updating files: 48% (1643/3421) Updating files: 49% (1677/3421) Updating files: 50% (1711/3421) Updating files: 51% (1745/3421) Updating files: 52% (1779/3421) Updating files: 53% (1814/3421) Updating files: 54% (1848/3421) Updating files: 55% (1882/3421) Updating files: 56% (1916/3421) Updating files: 57% (1950/3421) Updating files: 58% (1985/3421) Updating files: 59% (2019/3421) Updating files: 59% (2027/3421) Updating files: 60% (2053/3421) Updating files: 61% (2087/3421) Updating files: 62% (2122/3421) Updating files: 63% (2156/3421) Updating files: 64% (2190/3421) Updating files: 65% (2224/3421) Updating files: 66% (2258/3421) Updating files: 67% (2293/3421) Updating files: 68% (2327/3421) Updating files: 69% (2361/3421) Updating files: 70% (2395/3421) Updating files: 70% (2402/3421) Updating files: 71% (2429/3421) Updating files: 72% (2464/3421) Updating files: 73% (2498/3421) Updating files: 74% (2532/3421) Updating files: 75% (2566/3421) Updating files: 76% (2600/3421) Updating files: 77% (2635/3421) Updating files: 78% (2669/3421) Updating files: 79% (2703/3421) Updating files: 80% (2737/3421) Updating files: 81% (2772/3421) Updating files: 82% (2806/3421) Updating files: 82% (2838/3421) Updating files: 83% (2840/3421) Updating files: 84% (2874/3421) Updating files: 85% (2908/3421) Updating files: 86% (2943/3421) Updating files: 87% (2977/3421) Updating files: 88% (3011/3421) Updating files: 89% (3045/3421) Updating files: 90% (3079/3421) Updating files: 91% (3114/3421) Updating files: 92% (3148/3421) Updating files: 93% (3182/3421) Updating files: 94% (3216/3421) Updating files: 95% (3250/3421) Updating files: 96% (3285/3421) Updating files: 97% (3319/3421) Updating files: 98% (3353/3421) Updating files: 99% (3387/3421) Updating files: 100% (3421/3421) Updating files: 100% (3421/3421), done. 2024-05-27T06:13:19.726 INFO:teuthology.orchestra.run.smithi149.stdout:HEAD is now at ec8627ef Merge branch 'amd-isp-staging' into 'main' 2024-05-27T06:13:19.751 INFO:teuthology.task.kernel:Downloading kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on mon.b... 2024-05-27T06:13:19.752 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-27T06:13:19.993 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-gb9459a26b088/ 2024-05-27T06:13:19.994 DEBUG:teuthology.orchestra.run.smithi149:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-gb9459a26b088_6.9.0-gb9459a26b088-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-gb9459a26b088/ --input-file=- 2024-05-27T06:13:19.996 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi149.front.sepia.ceph.com to complete... 2024-05-27T06:13:22.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27 06:13:22 URL:https://2.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-gb9459a26b088/linux-image-6.9.0-gb9459a26b088_6.9.0-gb9459a26b088-1_amd64.deb [44988888/44988888] -> "/tmp/linux-image.deb" [1] 2024-05-27T06:13:22.323 INFO:teuthology.orchestra.run.smithi149.stderr:FINISHED --2024-05-27 06:13:22-- 2024-05-27T06:13:22.323 INFO:teuthology.orchestra.run.smithi149.stderr:Total wall clock time: 2.2s 2024-05-27T06:13:22.323 INFO:teuthology.orchestra.run.smithi149.stderr:Downloaded: 1 files, 43M in 2.0s (21.4 MB/s) 2024-05-27T06:13:22.327 INFO:teuthology.task.kernel:Installing kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on mon.b... 2024-05-27T06:13:22.327 DEBUG:teuthology.orchestra.run.smithi149:> sudo dpkg -i /tmp/linux-image.deb 2024-05-27T06:13:22.577 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package linux-image-6.9.0-gb9459a26b088. 2024-05-27T06:13:23.352 INFO:teuthology.orchestra.run.smithi087.stderr:Updating files: 45% (1541/3421) Updating files: 46% (1574/3421) Updating files: 47% (1608/3421) Updating files: 48% (1643/3421) Updating files: 49% (1677/3421) Updating files: 50% (1711/3421) Updating files: 51% (1745/3421) Updating files: 52% (1779/3421) Updating files: 53% (1814/3421) Updating files: 54% (1848/3421) Updating files: 55% (1882/3421) Updating files: 56% (1916/3421) Updating files: 57% (1950/3421) Updating files: 58% (1985/3421) Updating files: 59% (2019/3421) Updating files: 59% (2033/3421) Updating files: 60% (2053/3421) Updating files: 61% (2087/3421) Updating files: 62% (2122/3421) Updating files: 63% (2156/3421) Updating files: 64% (2190/3421) Updating files: 65% (2224/3421) Updating files: 66% (2258/3421) Updating files: 67% (2293/3421) Updating files: 68% (2327/3421) Updating files: 69% (2361/3421) Updating files: 70% (2395/3421) Updating files: 70% (2402/3421) Updating files: 71% (2429/3421) Updating files: 72% (2464/3421) Updating files: 73% (2498/3421) Updating files: 74% (2532/3421) Updating files: 75% (2566/3421) Updating files: 76% (2600/3421) Updating files: 77% (2635/3421) Updating files: 78% (2669/3421) Updating files: 79% (2703/3421) Updating files: 80% (2737/3421) Updating files: 81% (2772/3421) Updating files: 82% (2806/3421) Updating files: 83% (2840/3421) Updating files: 83% (2841/3421) Updating files: 84% (2874/3421) Updating files: 85% (2908/3421) Updating files: 86% (2943/3421) Updating files: 87% (2977/3421) Updating files: 88% (3011/3421) Updating files: 89% (3045/3421) Updating files: 90% (3079/3421) Updating files: 91% (3114/3421) Updating files: 92% (3148/3421) Updating files: 93% (3182/3421) Updating files: 94% (3216/3421) Updating files: 95% (3250/3421) Updating files: 96% (3285/3421) Updating files: 97% (3319/3421) Updating files: 98% (3353/3421) Updating files: 99% (3387/3421) Updating files: 100% (3421/3421) Updating files: 100% (3421/3421), done. 2024-05-27T06:13:23.357 INFO:teuthology.orchestra.run.smithi087.stdout:HEAD is now at ec8627ef Merge branch 'amd-isp-staging' into 'main' 2024-05-27T06:13:23.378 INFO:teuthology.task.kernel:Downloading kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on mon.a... 2024-05-27T06:13:23.379 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-27T06:13:23.612 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-gb9459a26b088/ 2024-05-27T06:13:23.613 DEBUG:teuthology.orchestra.run.smithi087:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-gb9459a26b088_6.9.0-gb9459a26b088-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-gb9459a26b088/ --input-file=- 2024-05-27T06:13:23.615 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi087.front.sepia.ceph.com to complete... 2024-05-27T06:13:24.501 INFO:teuthology.orchestra.run.smithi149.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-05-27T06:13:24.505 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-05-27T06:13:24.619 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking linux-image-6.9.0-gb9459a26b088 (6.9.0-gb9459a26b088-1) ... 2024-05-27T06:13:25.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27 06:13:24 URL:https://2.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-gb9459a26b088/linux-image-6.9.0-gb9459a26b088_6.9.0-gb9459a26b088-1_amd64.deb [44988888/44988888] -> "/tmp/linux-image.deb" [1] 2024-05-27T06:13:25.318 INFO:teuthology.orchestra.run.smithi087.stderr:FINISHED --2024-05-27 06:13:24-- 2024-05-27T06:13:25.319 INFO:teuthology.orchestra.run.smithi087.stderr:Total wall clock time: 1.7s 2024-05-27T06:13:25.319 INFO:teuthology.orchestra.run.smithi087.stderr:Downloaded: 1 files, 43M in 1.6s (27.6 MB/s) 2024-05-27T06:13:25.323 INFO:teuthology.task.kernel:Installing kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on mon.a... 2024-05-27T06:13:25.323 DEBUG:teuthology.orchestra.run.smithi087:> sudo dpkg -i /tmp/linux-image.deb 2024-05-27T06:13:25.584 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-image-6.9.0-gb9459a26b088. 2024-05-27T06:13:27.654 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-05-27T06:13:27.658 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-05-27T06:13:27.952 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-image-6.9.0-gb9459a26b088 (6.9.0-gb9459a26b088-1) ... 2024-05-27T06:13:28.720 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up linux-image-6.9.0-gb9459a26b088 (6.9.0-gb9459a26b088-1) ... 2024-05-27T06:13:28.809 INFO:teuthology.orchestra.run.smithi149.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-gb9459a26b088 2024-05-27T06:13:31.632 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-image-6.9.0-gb9459a26b088 (6.9.0-gb9459a26b088-1) ... 2024-05-27T06:13:31.742 INFO:teuthology.orchestra.run.smithi087.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-gb9459a26b088 2024-05-27T06:13:50.454 INFO:teuthology.orchestra.run.smithi149.stderr:Sourcing file `/etc/default/grub' 2024-05-27T06:13:50.466 INFO:teuthology.orchestra.run.smithi149.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-27T06:13:50.496 INFO:teuthology.orchestra.run.smithi149.stderr:Generating grub configuration file ... 2024-05-27T06:13:50.819 INFO:teuthology.orchestra.run.smithi149.stderr:Found linux image: /boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-27T06:13:50.834 INFO:teuthology.orchestra.run.smithi149.stderr:Found initrd image: /boot/initrd.img-6.9.0-gb9459a26b088 2024-05-27T06:13:51.150 INFO:teuthology.orchestra.run.smithi149.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-27T06:13:51.161 INFO:teuthology.orchestra.run.smithi149.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-27T06:13:51.225 INFO:teuthology.orchestra.run.smithi149.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-27T06:13:51.230 INFO:teuthology.orchestra.run.smithi149.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-27T06:13:51.370 INFO:teuthology.orchestra.run.smithi149.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-27T06:13:51.370 INFO:teuthology.orchestra.run.smithi149.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-27T06:13:51.370 INFO:teuthology.orchestra.run.smithi149.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-27T06:13:51.403 INFO:teuthology.orchestra.run.smithi149.stderr:done 2024-05-27T06:13:51.586 DEBUG:teuthology.orchestra.run.smithi149:> dpkg-deb -c /tmp/linux-image.deb 2024-05-27T06:13:51.594 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./ 2024-05-27T06:13:51.594 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./boot/ 2024-05-27T06:13:51.594 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7004139 2024-05-23 11:07 ./boot/System.map-6.9.0-gb9459a26b088 2024-05-27T06:13:51.612 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 172251 2024-05-23 11:07 ./boot/config-6.9.0-gb9459a26b088 2024-05-27T06:13:51.612 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13136896 2024-05-23 11:07 ./boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-27T06:13:51.632 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/ 2024-05-27T06:13:51.633 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/ 2024-05-27T06:13:51.633 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/postinst.d/ 2024-05-27T06:13:51.633 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/postrm.d/ 2024-05-27T06:13:51.633 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/preinst.d/ 2024-05-27T06:13:51.633 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/prerm.d/ 2024-05-27T06:13:51.633 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/ 2024-05-27T06:13:51.633 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/ 2024-05-27T06:13:51.633 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/ 2024-05-27T06:13:51.633 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/ 2024-05-27T06:13:51.633 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/ 2024-05-27T06:13:51.633 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/ 2024-05-27T06:13:51.633 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ 2024-05-27T06:13:51.634 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 507497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/aesni-intel.ko 2024-05-27T06:13:51.636 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-27T06:13:51.636 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-27T06:13:51.637 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-27T06:13:51.637 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 97945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-27T06:13:51.637 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 109897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-27T06:13:51.637 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 155241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-27T06:13:51.637 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-27T06:13:51.637 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-27T06:13:51.637 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 87001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-27T06:13:51.637 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-27T06:13:51.637 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 50297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-27T06:13:51.637 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 50369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-27T06:13:51.637 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 54505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-27T06:13:51.637 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-27T06:13:51.638 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 48041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-27T06:13:51.638 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 62865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-27T06:13:51.638 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 53561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-27T06:13:51.638 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-27T06:13:51.638 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-27T06:13:51.638 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/ 2024-05-27T06:13:51.638 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/ 2024-05-27T06:13:51.641 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/ 2024-05-27T06:13:51.641 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 49073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-27T06:13:51.641 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpuid.ko 2024-05-27T06:13:51.642 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/msr.ko 2024-05-27T06:13:51.642 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/ 2024-05-27T06:13:51.642 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 443289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-27T06:13:51.642 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1037081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-27T06:13:51.642 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 2850153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm.ko 2024-05-27T06:13:51.659 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ 2024-05-27T06:13:51.659 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 65017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/af_alg.ko 2024-05-27T06:13:51.659 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/algif_hash.ko 2024-05-27T06:13:51.659 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/algif_skcipher.ko 2024-05-27T06:13:51.659 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ansi_cprng.ko 2024-05-27T06:13:51.659 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/anubis.ko 2024-05-27T06:13:51.659 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/arc4.ko 2024-05-27T06:13:51.659 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/asymmetric_keys/ 2024-05-27T06:13:51.659 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-05-27T06:13:51.660 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/ 2024-05-27T06:13:51.660 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_memcpy.ko 2024-05-27T06:13:51.660 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_pq.ko 2024-05-27T06:13:51.660 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-27T06:13:51.660 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_tx.ko 2024-05-27T06:13:51.660 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_xor.ko 2024-05-27T06:13:51.660 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/raid6test.ko 2024-05-27T06:13:51.660 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authenc.ko 2024-05-27T06:13:51.660 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authencesn.ko 2024-05-27T06:13:51.660 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blake2b_generic.ko 2024-05-27T06:13:51.660 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_common.ko 2024-05-27T06:13:51.660 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_generic.ko 2024-05-27T06:13:51.660 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/camellia_generic.ko 2024-05-27T06:13:51.661 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast5_generic.ko 2024-05-27T06:13:51.661 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast6_generic.ko 2024-05-27T06:13:51.661 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast_common.ko 2024-05-27T06:13:51.661 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ccm.ko 2024-05-27T06:13:51.661 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cmac.ko 2024-05-27T06:13:51.661 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crc32_generic.ko 2024-05-27T06:13:51.661 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 59121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cryptd.ko 2024-05-27T06:13:51.661 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 48105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_engine.ko 2024-05-27T06:13:51.661 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_simd.ko 2024-05-27T06:13:51.661 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_user.ko 2024-05-27T06:13:51.661 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cts.ko 2024-05-27T06:13:51.661 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/des_generic.ko 2024-05-27T06:13:51.661 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/dh_generic.ko 2024-05-27T06:13:51.661 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/echainiv.ko 2024-05-27T06:13:51.662 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/essiv.ko 2024-05-27T06:13:51.662 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/fcrypt.ko 2024-05-27T06:13:51.662 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/khazad.ko 2024-05-27T06:13:51.662 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lrw.ko 2024-05-27T06:13:51.662 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4.ko 2024-05-27T06:13:51.662 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4hc.ko 2024-05-27T06:13:51.662 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/md4.ko 2024-05-27T06:13:51.662 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/michael_mic.ko 2024-05-27T06:13:51.662 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcbc.ko 2024-05-27T06:13:51.662 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcrypt.ko 2024-05-27T06:13:51.662 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/rmd160.ko 2024-05-27T06:13:51.662 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/seed.ko 2024-05-27T06:13:51.663 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/serpent_generic.ko 2024-05-27T06:13:51.663 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 169057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tcrypt.ko 2024-05-27T06:13:51.663 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tea.ko 2024-05-27T06:13:51.663 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_common.ko 2024-05-27T06:13:51.663 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_generic.ko 2024-05-27T06:13:51.663 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/vmac.ko 2024-05-27T06:13:51.663 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/wp512.ko 2024-05-27T06:13:51.663 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xcbc.ko 2024-05-27T06:13:51.663 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xor.ko 2024-05-27T06:13:51.663 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xts.ko 2024-05-27T06:13:51.663 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xxhash_generic.ko 2024-05-27T06:13:51.663 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ 2024-05-27T06:13:51.663 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ 2024-05-27T06:13:51.663 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_extlog.ko 2024-05-27T06:13:51.664 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-27T06:13:51.664 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_pad.ko 2024-05-27T06:13:51.664 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/apei/ 2024-05-27T06:13:51.664 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/apei/einj.ko 2024-05-27T06:13:51.664 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ec_sys.ko 2024-05-27T06:13:51.664 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/platform_profile.ko 2024-05-27T06:13:51.664 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbs.ko 2024-05-27T06:13:51.664 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbshc.ko 2024-05-27T06:13:51.664 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 119017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/video.ko 2024-05-27T06:13:51.664 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ 2024-05-27T06:13:51.664 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/acard-ahci.ko 2024-05-27T06:13:51.664 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 99177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci.ko 2024-05-27T06:13:51.664 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci_platform.ko 2024-05-27T06:13:51.665 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 107729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci.ko 2024-05-27T06:13:51.665 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci_platform.ko 2024-05-27T06:13:51.665 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_acpi.ko 2024-05-27T06:13:51.665 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ali.ko 2024-05-27T06:13:51.665 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_amd.ko 2024-05-27T06:13:51.665 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_artop.ko 2024-05-27T06:13:51.665 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atiixp.ko 2024-05-27T06:13:51.665 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atp867x.ko 2024-05-27T06:13:51.665 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd640.ko 2024-05-27T06:13:51.665 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd64x.ko 2024-05-27T06:13:51.665 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cypress.ko 2024-05-27T06:13:51.665 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_efar.ko 2024-05-27T06:13:51.665 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt366.ko 2024-05-27T06:13:51.665 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt37x.ko 2024-05-27T06:13:51.666 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-27T06:13:51.666 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-27T06:13:51.666 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it8213.ko 2024-05-27T06:13:51.666 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it821x.ko 2024-05-27T06:13:51.666 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_jmicron.ko 2024-05-27T06:13:51.666 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 60249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_legacy.ko 2024-05-27T06:13:51.666 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_marvell.ko 2024-05-27T06:13:51.666 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_mpiix.ko 2024-05-27T06:13:51.666 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_netcell.ko 2024-05-27T06:13:51.666 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ninja32.ko 2024-05-27T06:13:51.666 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87410.ko 2024-05-27T06:13:51.666 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87415.ko 2024-05-27T06:13:51.666 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_oldpiix.ko 2024-05-27T06:13:51.667 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_opti.ko 2024-05-27T06:13:51.667 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_optidma.ko 2024-05-27T06:13:51.667 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pcmcia.ko 2024-05-27T06:13:51.667 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-27T06:13:51.667 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-27T06:13:51.667 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_piccolo.ko 2024-05-27T06:13:51.667 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_radisys.ko 2024-05-27T06:13:51.667 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rdc.ko 2024-05-27T06:13:51.667 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rz1000.ko 2024-05-27T06:13:51.667 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sch.ko 2024-05-27T06:13:51.667 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_serverworks.ko 2024-05-27T06:13:51.667 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sil680.ko 2024-05-27T06:13:51.667 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sl82c105.ko 2024-05-27T06:13:51.668 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_triflex.ko 2024-05-27T06:13:51.668 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_via.ko 2024-05-27T06:13:51.668 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pdc_adma.ko 2024-05-27T06:13:51.668 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_inic162x.ko 2024-05-27T06:13:51.668 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 102113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_mv.ko 2024-05-27T06:13:51.668 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 85401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_nv.ko 2024-05-27T06:13:51.668 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_promise.ko 2024-05-27T06:13:51.668 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_qstor.ko 2024-05-27T06:13:51.668 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil.ko 2024-05-27T06:13:51.668 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 45897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil24.ko 2024-05-27T06:13:51.668 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sis.ko 2024-05-27T06:13:51.668 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_svw.ko 2024-05-27T06:13:51.668 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 53345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sx4.ko 2024-05-27T06:13:51.668 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_uli.ko 2024-05-27T06:13:51.669 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_via.ko 2024-05-27T06:13:51.669 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_vsc.ko 2024-05-27T06:13:51.669 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ 2024-05-27T06:13:51.669 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ks0108.ko 2024-05-27T06:13:51.669 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/ 2024-05-27T06:13:51.669 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 163833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/bcma.ko 2024-05-27T06:13:51.669 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/ 2024-05-27T06:13:51.669 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/ 2024-05-27T06:13:51.669 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 140833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/aoe.ko 2024-05-27T06:13:51.669 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/ 2024-05-27T06:13:51.669 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1241585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/drbd.ko 2024-05-27T06:13:51.669 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 203281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/floppy.ko 2024-05-27T06:13:51.669 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/ 2024-05-27T06:13:51.669 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 115257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-27T06:13:51.670 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 143425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/nbd.ko 2024-05-27T06:13:51.670 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/ 2024-05-27T06:13:51.670 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 126609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/null_blk.ko 2024-05-27T06:13:51.670 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 119865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/pktcdvd.ko 2024-05-27T06:13:51.670 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 313209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/rbd.ko 2024-05-27T06:13:51.670 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/ 2024-05-27T06:13:51.670 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 117217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-27T06:13:51.670 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/ 2024-05-27T06:13:51.670 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 70369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/zram.ko 2024-05-27T06:13:51.670 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ 2024-05-27T06:13:51.670 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/applicom.ko 2024-05-27T06:13:51.670 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hangcheck-timer.ko 2024-05-27T06:13:51.670 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/ 2024-05-27T06:13:51.671 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-27T06:13:51.671 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-27T06:13:51.671 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-27T06:13:51.671 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/via-rng.ko 2024-05-27T06:13:51.671 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-27T06:13:51.671 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ 2024-05-27T06:13:51.671 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 37185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-27T06:13:51.671 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 186913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-27T06:13:51.671 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-27T06:13:51.671 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 179441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-27T06:13:51.671 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 85433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-27T06:13:51.671 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 65305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-27T06:13:51.671 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/lp.ko 2024-05-27T06:13:51.672 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/ 2024-05-27T06:13:51.672 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 103385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/mwave.ko 2024-05-27T06:13:51.672 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/nvram.ko 2024-05-27T06:13:51.672 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ppdev.ko 2024-05-27T06:13:51.672 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 59233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tlclk.ko 2024-05-27T06:13:51.672 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/ 2024-05-27T06:13:51.672 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-27T06:13:51.672 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-05-27T06:13:51.672 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-05-27T06:13:51.672 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-05-27T06:13:51.672 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-27T06:13:51.672 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-27T06:13:51.672 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-05-27T06:13:51.673 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/ 2024-05-27T06:13:51.673 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/xillybus_class.ko 2024-05-27T06:13:51.673 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 62537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/xillybus_core.ko 2024-05-27T06:13:51.673 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-05-27T06:13:51.673 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/ 2024-05-27T06:13:51.673 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-palmas.ko 2024-05-27T06:13:51.673 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 57281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-si5351.ko 2024-05-27T06:13:51.673 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-twl6040.ko 2024-05-27T06:13:51.673 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-wm831x.ko 2024-05-27T06:13:51.673 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/ 2024-05-27T06:13:51.673 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-27T06:13:51.673 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-27T06:13:51.673 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-27T06:13:51.673 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ 2024-05-27T06:13:51.674 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ 2024-05-27T06:13:51.674 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 89209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-27T06:13:51.674 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 333593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp.ko 2024-05-27T06:13:51.674 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/ 2024-05-27T06:13:51.674 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/ 2024-05-27T06:13:51.674 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/ 2024-05-27T06:13:51.674 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 751433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-27T06:13:51.723 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-05-27T06:13:51.723 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-27T06:13:51.724 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-aes.ko 2024-05-27T06:13:51.724 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-sha.ko 2024-05-27T06:13:51.724 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/ 2024-05-27T06:13:51.724 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 90465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-27T06:13:51.724 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/ 2024-05-27T06:13:51.724 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/dca.ko 2024-05-27T06:13:51.724 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ 2024-05-27T06:13:51.724 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/ 2024-05-27T06:13:51.724 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-27T06:13:51.724 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ 2024-05-27T06:13:51.724 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 146745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-27T06:13:51.724 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ 2024-05-27T06:13:51.725 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 96137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/amd64_edac.ko 2024-05-27T06:13:51.725 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/e752x_edac.ko 2024-05-27T06:13:51.725 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 51097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/edac_mce_amd.ko 2024-05-27T06:13:51.725 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3000_edac.ko 2024-05-27T06:13:51.725 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3200_edac.ko 2024-05-27T06:13:51.725 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5100_edac.ko 2024-05-27T06:13:51.725 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5400_edac.ko 2024-05-27T06:13:51.725 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7300_edac.ko 2024-05-27T06:13:51.725 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 64153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7core_edac.ko 2024-05-27T06:13:51.725 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i82975x_edac.ko 2024-05-27T06:13:51.725 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ie31200_edac.ko 2024-05-27T06:13:51.725 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 68689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/sb_edac.ko 2024-05-27T06:13:51.725 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/x38_edac.ko 2024-05-27T06:13:51.726 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/ 2024-05-27T06:13:51.726 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-gpio.ko 2024-05-27T06:13:51.726 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-max14577.ko 2024-05-27T06:13:51.726 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-max77693.ko 2024-05-27T06:13:51.726 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-max8997.ko 2024-05-27T06:13:51.726 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-palmas.ko 2024-05-27T06:13:51.726 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-rt8973a.ko 2024-05-27T06:13:51.726 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-sm5502.ko 2024-05-27T06:13:51.726 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/ 2024-05-27T06:13:51.726 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 42945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/dmi-sysfs.ko 2024-05-27T06:13:51.726 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/efi/ 2024-05-27T06:13:51.726 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/efi/efi-pstore.ko 2024-05-27T06:13:51.726 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-27T06:13:51.727 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/ 2024-05-27T06:13:51.727 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-adp5520.ko 2024-05-27T06:13:51.727 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-amd8111.ko 2024-05-27T06:13:51.727 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-arizona.ko 2024-05-27T06:13:51.727 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-da9052.ko 2024-05-27T06:13:51.727 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-da9055.ko 2024-05-27T06:13:51.727 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-dln2.ko 2024-05-27T06:13:51.727 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 81065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-f7188x.ko 2024-05-27T06:13:51.727 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-generic.ko 2024-05-27T06:13:51.727 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ich.ko 2024-05-27T06:13:51.727 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-05-27T06:13:51.727 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-kempld.ko 2024-05-27T06:13:51.728 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-lp3943.ko 2024-05-27T06:13:51.728 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-max7300.ko 2024-05-27T06:13:51.728 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-max730x.ko 2024-05-27T06:13:51.728 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-max732x.ko 2024-05-27T06:13:51.728 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-05-27T06:13:51.728 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 55497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-pca953x.ko 2024-05-27T06:13:51.728 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-pcf857x.ko 2024-05-27T06:13:51.728 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-rdc321x.ko 2024-05-27T06:13:51.728 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-sch.ko 2024-05-27T06:13:51.728 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-sch311x.ko 2024-05-27T06:13:51.728 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-tps65912.ko 2024-05-27T06:13:51.728 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-twl4030.ko 2024-05-27T06:13:51.728 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-twl6040.ko 2024-05-27T06:13:51.729 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-27T06:13:51.729 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-vx855.ko 2024-05-27T06:13:51.729 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-wm831x.ko 2024-05-27T06:13:51.729 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-wm8350.ko 2024-05-27T06:13:51.729 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-wm8994.ko 2024-05-27T06:13:51.729 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/ 2024-05-27T06:13:51.729 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-a4tech.ko 2024-05-27T06:13:51.729 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-apple.ko 2024-05-27T06:13:51.729 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-appleir.ko 2024-05-27T06:13:51.729 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-aureal.ko 2024-05-27T06:13:51.729 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-axff.ko 2024-05-27T06:13:51.729 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-belkin.ko 2024-05-27T06:13:51.729 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-cherry.ko 2024-05-27T06:13:51.730 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-chicony.ko 2024-05-27T06:13:51.730 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 74385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-cp2112.ko 2024-05-27T06:13:51.730 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-cypress.ko 2024-05-27T06:13:51.730 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-dr.ko 2024-05-27T06:13:51.730 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elecom.ko 2024-05-27T06:13:51.730 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elo.ko 2024-05-27T06:13:51.730 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-emsff.ko 2024-05-27T06:13:51.730 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ezkey.ko 2024-05-27T06:13:51.730 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gaff.ko 2024-05-27T06:13:51.730 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-generic.ko 2024-05-27T06:13:51.730 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gt683r.ko 2024-05-27T06:13:51.730 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gyration.ko 2024-05-27T06:13:51.730 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-27T06:13:51.731 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-27T06:13:51.731 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtekff.ko 2024-05-27T06:13:51.731 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-hyperv.ko 2024-05-27T06:13:51.731 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-icade.ko 2024-05-27T06:13:51.731 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kensington.ko 2024-05-27T06:13:51.731 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-keytouch.ko 2024-05-27T06:13:51.731 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kye.ko 2024-05-27T06:13:51.731 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lcpower.ko 2024-05-27T06:13:51.731 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-led.ko 2024-05-27T06:13:51.731 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 54209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lenovo.ko 2024-05-27T06:13:51.731 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 37545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lg-g15.ko 2024-05-27T06:13:51.731 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 67961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-27T06:13:51.731 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 121361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-27T06:13:51.732 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 97929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech.ko 2024-05-27T06:13:51.732 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-magicmouse.ko 2024-05-27T06:13:51.732 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-microsoft.ko 2024-05-27T06:13:51.732 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-monterey.ko 2024-05-27T06:13:51.732 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 58993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-multitouch.ko 2024-05-27T06:13:51.732 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ntrig.ko 2024-05-27T06:13:51.732 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ortek.ko 2024-05-27T06:13:51.732 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-penmount.ko 2024-05-27T06:13:51.732 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-petalynx.ko 2024-05-27T06:13:51.732 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 91217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-picolcd.ko 2024-05-27T06:13:51.732 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-pl.ko 2024-05-27T06:13:51.732 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-plantronics.ko 2024-05-27T06:13:51.732 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-primax.ko 2024-05-27T06:13:51.733 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 42881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-rmi.ko 2024-05-27T06:13:51.733 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-27T06:13:51.733 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-common.ko 2024-05-27T06:13:51.733 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-27T06:13:51.733 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-27T06:13:51.733 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-27T06:13:51.733 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-27T06:13:51.733 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-27T06:13:51.733 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-27T06:13:51.733 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-27T06:13:51.733 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-27T06:13:51.733 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-27T06:13:51.733 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat.ko 2024-05-27T06:13:51.734 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-saitek.ko 2024-05-27T06:13:51.734 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 42297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-samsung.ko 2024-05-27T06:13:51.734 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-27T06:13:51.734 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sjoy.ko 2024-05-27T06:13:51.734 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 62121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sony.ko 2024-05-27T06:13:51.734 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-speedlink.ko 2024-05-27T06:13:51.734 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-steelseries.ko 2024-05-27T06:13:51.734 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sunplus.ko 2024-05-27T06:13:51.734 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-27T06:13:51.734 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tivo.ko 2024-05-27T06:13:51.734 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tmff.ko 2024-05-27T06:13:51.734 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-topseed.ko 2024-05-27T06:13:51.734 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-twinhan.ko 2024-05-27T06:13:51.735 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 81097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-uclogic.ko 2024-05-27T06:13:51.735 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-waltop.ko 2024-05-27T06:13:51.735 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 184729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-wiimote.ko 2024-05-27T06:13:51.735 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-xinmo.ko 2024-05-27T06:13:51.735 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zpff.ko 2024-05-27T06:13:51.735 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zydacron.ko 2024-05-27T06:13:51.735 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 319897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid.ko 2024-05-27T06:13:51.735 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/uhid.ko 2024-05-27T06:13:51.735 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/ 2024-05-27T06:13:51.735 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 153617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/usbhid.ko 2024-05-27T06:13:51.735 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/usbkbd.ko 2024-05-27T06:13:51.735 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/usbmouse.ko 2024-05-27T06:13:51.735 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 261929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/wacom.ko 2024-05-27T06:13:51.736 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/ 2024-05-27T06:13:51.736 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 75057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_balloon.ko 2024-05-27T06:13:51.736 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 110657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_utils.ko 2024-05-27T06:13:51.736 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 381625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_vmbus.ko 2024-05-27T06:13:51.736 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ 2024-05-27T06:13:51.736 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 77145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru.ko 2024-05-27T06:13:51.736 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 67001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru3.ko 2024-05-27T06:13:51.736 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 42241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-27T06:13:51.736 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7414.ko 2024-05-27T06:13:51.736 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7418.ko 2024-05-27T06:13:51.736 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adc128d818.ko 2024-05-27T06:13:51.736 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1025.ko 2024-05-27T06:13:51.736 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 115049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1026.ko 2024-05-27T06:13:51.736 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1029.ko 2024-05-27T06:13:51.737 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 55217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1031.ko 2024-05-27T06:13:51.737 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm9240.ko 2024-05-27T06:13:51.737 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ads7828.ko 2024-05-27T06:13:51.737 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7410.ko 2024-05-27T06:13:51.737 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7411.ko 2024-05-27T06:13:51.737 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 89017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7462.ko 2024-05-27T06:13:51.737 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 49145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7470.ko 2024-05-27T06:13:51.737 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 81465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7475.ko 2024-05-27T06:13:51.737 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7x10.ko 2024-05-27T06:13:51.737 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 48169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/amc6821.ko 2024-05-27T06:13:51.737 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 68857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/applesmc.ko 2024-05-27T06:13:51.737 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 60185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asb100.ko 2024-05-27T06:13:51.737 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 69001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asc7621.ko 2024-05-27T06:13:51.737 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 47969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-27T06:13:51.738 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/atxp1.ko 2024-05-27T06:13:51.738 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/coretemp.ko 2024-05-27T06:13:51.738 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/da9052-hwmon.ko 2024-05-27T06:13:51.738 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/da9055-hwmon.ko 2024-05-27T06:13:51.738 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 55705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-27T06:13:51.738 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 113129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dme1737.ko 2024-05-27T06:13:51.738 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds1621.ko 2024-05-27T06:13:51.738 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds620.ko 2024-05-27T06:13:51.738 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc1403.ko 2024-05-27T06:13:51.738 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc2103.ko 2024-05-27T06:13:51.738 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc6w201.ko 2024-05-27T06:13:51.738 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 78913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71805f.ko 2024-05-27T06:13:51.739 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 108953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71882fg.ko 2024-05-27T06:13:51.739 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 50689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f75375s.ko 2024-05-27T06:13:51.739 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fam15h_power.ko 2024-05-27T06:13:51.739 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 65761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fschmd.ko 2024-05-27T06:13:51.739 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g760a.ko 2024-05-27T06:13:51.739 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g762.ko 2024-05-27T06:13:51.739 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 59753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl518sm.ko 2024-05-27T06:13:51.739 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 56305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl520sm.ko 2024-05-27T06:13:51.739 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hih6130.ko 2024-05-27T06:13:51.739 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-27T06:13:51.739 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5500_temp.ko 2024-05-27T06:13:51.739 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5k_amb.ko 2024-05-27T06:13:51.739 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 42577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmaem.ko 2024-05-27T06:13:51.739 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmpex.ko 2024-05-27T06:13:51.740 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina209.ko 2024-05-27T06:13:51.740 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina2xx.ko 2024-05-27T06:13:51.740 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 156457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/it87.ko 2024-05-27T06:13:51.740 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/jc42.ko 2024-05-27T06:13:51.740 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k10temp.ko 2024-05-27T06:13:51.740 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k8temp.ko 2024-05-27T06:13:51.740 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lineage-pem.ko 2024-05-27T06:13:51.740 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 57761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm63.ko 2024-05-27T06:13:51.740 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm73.ko 2024-05-27T06:13:51.740 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm75.ko 2024-05-27T06:13:51.740 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm77.ko 2024-05-27T06:13:51.740 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm78.ko 2024-05-27T06:13:51.740 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 37041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm80.ko 2024-05-27T06:13:51.741 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm83.ko 2024-05-27T06:13:51.741 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 86489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm85.ko 2024-05-27T06:13:51.741 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 55633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm87.ko 2024-05-27T06:13:51.741 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 76481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm90.ko 2024-05-27T06:13:51.741 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm92.ko 2024-05-27T06:13:51.741 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 131497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm93.ko 2024-05-27T06:13:51.741 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95234.ko 2024-05-27T06:13:51.741 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95241.ko 2024-05-27T06:13:51.741 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95245.ko 2024-05-27T06:13:51.741 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc2945.ko 2024-05-27T06:13:51.741 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4151.ko 2024-05-27T06:13:51.741 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4215.ko 2024-05-27T06:13:51.741 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4222.ko 2024-05-27T06:13:51.741 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4245.ko 2024-05-27T06:13:51.742 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4260.ko 2024-05-27T06:13:51.742 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4261.ko 2024-05-27T06:13:51.742 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max16065.ko 2024-05-27T06:13:51.742 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1619.ko 2024-05-27T06:13:51.742 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1668.ko 2024-05-27T06:13:51.742 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max197.ko 2024-05-27T06:13:51.742 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6639.ko 2024-05-27T06:13:51.742 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6650.ko 2024-05-27T06:13:51.742 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6697.ko 2024-05-27T06:13:51.742 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mc13783-adc.ko 2024-05-27T06:13:51.742 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mcp3021.ko 2024-05-27T06:13:51.742 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-05-27T06:13:51.742 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 56497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6683.ko 2024-05-27T06:13:51.743 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 141345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775-core.ko 2024-05-27T06:13:51.743 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 72729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775.ko 2024-05-27T06:13:51.743 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 67769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct7802.ko 2024-05-27T06:13:51.743 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 97769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87360.ko 2024-05-27T06:13:51.743 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 61913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87427.ko 2024-05-27T06:13:51.743 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pcf8591.ko 2024-05-27T06:13:51.743 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ 2024-05-27T06:13:51.743 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-27T06:13:51.743 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-27T06:13:51.743 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-27T06:13:51.743 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-27T06:13:51.743 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-27T06:13:51.743 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-27T06:13:51.744 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-27T06:13:51.744 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 101225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-27T06:13:51.744 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-27T06:13:51.744 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-27T06:13:51.744 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-27T06:13:51.744 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-27T06:13:51.744 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/powr1220.ko 2024-05-27T06:13:51.744 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5627.ko 2024-05-27T06:13:51.744 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5636.ko 2024-05-27T06:13:51.744 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-27T06:13:51.744 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht15.ko 2024-05-27T06:13:51.744 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht21.ko 2024-05-27T06:13:51.744 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/shtc1.ko 2024-05-27T06:13:51.744 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 48705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sis5595.ko 2024-05-27T06:13:51.745 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47b397.ko 2024-05-27T06:13:51.745 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 46465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m1.ko 2024-05-27T06:13:51.745 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m192.ko 2024-05-27T06:13:51.745 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/thmc50.ko 2024-05-27T06:13:51.745 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp102.ko 2024-05-27T06:13:51.745 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp103.ko 2024-05-27T06:13:51.745 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp401.ko 2024-05-27T06:13:51.745 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp421.ko 2024-05-27T06:13:51.745 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via-cputemp.ko 2024-05-27T06:13:51.745 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 50209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via686a.ko 2024-05-27T06:13:51.745 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 59657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt1211.ko 2024-05-27T06:13:51.745 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 62729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt8231.ko 2024-05-27T06:13:51.745 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 71161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627ehf.ko 2024-05-27T06:13:51.745 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 96569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627hf.ko 2024-05-27T06:13:51.746 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 85905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83781d.ko 2024-05-27T06:13:51.746 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 75121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83791d.ko 2024-05-27T06:13:51.746 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 83417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83792d.ko 2024-05-27T06:13:51.746 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 116769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83793.ko 2024-05-27T06:13:51.746 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 134433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83795.ko 2024-05-27T06:13:51.746 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l785ts.ko 2024-05-27T06:13:51.746 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l786ng.ko 2024-05-27T06:13:51.746 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-05-27T06:13:51.746 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-05-27T06:13:51.746 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/ 2024-05-27T06:13:51.746 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/ 2024-05-27T06:13:51.746 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-27T06:13:51.746 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-27T06:13:51.747 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/ 2024-05-27T06:13:51.747 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-05-27T06:13:51.747 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-05-27T06:13:51.747 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-05-27T06:13:51.747 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-27T06:13:51.747 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-27T06:13:51.747 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-27T06:13:51.747 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-05-27T06:13:51.747 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-27T06:13:51.747 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-05-27T06:13:51.747 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 64217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-27T06:13:51.747 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-27T06:13:51.747 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-27T06:13:51.748 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-27T06:13:51.748 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-05-27T06:13:51.748 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-05-27T06:13:51.748 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 76961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-27T06:13:51.748 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-27T06:13:51.748 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 52929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-27T06:13:51.748 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-05-27T06:13:51.748 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-27T06:13:51.748 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-27T06:13:51.748 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-05-27T06:13:51.748 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-27T06:13:51.748 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-27T06:13:51.748 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 57209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-27T06:13:51.748 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-05-27T06:13:51.749 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-27T06:13:51.749 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-27T06:13:51.749 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-05-27T06:13:51.749 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-05-27T06:13:51.749 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-27T06:13:51.749 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-05-27T06:13:51.749 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-27T06:13:51.749 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-27T06:13:51.749 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-27T06:13:51.749 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-27T06:13:51.749 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 59121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-05-27T06:13:51.749 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-mux.ko 2024-05-27T06:13:51.749 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-smbus.ko 2024-05-27T06:13:51.750 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-stub.ko 2024-05-27T06:13:51.750 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/ 2024-05-27T06:13:51.750 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-05-27T06:13:51.750 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-05-27T06:13:51.750 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-05-27T06:13:51.750 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ 2024-05-27T06:13:51.750 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ 2024-05-27T06:13:51.750 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 329681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-27T06:13:51.750 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1119785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_core.ko 2024-05-27T06:13:51.750 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 83897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-27T06:13:51.750 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 408329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-27T06:13:51.750 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 120905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-27T06:13:51.750 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 347201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-27T06:13:51.751 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 84937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-27T06:13:51.751 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/ 2024-05-27T06:13:51.751 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/ 2024-05-27T06:13:51.751 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 590873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-27T06:13:51.751 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/ 2024-05-27T06:13:51.751 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 514577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-27T06:13:51.751 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/ 2024-05-27T06:13:51.751 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 911649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-27T06:13:51.751 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ 2024-05-27T06:13:51.751 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 375449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-27T06:13:51.751 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/ocrdma/ 2024-05-27T06:13:51.751 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 197097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-05-27T06:13:51.751 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/usnic/ 2024-05-27T06:13:51.751 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 212497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-05-27T06:13:51.752 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ 2024-05-27T06:13:51.752 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ 2024-05-27T06:13:51.752 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 334353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-27T06:13:51.752 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ 2024-05-27T06:13:51.752 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 120649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-27T06:13:51.752 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ 2024-05-27T06:13:51.752 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 132577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-27T06:13:51.752 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ 2024-05-27T06:13:51.752 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 157929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-27T06:13:51.752 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ 2024-05-27T06:13:51.752 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 156665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-27T06:13:51.752 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/ 2024-05-27T06:13:51.752 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/evbug.ko 2024-05-27T06:13:51.753 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/ff-memless.ko 2024-05-27T06:13:51.753 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/ 2024-05-27T06:13:51.753 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-27T06:13:51.753 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-27T06:13:51.753 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 50705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/gameport.ko 2024-05-27T06:13:51.753 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 49433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/joydev.ko 2024-05-27T06:13:51.753 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/ 2024-05-27T06:13:51.753 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-05-27T06:13:51.753 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-05-27T06:13:51.753 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-05-27T06:13:51.753 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-05-27T06:13:51.753 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 45465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-27T06:13:51.753 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-05-27T06:13:51.754 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/lkkbd.ko 2024-05-27T06:13:51.754 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/lm8323.ko 2024-05-27T06:13:51.754 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/lm8333.ko 2024-05-27T06:13:51.754 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-05-27T06:13:51.754 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-05-27T06:13:51.754 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-05-27T06:13:51.754 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-05-27T06:13:51.754 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/newtonkbd.ko 2024-05-27T06:13:51.754 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-05-27T06:13:51.754 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/qt1070.ko 2024-05-27T06:13:51.754 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/qt2160.ko 2024-05-27T06:13:51.754 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-05-27T06:13:51.754 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/stowaway.ko 2024-05-27T06:13:51.755 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/sunkbd.ko 2024-05-27T06:13:51.755 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-05-27T06:13:51.755 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-05-27T06:13:51.755 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-05-27T06:13:51.755 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/xtkbd.ko 2024-05-27T06:13:51.755 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/matrix-keymap.ko 2024-05-27T06:13:51.755 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/ 2024-05-27T06:13:51.755 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/appletouch.ko 2024-05-27T06:13:51.755 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/bcm5974.ko 2024-05-27T06:13:51.755 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 159993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/cyapatp.ko 2024-05-27T06:13:51.755 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 114193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-27T06:13:51.755 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/gpio_mouse.ko 2024-05-27T06:13:51.755 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 428121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/psmouse.ko 2024-05-27T06:13:51.756 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/sermouse.ko 2024-05-27T06:13:51.756 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-27T06:13:51.756 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-27T06:13:51.756 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-27T06:13:51.756 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/ 2024-05-27T06:13:51.756 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 140921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-27T06:13:51.756 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/ 2024-05-27T06:13:51.756 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/altera_ps2.ko 2024-05-27T06:13:51.756 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/arc_ps2.ko 2024-05-27T06:13:51.756 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/ct82c710.ko 2024-05-27T06:13:51.756 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-27T06:13:51.756 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/parkbd.ko 2024-05-27T06:13:51.756 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/pcips2.ko 2024-05-27T06:13:51.757 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/ps2mult.ko 2024-05-27T06:13:51.757 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serio_raw.ko 2024-05-27T06:13:51.757 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serport.ko 2024-05-27T06:13:51.757 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/sparse-keymap.ko 2024-05-27T06:13:51.757 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/ 2024-05-27T06:13:51.757 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-88pm860x.ko 2024-05-27T06:13:51.757 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-adp5520.ko 2024-05-27T06:13:51.757 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 77193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-bd2802.ko 2024-05-27T06:13:51.757 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-blinkm.ko 2024-05-27T06:13:51.757 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-da903x.ko 2024-05-27T06:13:51.757 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-da9052.ko 2024-05-27T06:13:51.757 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-gpio.ko 2024-05-27T06:13:51.757 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3530.ko 2024-05-27T06:13:51.757 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3533.ko 2024-05-27T06:13:51.758 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm355x.ko 2024-05-27T06:13:51.758 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3642.ko 2024-05-27T06:13:51.758 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp3944.ko 2024-05-27T06:13:51.758 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp8788.ko 2024-05-27T06:13:51.758 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-max8997.ko 2024-05-27T06:13:51.758 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-mc13783.ko 2024-05-27T06:13:51.758 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-menf21bmc.ko 2024-05-27T06:13:51.758 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-pca9532.ko 2024-05-27T06:13:51.758 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-pca955x.ko 2024-05-27T06:13:51.758 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-pca963x.ko 2024-05-27T06:13:51.758 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-ss4200.ko 2024-05-27T06:13:51.758 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-tca6507.ko 2024-05-27T06:13:51.758 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-wm831x-status.ko 2024-05-27T06:13:51.759 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-wm8350.ko 2024-05-27T06:13:51.759 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ 2024-05-27T06:13:51.759 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-27T06:13:51.759 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-27T06:13:51.759 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-27T06:13:51.759 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-27T06:13:51.759 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-27T06:13:51.759 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-27T06:13:51.759 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-27T06:13:51.759 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-27T06:13:51.759 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-27T06:13:51.759 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/ 2024-05-27T06:13:51.759 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/ 2024-05-27T06:13:51.760 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 790665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/bcache.ko 2024-05-27T06:13:51.760 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 49065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bio-prison.ko 2024-05-27T06:13:51.760 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 116817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bufio.ko 2024-05-27T06:13:51.760 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 58273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache-smq.ko 2024-05-27T06:13:51.760 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 199017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache.ko 2024-05-27T06:13:51.760 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 134937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-crypt.ko 2024-05-27T06:13:51.760 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-delay.ko 2024-05-27T06:13:51.760 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 67489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-era.ko 2024-05-27T06:13:51.760 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-flakey.ko 2024-05-27T06:13:51.760 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 50441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log-userspace.ko 2024-05-27T06:13:51.760 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log.ko 2024-05-27T06:13:51.760 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 60969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-mirror.ko 2024-05-27T06:13:51.760 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 97193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-multipath.ko 2024-05-27T06:13:51.761 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-queue-length.ko 2024-05-27T06:13:51.761 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 85681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-raid.ko 2024-05-27T06:13:51.761 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-region-hash.ko 2024-05-27T06:13:51.761 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-round-robin.ko 2024-05-27T06:13:51.761 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-service-time.ko 2024-05-27T06:13:51.761 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 139793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-snapshot.ko 2024-05-27T06:13:51.761 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-switch.ko 2024-05-27T06:13:51.761 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 234441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-thin-pool.ko 2024-05-27T06:13:51.761 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 66417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-verity.ko 2024-05-27T06:13:51.761 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-zero.ko 2024-05-27T06:13:51.761 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/ 2024-05-27T06:13:51.761 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 264273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-27T06:13:51.761 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid0.ko 2024-05-27T06:13:51.761 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 124705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid1.ko 2024-05-27T06:13:51.762 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 157673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid10.ko 2024-05-27T06:13:51.762 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 444649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid456.ko 2024-05-27T06:13:51.762 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/ 2024-05-27T06:13:51.762 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/ 2024-05-27T06:13:51.762 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 214833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptbase.ko 2024-05-27T06:13:51.762 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 77977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptctl.ko 2024-05-27T06:13:51.762 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 54777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptfc.ko 2024-05-27T06:13:51.762 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptlan.ko 2024-05-27T06:13:51.762 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 150753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptsas.ko 2024-05-27T06:13:51.762 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 97209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptscsih.ko 2024-05-27T06:13:51.762 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 63865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptspi.ko 2024-05-27T06:13:51.762 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/ 2024-05-27T06:13:51.762 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/88pm800.ko 2024-05-27T06:13:51.762 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/88pm805.ko 2024-05-27T06:13:51.763 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/88pm80x.ko 2024-05-27T06:13:51.763 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/arizona-i2c.ko 2024-05-27T06:13:51.763 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 148545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/arizona.ko 2024-05-27T06:13:51.763 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/bcm590xx.ko 2024-05-27T06:13:51.763 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/cros_ec_dev.ko 2024-05-27T06:13:51.763 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/dln2.ko 2024-05-27T06:13:51.763 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/janz-cmodio.ko 2024-05-27T06:13:51.763 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 59081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/kempld-core.ko 2024-05-27T06:13:51.763 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lm3533-core.ko 2024-05-27T06:13:51.763 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-05-27T06:13:51.763 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lp3943.ko 2024-05-27T06:13:51.763 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 60489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_ich.ko 2024-05-27T06:13:51.763 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_sch.ko 2024-05-27T06:13:51.763 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/max8907.ko 2024-05-27T06:13:51.764 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mc13xxx-core.ko 2024-05-27T06:13:51.764 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-05-27T06:13:51.764 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/menf21bmc.ko 2024-05-27T06:13:51.764 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/pcf50633-adc.ko 2024-05-27T06:13:51.764 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/pcf50633-gpio.ko 2024-05-27T06:13:51.764 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 42281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/pcf50633.ko 2024-05-27T06:13:51.764 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-05-27T06:13:51.764 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/retu-mfd.ko 2024-05-27T06:13:51.764 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 99409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/si476x-core.ko 2024-05-27T06:13:51.764 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 58049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/sm501.ko 2024-05-27T06:13:51.764 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 60673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/tps65010.ko 2024-05-27T06:13:51.764 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/tps6507x.ko 2024-05-27T06:13:51.764 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/viperboard.ko 2024-05-27T06:13:51.764 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/vx855.ko 2024-05-27T06:13:51.765 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wl1273-core.ko 2024-05-27T06:13:51.765 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 52345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wm8994.ko 2024-05-27T06:13:51.765 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ 2024-05-27T06:13:51.765 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-05-27T06:13:51.765 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 64257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ad525x_dpot.ko 2024-05-27T06:13:51.765 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/ 2024-05-27T06:13:51.765 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 57497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-27T06:13:51.765 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds9802als.ko 2024-05-27T06:13:51.765 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 47681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds990x.ko 2024-05-27T06:13:51.765 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 58625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/bh1770glc.ko 2024-05-27T06:13:51.765 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/c2port/ 2024-05-27T06:13:51.765 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-05-27T06:13:51.765 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 47441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/c2port/core.ko 2024-05-27T06:13:51.766 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/ 2024-05-27T06:13:51.766 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/cb710.ko 2024-05-27T06:13:51.766 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ds1682.ko 2024-05-27T06:13:51.766 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/dummy-irq.ko 2024-05-27T06:13:51.766 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/echo/ 2024-05-27T06:13:51.766 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/echo/echo.ko 2024-05-27T06:13:51.766 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/ 2024-05-27T06:13:51.766 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 42921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/at24.ko 2024-05-27T06:13:51.766 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-27T06:13:51.766 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/max6875.ko 2024-05-27T06:13:51.766 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/enclosure.ko 2024-05-27T06:13:51.766 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/genwqe/ 2024-05-27T06:13:51.766 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 191617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-05-27T06:13:51.766 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hmc6352.ko 2024-05-27T06:13:51.767 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 37753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hpilo.ko 2024-05-27T06:13:51.767 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ibmasm/ 2024-05-27T06:13:51.767 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 92289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-05-27T06:13:51.767 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ics932s401.ko 2024-05-27T06:13:51.767 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29003.ko 2024-05-27T06:13:51.767 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29020.ko 2024-05-27T06:13:51.767 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/ 2024-05-27T06:13:51.767 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 54857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-27T06:13:51.767 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-27T06:13:51.767 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/ 2024-05-27T06:13:51.767 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 154257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-me.ko 2024-05-27T06:13:51.767 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 69793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-txe.ko 2024-05-27T06:13:51.767 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 388977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei.ko 2024-05-27T06:13:51.768 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 37953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/phantom.ko 2024-05-27T06:13:51.768 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ti-st/ 2024-05-27T06:13:51.768 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 91129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ti-st/st_drv.ko 2024-05-27T06:13:51.768 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_7xx1.ko 2024-05-27T06:13:51.768 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_core.ko 2024-05-27T06:13:51.768 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tsl2550.ko 2024-05-27T06:13:51.768 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 55785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_balloon.ko 2024-05-27T06:13:51.768 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/ 2024-05-27T06:13:51.768 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 234849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-27T06:13:51.768 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ 2024-05-27T06:13:51.768 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/ 2024-05-27T06:13:51.768 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 620849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/bonding.ko 2024-05-27T06:13:51.768 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/ 2024-05-27T06:13:51.768 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/ 2024-05-27T06:13:51.769 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 139745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-27T06:13:51.769 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 49529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-27T06:13:51.769 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-27T06:13:51.769 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/ 2024-05-27T06:13:51.769 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 589537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-27T06:13:51.769 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dummy.ko 2024-05-27T06:13:51.769 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/eql.ko 2024-05-27T06:13:51.769 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ 2024-05-27T06:13:51.769 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/ 2024-05-27T06:13:51.769 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 53745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-27T06:13:51.769 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 49193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-27T06:13:51.769 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 158641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-27T06:13:51.769 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 85945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-27T06:13:51.769 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ 2024-05-27T06:13:51.770 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-27T06:13:51.770 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 73857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-27T06:13:51.770 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-27T06:13:51.770 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 109513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-27T06:13:51.770 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/ 2024-05-27T06:13:51.770 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 64697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-27T06:13:51.770 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/ 2024-05-27T06:13:51.770 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 84321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-27T06:13:51.770 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/ 2024-05-27T06:13:51.770 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 70729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-27T06:13:51.770 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/ 2024-05-27T06:13:51.770 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 52681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-27T06:13:51.770 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/ 2024-05-27T06:13:51.771 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 65785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-27T06:13:51.771 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 56049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-27T06:13:51.771 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 115873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-27T06:13:51.771 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/ 2024-05-27T06:13:51.771 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/ 2024-05-27T06:13:51.771 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 124481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-27T06:13:51.771 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-05-27T06:13:51.771 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 128393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-27T06:13:51.771 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-05-27T06:13:51.771 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 110321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-27T06:13:51.771 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/ 2024-05-27T06:13:51.771 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 101849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-27T06:13:51.771 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 88945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-27T06:13:51.771 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/ 2024-05-27T06:13:51.772 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 105625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-27T06:13:51.772 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 228977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-27T06:13:51.772 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-05-27T06:13:51.772 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1733297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-27T06:13:51.772 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 167177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-27T06:13:51.772 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/ 2024-05-27T06:13:51.772 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 164249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-27T06:13:51.807 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 440553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-27T06:13:51.807 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/ 2024-05-27T06:13:51.807 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/ 2024-05-27T06:13:51.807 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 432145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-27T06:13:51.807 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/ 2024-05-27T06:13:51.807 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-05-27T06:13:51.807 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 257145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-27T06:13:51.807 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-05-27T06:13:51.807 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 446057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-27T06:13:51.807 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-05-27T06:13:51.808 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1311193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-27T06:13:51.808 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-05-27T06:13:51.808 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 206673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-27T06:13:51.808 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-05-27T06:13:51.808 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-27T06:13:51.808 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/ 2024-05-27T06:13:51.808 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/ 2024-05-27T06:13:51.808 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 269249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-27T06:13:51.808 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/ 2024-05-27T06:13:51.808 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/ 2024-05-27T06:13:51.808 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 85377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-27T06:13:51.808 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 77449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-27T06:13:51.808 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 169041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-27T06:13:51.809 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 65905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-27T06:13:51.809 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 76201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-27T06:13:51.809 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-27T06:13:51.809 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/ 2024-05-27T06:13:51.809 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 75937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-27T06:13:51.809 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 78697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-27T06:13:51.809 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 52305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dnet.ko 2024-05-27T06:13:51.809 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ec_bhf.ko 2024-05-27T06:13:51.809 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/ 2024-05-27T06:13:51.809 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/ 2024-05-27T06:13:51.809 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 356353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-27T06:13:51.809 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 61729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ethoc.ko 2024-05-27T06:13:51.809 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 63177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fealnx.ko 2024-05-27T06:13:51.809 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fujitsu/ 2024-05-27T06:13:51.810 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 51505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-05-27T06:13:51.810 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ 2024-05-27T06:13:51.810 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 115561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-27T06:13:51.810 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/ 2024-05-27T06:13:51.810 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 366193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-27T06:13:51.810 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/ 2024-05-27T06:13:51.810 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 755673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-27T06:13:51.810 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/ 2024-05-27T06:13:51.810 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 324513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-27T06:13:51.810 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/ 2024-05-27T06:13:51.810 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1196201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-27T06:13:51.810 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/ 2024-05-27T06:13:51.810 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 362609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-27T06:13:51.811 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/ 2024-05-27T06:13:51.811 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 672313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-27T06:13:51.811 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/ 2024-05-27T06:13:51.811 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 121513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-27T06:13:51.811 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-05-27T06:13:51.811 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 966601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-27T06:13:51.811 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-05-27T06:13:51.811 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 193465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-27T06:13:51.811 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 108625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/jme.ko 2024-05-27T06:13:51.811 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/ 2024-05-27T06:13:51.811 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-27T06:13:51.811 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 126873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-27T06:13:51.811 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 150769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-27T06:13:51.811 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/ 2024-05-27T06:13:51.812 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-05-27T06:13:51.812 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 904929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-27T06:13:51.812 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 344089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-27T06:13:51.812 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-05-27T06:13:51.812 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-05-27T06:13:51.812 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1413529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-27T06:13:51.812 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ 2024-05-27T06:13:51.812 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 65905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-05-27T06:13:51.812 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 54217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-05-27T06:13:51.812 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-05-27T06:13:51.812 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 117345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-27T06:13:51.812 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/ 2024-05-27T06:13:51.812 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-05-27T06:13:51.813 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 131353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-27T06:13:51.813 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ 2024-05-27T06:13:51.813 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 91457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-27T06:13:51.813 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 56681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-27T06:13:51.813 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/ 2024-05-27T06:13:51.813 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 181201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-27T06:13:51.813 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/ 2024-05-27T06:13:51.813 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 171409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-27T06:13:51.813 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/ 2024-05-27T06:13:51.813 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 58241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-27T06:13:51.813 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 50113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-27T06:13:51.813 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/ 2024-05-27T06:13:51.813 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-05-27T06:13:51.814 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 300793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-27T06:13:51.814 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 105681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-27T06:13:51.814 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-05-27T06:13:51.814 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 885057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-27T06:13:51.814 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/ 2024-05-27T06:13:51.814 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 52297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-27T06:13:51.814 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/ 2024-05-27T06:13:51.814 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 81633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-27T06:13:51.814 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 100681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-27T06:13:51.814 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-27T06:13:51.814 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 264145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-27T06:13:51.814 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/samsung/ 2024-05-27T06:13:51.814 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-05-27T06:13:51.814 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 142401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-05-27T06:13:51.815 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/ 2024-05-27T06:13:51.815 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1350201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-27T06:13:51.815 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/ 2024-05-27T06:13:51.815 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 57945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-27T06:13:51.815 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/ 2024-05-27T06:13:51.815 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 66497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-27T06:13:51.815 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 80057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-27T06:13:51.815 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/ 2024-05-27T06:13:51.815 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 74281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-27T06:13:51.815 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 79449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-27T06:13:51.815 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 100777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-27T06:13:51.815 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 83433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-27T06:13:51.815 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/ 2024-05-27T06:13:51.816 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-05-27T06:13:51.816 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-05-27T06:13:51.816 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 46977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-27T06:13:51.816 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-05-27T06:13:51.816 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 644329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-27T06:13:51.816 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/ 2024-05-27T06:13:51.816 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 128489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-27T06:13:51.816 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 207985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-27T06:13:51.816 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 82625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-27T06:13:51.816 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 91345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-27T06:13:51.816 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/ 2024-05-27T06:13:51.816 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 59793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-27T06:13:51.816 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/ 2024-05-27T06:13:51.816 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 110721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-27T06:13:51.817 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/ 2024-05-27T06:13:51.817 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 98681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-27T06:13:51.817 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 102505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-27T06:13:51.817 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/ 2024-05-27T06:13:51.817 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 61489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-27T06:13:51.817 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-27T06:13:51.817 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/ 2024-05-27T06:13:51.817 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 69905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-27T06:13:51.817 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/ 2024-05-27T06:13:51.817 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 49441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/defxx.ko 2024-05-27T06:13:51.817 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/skfp/ 2024-05-27T06:13:51.817 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 275713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/skfp/skfp.ko 2024-05-27T06:13:51.817 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 91665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/geneve.ko 2024-05-27T06:13:51.818 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/ 2024-05-27T06:13:51.818 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 290441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-27T06:13:51.818 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/ 2024-05-27T06:13:51.818 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-27T06:13:51.818 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ifb.ko 2024-05-27T06:13:51.818 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ 2024-05-27T06:13:51.818 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 108313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-27T06:13:51.818 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 78057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvlan.ko 2024-05-27T06:13:51.818 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvtap.ko 2024-05-27T06:13:51.818 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/ 2024-05-27T06:13:51.818 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-27T06:13:51.818 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-27T06:13:51.818 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-gpio.ko 2024-05-27T06:13:51.819 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-27T06:13:51.819 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio.ko 2024-05-27T06:13:51.819 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mii.ko 2024-05-27T06:13:51.819 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 62673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/netconsole.ko 2024-05-27T06:13:51.819 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/nlmon.ko 2024-05-27T06:13:51.819 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/ 2024-05-27T06:13:51.819 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-27T06:13:51.819 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 48233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-27T06:13:51.819 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ 2024-05-27T06:13:51.819 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/amd.ko 2024-05-27T06:13:51.819 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 61977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-27T06:13:51.819 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 52857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-27T06:13:51.819 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm87xx.ko 2024-05-27T06:13:51.819 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 53401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/broadcom.ko 2024-05-27T06:13:51.820 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/cicada.ko 2024-05-27T06:13:51.820 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/davicom.ko 2024-05-27T06:13:51.820 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/et1011c.ko 2024-05-27T06:13:51.820 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/icplus.ko 2024-05-27T06:13:51.820 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/lxt.ko 2024-05-27T06:13:51.820 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 103369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/marvell.ko 2024-05-27T06:13:51.820 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 96017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/micrel.ko 2024-05-27T06:13:51.820 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/national.ko 2024-05-27T06:13:51.820 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 121097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/phylink.ko 2024-05-27T06:13:51.820 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/qsemi.ko 2024-05-27T06:13:51.820 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 62105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/realtek.ko 2024-05-27T06:13:51.820 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/smsc.ko 2024-05-27T06:13:51.820 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ste10Xp.ko 2024-05-27T06:13:51.820 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/vitesse.ko 2024-05-27T06:13:51.821 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/plip/ 2024-05-27T06:13:51.821 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 55345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/plip/plip.ko 2024-05-27T06:13:51.821 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ 2024-05-27T06:13:51.821 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-27T06:13:51.821 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_async.ko 2024-05-27T06:13:51.821 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-27T06:13:51.821 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-27T06:13:51.821 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-27T06:13:51.821 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 53225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppoe.ko 2024-05-27T06:13:51.821 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppox.ko 2024-05-27T06:13:51.821 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pptp.ko 2024-05-27T06:13:51.821 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sb1000.ko 2024-05-27T06:13:51.821 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/ 2024-05-27T06:13:51.821 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 52065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slip.ko 2024-05-27T06:13:51.822 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 42401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sungem_phy.ko 2024-05-27T06:13:51.822 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 80153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tap.ko 2024-05-27T06:13:51.822 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/ 2024-05-27T06:13:51.822 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 137313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team.ko 2024-05-27T06:13:51.822 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-27T06:13:51.822 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-27T06:13:51.822 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-27T06:13:51.822 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_random.ko 2024-05-27T06:13:51.822 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-27T06:13:51.822 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 108081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/veth.ko 2024-05-27T06:13:51.822 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/ 2024-05-27T06:13:51.822 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 176481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-27T06:13:51.822 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/ 2024-05-27T06:13:51.823 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 384329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/vxlan.ko 2024-05-27T06:13:51.823 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/ 2024-05-27T06:13:51.823 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 175513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-27T06:13:51.823 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ 2024-05-27T06:13:51.823 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ntb.ko 2024-05-27T06:13:51.823 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/ 2024-05-27T06:13:51.823 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/ 2024-05-27T06:13:51.823 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 335489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme-core.ko 2024-05-27T06:13:51.823 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 127497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme.ko 2024-05-27T06:13:51.823 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/ 2024-05-27T06:13:51.823 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 168113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport.ko 2024-05-27T06:13:51.823 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_cs.ko 2024-05-27T06:13:51.823 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 103881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_pc.ko 2024-05-27T06:13:51.823 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_serial.ko 2024-05-27T06:13:51.824 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/ 2024-05-27T06:13:51.824 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/ 2024-05-27T06:13:51.824 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-27T06:13:51.824 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-05-27T06:13:51.824 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-05-27T06:13:51.824 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pci-stub.ko 2024-05-27T06:13:51.824 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 55321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/xen-pcifront.ko 2024-05-27T06:13:51.824 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/ 2024-05-27T06:13:51.824 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/i82092.ko 2024-05-27T06:13:51.824 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 179937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pcmcia.ko 2024-05-27T06:13:51.824 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 78145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pcmcia_core.ko 2024-05-27T06:13:51.824 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-05-27T06:13:51.824 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pd6729.ko 2024-05-27T06:13:51.825 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 133745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-27T06:13:51.825 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/ 2024-05-27T06:13:51.825 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/broadcom/ 2024-05-27T06:13:51.825 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-05-27T06:13:51.825 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/samsung/ 2024-05-27T06:13:51.825 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-05-27T06:13:51.825 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/ 2024-05-27T06:13:51.825 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/ 2024-05-27T06:13:51.825 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 78185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-27T06:13:51.825 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/ 2024-05-27T06:13:51.825 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/ 2024-05-27T06:13:51.825 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 61025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-05-27T06:13:51.825 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec.ko 2024-05-27T06:13:51.825 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-05-27T06:13:51.826 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-05-27T06:13:51.826 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-05-27T06:13:51.826 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-05-27T06:13:51.826 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-05-27T06:13:51.826 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/ 2024-05-27T06:13:51.826 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 87929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-27T06:13:51.826 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acerhdf.ko 2024-05-27T06:13:51.826 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 48249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-27T06:13:51.826 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 73857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-27T06:13:51.826 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-27T06:13:51.826 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 164761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-27T06:13:51.826 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 46177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-27T06:13:51.826 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 62065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-27T06:13:51.827 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-27T06:13:51.827 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 51873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-27T06:13:51.827 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-27T06:13:51.827 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 42753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/hdaps.ko 2024-05-27T06:13:51.827 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/ibm_rtl.ko 2024-05-27T06:13:51.827 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/ 2024-05-27T06:13:51.827 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-27T06:13:51.827 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-05-27T06:13:51.827 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 53993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel_ips.ko 2024-05-27T06:13:51.827 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-27T06:13:51.827 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-27T06:13:51.827 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-27T06:13:51.827 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 51889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-27T06:13:51.827 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-27T06:13:51.828 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-27T06:13:51.828 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-27T06:13:51.828 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-27T06:13:51.828 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-27T06:13:51.828 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 61409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi.ko 2024-05-27T06:13:51.828 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/ 2024-05-27T06:13:51.828 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ 2024-05-27T06:13:51.828 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/88pm860x_battery.ko 2024-05-27T06:13:51.828 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/88pm860x_charger.ko 2024-05-27T06:13:51.828 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 68825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/bq2415x_charger.ko 2024-05-27T06:13:51.828 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 73065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/bq24190_charger.ko 2024-05-27T06:13:51.828 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/bq24735-charger.ko 2024-05-27T06:13:51.828 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-05-27T06:13:51.829 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/da9030_battery.ko 2024-05-27T06:13:51.829 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/da9052-battery.ko 2024-05-27T06:13:51.829 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2760_battery.ko 2024-05-27T06:13:51.829 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2780_battery.ko 2024-05-27T06:13:51.829 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2781_battery.ko 2024-05-27T06:13:51.829 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2782_battery.ko 2024-05-27T06:13:51.829 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/gpio-charger.ko 2024-05-27T06:13:51.829 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/isp1704_charger.ko 2024-05-27T06:13:51.829 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/lp8727_charger.ko 2024-05-27T06:13:51.829 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max14577_charger.ko 2024-05-27T06:13:51.829 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 37825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max17042_battery.ko 2024-05-27T06:13:51.829 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max8903_charger.ko 2024-05-27T06:13:51.829 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max8925_power.ko 2024-05-27T06:13:51.829 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/pcf50633-charger.ko 2024-05-27T06:13:51.830 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/sbs-battery.ko 2024-05-27T06:13:51.830 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/test_power.ko 2024-05-27T06:13:51.830 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/tps65090-charger.ko 2024-05-27T06:13:51.830 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/wm831x_backup.ko 2024-05-27T06:13:51.830 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/wm831x_power.ko 2024-05-27T06:13:51.830 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/wm8350_power.ko 2024-05-27T06:13:51.830 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/ 2024-05-27T06:13:51.830 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 73289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-27T06:13:51.830 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-27T06:13:51.830 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/ 2024-05-27T06:13:51.830 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/ 2024-05-27T06:13:51.830 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-27T06:13:51.830 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-27T06:13:51.831 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps_parport.ko 2024-05-27T06:13:51.831 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 49801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/pps_core.ko 2024-05-27T06:13:51.831 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ 2024-05-27T06:13:51.831 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 91369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp.ko 2024-05-27T06:13:51.831 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp_kvm.ko 2024-05-27T06:13:51.831 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/ 2024-05-27T06:13:51.831 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/ 2024-05-27T06:13:51.831 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/ 2024-05-27T06:13:51.831 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 67473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-27T06:13:51.831 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 47129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/fmpm.ko 2024-05-27T06:13:51.831 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/ 2024-05-27T06:13:51.831 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-88pm80x.ko 2024-05-27T06:13:51.831 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-88pm860x.ko 2024-05-27T06:13:51.831 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-27T06:13:51.832 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-da9052.ko 2024-05-27T06:13:51.832 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-da9055.ko 2024-05-27T06:13:51.832 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-da9063.ko 2024-05-27T06:13:51.832 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-27T06:13:51.832 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 82217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-27T06:13:51.832 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-27T06:13:51.832 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-27T06:13:51.832 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-27T06:13:51.832 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-27T06:13:51.832 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-27T06:13:51.832 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-27T06:13:51.832 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-27T06:13:51.832 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-em3027.ko 2024-05-27T06:13:51.833 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-27T06:13:51.833 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-27T06:13:51.833 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-27T06:13:51.833 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-lp8788.ko 2024-05-27T06:13:51.833 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 46905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-27T06:13:51.833 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-27T06:13:51.833 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-27T06:13:51.833 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t86.ko 2024-05-27T06:13:51.833 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max6900.ko 2024-05-27T06:13:51.833 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8907.ko 2024-05-27T06:13:51.833 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8925.ko 2024-05-27T06:13:51.833 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8997.ko 2024-05-27T06:13:51.833 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8998.ko 2024-05-27T06:13:51.833 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-05-27T06:13:51.834 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-27T06:13:51.834 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-palmas.ko 2024-05-27T06:13:51.834 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 56769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-27T06:13:51.834 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf50633.ko 2024-05-27T06:13:51.834 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-27T06:13:51.834 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-27T06:13:51.834 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-27T06:13:51.834 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-27T06:13:51.834 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rc5t583.ko 2024-05-27T06:13:51.834 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-27T06:13:51.834 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-27T06:13:51.834 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-27T06:13:51.834 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-27T06:13:51.835 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-27T06:13:51.835 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-s35390a.ko 2024-05-27T06:13:51.835 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-27T06:13:51.835 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-tps6586x.ko 2024-05-27T06:13:51.835 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-tps65910.ko 2024-05-27T06:13:51.835 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-wm831x.ko 2024-05-27T06:13:51.835 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-wm8350.ko 2024-05-27T06:13:51.835 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-x1205.ko 2024-05-27T06:13:51.835 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ 2024-05-27T06:13:51.835 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 90369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-9xxx.ko 2024-05-27T06:13:51.835 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 69585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-sas.ko 2024-05-27T06:13:51.835 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 65937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-xxxx.ko 2024-05-27T06:13:51.835 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 164473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/BusLogic.ko 2024-05-27T06:13:51.835 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/a100u2w.ko 2024-05-27T06:13:51.836 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/ 2024-05-27T06:13:51.836 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 340689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-27T06:13:51.836 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 120393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/advansys.ko 2024-05-27T06:13:51.836 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/ 2024-05-27T06:13:51.836 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 468049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-27T06:13:51.836 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 380633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-27T06:13:51.836 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic94xx/ 2024-05-27T06:13:51.836 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 243649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-05-27T06:13:51.836 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/am53c974.ko 2024-05-27T06:13:51.836 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/ 2024-05-27T06:13:51.836 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 135601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-27T06:13:51.836 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/atp870u.ko 2024-05-27T06:13:51.836 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/ 2024-05-27T06:13:51.836 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 304969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-27T06:13:51.837 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/ 2024-05-27T06:13:51.837 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1527017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/bfa.ko 2024-05-27T06:13:51.837 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/ 2024-05-27T06:13:51.837 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 297769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-27T06:13:51.837 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/ 2024-05-27T06:13:51.837 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 144377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-27T06:13:51.837 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 47449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ch.ko 2024-05-27T06:13:51.837 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/ 2024-05-27T06:13:51.837 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 390657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-27T06:13:51.837 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/ 2024-05-27T06:13:51.837 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-05-27T06:13:51.837 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 88873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-27T06:13:51.837 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-05-27T06:13:51.838 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 117473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-27T06:13:51.838 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 173009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-27T06:13:51.838 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 91497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dc395x.ko 2024-05-27T06:13:51.838 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 45393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dmx3191d.ko 2024-05-27T06:13:51.838 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/ 2024-05-27T06:13:51.838 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 267521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-27T06:13:51.838 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 78961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esp_scsi.ko 2024-05-27T06:13:51.838 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/ 2024-05-27T06:13:51.838 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 95321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-27T06:13:51.838 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 194001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-27T06:13:51.838 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fdomain.ko 2024-05-27T06:13:51.838 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/ 2024-05-27T06:13:51.838 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 366457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/fnic.ko 2024-05-27T06:13:51.839 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 251497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hpsa.ko 2024-05-27T06:13:51.839 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 65689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hptiop.ko 2024-05-27T06:13:51.839 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 57089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hv_storvsc.ko 2024-05-27T06:13:51.839 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/imm.ko 2024-05-27T06:13:51.839 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 55145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/initio.ko 2024-05-27T06:13:51.839 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 327833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ipr.ko 2024-05-27T06:13:51.839 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 129777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ips.ko 2024-05-27T06:13:51.839 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/ 2024-05-27T06:13:51.839 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 397657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/isci.ko 2024-05-27T06:13:51.839 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-27T06:13:51.839 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 63113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-27T06:13:51.839 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/ 2024-05-27T06:13:51.839 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 386801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/libfc.ko 2024-05-27T06:13:51.840 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 178169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi.ko 2024-05-27T06:13:51.840 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 64801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-27T06:13:51.840 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/ 2024-05-27T06:13:51.840 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 273953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/libsas.ko 2024-05-27T06:13:51.840 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/ 2024-05-27T06:13:51.840 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 2735913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-27T06:13:51.840 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/ 2024-05-27T06:13:51.840 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 88521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-27T06:13:51.840 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-27T06:13:51.840 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 389089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-27T06:13:51.840 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 104761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid.ko 2024-05-27T06:13:51.840 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/ 2024-05-27T06:13:51.840 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 836897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-27T06:13:51.840 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/ 2024-05-27T06:13:51.841 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 158705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-27T06:13:51.841 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 96529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvumi.ko 2024-05-27T06:13:51.841 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/ 2024-05-27T06:13:51.841 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 101609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-05-27T06:13:51.841 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-05-27T06:13:51.841 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-05-27T06:13:51.841 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-05-27T06:13:51.841 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/ 2024-05-27T06:13:51.841 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 443713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-27T06:13:51.841 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 152025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pmcraid.ko 2024-05-27T06:13:51.841 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ppa.ko 2024-05-27T06:13:51.841 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 66969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla1280.ko 2024-05-27T06:13:51.841 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/ 2024-05-27T06:13:51.841 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 2324713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-27T06:13:51.842 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 103593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-27T06:13:51.842 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/ 2024-05-27T06:13:51.842 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 697281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-27T06:13:51.842 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qlogicfas408.ko 2024-05-27T06:13:51.842 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/raid_class.ko 2024-05-27T06:13:51.842 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 322857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_debug.ko 2024-05-27T06:13:51.842 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 219849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-27T06:13:51.842 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 357145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-27T06:13:51.842 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 121177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-27T06:13:51.842 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 93473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-27T06:13:51.842 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 55393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-27T06:13:51.881 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ses.ko 2024-05-27T06:13:51.881 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 138113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/st.ko 2024-05-27T06:13:51.881 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 57393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/stex.ko 2024-05-27T06:13:51.881 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/ 2024-05-27T06:13:51.882 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 205001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-27T06:13:51.882 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 55465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/virtio_scsi.ko 2024-05-27T06:13:51.882 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 59113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-27T06:13:51.882 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 48769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/wd719x.ko 2024-05-27T06:13:51.882 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 59409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/xen-scsifront.ko 2024-05-27T06:13:51.882 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ 2024-05-27T06:13:51.882 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 174865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ssb.ko 2024-05-27T06:13:51.882 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/ 2024-05-27T06:13:51.882 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/ 2024-05-27T06:13:51.882 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 920073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-27T06:13:51.882 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/ 2024-05-27T06:13:51.882 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 60313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-27T06:13:51.883 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 48121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_file.ko 2024-05-27T06:13:51.883 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 54225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_iblock.ko 2024-05-27T06:13:51.883 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1170873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_mod.ko 2024-05-27T06:13:51.883 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 51889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_pscsi.ko 2024-05-27T06:13:51.883 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 149777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_user.ko 2024-05-27T06:13:51.883 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/ 2024-05-27T06:13:51.883 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 90033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-27T06:13:51.883 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/ 2024-05-27T06:13:51.883 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/ 2024-05-27T06:13:51.883 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/ 2024-05-27T06:13:51.883 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-27T06:13:51.883 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-27T06:13:51.883 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-27T06:13:51.884 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-27T06:13:51.884 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-27T06:13:51.884 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-27T06:13:51.884 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-27T06:13:51.884 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-27T06:13:51.884 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-27T06:13:51.884 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-27T06:13:51.884 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-27T06:13:51.884 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-27T06:13:51.884 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 45993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-27T06:13:51.884 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-27T06:13:51.884 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-27T06:13:51.884 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-05-27T06:13:51.885 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-27T06:13:51.885 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-27T06:13:51.885 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-27T06:13:51.885 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ 2024-05-27T06:13:51.885 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ 2024-05-27T06:13:51.885 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 99289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-27T06:13:51.885 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 69721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/moxa.ko 2024-05-27T06:13:51.885 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 61641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/mxser.ko 2024-05-27T06:13:51.885 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 134329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_gsm.ko 2024-05-27T06:13:51.885 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 37897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_hdlc.ko 2024-05-27T06:13:51.885 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 78961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/nozomi.ko 2024-05-27T06:13:51.885 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/ 2024-05-27T06:13:51.885 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/ 2024-05-27T06:13:51.885 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-05-27T06:13:51.886 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 65113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-27T06:13:51.886 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-05-27T06:13:51.886 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/altera_uart.ko 2024-05-27T06:13:51.886 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/arc_uart.ko 2024-05-27T06:13:51.886 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 91593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-05-27T06:13:51.886 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/ 2024-05-27T06:13:51.886 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 120553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-27T06:13:51.886 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/rp2.ko 2024-05-27T06:13:51.886 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 65633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/sc16is7xx.ko 2024-05-27T06:13:51.886 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/ 2024-05-27T06:13:51.886 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ 2024-05-27T06:13:51.886 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 693057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-27T06:13:51.887 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ 2024-05-27T06:13:51.887 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-27T06:13:51.887 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-05-27T06:13:51.887 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/ 2024-05-27T06:13:51.887 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 55609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio.ko 2024-05-27T06:13:51.887 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_aec.ko 2024-05-27T06:13:51.887 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_cif.ko 2024-05-27T06:13:51.887 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_dmem_genirq.ko 2024-05-27T06:13:51.887 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_mf624.ko 2024-05-27T06:13:51.887 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_netx.ko 2024-05-27T06:13:51.887 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pci_generic.ko 2024-05-27T06:13:51.887 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-05-27T06:13:51.887 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_sercos3.ko 2024-05-27T06:13:51.887 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/ 2024-05-27T06:13:51.888 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/c67x00/ 2024-05-27T06:13:51.888 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 90297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/c67x00/c67x00.ko 2024-05-27T06:13:51.888 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ 2024-05-27T06:13:51.888 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 189169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-05-27T06:13:51.888 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-05-27T06:13:51.888 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-05-27T06:13:51.888 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-05-27T06:13:51.888 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-05-27T06:13:51.888 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/ 2024-05-27T06:13:51.888 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 101537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-acm.ko 2024-05-27T06:13:51.888 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 63017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-27T06:13:51.888 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 56713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usblp.ko 2024-05-27T06:13:51.888 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 107409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usbtmc.ko 2024-05-27T06:13:51.888 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/common/ 2024-05-27T06:13:51.889 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/common/ulpi.ko 2024-05-27T06:13:51.889 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc2/ 2024-05-27T06:13:51.889 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-05-27T06:13:51.889 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/ 2024-05-27T06:13:51.889 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-05-27T06:13:51.889 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-05-27T06:13:51.889 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 575217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/dwc3.ko 2024-05-27T06:13:51.889 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/ 2024-05-27T06:13:51.889 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/ 2024-05-27T06:13:51.889 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 72241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/u_ether.ko 2024-05-27T06:13:51.889 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 61945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/u_serial.ko 2024-05-27T06:13:51.889 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-05-27T06:13:51.889 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 49729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-05-27T06:13:51.889 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-05-27T06:13:51.890 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-05-27T06:13:51.890 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 131513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-05-27T06:13:51.890 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 62313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-05-27T06:13:51.890 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 146601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-05-27T06:13:51.890 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 70569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-05-27T06:13:51.890 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-05-27T06:13:51.890 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 37641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-05-27T06:13:51.890 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 70009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-05-27T06:13:51.890 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 101233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-05-27T06:13:51.890 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-05-27T06:13:51.890 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 71241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-05-27T06:13:51.890 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 84929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-05-27T06:13:51.890 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/ 2024-05-27T06:13:51.891 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-05-27T06:13:51.891 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-05-27T06:13:51.891 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-05-27T06:13:51.891 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-05-27T06:13:51.891 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-05-27T06:13:51.891 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-05-27T06:13:51.891 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-05-27T06:13:51.891 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-05-27T06:13:51.891 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-05-27T06:13:51.891 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-05-27T06:13:51.891 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-05-27T06:13:51.891 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-05-27T06:13:51.891 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 78065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-05-27T06:13:51.891 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-05-27T06:13:51.892 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 204009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/libcomposite.ko 2024-05-27T06:13:51.892 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/ 2024-05-27T06:13:51.892 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-05-27T06:13:51.892 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/bdc/ 2024-05-27T06:13:51.892 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 182537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-05-27T06:13:51.892 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 45537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-05-27T06:13:51.892 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 66505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-05-27T06:13:51.892 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 85209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-05-27T06:13:51.892 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 69305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-05-27T06:13:51.892 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 90305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/net2272.ko 2024-05-27T06:13:51.892 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 90353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/net2280.ko 2024-05-27T06:13:51.892 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 94833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-05-27T06:13:51.892 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 80513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-05-27T06:13:51.893 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 87457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-05-27T06:13:51.893 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 95433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-05-27T06:13:51.893 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 195953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-05-27T06:13:51.893 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/ 2024-05-27T06:13:51.893 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/bcma-hcd.ko 2024-05-27T06:13:51.893 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 108313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/isp116x-hcd.ko 2024-05-27T06:13:51.893 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 104433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-05-27T06:13:51.893 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 102265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-05-27T06:13:51.893 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 60097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-27T06:13:51.893 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811_cs.ko 2024-05-27T06:13:51.893 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/ssb-hcd.ko 2024-05-27T06:13:51.893 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-05-27T06:13:51.893 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/ 2024-05-27T06:13:51.894 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/mdc800.ko 2024-05-27T06:13:51.894 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/microtek.ko 2024-05-27T06:13:51.894 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ 2024-05-27T06:13:51.894 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 47345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/adutux.ko 2024-05-27T06:13:51.894 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/appledisplay.ko 2024-05-27T06:13:51.894 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-05-27T06:13:51.894 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/cytherm.ko 2024-05-27T06:13:51.894 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ehset.ko 2024-05-27T06:13:51.894 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi26.ko 2024-05-27T06:13:51.894 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi62.ko 2024-05-27T06:13:51.894 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ezusb.ko 2024-05-27T06:13:51.894 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/idmouse.ko 2024-05-27T06:13:51.894 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 42721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/iowarrior.ko 2024-05-27T06:13:51.894 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-27T06:13:51.895 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 42233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ldusb.ko 2024-05-27T06:13:51.895 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 42225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/legousbtower.ko 2024-05-27T06:13:51.895 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/lvstest.ko 2024-05-27T06:13:51.895 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/ 2024-05-27T06:13:51.895 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 85305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-27T06:13:51.895 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-27T06:13:51.895 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usb3503.ko 2024-05-27T06:13:51.895 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usblcd.ko 2024-05-27T06:13:51.895 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-27T06:13:51.895 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 84257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbtest.ko 2024-05-27T06:13:51.895 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 52057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/uss720.ko 2024-05-27T06:13:51.895 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/yurex.ko 2024-05-27T06:13:51.895 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/mon/ 2024-05-27T06:13:51.895 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 91505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/mon/usbmon.ko 2024-05-27T06:13:51.896 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/musb/ 2024-05-27T06:13:51.896 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 396169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/musb/musb_hdrc.ko 2024-05-27T06:13:51.896 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/ 2024-05-27T06:13:51.896 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-generic.ko 2024-05-27T06:13:51.896 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-05-27T06:13:51.896 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-isp1301.ko 2024-05-27T06:13:51.896 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-tahvo.ko 2024-05-27T06:13:51.896 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ 2024-05-27T06:13:51.896 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/aircable.ko 2024-05-27T06:13:51.896 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ark3116.ko 2024-05-27T06:13:51.896 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-27T06:13:51.896 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ch341.ko 2024-05-27T06:13:51.896 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 79673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cp210x.ko 2024-05-27T06:13:51.896 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cyberjack.ko 2024-05-27T06:13:51.897 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 66865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-27T06:13:51.897 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 58321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-27T06:13:51.897 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/empeg.ko 2024-05-27T06:13:51.897 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 53001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/f81232.ko 2024-05-27T06:13:51.897 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 188601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-27T06:13:51.897 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 61481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-27T06:13:51.897 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 152297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-27T06:13:51.897 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 142825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_ti.ko 2024-05-27T06:13:51.897 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 69209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipaq.ko 2024-05-27T06:13:51.897 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipw.ko 2024-05-27T06:13:51.897 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ir-usb.ko 2024-05-27T06:13:51.897 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 66353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-27T06:13:51.897 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 122321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan.ko 2024-05-27T06:13:51.898 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-27T06:13:51.898 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-27T06:13:51.898 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-27T06:13:51.898 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mct_u232.ko 2024-05-27T06:13:51.898 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/metro-usb.ko 2024-05-27T06:13:51.898 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 79673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7720.ko 2024-05-27T06:13:51.898 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 89961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7840.ko 2024-05-27T06:13:51.898 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 65065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mxuport.ko 2024-05-27T06:13:51.898 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/navman.ko 2024-05-27T06:13:51.898 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/omninet.ko 2024-05-27T06:13:51.898 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/opticon.ko 2024-05-27T06:13:51.898 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 197201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/option.ko 2024-05-27T06:13:51.899 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 45329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/oti6858.ko 2024-05-27T06:13:51.899 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 61753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/pl2303.ko 2024-05-27T06:13:51.899 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcaux.ko 2024-05-27T06:13:51.899 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcserial.ko 2024-05-27T06:13:51.899 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/quatech2.ko 2024-05-27T06:13:51.899 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/safe_serial.ko 2024-05-27T06:13:51.899 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 59337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/sierra.ko 2024-05-27T06:13:51.899 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-27T06:13:51.899 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ssu100.ko 2024-05-27T06:13:51.899 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/symbolserial.ko 2024-05-27T06:13:51.899 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 70489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-27T06:13:51.899 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-27T06:13:51.899 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_debug.ko 2024-05-27T06:13:51.899 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-27T06:13:51.900 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 151121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usbserial.ko 2024-05-27T06:13:51.900 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/visor.ko 2024-05-27T06:13:51.900 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/whiteheat.ko 2024-05-27T06:13:51.900 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/wishbone-serial.ko 2024-05-27T06:13:51.900 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-27T06:13:51.900 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ 2024-05-27T06:13:51.900 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 64041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/uas.ko 2024-05-27T06:13:51.900 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-27T06:13:51.900 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-27T06:13:51.900 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-27T06:13:51.900 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-27T06:13:51.900 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-27T06:13:51.900 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-27T06:13:51.901 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-27T06:13:51.901 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-karma.ko 2024-05-27T06:13:51.901 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-27T06:13:51.901 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-27T06:13:51.901 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-27T06:13:51.901 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-27T06:13:51.901 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-27T06:13:51.901 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 201145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/usb-storage.ko 2024-05-27T06:13:51.901 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/ 2024-05-27T06:13:51.901 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 76025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-27T06:13:51.901 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 85233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-27T06:13:51.901 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 122233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-27T06:13:51.901 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/ 2024-05-27T06:13:51.902 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/ 2024-05-27T06:13:51.902 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 206897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-27T06:13:51.902 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-27T06:13:51.902 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 134241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio.ko 2024-05-27T06:13:51.902 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 93665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-27T06:13:51.902 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/ 2024-05-27T06:13:51.902 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 138641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost.ko 2024-05-27T06:13:51.902 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-27T06:13:51.902 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 71273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_net.ko 2024-05-27T06:13:51.902 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 107897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_scsi.ko 2024-05-27T06:13:51.902 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/ 2024-05-27T06:13:51.902 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/ 2024-05-27T06:13:51.903 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-05-27T06:13:51.903 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/aat2870_bl.ko 2024-05-27T06:13:51.903 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/adp5520_bl.ko 2024-05-27T06:13:51.903 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/adp8860_bl.ko 2024-05-27T06:13:51.903 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 51737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/adp8870_bl.ko 2024-05-27T06:13:51.903 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/apple_bl.ko 2024-05-27T06:13:51.903 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/as3711_bl.ko 2024-05-27T06:13:51.903 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/bd6107.ko 2024-05-27T06:13:51.903 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/da903x_bl.ko 2024-05-27T06:13:51.903 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/da9052_bl.ko 2024-05-27T06:13:51.903 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/gpio_backlight.ko 2024-05-27T06:13:51.903 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/kb3886_bl.ko 2024-05-27T06:13:51.903 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lcd.ko 2024-05-27T06:13:51.903 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lm3533_bl.ko 2024-05-27T06:13:51.904 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lm3639_bl.ko 2024-05-27T06:13:51.904 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lv5207lp.ko 2024-05-27T06:13:51.904 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/max8925_bl.ko 2024-05-27T06:13:51.904 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/pandora_bl.ko 2024-05-27T06:13:51.904 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-05-27T06:13:51.904 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-27T06:13:51.904 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/wm831x_bl.ko 2024-05-27T06:13:51.904 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/ 2024-05-27T06:13:51.904 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ 2024-05-27T06:13:51.904 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2482.ko 2024-05-27T06:13:51.904 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 46793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2490.ko 2024-05-27T06:13:51.904 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/matrox_w1.ko 2024-05-27T06:13:51.904 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/w1-gpio.ko 2024-05-27T06:13:51.905 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/ 2024-05-27T06:13:51.905 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-27T06:13:51.905 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-27T06:13:51.905 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-27T06:13:51.905 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-27T06:13:51.905 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-27T06:13:51.905 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-27T06:13:51.905 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-27T06:13:51.905 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-27T06:13:51.905 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-27T06:13:51.905 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-27T06:13:51.905 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 70361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-27T06:13:51.905 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 129409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/wire.ko 2024-05-27T06:13:51.906 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ 2024-05-27T06:13:51.906 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/acquirewdt.ko 2024-05-27T06:13:51.906 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/advantechwdt.ko 2024-05-27T06:13:51.906 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-27T06:13:51.906 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-27T06:13:51.906 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/cpu5wdt.ko 2024-05-27T06:13:51.906 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/da9052_wdt.ko 2024-05-27T06:13:51.906 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/da9055_wdt.ko 2024-05-27T06:13:51.906 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/da9063_wdt.ko 2024-05-27T06:13:51.906 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/dw_wdt.ko 2024-05-27T06:13:51.906 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/eurotechwdt.ko 2024-05-27T06:13:51.906 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-27T06:13:51.906 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/hpwdt.ko 2024-05-27T06:13:51.907 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/i6300esb.ko 2024-05-27T06:13:51.907 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-27T06:13:51.907 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-27T06:13:51.907 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ib700wdt.ko 2024-05-27T06:13:51.907 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ibmasr.ko 2024-05-27T06:13:51.907 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-27T06:13:51.907 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-27T06:13:51.907 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it87_wdt.ko 2024-05-27T06:13:51.907 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/kempld_wdt.ko 2024-05-27T06:13:51.907 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/machzwd.ko 2024-05-27T06:13:51.907 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/mena21_wdt.ko 2024-05-27T06:13:51.907 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-05-27T06:13:51.908 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/nv_tco.ko 2024-05-27T06:13:51.908 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-05-27T06:13:51.908 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pc87413_wdt.ko 2024-05-27T06:13:51.908 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 46945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-27T06:13:51.908 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 37185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-27T06:13:51.908 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/retu_wdt.ko 2024-05-27T06:13:51.908 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-05-27T06:13:51.908 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-05-27T06:13:51.908 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-27T06:13:51.908 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sc1200wdt.ko 2024-05-27T06:13:51.908 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-27T06:13:51.908 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-05-27T06:13:51.908 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/softdog.ko 2024-05-27T06:13:51.908 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-27T06:13:51.909 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/twl4030_wdt.ko 2024-05-27T06:13:51.909 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/via_wdt.ko 2024-05-27T06:13:51.909 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-27T06:13:51.909 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-27T06:13:51.909 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-27T06:13:51.909 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wafer5823wdt.ko 2024-05-27T06:13:51.909 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wdt_pci.ko 2024-05-27T06:13:51.909 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wm831x_wdt.ko 2024-05-27T06:13:51.909 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wm8350_wdt.ko 2024-05-27T06:13:51.909 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/xen_wdt.ko 2024-05-27T06:13:51.909 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/ 2024-05-27T06:13:51.909 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-evtchn.ko 2024-05-27T06:13:51.909 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntalloc.ko 2024-05-27T06:13:51.910 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 55705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntdev.ko 2024-05-27T06:13:51.910 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/ 2024-05-27T06:13:51.910 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 213865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-27T06:13:51.910 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 47673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-privcmd.ko 2024-05-27T06:13:51.910 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 85705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-scsiback.ko 2024-05-27T06:13:51.910 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/ 2024-05-27T06:13:51.910 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-27T06:13:51.910 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ 2024-05-27T06:13:51.910 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/ 2024-05-27T06:13:51.910 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 194449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/9p.ko 2024-05-27T06:13:51.910 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/adfs/ 2024-05-27T06:13:51.910 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 78049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/adfs/adfs.ko 2024-05-27T06:13:51.910 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/ 2024-05-27T06:13:51.911 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 197801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/affs.ko 2024-05-27T06:13:51.911 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/afs/ 2024-05-27T06:13:51.911 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1260937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/afs/kafs.ko 2024-05-27T06:13:51.911 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/autofs/ 2024-05-27T06:13:51.911 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 127337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/autofs/autofs4.ko 2024-05-27T06:13:51.911 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/ 2024-05-27T06:13:51.911 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 80481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/befs.ko 2024-05-27T06:13:51.911 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/bfs/ 2024-05-27T06:13:51.911 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 50457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/bfs/bfs.ko 2024-05-27T06:13:51.911 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 45553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/binfmt_misc.ko 2024-05-27T06:13:51.911 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/ 2024-05-27T06:13:51.911 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 4491713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/btrfs.ko 2024-05-27T06:13:51.911 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/ 2024-05-27T06:13:51.912 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 376801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/cachefiles.ko 2024-05-27T06:13:51.912 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ 2024-05-27T06:13:51.912 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1586617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ceph.ko 2024-05-27T06:13:51.912 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/ 2024-05-27T06:13:51.912 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 130017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/coda.ko 2024-05-27T06:13:51.912 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/configfs/ 2024-05-27T06:13:51.912 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 139049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/configfs/configfs.ko 2024-05-27T06:13:51.912 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/ 2024-05-27T06:13:51.912 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/cramfs.ko 2024-05-27T06:13:51.912 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/ 2024-05-27T06:13:51.912 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 813137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/dlm.ko 2024-05-27T06:13:51.912 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/efs/ 2024-05-27T06:13:51.912 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 46377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/efs/efs.ko 2024-05-27T06:13:51.912 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/ 2024-05-27T06:13:51.913 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1906713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/f2fs.ko 2024-05-27T06:13:51.913 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/ 2024-05-27T06:13:51.913 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/msdos.ko 2024-05-27T06:13:51.913 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/freevxfs/ 2024-05-27T06:13:51.913 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 52265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/freevxfs/freevxfs.ko 2024-05-27T06:13:51.913 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/ 2024-05-27T06:13:51.913 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/cuse.ko 2024-05-27T06:13:51.913 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/ 2024-05-27T06:13:51.913 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1486393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/gfs2.ko 2024-05-27T06:13:51.913 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/ 2024-05-27T06:13:51.913 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 183217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/hfs.ko 2024-05-27T06:13:51.913 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/ 2024-05-27T06:13:51.913 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 281993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/hfsplus.ko 2024-05-27T06:13:51.913 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hpfs/ 2024-05-27T06:13:51.914 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 248945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hpfs/hpfs.ko 2024-05-27T06:13:51.914 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/ 2024-05-27T06:13:51.914 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 92985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/isofs.ko 2024-05-27T06:13:51.914 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/ 2024-05-27T06:13:51.914 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 532953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/jfs.ko 2024-05-27T06:13:51.914 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/ 2024-05-27T06:13:51.914 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 361281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/lockd.ko 2024-05-27T06:13:51.914 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/ 2024-05-27T06:13:51.914 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 112569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/minix.ko 2024-05-27T06:13:51.914 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/ 2024-05-27T06:13:51.914 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 591625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/netfs.ko 2024-05-27T06:13:51.914 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/ 2024-05-27T06:13:51.914 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/ 2024-05-27T06:13:51.915 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 102537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-27T06:13:51.915 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/ 2024-05-27T06:13:51.915 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 74337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-27T06:13:51.915 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/ 2024-05-27T06:13:51.915 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 147673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-27T06:13:51.915 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1320377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfs.ko 2024-05-27T06:13:51.915 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 82089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv2.ko 2024-05-27T06:13:51.915 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 151617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv3.ko 2024-05-27T06:13:51.915 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 2518385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv4.ko 2024-05-27T06:13:51.915 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/ 2024-05-27T06:13:51.915 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/grace.ko 2024-05-27T06:13:51.915 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/nfs_acl.ko 2024-05-27T06:13:51.915 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/ 2024-05-27T06:13:51.916 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 2021969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/nfsd.ko 2024-05-27T06:13:51.916 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/ 2024-05-27T06:13:51.916 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 733969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/nilfs2.ko 2024-05-27T06:13:51.916 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/ 2024-05-27T06:13:51.916 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-celtic.ko 2024-05-27T06:13:51.916 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-centeuro.ko 2024-05-27T06:13:51.916 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-croatian.ko 2024-05-27T06:13:51.916 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-cyrillic.ko 2024-05-27T06:13:51.916 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-gaelic.ko 2024-05-27T06:13:51.916 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-greek.ko 2024-05-27T06:13:51.916 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-iceland.ko 2024-05-27T06:13:51.916 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-inuit.ko 2024-05-27T06:13:51.916 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-roman.ko 2024-05-27T06:13:51.917 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-romanian.ko 2024-05-27T06:13:51.917 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-turkish.ko 2024-05-27T06:13:51.917 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ascii.ko 2024-05-27T06:13:51.917 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1250.ko 2024-05-27T06:13:51.917 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1251.ko 2024-05-27T06:13:51.917 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1255.ko 2024-05-27T06:13:51.917 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp737.ko 2024-05-27T06:13:51.917 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp775.ko 2024-05-27T06:13:51.917 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp850.ko 2024-05-27T06:13:51.917 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp852.ko 2024-05-27T06:13:51.917 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp855.ko 2024-05-27T06:13:51.917 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp857.ko 2024-05-27T06:13:51.917 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp860.ko 2024-05-27T06:13:51.917 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp861.ko 2024-05-27T06:13:51.918 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp862.ko 2024-05-27T06:13:51.918 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp863.ko 2024-05-27T06:13:51.918 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp864.ko 2024-05-27T06:13:51.918 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp865.ko 2024-05-27T06:13:51.918 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp866.ko 2024-05-27T06:13:51.918 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp869.ko 2024-05-27T06:13:51.918 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp874.ko 2024-05-27T06:13:51.918 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 95617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp932.ko 2024-05-27T06:13:51.918 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 144201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp936.ko 2024-05-27T06:13:51.919 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 167129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp949.ko 2024-05-27T06:13:51.919 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 119505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp950.ko 2024-05-27T06:13:51.919 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_euc-jp.ko 2024-05-27T06:13:51.919 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-1.ko 2024-05-27T06:13:51.919 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-13.ko 2024-05-27T06:13:51.919 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-14.ko 2024-05-27T06:13:51.919 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-15.ko 2024-05-27T06:13:51.919 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-2.ko 2024-05-27T06:13:51.919 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-3.ko 2024-05-27T06:13:51.919 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-4.ko 2024-05-27T06:13:51.919 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-5.ko 2024-05-27T06:13:51.919 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-6.ko 2024-05-27T06:13:51.920 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-7.ko 2024-05-27T06:13:51.920 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-9.ko 2024-05-27T06:13:51.920 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-r.ko 2024-05-27T06:13:51.920 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-ru.ko 2024-05-27T06:13:51.920 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-u.ko 2024-05-27T06:13:51.920 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-27T06:13:51.920 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_utf8.ko 2024-05-27T06:13:51.920 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ntfs3/ 2024-05-27T06:13:51.920 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 634457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ntfs3/ntfs3.ko 2024-05-27T06:13:51.920 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ 2024-05-27T06:13:51.920 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ 2024-05-27T06:13:51.920 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 302033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-27T06:13:51.920 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ 2024-05-27T06:13:51.921 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 548057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-27T06:13:51.921 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ 2024-05-27T06:13:51.921 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 66345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-27T06:13:51.921 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 3245449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2.ko 2024-05-27T06:13:51.959 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-27T06:13:51.959 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-27T06:13:51.959 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-27T06:13:51.959 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/omfs/ 2024-05-27T06:13:51.959 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 67465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/omfs/omfs.ko 2024-05-27T06:13:51.959 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/ 2024-05-27T06:13:51.959 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 462817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/overlay.ko 2024-05-27T06:13:51.959 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ 2024-05-27T06:13:51.959 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 67961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ramoops.ko 2024-05-27T06:13:51.959 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx4/ 2024-05-27T06:13:51.959 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx4/qnx4.ko 2024-05-27T06:13:51.959 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx6/ 2024-05-27T06:13:51.959 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 56073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx6/qnx6.ko 2024-05-27T06:13:51.960 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/ 2024-05-27T06:13:51.960 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/quota_tree.ko 2024-05-27T06:13:51.960 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/quota_v1.ko 2024-05-27T06:13:51.960 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/quota_v2.ko 2024-05-27T06:13:51.960 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/ 2024-05-27T06:13:51.960 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 684713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/reiserfs.ko 2024-05-27T06:13:51.960 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/ 2024-05-27T06:13:51.960 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/romfs.ko 2024-05-27T06:13:51.960 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/ 2024-05-27T06:13:51.960 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/ 2024-05-27T06:13:51.960 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 3350841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/cifs.ko 2024-05-27T06:13:51.960 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/ 2024-05-27T06:13:51.960 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_arc4.ko 2024-05-27T06:13:51.960 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_md4.ko 2024-05-27T06:13:51.961 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/ 2024-05-27T06:13:51.961 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 164145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/squashfs.ko 2024-05-27T06:13:51.961 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/ 2024-05-27T06:13:51.961 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 115865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/sysv.ko 2024-05-27T06:13:51.961 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/ 2024-05-27T06:13:51.961 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 309937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/udf.ko 2024-05-27T06:13:51.961 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ 2024-05-27T06:13:51.961 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 198185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ufs.ko 2024-05-27T06:13:51.961 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/ 2024-05-27T06:13:51.961 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 5192193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/xfs.ko 2024-05-27T06:13:51.961 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/ 2024-05-27T06:13:51.961 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/locking/ 2024-05-27T06:13:51.961 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 97617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/locking/locktorture.ko 2024-05-27T06:13:51.962 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/time/ 2024-05-27T06:13:51.962 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/time/test_udelay.ko 2024-05-27T06:13:51.962 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 72657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/torture.ko 2024-05-27T06:13:51.962 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ 2024-05-27T06:13:51.962 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc-itu-t.ko 2024-05-27T06:13:51.962 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc7.ko 2024-05-27T06:13:51.962 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc8.ko 2024-05-27T06:13:51.962 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/ 2024-05-27T06:13:51.962 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libarc4.ko 2024-05-27T06:13:51.962 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libdes.ko 2024-05-27T06:13:51.962 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/interval_tree_test.ko 2024-05-27T06:13:51.962 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/libcrc32c.ko 2024-05-27T06:13:51.962 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lru_cache.ko 2024-05-27T06:13:51.962 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/ 2024-05-27T06:13:51.963 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4_compress.ko 2024-05-27T06:13:51.963 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4hc_compress.ko 2024-05-27T06:13:51.963 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/ 2024-05-27T06:13:51.963 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/cordic.ko 2024-05-27T06:13:51.963 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/memory-notifier-error-inject.ko 2024-05-27T06:13:51.963 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/notifier-error-inject.ko 2024-05-27T06:13:51.963 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/percpu_test.ko 2024-05-27T06:13:51.963 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/pm-notifier-error-inject.ko 2024-05-27T06:13:51.963 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/ 2024-05-27T06:13:51.963 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 151945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/raid6_pq.ko 2024-05-27T06:13:51.963 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/rbtree_test.ko 2024-05-27T06:13:51.963 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/ 2024-05-27T06:13:51.963 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-27T06:13:51.963 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test-kstrtox.ko 2024-05-27T06:13:51.963 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 4912433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_bpf.ko 2024-05-27T06:13:51.964 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 61161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_firmware.ko 2024-05-27T06:13:51.964 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_module.ko 2024-05-27T06:13:51.964 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_user_copy.ko 2024-05-27T06:13:51.964 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_bm.ko 2024-05-27T06:13:51.964 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_fsm.ko 2024-05-27T06:13:51.964 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_kmp.ko 2024-05-27T06:13:51.964 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/xz/ 2024-05-27T06:13:51.964 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/xz/xz_dec_test.ko 2024-05-27T06:13:51.964 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/mm/ 2024-05-27T06:13:51.964 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/mm/hwpoison-inject.ko 2024-05-27T06:13:51.964 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ 2024-05-27T06:13:51.964 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/ 2024-05-27T06:13:51.964 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 66945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/6lowpan.ko 2024-05-27T06:13:51.964 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_dest.ko 2024-05-27T06:13:51.965 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_fragment.ko 2024-05-27T06:13:51.965 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_hop.ko 2024-05-27T06:13:51.965 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-27T06:13:51.965 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_mobility.ko 2024-05-27T06:13:51.965 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_routing.ko 2024-05-27T06:13:51.965 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_udp.ko 2024-05-27T06:13:51.965 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/ 2024-05-27T06:13:51.965 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/garp.ko 2024-05-27T06:13:51.965 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 42289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/mrp.ko 2024-05-27T06:13:51.965 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/p8022.ko 2024-05-27T06:13:51.965 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/psnap.ko 2024-05-27T06:13:51.965 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/stp.ko 2024-05-27T06:13:51.965 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/ 2024-05-27T06:13:51.965 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 106697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/8021q.ko 2024-05-27T06:13:51.966 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/ 2024-05-27T06:13:51.966 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 236769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet.ko 2024-05-27T06:13:51.966 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_fd.ko 2024-05-27T06:13:51.966 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_rdma.ko 2024-05-27T06:13:51.966 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_virtio.ko 2024-05-27T06:13:51.966 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/ 2024-05-27T06:13:51.966 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 879593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/batman-adv.ko 2024-05-27T06:13:51.966 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/ 2024-05-27T06:13:51.966 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 85225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/br_netfilter.ko 2024-05-27T06:13:51.966 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1031177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/bridge.ko 2024-05-27T06:13:51.966 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ 2024-05-27T06:13:51.966 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-27T06:13:51.967 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-27T06:13:51.967 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-27T06:13:51.967 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-27T06:13:51.967 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-27T06:13:51.967 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-27T06:13:51.967 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-27T06:13:51.967 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-27T06:13:51.967 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-27T06:13:51.967 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-27T06:13:51.967 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-27T06:13:51.967 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-27T06:13:51.967 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-27T06:13:51.967 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-27T06:13:51.968 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-27T06:13:51.968 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-27T06:13:51.968 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-27T06:13:51.968 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-27T06:13:51.968 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-27T06:13:51.968 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-27T06:13:51.968 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 70521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtables.ko 2024-05-27T06:13:51.968 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-27T06:13:51.968 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-27T06:13:51.968 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/ 2024-05-27T06:13:51.968 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1243369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/libceph.ko 2024-05-27T06:13:51.968 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/core/ 2024-05-27T06:13:51.968 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 153793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/core/pktgen.ko 2024-05-27T06:13:51.968 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/ 2024-05-27T06:13:51.969 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 244825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp.ko 2024-05-27T06:13:51.969 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_diag.ko 2024-05-27T06:13:51.969 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 71025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv4.ko 2024-05-27T06:13:51.969 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 74985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv6.ko 2024-05-27T06:13:51.969 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/ 2024-05-27T06:13:51.969 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 507649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/dsa_core.ko 2024-05-27T06:13:51.969 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_brcm.ko 2024-05-27T06:13:51.969 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_dsa.ko 2024-05-27T06:13:51.969 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_none.ko 2024-05-27T06:13:51.969 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_trailer.ko 2024-05-27T06:13:51.969 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/hsr/ 2024-05-27T06:13:51.969 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 128577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/hsr/hsr.ko 2024-05-27T06:13:51.969 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ 2024-05-27T06:13:51.969 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ 2024-05-27T06:13:51.970 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 55481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-27T06:13:51.970 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 357369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154.ko 2024-05-27T06:13:51.970 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 59385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-27T06:13:51.970 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ 2024-05-27T06:13:51.970 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ah4.ko 2024-05-27T06:13:51.970 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 46409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/esp4.ko 2024-05-27T06:13:51.970 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 60217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/fou.ko 2024-05-27T06:13:51.970 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/gre.ko 2024-05-27T06:13:51.970 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 65657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/inet_diag.ko 2024-05-27T06:13:51.970 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 75481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_gre.ko 2024-05-27T06:13:51.970 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 77713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_tunnel.ko 2024-05-27T06:13:51.970 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_vti.ko 2024-05-27T06:13:51.970 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipcomp.ko 2024-05-27T06:13:51.971 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipip.ko 2024-05-27T06:13:51.971 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ 2024-05-27T06:13:51.971 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 45513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-27T06:13:51.971 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-27T06:13:51.971 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-27T06:13:51.971 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 50161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ip_tables.ko 2024-05-27T06:13:51.971 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-27T06:13:51.971 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-05-27T06:13:51.971 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-27T06:13:51.971 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-27T06:13:51.971 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-27T06:13:51.971 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-05-27T06:13:51.971 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-27T06:13:51.972 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-27T06:13:51.972 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-27T06:13:51.972 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-27T06:13:51.972 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-27T06:13:51.972 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-27T06:13:51.972 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-27T06:13:51.972 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-27T06:13:51.972 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-27T06:13:51.972 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-05-27T06:13:51.972 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-27T06:13:51.972 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-27T06:13:51.972 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-27T06:13:51.972 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-27T06:13:51.972 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-27T06:13:51.972 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_bic.ko 2024-05-27T06:13:51.973 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_dctcp.ko 2024-05-27T06:13:51.973 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_diag.ko 2024-05-27T06:13:51.973 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_highspeed.ko 2024-05-27T06:13:51.973 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_htcp.ko 2024-05-27T06:13:51.973 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_hybla.ko 2024-05-27T06:13:51.973 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_illinois.ko 2024-05-27T06:13:51.973 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_lp.ko 2024-05-27T06:13:51.973 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_scalable.ko 2024-05-27T06:13:51.973 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_vegas.ko 2024-05-27T06:13:51.973 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_veno.ko 2024-05-27T06:13:51.973 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_westwood.ko 2024-05-27T06:13:51.973 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_yeah.ko 2024-05-27T06:13:51.973 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tunnel4.ko 2024-05-27T06:13:51.974 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_diag.ko 2024-05-27T06:13:51.974 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 54425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_tunnel.ko 2024-05-27T06:13:51.974 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-27T06:13:51.974 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ 2024-05-27T06:13:51.974 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ah6.ko 2024-05-27T06:13:51.974 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 47425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/esp6.ko 2024-05-27T06:13:51.974 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/fou6.ko 2024-05-27T06:13:51.974 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 103169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_gre.ko 2024-05-27T06:13:51.974 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 118873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_tunnel.ko 2024-05-27T06:13:51.974 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-27T06:13:51.974 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 71081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_vti.ko 2024-05-27T06:13:51.974 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ipcomp6.ko 2024-05-27T06:13:51.974 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/mip6.ko 2024-05-27T06:13:51.975 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ 2024-05-27T06:13:51.975 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 50729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-27T06:13:51.975 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-05-27T06:13:51.975 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-27T06:13:51.975 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-27T06:13:51.975 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-27T06:13:51.975 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-27T06:13:51.975 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-27T06:13:51.975 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-27T06:13:51.975 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-27T06:13:51.975 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-27T06:13:51.975 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-27T06:13:51.975 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-27T06:13:51.975 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-27T06:13:51.975 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-27T06:13:51.976 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-27T06:13:51.976 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-27T06:13:51.976 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-27T06:13:51.976 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 46297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-27T06:13:51.976 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-27T06:13:51.976 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-27T06:13:51.976 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-27T06:13:51.976 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-27T06:13:51.976 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-27T06:13:51.976 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-27T06:13:51.976 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-27T06:13:51.976 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 94081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/sit.ko 2024-05-27T06:13:51.976 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/tunnel6.ko 2024-05-27T06:13:51.976 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-27T06:13:51.976 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/key/ 2024-05-27T06:13:51.977 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 106361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/key/af_key.ko 2024-05-27T06:13:51.977 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/ 2024-05-27T06:13:51.977 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 153209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_core.ko 2024-05-27T06:13:51.977 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-27T06:13:51.977 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_eth.ko 2024-05-27T06:13:51.977 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip.ko 2024-05-27T06:13:51.977 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip6.ko 2024-05-27T06:13:51.977 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 42041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_netlink.ko 2024-05-27T06:13:51.977 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 66233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ppp.ko 2024-05-27T06:13:51.977 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/lapb/ 2024-05-27T06:13:51.977 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 63321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/lapb/lapb.ko 2024-05-27T06:13:51.977 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/ 2024-05-27T06:13:51.977 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc.ko 2024-05-27T06:13:51.978 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 332817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc2.ko 2024-05-27T06:13:51.978 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/ 2024-05-27T06:13:51.978 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 388817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/mac802154.ko 2024-05-27T06:13:51.978 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/ 2024-05-27T06:13:51.978 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/mpls_gso.ko 2024-05-27T06:13:51.978 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ 2024-05-27T06:13:51.978 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ 2024-05-27T06:13:51.978 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 147729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set.ko 2024-05-27T06:13:51.978 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-27T06:13:51.978 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-27T06:13:51.978 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-27T06:13:51.978 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 124033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-27T06:13:51.979 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 124337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-27T06:13:51.979 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 126673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-27T06:13:51.979 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 126465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-27T06:13:51.979 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 137825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-27T06:13:51.979 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 72345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-27T06:13:51.979 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 133673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-27T06:13:51.979 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 139065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-27T06:13:51.979 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 138257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-27T06:13:51.979 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 136169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-27T06:13:51.979 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 139889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-27T06:13:51.979 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 37121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-27T06:13:51.979 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ 2024-05-27T06:13:51.979 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 534033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-27T06:13:51.980 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-27T06:13:51.980 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-27T06:13:51.980 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-27T06:13:51.980 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-27T06:13:51.980 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-27T06:13:51.980 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-27T06:13:51.980 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-27T06:13:51.980 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-27T06:13:51.980 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-27T06:13:51.980 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-27T06:13:51.980 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-27T06:13:51.980 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-27T06:13:51.980 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-27T06:13:51.981 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 55209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conncount.ko 2024-05-27T06:13:51.981 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 496713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack.ko 2024-05-27T06:13:51.981 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-27T06:13:51.981 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-27T06:13:51.981 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 37857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-27T06:13:51.981 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 134361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-27T06:13:51.981 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-27T06:13:51.981 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-27T06:13:51.981 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 140793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-27T06:13:51.981 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-27T06:13:51.981 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-27T06:13:51.981 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 79865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-27T06:13:51.981 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-27T06:13:51.981 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-27T06:13:51.982 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-27T06:13:51.982 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 117385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table.ko 2024-05-27T06:13:51.982 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-27T06:13:51.982 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 46097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_log_syslog.ko 2024-05-27T06:13:51.982 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 118337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat.ko 2024-05-27T06:13:51.982 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-27T06:13:51.982 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-27T06:13:51.982 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_irc.ko 2024-05-27T06:13:51.982 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_sip.ko 2024-05-27T06:13:51.982 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-27T06:13:51.982 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 53385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-27T06:13:51.982 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 811705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_tables.ko 2024-05-27T06:13:51.982 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 53041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink.ko 2024-05-27T06:13:51.983 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-27T06:13:51.983 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 37201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-05-27T06:13:51.983 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 49289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_log.ko 2024-05-27T06:13:51.983 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-27T06:13:51.983 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 65137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-27T06:13:51.983 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_chain_nat.ko 2024-05-27T06:13:51.983 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_compat.ko 2024-05-27T06:13:51.983 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 50649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_ct.ko 2024-05-27T06:13:51.983 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-27T06:13:51.983 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fib.ko 2024-05-27T06:13:51.983 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-27T06:13:51.983 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_hash.ko 2024-05-27T06:13:51.983 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_limit.ko 2024-05-27T06:13:51.983 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_log.ko 2024-05-27T06:13:51.983 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_masq.ko 2024-05-27T06:13:51.984 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_nat.ko 2024-05-27T06:13:51.984 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_numgen.ko 2024-05-27T06:13:51.984 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_osf.ko 2024-05-27T06:13:51.984 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_queue.ko 2024-05-27T06:13:51.984 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_redir.ko 2024-05-27T06:13:51.984 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject.ko 2024-05-27T06:13:51.984 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject_inet.ko 2024-05-27T06:13:51.984 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_socket.ko 2024-05-27T06:13:51.984 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_synproxy.ko 2024-05-27T06:13:51.984 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_tproxy.ko 2024-05-27T06:13:51.984 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 108385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/x_tables.ko 2024-05-27T06:13:51.984 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_AUDIT.ko 2024-05-27T06:13:51.984 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-27T06:13:51.984 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-27T06:13:51.985 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-27T06:13:51.985 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CT.ko 2024-05-27T06:13:51.985 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_DSCP.ko 2024-05-27T06:13:51.985 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HL.ko 2024-05-27T06:13:51.985 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HMARK.ko 2024-05-27T06:13:51.985 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 45209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-27T06:13:51.985 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LED.ko 2024-05-27T06:13:51.985 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LOG.ko 2024-05-27T06:13:51.985 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-27T06:13:51.985 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NETMAP.ko 2024-05-27T06:13:51.985 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFLOG.ko 2024-05-27T06:13:51.985 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-27T06:13:51.985 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_RATEEST.ko 2024-05-27T06:13:51.986 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-27T06:13:51.986 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_SECMARK.ko 2024-05-27T06:13:51.986 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-27T06:13:51.986 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-27T06:13:51.986 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TEE.ko 2024-05-27T06:13:51.986 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TPROXY.ko 2024-05-27T06:13:51.986 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TRACE.ko 2024-05-27T06:13:51.986 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_addrtype.ko 2024-05-27T06:13:51.986 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_bpf.ko 2024-05-27T06:13:51.986 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cgroup.ko 2024-05-27T06:13:51.986 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cluster.ko 2024-05-27T06:13:51.986 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_comment.ko 2024-05-27T06:13:51.986 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connbytes.ko 2024-05-27T06:13:51.986 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlabel.ko 2024-05-27T06:13:51.987 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlimit.ko 2024-05-27T06:13:51.987 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connmark.ko 2024-05-27T06:13:51.987 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_conntrack.ko 2024-05-27T06:13:51.987 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cpu.ko 2024-05-27T06:13:51.987 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dccp.ko 2024-05-27T06:13:51.987 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_devgroup.ko 2024-05-27T06:13:51.987 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dscp.ko 2024-05-27T06:13:51.987 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ecn.ko 2024-05-27T06:13:51.987 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_esp.ko 2024-05-27T06:13:51.987 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 52809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hashlimit.ko 2024-05-27T06:13:51.987 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_helper.ko 2024-05-27T06:13:51.987 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hl.ko 2024-05-27T06:13:51.987 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipcomp.ko 2024-05-27T06:13:51.987 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_iprange.ko 2024-05-27T06:13:51.988 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipvs.ko 2024-05-27T06:13:51.988 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_l2tp.ko 2024-05-27T06:13:51.988 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_length.ko 2024-05-27T06:13:51.988 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_limit.ko 2024-05-27T06:13:51.988 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mac.ko 2024-05-27T06:13:51.988 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mark.ko 2024-05-27T06:13:51.988 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_multiport.ko 2024-05-27T06:13:51.988 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nat.ko 2024-05-27T06:13:51.988 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nfacct.ko 2024-05-27T06:13:51.988 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_osf.ko 2024-05-27T06:13:51.988 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_owner.ko 2024-05-27T06:13:51.988 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_physdev.ko 2024-05-27T06:13:51.988 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_pkttype.ko 2024-05-27T06:13:51.988 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_policy.ko 2024-05-27T06:13:51.989 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_quota.ko 2024-05-27T06:13:51.989 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_rateest.ko 2024-05-27T06:13:51.989 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_realm.ko 2024-05-27T06:13:51.989 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_recent.ko 2024-05-27T06:13:51.989 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_sctp.ko 2024-05-27T06:13:51.989 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_set.ko 2024-05-27T06:13:51.989 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_socket.ko 2024-05-27T06:13:51.989 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_state.ko 2024-05-27T06:13:51.989 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_statistic.ko 2024-05-27T06:13:51.989 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_string.ko 2024-05-27T06:13:51.989 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpmss.ko 2024-05-27T06:13:51.989 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpudp.ko 2024-05-27T06:13:51.989 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_time.ko 2024-05-27T06:13:51.990 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_u32.ko 2024-05-27T06:13:51.990 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/ 2024-05-27T06:13:51.990 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/netlink_diag.ko 2024-05-27T06:13:51.990 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/ 2024-05-27T06:13:51.990 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/nsh.ko 2024-05-27T06:13:51.990 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/ 2024-05-27T06:13:51.990 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 488457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/openvswitch.ko 2024-05-27T06:13:51.990 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-geneve.ko 2024-05-27T06:13:51.990 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-gre.ko 2024-05-27T06:13:51.990 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-vxlan.ko 2024-05-27T06:13:51.990 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/ 2024-05-27T06:13:51.991 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/af_packet_diag.ko 2024-05-27T06:13:51.991 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/phonet/ 2024-05-27T06:13:51.991 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 141993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/phonet/phonet.ko 2024-05-27T06:13:51.991 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 68801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/phonet/pn_pep.ko 2024-05-27T06:13:51.991 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/ 2024-05-27T06:13:51.991 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 318537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds.ko 2024-05-27T06:13:51.991 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 202249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_rdma.ko 2024-05-27T06:13:51.991 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 85073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_tcp.ko 2024-05-27T06:13:51.991 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rxrpc/ 2024-05-27T06:13:51.991 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1028129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rxrpc/rxrpc.ko 2024-05-27T06:13:51.991 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/ 2024-05-27T06:13:51.991 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_csum.ko 2024-05-27T06:13:51.991 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_gact.ko 2024-05-27T06:13:51.992 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 45401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_mirred.ko 2024-05-27T06:13:51.992 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_nat.ko 2024-05-27T06:13:51.992 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 53457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_pedit.ko 2024-05-27T06:13:51.992 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_police.ko 2024-05-27T06:13:51.992 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_simple.ko 2024-05-27T06:13:51.992 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_skbedit.ko 2024-05-27T06:13:51.992 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 45665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_vlan.ko 2024-05-27T06:13:51.992 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_basic.ko 2024-05-27T06:13:51.992 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_bpf.ko 2024-05-27T06:13:51.992 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_cgroup.ko 2024-05-27T06:13:51.992 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 37297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_flow.ko 2024-05-27T06:13:51.992 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_fw.ko 2024-05-27T06:13:51.992 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 49313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_route.ko 2024-05-27T06:13:51.992 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 79137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_u32.ko 2024-05-27T06:13:51.993 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_cmp.ko 2024-05-27T06:13:51.993 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_ipset.ko 2024-05-27T06:13:51.993 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 48777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_meta.ko 2024-05-27T06:13:51.993 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_nbyte.ko 2024-05-27T06:13:51.993 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_text.ko 2024-05-27T06:13:51.993 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_u32.ko 2024-05-27T06:13:51.993 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_choke.ko 2024-05-27T06:13:51.993 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_codel.ko 2024-05-27T06:13:51.993 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_drr.ko 2024-05-27T06:13:51.993 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq.ko 2024-05-27T06:13:51.993 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq_codel.ko 2024-05-27T06:13:51.993 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 42881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_gred.ko 2024-05-27T06:13:51.993 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 62809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hfsc.ko 2024-05-27T06:13:51.994 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hhf.ko 2024-05-27T06:13:51.994 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 81825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_htb.ko 2024-05-27T06:13:51.994 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_ingress.ko 2024-05-27T06:13:51.994 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio.ko 2024-05-27T06:13:51.994 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio_lib.ko 2024-05-27T06:13:51.994 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_multiq.ko 2024-05-27T06:13:51.994 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_netem.ko 2024-05-27T06:13:51.994 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_pie.ko 2024-05-27T06:13:51.994 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_plug.ko 2024-05-27T06:13:51.994 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_prio.ko 2024-05-27T06:13:51.994 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 60241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_qfq.ko 2024-05-27T06:13:51.994 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_red.ko 2024-05-27T06:13:51.994 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfb.ko 2024-05-27T06:13:51.995 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfq.ko 2024-05-27T06:13:51.995 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_tbf.ko 2024-05-27T06:13:51.995 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_teql.ko 2024-05-27T06:13:51.995 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/ 2024-05-27T06:13:51.995 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1187153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp.ko 2024-05-27T06:13:51.995 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp_diag.ko 2024-05-27T06:13:51.995 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/ 2024-05-27T06:13:51.995 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/ 2024-05-27T06:13:51.995 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 432225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-27T06:13:51.995 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 70081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-27T06:13:51.995 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1940753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/sunrpc.ko 2024-05-27T06:13:51.995 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/ 2024-05-27T06:13:51.995 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 889729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-27T06:13:51.996 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/ 2024-05-27T06:13:51.996 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1122273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc.ko 2024-05-27T06:13:51.996 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc_diag.ko 2024-05-27T06:13:51.996 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/ 2024-05-27T06:13:51.996 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/unix_diag.ko 2024-05-27T06:13:51.996 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/ 2024-05-27T06:13:51.996 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 105601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-27T06:13:51.996 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 90249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-27T06:13:51.996 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 123745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock.ko 2024-05-27T06:13:51.996 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-27T06:13:51.996 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-27T06:13:51.996 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/x25/ 2024-05-27T06:13:51.996 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 165777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/x25/x25.ko 2024-05-27T06:13:51.997 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/ 2024-05-27T06:13:51.997 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_algo.ko 2024-05-27T06:13:51.997 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-27T06:13:51.997 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 131857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_user.ko 2024-05-27T06:13:51.997 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 646387 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.alias 2024-05-27T06:13:51.997 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 630543 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.alias.bin 2024-05-27T06:13:51.997 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7706 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin 2024-05-27T06:13:51.997 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin.alias.bin 2024-05-27T06:13:51.997 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9941 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin.bin 2024-05-27T06:13:51.997 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 70990 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin.modinfo 2024-05-27T06:13:51.997 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 146985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.dep 2024-05-27T06:13:51.997 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 232892 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.dep.bin 2024-05-27T06:13:51.997 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 210 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.devname 2024-05-27T06:13:51.997 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 72627 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.order 2024-05-27T06:13:51.998 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 879 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.softdep 2024-05-27T06:13:51.998 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 258450 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.symbols 2024-05-27T06:13:51.998 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 313019 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.symbols.bin 2024-05-27T06:13:51.998 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/ 2024-05-27T06:13:51.998 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/share/ 2024-05-27T06:13:51.998 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/share/doc/ 2024-05-27T06:13:51.998 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/share/doc/linux-image-6.9.0-gb9459a26b088/ 2024-05-27T06:13:51.998 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 171 2024-05-23 11:07 ./usr/share/doc/linux-image-6.9.0-gb9459a26b088/changelog.Debian.gz 2024-05-27T06:13:51.998 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 691 2024-05-23 11:07 ./usr/share/doc/linux-image-6.9.0-gb9459a26b088/copyright 2024-05-27T06:13:52.003 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-gb9459a26b088 2024-05-27T06:13:52.003 INFO:teuthology.task.kernel:searching for kernel 6.9.0-gb9459a26b088 2024-05-27T06:13:52.003 DEBUG:teuthology.orchestra.run.smithi149:> egrep '(submenu|menuentry.*6.9.0-gb9459a26b088).*{' /boot/grub/grub.cfg 2024-05-27T06:13:52.010 INFO:teuthology.orchestra.run.smithi149.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-27T06:13:52.011 INFO:teuthology.orchestra.run.smithi149.stdout: menuentry 'Ubuntu, with Linux 6.9.0-gb9459a26b088' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-gb9459a26b088-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-27T06:13:52.011 INFO:teuthology.orchestra.run.smithi149.stdout: menuentry 'Ubuntu, with Linux 6.9.0-gb9459a26b088 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-gb9459a26b088-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-27T06:13:52.011 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-05-27T06:13:52.011 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-gb9459a26b088 2024-05-27T06:13:52.011 DEBUG:teuthology.orchestra.run.smithi149:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-05-27T06:13:52.056 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi149.front.sepia.ceph.com to complete... 2024-05-27T06:13:52.457 INFO:teuthology.orchestra.run.smithi149.stderr:Sourcing file `/etc/default/grub' 2024-05-27T06:13:52.458 INFO:teuthology.orchestra.run.smithi149.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-27T06:13:52.470 INFO:teuthology.orchestra.run.smithi149.stderr:Generating grub configuration file ... 2024-05-27T06:13:52.683 INFO:teuthology.orchestra.run.smithi149.stderr:Found linux image: /boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-27T06:13:52.689 INFO:teuthology.orchestra.run.smithi149.stderr:Found initrd image: /boot/initrd.img-6.9.0-gb9459a26b088 2024-05-27T06:13:52.911 INFO:teuthology.orchestra.run.smithi149.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-27T06:13:52.917 INFO:teuthology.orchestra.run.smithi149.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-27T06:13:52.958 INFO:teuthology.orchestra.run.smithi149.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-27T06:13:52.963 INFO:teuthology.orchestra.run.smithi149.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-27T06:13:53.097 INFO:teuthology.orchestra.run.smithi149.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-27T06:13:53.097 INFO:teuthology.orchestra.run.smithi149.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-27T06:13:53.097 INFO:teuthology.orchestra.run.smithi149.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-27T06:13:53.106 INFO:teuthology.orchestra.run.smithi149.stderr:done 2024-05-27T06:13:54.703 INFO:teuthology.orchestra.run.smithi087.stderr:Sourcing file `/etc/default/grub' 2024-05-27T06:13:54.718 INFO:teuthology.orchestra.run.smithi087.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-27T06:13:54.750 INFO:teuthology.orchestra.run.smithi087.stderr:Generating grub configuration file ... 2024-05-27T06:13:55.094 INFO:teuthology.orchestra.run.smithi087.stderr:Found linux image: /boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-27T06:13:55.108 INFO:teuthology.orchestra.run.smithi087.stderr:Found initrd image: /boot/initrd.img-6.9.0-gb9459a26b088 2024-05-27T06:13:55.397 INFO:teuthology.orchestra.run.smithi087.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-27T06:13:55.410 INFO:teuthology.orchestra.run.smithi087.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-27T06:13:55.477 INFO:teuthology.orchestra.run.smithi087.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-27T06:13:55.483 INFO:teuthology.orchestra.run.smithi087.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-27T06:13:55.636 INFO:teuthology.orchestra.run.smithi087.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-27T06:13:55.636 INFO:teuthology.orchestra.run.smithi087.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-27T06:13:55.636 INFO:teuthology.orchestra.run.smithi087.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-27T06:13:55.680 INFO:teuthology.orchestra.run.smithi087.stderr:done 2024-05-27T06:13:55.878 DEBUG:teuthology.orchestra.run.smithi087:> dpkg-deb -c /tmp/linux-image.deb 2024-05-27T06:13:55.886 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./ 2024-05-27T06:13:55.887 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./boot/ 2024-05-27T06:13:55.887 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7004139 2024-05-23 11:07 ./boot/System.map-6.9.0-gb9459a26b088 2024-05-27T06:13:55.901 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 172251 2024-05-23 11:07 ./boot/config-6.9.0-gb9459a26b088 2024-05-27T06:13:55.901 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13136896 2024-05-23 11:07 ./boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-27T06:13:55.922 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/ 2024-05-27T06:13:55.922 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/ 2024-05-27T06:13:55.922 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/postinst.d/ 2024-05-27T06:13:55.922 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/postrm.d/ 2024-05-27T06:13:55.922 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/preinst.d/ 2024-05-27T06:13:55.922 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/prerm.d/ 2024-05-27T06:13:55.922 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/ 2024-05-27T06:13:55.922 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/ 2024-05-27T06:13:55.922 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/ 2024-05-27T06:13:55.922 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/ 2024-05-27T06:13:55.922 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/ 2024-05-27T06:13:55.923 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/ 2024-05-27T06:13:55.923 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ 2024-05-27T06:13:55.923 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 507497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/aesni-intel.ko 2024-05-27T06:13:55.925 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-27T06:13:55.925 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-27T06:13:55.926 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-27T06:13:55.926 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 97945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-27T06:13:55.926 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 109897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-27T06:13:55.926 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 155241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-27T06:13:55.926 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-27T06:13:55.926 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-27T06:13:55.926 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 87001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-27T06:13:55.926 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-27T06:13:55.926 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 50297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-27T06:13:55.926 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 50369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-27T06:13:55.926 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 54505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-27T06:13:55.926 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 44649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-27T06:13:55.927 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 48041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-27T06:13:55.927 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 62865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-27T06:13:55.927 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 53561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-27T06:13:55.927 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-27T06:13:55.927 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-27T06:13:55.927 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/ 2024-05-27T06:13:55.927 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/ 2024-05-27T06:13:55.927 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/ 2024-05-27T06:13:55.927 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 49073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-27T06:13:55.927 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpuid.ko 2024-05-27T06:13:55.927 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/msr.ko 2024-05-27T06:13:55.927 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/ 2024-05-27T06:13:55.927 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 443289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-27T06:13:55.928 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1037081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-27T06:13:55.928 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 2850153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm.ko 2024-05-27T06:13:55.978 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ 2024-05-27T06:13:55.978 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 65017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/af_alg.ko 2024-05-27T06:13:55.978 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/algif_hash.ko 2024-05-27T06:13:55.978 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/algif_skcipher.ko 2024-05-27T06:13:55.978 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ansi_cprng.ko 2024-05-27T06:13:55.978 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/anubis.ko 2024-05-27T06:13:55.978 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/arc4.ko 2024-05-27T06:13:55.978 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/asymmetric_keys/ 2024-05-27T06:13:55.979 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-05-27T06:13:55.979 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/ 2024-05-27T06:13:55.979 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_memcpy.ko 2024-05-27T06:13:55.979 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_pq.ko 2024-05-27T06:13:55.979 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-27T06:13:55.979 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_tx.ko 2024-05-27T06:13:55.979 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_xor.ko 2024-05-27T06:13:55.979 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/raid6test.ko 2024-05-27T06:13:55.979 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authenc.ko 2024-05-27T06:13:55.979 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authencesn.ko 2024-05-27T06:13:55.979 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blake2b_generic.ko 2024-05-27T06:13:55.979 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_common.ko 2024-05-27T06:13:55.979 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_generic.ko 2024-05-27T06:13:55.980 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/camellia_generic.ko 2024-05-27T06:13:55.980 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast5_generic.ko 2024-05-27T06:13:55.980 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast6_generic.ko 2024-05-27T06:13:55.980 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast_common.ko 2024-05-27T06:13:55.980 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ccm.ko 2024-05-27T06:13:55.980 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cmac.ko 2024-05-27T06:13:55.980 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crc32_generic.ko 2024-05-27T06:13:55.980 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 59121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cryptd.ko 2024-05-27T06:13:55.980 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 48105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_engine.ko 2024-05-27T06:13:55.980 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_simd.ko 2024-05-27T06:13:55.980 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_user.ko 2024-05-27T06:13:55.980 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cts.ko 2024-05-27T06:13:55.980 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/des_generic.ko 2024-05-27T06:13:55.981 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/dh_generic.ko 2024-05-27T06:13:55.981 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/echainiv.ko 2024-05-27T06:13:55.981 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/essiv.ko 2024-05-27T06:13:55.981 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/fcrypt.ko 2024-05-27T06:13:55.981 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/khazad.ko 2024-05-27T06:13:55.981 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lrw.ko 2024-05-27T06:13:55.981 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4.ko 2024-05-27T06:13:55.981 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4hc.ko 2024-05-27T06:13:55.981 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/md4.ko 2024-05-27T06:13:55.981 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/michael_mic.ko 2024-05-27T06:13:55.981 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcbc.ko 2024-05-27T06:13:55.981 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcrypt.ko 2024-05-27T06:13:55.982 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/rmd160.ko 2024-05-27T06:13:55.982 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/seed.ko 2024-05-27T06:13:55.982 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/serpent_generic.ko 2024-05-27T06:13:55.982 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 169057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tcrypt.ko 2024-05-27T06:13:55.982 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tea.ko 2024-05-27T06:13:55.982 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_common.ko 2024-05-27T06:13:55.982 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_generic.ko 2024-05-27T06:13:55.982 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/vmac.ko 2024-05-27T06:13:55.982 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/wp512.ko 2024-05-27T06:13:55.982 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xcbc.ko 2024-05-27T06:13:55.982 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xor.ko 2024-05-27T06:13:55.982 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xts.ko 2024-05-27T06:13:55.982 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xxhash_generic.ko 2024-05-27T06:13:55.983 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ 2024-05-27T06:13:55.983 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ 2024-05-27T06:13:55.983 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_extlog.ko 2024-05-27T06:13:55.983 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-27T06:13:55.983 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_pad.ko 2024-05-27T06:13:55.983 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/apei/ 2024-05-27T06:13:55.983 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 44697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/apei/einj.ko 2024-05-27T06:13:55.983 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ec_sys.ko 2024-05-27T06:13:55.983 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/platform_profile.ko 2024-05-27T06:13:55.983 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbs.ko 2024-05-27T06:13:55.983 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbshc.ko 2024-05-27T06:13:55.983 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 119017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/video.ko 2024-05-27T06:13:55.983 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ 2024-05-27T06:13:55.983 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/acard-ahci.ko 2024-05-27T06:13:55.983 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 99177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci.ko 2024-05-27T06:13:55.984 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci_platform.ko 2024-05-27T06:13:55.984 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 107729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci.ko 2024-05-27T06:13:55.984 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci_platform.ko 2024-05-27T06:13:55.984 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_acpi.ko 2024-05-27T06:13:55.984 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ali.ko 2024-05-27T06:13:55.984 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_amd.ko 2024-05-27T06:13:55.984 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_artop.ko 2024-05-27T06:13:55.984 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atiixp.ko 2024-05-27T06:13:55.984 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atp867x.ko 2024-05-27T06:13:55.984 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd640.ko 2024-05-27T06:13:55.984 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd64x.ko 2024-05-27T06:13:55.984 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cypress.ko 2024-05-27T06:13:55.984 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_efar.ko 2024-05-27T06:13:55.985 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt366.ko 2024-05-27T06:13:55.985 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt37x.ko 2024-05-27T06:13:55.985 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-27T06:13:55.985 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-27T06:13:55.985 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it8213.ko 2024-05-27T06:13:55.985 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it821x.ko 2024-05-27T06:13:55.985 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_jmicron.ko 2024-05-27T06:13:55.985 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 60249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_legacy.ko 2024-05-27T06:13:55.985 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_marvell.ko 2024-05-27T06:13:55.985 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_mpiix.ko 2024-05-27T06:13:55.985 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_netcell.ko 2024-05-27T06:13:55.985 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ninja32.ko 2024-05-27T06:13:55.986 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87410.ko 2024-05-27T06:13:55.986 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87415.ko 2024-05-27T06:13:55.986 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_oldpiix.ko 2024-05-27T06:13:55.986 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_opti.ko 2024-05-27T06:13:55.986 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_optidma.ko 2024-05-27T06:13:55.986 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pcmcia.ko 2024-05-27T06:13:55.986 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-27T06:13:55.986 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-27T06:13:55.986 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_piccolo.ko 2024-05-27T06:13:55.986 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_radisys.ko 2024-05-27T06:13:55.986 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rdc.ko 2024-05-27T06:13:55.986 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rz1000.ko 2024-05-27T06:13:55.987 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sch.ko 2024-05-27T06:13:55.987 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_serverworks.ko 2024-05-27T06:13:55.987 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sil680.ko 2024-05-27T06:13:55.987 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sl82c105.ko 2024-05-27T06:13:55.987 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_triflex.ko 2024-05-27T06:13:55.987 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_via.ko 2024-05-27T06:13:55.987 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pdc_adma.ko 2024-05-27T06:13:55.987 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_inic162x.ko 2024-05-27T06:13:55.987 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 102113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_mv.ko 2024-05-27T06:13:55.987 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 85401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_nv.ko 2024-05-27T06:13:55.987 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 44305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_promise.ko 2024-05-27T06:13:55.987 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_qstor.ko 2024-05-27T06:13:55.987 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil.ko 2024-05-27T06:13:55.988 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 45897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil24.ko 2024-05-27T06:13:55.988 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sis.ko 2024-05-27T06:13:55.988 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_svw.ko 2024-05-27T06:13:55.988 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 53345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sx4.ko 2024-05-27T06:13:55.988 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_uli.ko 2024-05-27T06:13:55.988 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_via.ko 2024-05-27T06:13:55.988 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_vsc.ko 2024-05-27T06:13:55.988 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ 2024-05-27T06:13:55.988 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ks0108.ko 2024-05-27T06:13:55.988 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/ 2024-05-27T06:13:55.988 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 163833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/bcma.ko 2024-05-27T06:13:55.988 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/ 2024-05-27T06:13:55.988 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/ 2024-05-27T06:13:55.989 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 140833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/aoe.ko 2024-05-27T06:13:55.989 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/ 2024-05-27T06:13:55.989 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1241585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/drbd.ko 2024-05-27T06:13:55.989 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 203281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/floppy.ko 2024-05-27T06:13:55.989 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/ 2024-05-27T06:13:55.989 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 115257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-27T06:13:55.989 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 143425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/nbd.ko 2024-05-27T06:13:55.989 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/ 2024-05-27T06:13:55.989 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 126609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/null_blk.ko 2024-05-27T06:13:55.989 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 119865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/pktcdvd.ko 2024-05-27T06:13:55.989 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 313209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/rbd.ko 2024-05-27T06:13:55.989 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/ 2024-05-27T06:13:55.989 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 117217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-27T06:13:55.990 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/ 2024-05-27T06:13:55.990 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 70369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/zram.ko 2024-05-27T06:13:55.990 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ 2024-05-27T06:13:55.990 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/applicom.ko 2024-05-27T06:13:55.990 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hangcheck-timer.ko 2024-05-27T06:13:55.990 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/ 2024-05-27T06:13:55.990 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-27T06:13:55.990 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-27T06:13:55.990 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-27T06:13:55.990 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/via-rng.ko 2024-05-27T06:13:55.990 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-27T06:13:55.990 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ 2024-05-27T06:13:55.990 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-27T06:13:55.991 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 186913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-27T06:13:55.991 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-27T06:13:55.991 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 179441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-27T06:13:55.991 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 85433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-27T06:13:55.991 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 65305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-27T06:13:55.991 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/lp.ko 2024-05-27T06:13:55.991 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/ 2024-05-27T06:13:55.991 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 103385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/mwave.ko 2024-05-27T06:13:55.991 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/nvram.ko 2024-05-27T06:13:55.991 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ppdev.ko 2024-05-27T06:13:55.991 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 59233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tlclk.ko 2024-05-27T06:13:55.991 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/ 2024-05-27T06:13:55.992 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-27T06:13:55.992 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-05-27T06:13:55.992 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-05-27T06:13:55.992 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 39185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-05-27T06:13:55.992 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-27T06:13:55.992 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-27T06:13:55.992 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-05-27T06:13:55.992 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/ 2024-05-27T06:13:55.992 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/xillybus_class.ko 2024-05-27T06:13:55.992 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 62537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/xillybus_core.ko 2024-05-27T06:13:55.992 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-05-27T06:13:55.992 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/ 2024-05-27T06:13:55.992 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-palmas.ko 2024-05-27T06:13:55.992 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 57281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-si5351.ko 2024-05-27T06:13:55.993 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-twl6040.ko 2024-05-27T06:13:55.993 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-wm831x.ko 2024-05-27T06:13:55.993 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/ 2024-05-27T06:13:55.993 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-27T06:13:55.993 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-27T06:13:55.993 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-27T06:13:55.993 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ 2024-05-27T06:13:55.993 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ 2024-05-27T06:13:55.993 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 89209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-27T06:13:55.993 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 333593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp.ko 2024-05-27T06:13:55.993 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/ 2024-05-27T06:13:55.993 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/ 2024-05-27T06:13:55.993 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/ 2024-05-27T06:13:55.994 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 751433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-27T06:13:55.994 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-05-27T06:13:55.994 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-27T06:13:55.994 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-aes.ko 2024-05-27T06:13:55.994 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-sha.ko 2024-05-27T06:13:55.994 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/ 2024-05-27T06:13:55.994 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 90465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-27T06:13:55.994 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/ 2024-05-27T06:13:55.994 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/dca.ko 2024-05-27T06:13:55.994 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ 2024-05-27T06:13:55.994 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/ 2024-05-27T06:13:55.994 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-27T06:13:55.994 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ 2024-05-27T06:13:55.995 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 146745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-27T06:13:55.995 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ 2024-05-27T06:13:55.995 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 96137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/amd64_edac.ko 2024-05-27T06:13:55.995 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/e752x_edac.ko 2024-05-27T06:13:55.995 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 51097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/edac_mce_amd.ko 2024-05-27T06:13:55.995 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3000_edac.ko 2024-05-27T06:13:55.995 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3200_edac.ko 2024-05-27T06:13:55.995 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5100_edac.ko 2024-05-27T06:13:55.995 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5400_edac.ko 2024-05-27T06:13:55.995 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7300_edac.ko 2024-05-27T06:13:55.995 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 64153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7core_edac.ko 2024-05-27T06:13:55.995 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i82975x_edac.ko 2024-05-27T06:13:55.996 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ie31200_edac.ko 2024-05-27T06:13:55.996 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 68689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/sb_edac.ko 2024-05-27T06:13:55.996 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/x38_edac.ko 2024-05-27T06:13:55.996 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/ 2024-05-27T06:13:55.996 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-gpio.ko 2024-05-27T06:13:55.996 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-max14577.ko 2024-05-27T06:13:55.996 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-max77693.ko 2024-05-27T06:13:55.996 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-max8997.ko 2024-05-27T06:13:55.996 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-palmas.ko 2024-05-27T06:13:55.996 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-rt8973a.ko 2024-05-27T06:13:55.996 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-sm5502.ko 2024-05-27T06:13:55.996 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/ 2024-05-27T06:13:55.996 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 42945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/dmi-sysfs.ko 2024-05-27T06:13:55.997 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/efi/ 2024-05-27T06:13:55.997 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/efi/efi-pstore.ko 2024-05-27T06:13:55.997 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-27T06:13:55.997 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/ 2024-05-27T06:13:55.997 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-adp5520.ko 2024-05-27T06:13:55.997 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-amd8111.ko 2024-05-27T06:13:55.997 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-arizona.ko 2024-05-27T06:13:55.997 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-da9052.ko 2024-05-27T06:13:55.997 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-da9055.ko 2024-05-27T06:13:55.997 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-dln2.ko 2024-05-27T06:13:55.997 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 81065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-f7188x.ko 2024-05-27T06:13:55.997 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-generic.ko 2024-05-27T06:13:55.997 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ich.ko 2024-05-27T06:13:55.998 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-05-27T06:13:55.998 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-kempld.ko 2024-05-27T06:13:55.998 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-lp3943.ko 2024-05-27T06:13:55.998 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-max7300.ko 2024-05-27T06:13:55.998 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-max730x.ko 2024-05-27T06:13:55.998 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-max732x.ko 2024-05-27T06:13:55.998 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-05-27T06:13:55.998 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 55497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-pca953x.ko 2024-05-27T06:13:55.998 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-pcf857x.ko 2024-05-27T06:13:55.998 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-rdc321x.ko 2024-05-27T06:13:55.998 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-sch.ko 2024-05-27T06:13:55.998 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-sch311x.ko 2024-05-27T06:13:55.998 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-tps65912.ko 2024-05-27T06:13:55.999 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-twl4030.ko 2024-05-27T06:13:55.999 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-twl6040.ko 2024-05-27T06:13:55.999 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-27T06:13:55.999 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-vx855.ko 2024-05-27T06:13:55.999 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-wm831x.ko 2024-05-27T06:13:55.999 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-wm8350.ko 2024-05-27T06:13:55.999 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-wm8994.ko 2024-05-27T06:13:55.999 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/ 2024-05-27T06:13:55.999 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-a4tech.ko 2024-05-27T06:13:55.999 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-apple.ko 2024-05-27T06:13:55.999 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-appleir.ko 2024-05-27T06:13:55.999 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-aureal.ko 2024-05-27T06:13:55.999 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-axff.ko 2024-05-27T06:13:56.000 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-belkin.ko 2024-05-27T06:13:56.000 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-cherry.ko 2024-05-27T06:13:56.000 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-chicony.ko 2024-05-27T06:13:56.000 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 74385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-cp2112.ko 2024-05-27T06:13:56.000 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-cypress.ko 2024-05-27T06:13:56.000 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-dr.ko 2024-05-27T06:13:56.000 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elecom.ko 2024-05-27T06:13:56.000 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elo.ko 2024-05-27T06:13:56.000 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-emsff.ko 2024-05-27T06:13:56.000 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ezkey.ko 2024-05-27T06:13:56.000 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gaff.ko 2024-05-27T06:13:56.000 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-generic.ko 2024-05-27T06:13:56.000 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gt683r.ko 2024-05-27T06:13:56.001 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gyration.ko 2024-05-27T06:13:56.001 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-27T06:13:56.001 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-27T06:13:56.001 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtekff.ko 2024-05-27T06:13:56.001 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-hyperv.ko 2024-05-27T06:13:56.001 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-icade.ko 2024-05-27T06:13:56.001 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kensington.ko 2024-05-27T06:13:56.001 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-keytouch.ko 2024-05-27T06:13:56.001 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kye.ko 2024-05-27T06:13:56.001 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lcpower.ko 2024-05-27T06:13:56.001 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-led.ko 2024-05-27T06:13:56.001 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 54209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lenovo.ko 2024-05-27T06:13:56.001 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lg-g15.ko 2024-05-27T06:13:56.002 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 67961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-27T06:13:56.002 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 121361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-27T06:13:56.002 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 97929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech.ko 2024-05-27T06:13:56.002 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-magicmouse.ko 2024-05-27T06:13:56.002 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-microsoft.ko 2024-05-27T06:13:56.002 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-monterey.ko 2024-05-27T06:13:56.002 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 58993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-multitouch.ko 2024-05-27T06:13:56.002 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 39689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ntrig.ko 2024-05-27T06:13:56.002 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ortek.ko 2024-05-27T06:13:56.002 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-penmount.ko 2024-05-27T06:13:56.002 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-petalynx.ko 2024-05-27T06:13:56.002 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 91217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-picolcd.ko 2024-05-27T06:13:56.002 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-pl.ko 2024-05-27T06:13:56.003 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-plantronics.ko 2024-05-27T06:13:56.003 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-primax.ko 2024-05-27T06:13:56.003 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 42881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-rmi.ko 2024-05-27T06:13:56.003 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-27T06:13:56.003 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-common.ko 2024-05-27T06:13:56.003 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-27T06:13:56.003 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-27T06:13:56.003 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-27T06:13:56.003 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-27T06:13:56.003 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-27T06:13:56.003 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-27T06:13:56.003 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-27T06:13:56.003 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-27T06:13:56.003 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-27T06:13:56.004 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat.ko 2024-05-27T06:13:56.004 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-saitek.ko 2024-05-27T06:13:56.004 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 42297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-samsung.ko 2024-05-27T06:13:56.004 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-27T06:13:56.004 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sjoy.ko 2024-05-27T06:13:56.004 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 62121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sony.ko 2024-05-27T06:13:56.004 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-speedlink.ko 2024-05-27T06:13:56.004 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-steelseries.ko 2024-05-27T06:13:56.004 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sunplus.ko 2024-05-27T06:13:56.004 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-27T06:13:56.004 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tivo.ko 2024-05-27T06:13:56.004 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tmff.ko 2024-05-27T06:13:56.004 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-topseed.ko 2024-05-27T06:13:56.005 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-twinhan.ko 2024-05-27T06:13:56.005 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 81097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-uclogic.ko 2024-05-27T06:13:56.005 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-waltop.ko 2024-05-27T06:13:56.005 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 184729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-wiimote.ko 2024-05-27T06:13:56.005 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-xinmo.ko 2024-05-27T06:13:56.005 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zpff.ko 2024-05-27T06:13:56.005 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zydacron.ko 2024-05-27T06:13:56.005 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 319897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid.ko 2024-05-27T06:13:56.005 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 39521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/uhid.ko 2024-05-27T06:13:56.005 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/ 2024-05-27T06:13:56.005 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 153617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/usbhid.ko 2024-05-27T06:13:56.005 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/usbkbd.ko 2024-05-27T06:13:56.005 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/usbmouse.ko 2024-05-27T06:13:56.006 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 261929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/wacom.ko 2024-05-27T06:13:56.006 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/ 2024-05-27T06:13:56.006 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 75057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_balloon.ko 2024-05-27T06:13:56.006 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 110657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_utils.ko 2024-05-27T06:13:56.006 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 381625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_vmbus.ko 2024-05-27T06:13:56.006 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ 2024-05-27T06:13:56.006 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 77145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru.ko 2024-05-27T06:13:56.006 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 67001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru3.ko 2024-05-27T06:13:56.006 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 42241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-27T06:13:56.006 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7414.ko 2024-05-27T06:13:56.006 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7418.ko 2024-05-27T06:13:56.006 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adc128d818.ko 2024-05-27T06:13:56.007 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1025.ko 2024-05-27T06:13:56.007 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 115049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1026.ko 2024-05-27T06:13:56.007 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1029.ko 2024-05-27T06:13:56.007 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 55217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1031.ko 2024-05-27T06:13:56.007 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm9240.ko 2024-05-27T06:13:56.007 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ads7828.ko 2024-05-27T06:13:56.007 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7410.ko 2024-05-27T06:13:56.007 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7411.ko 2024-05-27T06:13:56.007 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 89017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7462.ko 2024-05-27T06:13:56.007 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 49145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7470.ko 2024-05-27T06:13:56.007 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 81465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7475.ko 2024-05-27T06:13:56.007 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7x10.ko 2024-05-27T06:13:56.007 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 48169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/amc6821.ko 2024-05-27T06:13:56.007 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 68857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/applesmc.ko 2024-05-27T06:13:56.008 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 60185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asb100.ko 2024-05-27T06:13:56.008 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 69001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asc7621.ko 2024-05-27T06:13:56.008 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 47969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-27T06:13:56.008 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/atxp1.ko 2024-05-27T06:13:56.008 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/coretemp.ko 2024-05-27T06:13:56.008 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/da9052-hwmon.ko 2024-05-27T06:13:56.008 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/da9055-hwmon.ko 2024-05-27T06:13:56.008 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 55705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-27T06:13:56.008 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 113129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dme1737.ko 2024-05-27T06:13:56.008 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds1621.ko 2024-05-27T06:13:56.008 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds620.ko 2024-05-27T06:13:56.008 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc1403.ko 2024-05-27T06:13:56.008 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc2103.ko 2024-05-27T06:13:56.009 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc6w201.ko 2024-05-27T06:13:56.009 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 78913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71805f.ko 2024-05-27T06:13:56.009 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 108953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71882fg.ko 2024-05-27T06:13:56.009 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 50689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f75375s.ko 2024-05-27T06:13:56.009 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fam15h_power.ko 2024-05-27T06:13:56.009 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 65761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fschmd.ko 2024-05-27T06:13:56.009 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g760a.ko 2024-05-27T06:13:56.009 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g762.ko 2024-05-27T06:13:56.009 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 59753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl518sm.ko 2024-05-27T06:13:56.009 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 56305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl520sm.ko 2024-05-27T06:13:56.009 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hih6130.ko 2024-05-27T06:13:56.009 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-27T06:13:56.009 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5500_temp.ko 2024-05-27T06:13:56.009 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5k_amb.ko 2024-05-27T06:13:56.010 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 42577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmaem.ko 2024-05-27T06:13:56.010 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmpex.ko 2024-05-27T06:13:56.010 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina209.ko 2024-05-27T06:13:56.010 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina2xx.ko 2024-05-27T06:13:56.010 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 156457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/it87.ko 2024-05-27T06:13:56.010 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/jc42.ko 2024-05-27T06:13:56.010 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k10temp.ko 2024-05-27T06:13:56.010 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k8temp.ko 2024-05-27T06:13:56.010 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lineage-pem.ko 2024-05-27T06:13:56.010 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 57761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm63.ko 2024-05-27T06:13:56.010 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm73.ko 2024-05-27T06:13:56.010 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 44113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm75.ko 2024-05-27T06:13:56.010 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm77.ko 2024-05-27T06:13:56.011 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm78.ko 2024-05-27T06:13:56.011 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm80.ko 2024-05-27T06:13:56.011 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm83.ko 2024-05-27T06:13:56.011 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 86489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm85.ko 2024-05-27T06:13:56.011 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 55633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm87.ko 2024-05-27T06:13:56.011 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 76481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm90.ko 2024-05-27T06:13:56.011 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm92.ko 2024-05-27T06:13:56.011 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 131497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm93.ko 2024-05-27T06:13:56.011 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95234.ko 2024-05-27T06:13:56.011 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95241.ko 2024-05-27T06:13:56.011 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95245.ko 2024-05-27T06:13:56.011 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc2945.ko 2024-05-27T06:13:56.012 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4151.ko 2024-05-27T06:13:56.012 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4215.ko 2024-05-27T06:13:56.012 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4222.ko 2024-05-27T06:13:56.012 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4245.ko 2024-05-27T06:13:56.012 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4260.ko 2024-05-27T06:13:56.012 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4261.ko 2024-05-27T06:13:56.012 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max16065.ko 2024-05-27T06:13:56.012 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1619.ko 2024-05-27T06:13:56.012 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1668.ko 2024-05-27T06:13:56.012 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max197.ko 2024-05-27T06:13:56.012 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6639.ko 2024-05-27T06:13:56.012 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6650.ko 2024-05-27T06:13:56.012 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 39721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6697.ko 2024-05-27T06:13:56.012 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mc13783-adc.ko 2024-05-27T06:13:56.013 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mcp3021.ko 2024-05-27T06:13:56.013 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-05-27T06:13:56.013 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 56497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6683.ko 2024-05-27T06:13:56.013 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 141345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775-core.ko 2024-05-27T06:13:56.013 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 72729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775.ko 2024-05-27T06:13:56.013 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 67769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct7802.ko 2024-05-27T06:13:56.013 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 97769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87360.ko 2024-05-27T06:13:56.013 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 61913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87427.ko 2024-05-27T06:13:56.013 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pcf8591.ko 2024-05-27T06:13:56.013 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ 2024-05-27T06:13:56.013 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-27T06:13:56.013 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-27T06:13:56.013 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-27T06:13:56.013 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-27T06:13:56.013 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-27T06:13:56.014 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-27T06:13:56.014 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-27T06:13:56.014 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 101225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-27T06:13:56.014 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-27T06:13:56.014 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-27T06:13:56.014 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-27T06:13:56.014 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-27T06:13:56.014 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/powr1220.ko 2024-05-27T06:13:56.014 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5627.ko 2024-05-27T06:13:56.014 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5636.ko 2024-05-27T06:13:56.014 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-27T06:13:56.014 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht15.ko 2024-05-27T06:13:56.014 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht21.ko 2024-05-27T06:13:56.015 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/shtc1.ko 2024-05-27T06:13:56.015 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 48705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sis5595.ko 2024-05-27T06:13:56.015 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47b397.ko 2024-05-27T06:13:56.015 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 46465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m1.ko 2024-05-27T06:13:56.015 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 44305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m192.ko 2024-05-27T06:13:56.015 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/thmc50.ko 2024-05-27T06:13:56.015 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp102.ko 2024-05-27T06:13:56.015 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp103.ko 2024-05-27T06:13:56.015 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp401.ko 2024-05-27T06:13:56.015 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp421.ko 2024-05-27T06:13:56.015 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via-cputemp.ko 2024-05-27T06:13:56.015 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 50209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via686a.ko 2024-05-27T06:13:56.015 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 59657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt1211.ko 2024-05-27T06:13:56.015 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 62729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt8231.ko 2024-05-27T06:13:56.016 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 71161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627ehf.ko 2024-05-27T06:13:56.016 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 96569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627hf.ko 2024-05-27T06:13:56.016 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 85905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83781d.ko 2024-05-27T06:13:56.016 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 75121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83791d.ko 2024-05-27T06:13:56.016 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 83417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83792d.ko 2024-05-27T06:13:56.016 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 116769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83793.ko 2024-05-27T06:13:56.016 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 134433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83795.ko 2024-05-27T06:13:56.016 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l785ts.ko 2024-05-27T06:13:56.016 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l786ng.ko 2024-05-27T06:13:56.016 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-05-27T06:13:56.016 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-05-27T06:13:56.016 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/ 2024-05-27T06:13:56.016 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/ 2024-05-27T06:13:56.017 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-27T06:13:56.017 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-27T06:13:56.017 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/ 2024-05-27T06:13:56.017 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-05-27T06:13:56.017 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-05-27T06:13:56.017 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-05-27T06:13:56.017 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-27T06:13:56.017 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-27T06:13:56.017 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-27T06:13:56.017 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-05-27T06:13:56.017 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-27T06:13:56.017 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-05-27T06:13:56.018 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 64217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-27T06:13:56.018 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-27T06:13:56.018 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-27T06:13:56.018 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-27T06:13:56.018 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-05-27T06:13:56.018 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-05-27T06:13:56.018 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 76961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-27T06:13:56.018 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-27T06:13:56.018 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 52929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-27T06:13:56.018 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-05-27T06:13:56.018 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-27T06:13:56.018 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-27T06:13:56.018 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-05-27T06:13:56.019 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-27T06:13:56.019 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-27T06:13:56.019 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 57209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-27T06:13:56.019 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-05-27T06:13:56.019 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-27T06:13:56.019 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-27T06:13:56.019 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-05-27T06:13:56.019 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-05-27T06:13:56.019 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-27T06:13:56.019 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-05-27T06:13:56.019 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-27T06:13:56.019 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-27T06:13:56.019 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-27T06:13:56.019 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-27T06:13:56.020 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 59121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-05-27T06:13:56.020 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-mux.ko 2024-05-27T06:13:56.020 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-smbus.ko 2024-05-27T06:13:56.020 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-stub.ko 2024-05-27T06:13:56.020 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/ 2024-05-27T06:13:56.020 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-05-27T06:13:56.020 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-05-27T06:13:56.020 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-05-27T06:13:56.020 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ 2024-05-27T06:13:56.020 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ 2024-05-27T06:13:56.020 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 329681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-27T06:13:56.020 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1119785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_core.ko 2024-05-27T06:13:56.020 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 83897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-27T06:13:56.020 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 408329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-27T06:13:56.021 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 120905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-27T06:13:56.021 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 347201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-27T06:13:56.021 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 84937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-27T06:13:56.021 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/ 2024-05-27T06:13:56.021 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/ 2024-05-27T06:13:56.021 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 590873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-27T06:13:56.021 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/ 2024-05-27T06:13:56.021 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 514577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-27T06:13:56.021 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/ 2024-05-27T06:13:56.021 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 911649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-27T06:13:56.021 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ 2024-05-27T06:13:56.021 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 375449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-27T06:13:56.021 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/ocrdma/ 2024-05-27T06:13:56.021 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 197097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-05-27T06:13:56.022 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/usnic/ 2024-05-27T06:13:56.022 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 212497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-05-27T06:13:56.022 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ 2024-05-27T06:13:56.022 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ 2024-05-27T06:13:56.022 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 334353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-27T06:13:56.022 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ 2024-05-27T06:13:56.022 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 120649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-27T06:13:56.022 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ 2024-05-27T06:13:56.022 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 132577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-27T06:13:56.022 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ 2024-05-27T06:13:56.022 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 157929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-27T06:13:56.022 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ 2024-05-27T06:13:56.022 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 156665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-27T06:13:56.077 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/ 2024-05-27T06:13:56.078 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/evbug.ko 2024-05-27T06:13:56.078 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/ff-memless.ko 2024-05-27T06:13:56.078 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/ 2024-05-27T06:13:56.078 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-27T06:13:56.078 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-27T06:13:56.078 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 50705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/gameport.ko 2024-05-27T06:13:56.078 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 49433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/joydev.ko 2024-05-27T06:13:56.078 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/ 2024-05-27T06:13:56.078 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-05-27T06:13:56.078 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-05-27T06:13:56.078 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-05-27T06:13:56.079 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-05-27T06:13:56.079 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 45465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-27T06:13:56.079 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-05-27T06:13:56.079 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/lkkbd.ko 2024-05-27T06:13:56.079 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/lm8323.ko 2024-05-27T06:13:56.079 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/lm8333.ko 2024-05-27T06:13:56.079 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-05-27T06:13:56.079 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-05-27T06:13:56.079 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-05-27T06:13:56.079 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-05-27T06:13:56.079 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/newtonkbd.ko 2024-05-27T06:13:56.079 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-05-27T06:13:56.079 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/qt1070.ko 2024-05-27T06:13:56.080 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/qt2160.ko 2024-05-27T06:13:56.080 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-05-27T06:13:56.080 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/stowaway.ko 2024-05-27T06:13:56.080 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/sunkbd.ko 2024-05-27T06:13:56.080 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-05-27T06:13:56.080 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-05-27T06:13:56.080 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-05-27T06:13:56.080 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/xtkbd.ko 2024-05-27T06:13:56.080 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/matrix-keymap.ko 2024-05-27T06:13:56.080 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/ 2024-05-27T06:13:56.080 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/appletouch.ko 2024-05-27T06:13:56.080 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 39545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/bcm5974.ko 2024-05-27T06:13:56.081 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 159993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/cyapatp.ko 2024-05-27T06:13:56.081 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 114193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-27T06:13:56.081 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/gpio_mouse.ko 2024-05-27T06:13:56.081 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 428121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/psmouse.ko 2024-05-27T06:13:56.081 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/sermouse.ko 2024-05-27T06:13:56.081 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-27T06:13:56.081 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-27T06:13:56.081 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-27T06:13:56.081 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/ 2024-05-27T06:13:56.081 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 140921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-27T06:13:56.081 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/ 2024-05-27T06:13:56.081 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/altera_ps2.ko 2024-05-27T06:13:56.081 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/arc_ps2.ko 2024-05-27T06:13:56.081 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/ct82c710.ko 2024-05-27T06:13:56.082 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-27T06:13:56.082 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/parkbd.ko 2024-05-27T06:13:56.082 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/pcips2.ko 2024-05-27T06:13:56.082 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/ps2mult.ko 2024-05-27T06:13:56.082 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serio_raw.ko 2024-05-27T06:13:56.082 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serport.ko 2024-05-27T06:13:56.082 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/sparse-keymap.ko 2024-05-27T06:13:56.082 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/ 2024-05-27T06:13:56.082 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-88pm860x.ko 2024-05-27T06:13:56.082 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-adp5520.ko 2024-05-27T06:13:56.082 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 77193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-bd2802.ko 2024-05-27T06:13:56.082 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-blinkm.ko 2024-05-27T06:13:56.082 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-da903x.ko 2024-05-27T06:13:56.083 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-da9052.ko 2024-05-27T06:13:56.083 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-gpio.ko 2024-05-27T06:13:56.083 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3530.ko 2024-05-27T06:13:56.083 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3533.ko 2024-05-27T06:13:56.083 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm355x.ko 2024-05-27T06:13:56.083 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3642.ko 2024-05-27T06:13:56.083 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp3944.ko 2024-05-27T06:13:56.083 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp8788.ko 2024-05-27T06:13:56.083 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-max8997.ko 2024-05-27T06:13:56.083 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-mc13783.ko 2024-05-27T06:13:56.083 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-menf21bmc.ko 2024-05-27T06:13:56.083 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-pca9532.ko 2024-05-27T06:13:56.084 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-pca955x.ko 2024-05-27T06:13:56.084 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-pca963x.ko 2024-05-27T06:13:56.084 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-ss4200.ko 2024-05-27T06:13:56.084 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-tca6507.ko 2024-05-27T06:13:56.084 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-wm831x-status.ko 2024-05-27T06:13:56.084 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-wm8350.ko 2024-05-27T06:13:56.084 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ 2024-05-27T06:13:56.084 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-27T06:13:56.084 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-27T06:13:56.084 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-27T06:13:56.084 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-27T06:13:56.084 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-27T06:13:56.084 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-27T06:13:56.085 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-27T06:13:56.085 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-27T06:13:56.085 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-27T06:13:56.085 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/ 2024-05-27T06:13:56.085 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/ 2024-05-27T06:13:56.085 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 790665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/bcache.ko 2024-05-27T06:13:56.085 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 49065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bio-prison.ko 2024-05-27T06:13:56.085 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 116817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bufio.ko 2024-05-27T06:13:56.085 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 58273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache-smq.ko 2024-05-27T06:13:56.085 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 199017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache.ko 2024-05-27T06:13:56.085 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 134937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-crypt.ko 2024-05-27T06:13:56.085 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-delay.ko 2024-05-27T06:13:56.085 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 67489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-era.ko 2024-05-27T06:13:56.085 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-flakey.ko 2024-05-27T06:13:56.086 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 50441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log-userspace.ko 2024-05-27T06:13:56.086 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log.ko 2024-05-27T06:13:56.086 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 60969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-mirror.ko 2024-05-27T06:13:56.086 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 97193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-multipath.ko 2024-05-27T06:13:56.086 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-queue-length.ko 2024-05-27T06:13:56.086 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 85681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-raid.ko 2024-05-27T06:13:56.086 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 44281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-region-hash.ko 2024-05-27T06:13:56.086 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-round-robin.ko 2024-05-27T06:13:56.086 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-service-time.ko 2024-05-27T06:13:56.086 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 139793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-snapshot.ko 2024-05-27T06:13:56.086 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-switch.ko 2024-05-27T06:13:56.086 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 234441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-thin-pool.ko 2024-05-27T06:13:56.087 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 66417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-verity.ko 2024-05-27T06:13:56.087 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-zero.ko 2024-05-27T06:13:56.087 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/ 2024-05-27T06:13:56.087 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 264273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-27T06:13:56.087 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid0.ko 2024-05-27T06:13:56.087 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 124705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid1.ko 2024-05-27T06:13:56.087 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 157673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid10.ko 2024-05-27T06:13:56.087 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 444649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid456.ko 2024-05-27T06:13:56.087 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/ 2024-05-27T06:13:56.087 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/ 2024-05-27T06:13:56.087 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 214833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptbase.ko 2024-05-27T06:13:56.087 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 77977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptctl.ko 2024-05-27T06:13:56.088 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 54777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptfc.ko 2024-05-27T06:13:56.088 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 44625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptlan.ko 2024-05-27T06:13:56.088 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 150753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptsas.ko 2024-05-27T06:13:56.088 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 97209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptscsih.ko 2024-05-27T06:13:56.088 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 63865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptspi.ko 2024-05-27T06:13:56.088 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/ 2024-05-27T06:13:56.088 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/88pm800.ko 2024-05-27T06:13:56.088 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/88pm805.ko 2024-05-27T06:13:56.088 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/88pm80x.ko 2024-05-27T06:13:56.088 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/arizona-i2c.ko 2024-05-27T06:13:56.088 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 148545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/arizona.ko 2024-05-27T06:13:56.088 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/bcm590xx.ko 2024-05-27T06:13:56.088 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/cros_ec_dev.ko 2024-05-27T06:13:56.088 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/dln2.ko 2024-05-27T06:13:56.089 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/janz-cmodio.ko 2024-05-27T06:13:56.089 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 59081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/kempld-core.ko 2024-05-27T06:13:56.089 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lm3533-core.ko 2024-05-27T06:13:56.089 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-05-27T06:13:56.089 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lp3943.ko 2024-05-27T06:13:56.089 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 60489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_ich.ko 2024-05-27T06:13:56.089 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_sch.ko 2024-05-27T06:13:56.089 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/max8907.ko 2024-05-27T06:13:56.089 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mc13xxx-core.ko 2024-05-27T06:13:56.089 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-05-27T06:13:56.089 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/menf21bmc.ko 2024-05-27T06:13:56.089 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/pcf50633-adc.ko 2024-05-27T06:13:56.089 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/pcf50633-gpio.ko 2024-05-27T06:13:56.090 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 42281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/pcf50633.ko 2024-05-27T06:13:56.090 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-05-27T06:13:56.090 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/retu-mfd.ko 2024-05-27T06:13:56.090 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 99409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/si476x-core.ko 2024-05-27T06:13:56.090 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 58049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/sm501.ko 2024-05-27T06:13:56.090 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 60673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/tps65010.ko 2024-05-27T06:13:56.090 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/tps6507x.ko 2024-05-27T06:13:56.090 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/viperboard.ko 2024-05-27T06:13:56.090 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/vx855.ko 2024-05-27T06:13:56.090 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wl1273-core.ko 2024-05-27T06:13:56.090 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 52345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wm8994.ko 2024-05-27T06:13:56.090 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ 2024-05-27T06:13:56.091 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-05-27T06:13:56.091 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 64257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ad525x_dpot.ko 2024-05-27T06:13:56.091 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/ 2024-05-27T06:13:56.091 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 57497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-27T06:13:56.091 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds9802als.ko 2024-05-27T06:13:56.091 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 47681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds990x.ko 2024-05-27T06:13:56.091 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 58625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/bh1770glc.ko 2024-05-27T06:13:56.091 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/c2port/ 2024-05-27T06:13:56.091 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-05-27T06:13:56.091 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 47441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/c2port/core.ko 2024-05-27T06:13:56.091 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/ 2024-05-27T06:13:56.091 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/cb710.ko 2024-05-27T06:13:56.091 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ds1682.ko 2024-05-27T06:13:56.092 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/dummy-irq.ko 2024-05-27T06:13:56.092 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/echo/ 2024-05-27T06:13:56.092 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/echo/echo.ko 2024-05-27T06:13:56.092 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/ 2024-05-27T06:13:56.092 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 42921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/at24.ko 2024-05-27T06:13:56.092 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-27T06:13:56.092 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/max6875.ko 2024-05-27T06:13:56.092 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/enclosure.ko 2024-05-27T06:13:56.092 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/genwqe/ 2024-05-27T06:13:56.092 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 191617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-05-27T06:13:56.092 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hmc6352.ko 2024-05-27T06:13:56.092 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hpilo.ko 2024-05-27T06:13:56.093 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ibmasm/ 2024-05-27T06:13:56.093 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 92289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-05-27T06:13:56.093 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ics932s401.ko 2024-05-27T06:13:56.093 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29003.ko 2024-05-27T06:13:56.093 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29020.ko 2024-05-27T06:13:56.093 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/ 2024-05-27T06:13:56.093 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 54857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-27T06:13:56.093 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-27T06:13:56.093 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/ 2024-05-27T06:13:56.093 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 154257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-me.ko 2024-05-27T06:13:56.093 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 69793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-txe.ko 2024-05-27T06:13:56.093 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 388977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei.ko 2024-05-27T06:13:56.093 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/phantom.ko 2024-05-27T06:13:56.093 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ti-st/ 2024-05-27T06:13:56.094 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 91129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ti-st/st_drv.ko 2024-05-27T06:13:56.094 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_7xx1.ko 2024-05-27T06:13:56.094 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_core.ko 2024-05-27T06:13:56.094 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tsl2550.ko 2024-05-27T06:13:56.094 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 55785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_balloon.ko 2024-05-27T06:13:56.094 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/ 2024-05-27T06:13:56.094 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 234849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-27T06:13:56.094 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ 2024-05-27T06:13:56.094 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/ 2024-05-27T06:13:56.094 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 620849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/bonding.ko 2024-05-27T06:13:56.094 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/ 2024-05-27T06:13:56.094 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/ 2024-05-27T06:13:56.094 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 139745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-27T06:13:56.095 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 49529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-27T06:13:56.095 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-27T06:13:56.095 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/ 2024-05-27T06:13:56.095 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 589537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-27T06:13:56.095 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dummy.ko 2024-05-27T06:13:56.095 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/eql.ko 2024-05-27T06:13:56.095 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ 2024-05-27T06:13:56.095 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/ 2024-05-27T06:13:56.095 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 53745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-27T06:13:56.095 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 49193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-27T06:13:56.095 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 158641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-27T06:13:56.095 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 85945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-27T06:13:56.096 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ 2024-05-27T06:13:56.096 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 44153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-27T06:13:56.096 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 73857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-27T06:13:56.096 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-27T06:13:56.096 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 109513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-27T06:13:56.096 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/ 2024-05-27T06:13:56.096 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 64697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-27T06:13:56.096 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/ 2024-05-27T06:13:56.096 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 84321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-27T06:13:56.096 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/ 2024-05-27T06:13:56.096 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 70729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-27T06:13:56.096 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/ 2024-05-27T06:13:56.096 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 52681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-27T06:13:56.096 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/ 2024-05-27T06:13:56.097 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 65785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-27T06:13:56.097 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 56049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-27T06:13:56.097 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 115873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-27T06:13:56.097 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/ 2024-05-27T06:13:56.097 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/ 2024-05-27T06:13:56.097 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 124481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-27T06:13:56.097 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-05-27T06:13:56.097 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 128393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-27T06:13:56.097 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-05-27T06:13:56.097 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 110321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-27T06:13:56.097 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/ 2024-05-27T06:13:56.097 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 101849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-27T06:13:56.097 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 88945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-27T06:13:56.098 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/ 2024-05-27T06:13:56.098 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 105625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-27T06:13:56.098 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 228977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-27T06:13:56.098 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-05-27T06:13:56.098 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1733297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-27T06:13:56.098 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 167177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-27T06:13:56.098 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/ 2024-05-27T06:13:56.098 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 164249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-27T06:13:56.098 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 440553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-27T06:13:56.098 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/ 2024-05-27T06:13:56.098 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/ 2024-05-27T06:13:56.098 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 432145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-27T06:13:56.098 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/ 2024-05-27T06:13:56.099 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-05-27T06:13:56.099 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 257145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-27T06:13:56.099 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-05-27T06:13:56.099 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 446057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-27T06:13:56.099 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-05-27T06:13:56.099 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1311193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-27T06:13:56.099 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-05-27T06:13:56.099 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 206673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-27T06:13:56.099 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-05-27T06:13:56.099 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-27T06:13:56.099 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/ 2024-05-27T06:13:56.099 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/ 2024-05-27T06:13:56.100 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 269249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-27T06:13:56.100 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/ 2024-05-27T06:13:56.100 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/ 2024-05-27T06:13:56.100 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 85377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-27T06:13:56.100 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 77449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-27T06:13:56.100 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 169041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-27T06:13:56.100 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 65905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-27T06:13:56.100 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 76201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-27T06:13:56.100 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-27T06:13:56.100 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/ 2024-05-27T06:13:56.100 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 75937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-27T06:13:56.100 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 78697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-27T06:13:56.100 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 52305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dnet.ko 2024-05-27T06:13:56.100 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ec_bhf.ko 2024-05-27T06:13:56.101 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/ 2024-05-27T06:13:56.101 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/ 2024-05-27T06:13:56.101 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 356353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-27T06:13:56.101 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 61729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ethoc.ko 2024-05-27T06:13:56.101 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 63177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fealnx.ko 2024-05-27T06:13:56.101 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fujitsu/ 2024-05-27T06:13:56.101 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 51505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-05-27T06:13:56.101 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ 2024-05-27T06:13:56.101 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 115561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-27T06:13:56.101 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/ 2024-05-27T06:13:56.101 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 366193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-27T06:13:56.101 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/ 2024-05-27T06:13:56.101 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 755673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-27T06:13:56.102 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/ 2024-05-27T06:13:56.102 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 324513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-27T06:13:56.102 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/ 2024-05-27T06:13:56.102 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1196201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-27T06:13:56.102 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/ 2024-05-27T06:13:56.102 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 362609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-27T06:13:56.102 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/ 2024-05-27T06:13:56.102 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 672313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-27T06:13:56.102 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/ 2024-05-27T06:13:56.102 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 121513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-27T06:13:56.102 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-05-27T06:13:56.102 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 966601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-27T06:13:56.102 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-05-27T06:13:56.103 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 193465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-27T06:13:56.103 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 108625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/jme.ko 2024-05-27T06:13:56.103 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/ 2024-05-27T06:13:56.103 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-27T06:13:56.103 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 126873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-27T06:13:56.103 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 150769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-27T06:13:56.103 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/ 2024-05-27T06:13:56.103 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-05-27T06:13:56.103 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 904929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-27T06:13:56.103 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 344089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-27T06:13:56.103 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-05-27T06:13:56.103 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-05-27T06:13:56.103 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1413529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-27T06:13:56.103 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ 2024-05-27T06:13:56.103 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 65905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-05-27T06:13:56.104 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 54217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-05-27T06:13:56.104 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-05-27T06:13:56.104 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 117345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-27T06:13:56.104 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/ 2024-05-27T06:13:56.104 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-05-27T06:13:56.104 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 131353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-27T06:13:56.104 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ 2024-05-27T06:13:56.104 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 91457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-27T06:13:56.104 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 56681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-27T06:13:56.104 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/ 2024-05-27T06:13:56.104 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 181201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-27T06:13:56.104 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/ 2024-05-27T06:13:56.104 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 171409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-27T06:13:56.105 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/ 2024-05-27T06:13:56.105 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 58241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-27T06:13:56.105 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 50113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-27T06:13:56.105 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/ 2024-05-27T06:13:56.105 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-05-27T06:13:56.105 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 300793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-27T06:13:56.105 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 105681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-27T06:13:56.105 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-05-27T06:13:56.105 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 885057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-27T06:13:56.105 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/ 2024-05-27T06:13:56.105 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 52297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-27T06:13:56.105 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/ 2024-05-27T06:13:56.105 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 81633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-27T06:13:56.106 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 100681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-27T06:13:56.106 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-27T06:13:56.106 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 264145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-27T06:13:56.106 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/samsung/ 2024-05-27T06:13:56.106 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-05-27T06:13:56.106 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 142401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-05-27T06:13:56.106 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/ 2024-05-27T06:13:56.106 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1350201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-27T06:13:56.106 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/ 2024-05-27T06:13:56.106 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 57945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-27T06:13:56.106 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/ 2024-05-27T06:13:56.106 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 66497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-27T06:13:56.106 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 80057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-27T06:13:56.106 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/ 2024-05-27T06:13:56.107 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 74281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-27T06:13:56.107 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 79449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-27T06:13:56.107 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 100777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-27T06:13:56.107 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 83433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-27T06:13:56.107 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/ 2024-05-27T06:13:56.107 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-05-27T06:13:56.107 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-05-27T06:13:56.107 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 46977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-27T06:13:56.107 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-05-27T06:13:56.107 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 644329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-27T06:13:56.107 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/ 2024-05-27T06:13:56.107 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 128489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-27T06:13:56.107 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 207985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-27T06:13:56.107 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 82625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-27T06:13:56.108 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 91345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-27T06:13:56.108 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/ 2024-05-27T06:13:56.108 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 59793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-27T06:13:56.108 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/ 2024-05-27T06:13:56.108 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 110721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-27T06:13:56.108 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/ 2024-05-27T06:13:56.108 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 98681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-27T06:13:56.108 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 102505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-27T06:13:56.108 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/ 2024-05-27T06:13:56.108 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 61489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-27T06:13:56.108 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-27T06:13:56.108 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/ 2024-05-27T06:13:56.108 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 69905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-27T06:13:56.108 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/ 2024-05-27T06:13:56.109 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 49441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/defxx.ko 2024-05-27T06:13:56.109 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/skfp/ 2024-05-27T06:13:56.109 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 275713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/skfp/skfp.ko 2024-05-27T06:13:56.109 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 91665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/geneve.ko 2024-05-27T06:13:56.109 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/ 2024-05-27T06:13:56.109 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 290441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-27T06:13:56.109 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/ 2024-05-27T06:13:56.109 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-27T06:13:56.109 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ifb.ko 2024-05-27T06:13:56.109 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ 2024-05-27T06:13:56.109 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 108313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-27T06:13:56.109 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 78057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvlan.ko 2024-05-27T06:13:56.109 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvtap.ko 2024-05-27T06:13:56.110 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/ 2024-05-27T06:13:56.110 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-27T06:13:56.110 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-27T06:13:56.110 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-gpio.ko 2024-05-27T06:13:56.110 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-27T06:13:56.110 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio.ko 2024-05-27T06:13:56.110 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mii.ko 2024-05-27T06:13:56.110 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 62673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/netconsole.ko 2024-05-27T06:13:56.110 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/nlmon.ko 2024-05-27T06:13:56.110 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/ 2024-05-27T06:13:56.110 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-27T06:13:56.110 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 48233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-27T06:13:56.110 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ 2024-05-27T06:13:56.111 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/amd.ko 2024-05-27T06:13:56.111 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 61977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-27T06:13:56.111 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 52857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-27T06:13:56.111 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm87xx.ko 2024-05-27T06:13:56.111 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 53401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/broadcom.ko 2024-05-27T06:13:56.111 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/cicada.ko 2024-05-27T06:13:56.111 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/davicom.ko 2024-05-27T06:13:56.111 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/et1011c.ko 2024-05-27T06:13:56.111 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/icplus.ko 2024-05-27T06:13:56.111 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/lxt.ko 2024-05-27T06:13:56.111 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 103369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/marvell.ko 2024-05-27T06:13:56.111 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 96017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/micrel.ko 2024-05-27T06:13:56.111 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/national.ko 2024-05-27T06:13:56.111 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 121097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/phylink.ko 2024-05-27T06:13:56.112 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/qsemi.ko 2024-05-27T06:13:56.112 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 62105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/realtek.ko 2024-05-27T06:13:56.112 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/smsc.ko 2024-05-27T06:13:56.112 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ste10Xp.ko 2024-05-27T06:13:56.112 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/vitesse.ko 2024-05-27T06:13:56.112 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/plip/ 2024-05-27T06:13:56.112 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 55345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/plip/plip.ko 2024-05-27T06:13:56.112 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ 2024-05-27T06:13:56.112 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-27T06:13:56.112 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_async.ko 2024-05-27T06:13:56.112 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-27T06:13:56.112 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-27T06:13:56.112 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-27T06:13:56.112 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 53225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppoe.ko 2024-05-27T06:13:56.112 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppox.ko 2024-05-27T06:13:56.113 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pptp.ko 2024-05-27T06:13:56.113 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sb1000.ko 2024-05-27T06:13:56.113 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/ 2024-05-27T06:13:56.113 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 52065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slip.ko 2024-05-27T06:13:56.113 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 42401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sungem_phy.ko 2024-05-27T06:13:56.113 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 80153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tap.ko 2024-05-27T06:13:56.113 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/ 2024-05-27T06:13:56.113 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 137313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team.ko 2024-05-27T06:13:56.113 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-27T06:13:56.113 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-27T06:13:56.113 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-27T06:13:56.113 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_random.ko 2024-05-27T06:13:56.113 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-27T06:13:56.113 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 108081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/veth.ko 2024-05-27T06:13:56.113 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/ 2024-05-27T06:13:56.113 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 176481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-27T06:13:56.114 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/ 2024-05-27T06:13:56.114 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 384329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/vxlan.ko 2024-05-27T06:13:56.114 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/ 2024-05-27T06:13:56.114 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 175513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-27T06:13:56.114 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ 2024-05-27T06:13:56.114 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ntb.ko 2024-05-27T06:13:56.114 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/ 2024-05-27T06:13:56.114 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/ 2024-05-27T06:13:56.114 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 335489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme-core.ko 2024-05-27T06:13:56.114 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 127497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme.ko 2024-05-27T06:13:56.114 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/ 2024-05-27T06:13:56.114 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 168113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport.ko 2024-05-27T06:13:56.114 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_cs.ko 2024-05-27T06:13:56.115 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 103881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_pc.ko 2024-05-27T06:13:56.115 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_serial.ko 2024-05-27T06:13:56.115 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/ 2024-05-27T06:13:56.115 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/ 2024-05-27T06:13:56.115 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-27T06:13:56.115 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-05-27T06:13:56.115 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-05-27T06:13:56.115 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pci-stub.ko 2024-05-27T06:13:56.115 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 55321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/xen-pcifront.ko 2024-05-27T06:13:56.115 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/ 2024-05-27T06:13:56.115 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/i82092.ko 2024-05-27T06:13:56.115 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 179937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pcmcia.ko 2024-05-27T06:13:56.115 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 78145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pcmcia_core.ko 2024-05-27T06:13:56.116 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-05-27T06:13:56.116 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pd6729.ko 2024-05-27T06:13:56.116 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 133745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-27T06:13:56.116 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/ 2024-05-27T06:13:56.116 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/broadcom/ 2024-05-27T06:13:56.116 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-05-27T06:13:56.116 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/samsung/ 2024-05-27T06:13:56.116 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-05-27T06:13:56.116 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/ 2024-05-27T06:13:56.116 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/ 2024-05-27T06:13:56.116 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 78185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-27T06:13:56.116 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/ 2024-05-27T06:13:56.116 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/ 2024-05-27T06:13:56.116 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 61025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-05-27T06:13:56.117 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec.ko 2024-05-27T06:13:56.117 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-05-27T06:13:56.117 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-05-27T06:13:56.117 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-05-27T06:13:56.117 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-05-27T06:13:56.117 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-05-27T06:13:56.117 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/ 2024-05-27T06:13:56.117 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 87929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-27T06:13:56.117 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 44097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acerhdf.ko 2024-05-27T06:13:56.117 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 48249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-27T06:13:56.117 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 73857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-27T06:13:56.117 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-27T06:13:56.117 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 164761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-27T06:13:56.117 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 46177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-27T06:13:56.118 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 62065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-27T06:13:56.118 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-27T06:13:56.118 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 51873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-27T06:13:56.118 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-27T06:13:56.118 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 42753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/hdaps.ko 2024-05-27T06:13:56.118 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/ibm_rtl.ko 2024-05-27T06:13:56.118 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/ 2024-05-27T06:13:56.118 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-27T06:13:56.118 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-05-27T06:13:56.118 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 53993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel_ips.ko 2024-05-27T06:13:56.118 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-27T06:13:56.118 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-27T06:13:56.118 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-27T06:13:56.118 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 51889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-27T06:13:56.119 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-27T06:13:56.119 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-27T06:13:56.119 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-27T06:13:56.119 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-27T06:13:56.119 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-27T06:13:56.119 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 61409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi.ko 2024-05-27T06:13:56.119 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/ 2024-05-27T06:13:56.119 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ 2024-05-27T06:13:56.119 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/88pm860x_battery.ko 2024-05-27T06:13:56.119 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/88pm860x_charger.ko 2024-05-27T06:13:56.119 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 68825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/bq2415x_charger.ko 2024-05-27T06:13:56.119 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 73065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/bq24190_charger.ko 2024-05-27T06:13:56.119 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/bq24735-charger.ko 2024-05-27T06:13:56.119 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-05-27T06:13:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/da9030_battery.ko 2024-05-27T06:13:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/da9052-battery.ko 2024-05-27T06:13:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2760_battery.ko 2024-05-27T06:13:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2780_battery.ko 2024-05-27T06:13:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2781_battery.ko 2024-05-27T06:13:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2782_battery.ko 2024-05-27T06:13:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/gpio-charger.ko 2024-05-27T06:13:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/isp1704_charger.ko 2024-05-27T06:13:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/lp8727_charger.ko 2024-05-27T06:13:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max14577_charger.ko 2024-05-27T06:13:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max17042_battery.ko 2024-05-27T06:13:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max8903_charger.ko 2024-05-27T06:13:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max8925_power.ko 2024-05-27T06:13:56.120 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/pcf50633-charger.ko 2024-05-27T06:13:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 44833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/sbs-battery.ko 2024-05-27T06:13:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/test_power.ko 2024-05-27T06:13:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/tps65090-charger.ko 2024-05-27T06:13:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/wm831x_backup.ko 2024-05-27T06:13:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/wm831x_power.ko 2024-05-27T06:13:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/wm8350_power.ko 2024-05-27T06:13:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/ 2024-05-27T06:13:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 73289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-27T06:13:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-27T06:13:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/ 2024-05-27T06:13:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/ 2024-05-27T06:13:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-27T06:13:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-27T06:13:56.121 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps_parport.ko 2024-05-27T06:13:56.122 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 49801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/pps_core.ko 2024-05-27T06:13:56.122 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ 2024-05-27T06:13:56.122 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 91369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp.ko 2024-05-27T06:13:56.122 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp_kvm.ko 2024-05-27T06:13:56.122 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/ 2024-05-27T06:13:56.122 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/ 2024-05-27T06:13:56.122 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/ 2024-05-27T06:13:56.122 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 67473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-27T06:13:56.122 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 47129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/fmpm.ko 2024-05-27T06:13:56.122 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/ 2024-05-27T06:13:56.122 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-88pm80x.ko 2024-05-27T06:13:56.122 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-88pm860x.ko 2024-05-27T06:13:56.122 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-27T06:13:56.122 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-da9052.ko 2024-05-27T06:13:56.123 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-da9055.ko 2024-05-27T06:13:56.123 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-da9063.ko 2024-05-27T06:13:56.123 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-27T06:13:56.123 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 82217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-27T06:13:56.123 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-27T06:13:56.123 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-27T06:13:56.123 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-27T06:13:56.123 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-27T06:13:56.123 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-27T06:13:56.123 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-27T06:13:56.123 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-27T06:13:56.123 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-em3027.ko 2024-05-27T06:13:56.123 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-27T06:13:56.123 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-27T06:13:56.124 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 44121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-27T06:13:56.124 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-lp8788.ko 2024-05-27T06:13:56.124 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 46905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-27T06:13:56.124 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-27T06:13:56.124 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-27T06:13:56.124 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t86.ko 2024-05-27T06:13:56.124 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max6900.ko 2024-05-27T06:13:56.124 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8907.ko 2024-05-27T06:13:56.124 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8925.ko 2024-05-27T06:13:56.124 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8997.ko 2024-05-27T06:13:56.124 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8998.ko 2024-05-27T06:13:56.124 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-05-27T06:13:56.124 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-27T06:13:56.124 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-palmas.ko 2024-05-27T06:13:56.125 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 56769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-27T06:13:56.125 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf50633.ko 2024-05-27T06:13:56.125 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-27T06:13:56.125 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-27T06:13:56.125 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-27T06:13:56.125 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-27T06:13:56.125 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rc5t583.ko 2024-05-27T06:13:56.125 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-27T06:13:56.125 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-27T06:13:56.125 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-27T06:13:56.125 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-27T06:13:56.125 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-27T06:13:56.125 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-s35390a.ko 2024-05-27T06:13:56.126 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-27T06:13:56.126 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-tps6586x.ko 2024-05-27T06:13:56.126 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-tps65910.ko 2024-05-27T06:13:56.126 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-wm831x.ko 2024-05-27T06:13:56.126 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-wm8350.ko 2024-05-27T06:13:56.126 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-x1205.ko 2024-05-27T06:13:56.126 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ 2024-05-27T06:13:56.126 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 90369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-9xxx.ko 2024-05-27T06:13:56.126 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 69585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-sas.ko 2024-05-27T06:13:56.126 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 65937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-xxxx.ko 2024-05-27T06:13:56.126 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 164473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/BusLogic.ko 2024-05-27T06:13:56.126 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/a100u2w.ko 2024-05-27T06:13:56.126 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/ 2024-05-27T06:13:56.127 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 340689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-27T06:13:56.127 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 120393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/advansys.ko 2024-05-27T06:13:56.127 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/ 2024-05-27T06:13:56.127 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 468049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-27T06:13:56.127 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 380633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-27T06:13:56.127 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic94xx/ 2024-05-27T06:13:56.127 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 243649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-05-27T06:13:56.127 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/am53c974.ko 2024-05-27T06:13:56.127 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/ 2024-05-27T06:13:56.127 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 135601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-27T06:13:56.127 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 44281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/atp870u.ko 2024-05-27T06:13:56.127 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/ 2024-05-27T06:13:56.127 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 304969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-27T06:13:56.128 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/ 2024-05-27T06:13:56.128 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1527017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/bfa.ko 2024-05-27T06:13:56.128 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/ 2024-05-27T06:13:56.128 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 297769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-27T06:13:56.128 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/ 2024-05-27T06:13:56.128 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 144377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-27T06:13:56.128 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 47449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ch.ko 2024-05-27T06:13:56.128 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/ 2024-05-27T06:13:56.128 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 390657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-27T06:13:56.128 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/ 2024-05-27T06:13:56.128 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-05-27T06:13:56.128 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 88873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-27T06:13:56.128 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-05-27T06:13:56.128 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 117473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-27T06:13:56.129 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 173009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-27T06:13:56.129 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 91497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dc395x.ko 2024-05-27T06:13:56.129 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 45393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dmx3191d.ko 2024-05-27T06:13:56.129 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/ 2024-05-27T06:13:56.129 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 267521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-27T06:13:56.129 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 78961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esp_scsi.ko 2024-05-27T06:13:56.129 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/ 2024-05-27T06:13:56.129 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 95321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-27T06:13:56.129 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 194001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-27T06:13:56.129 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fdomain.ko 2024-05-27T06:13:56.129 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/ 2024-05-27T06:13:56.129 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 366457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/fnic.ko 2024-05-27T06:13:56.129 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 251497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hpsa.ko 2024-05-27T06:13:56.130 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 65689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hptiop.ko 2024-05-27T06:13:56.130 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 57089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hv_storvsc.ko 2024-05-27T06:13:56.130 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 44681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/imm.ko 2024-05-27T06:13:56.130 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 55145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/initio.ko 2024-05-27T06:13:56.130 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 327833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ipr.ko 2024-05-27T06:13:56.130 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 129777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ips.ko 2024-05-27T06:13:56.130 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/ 2024-05-27T06:13:56.130 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 397657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/isci.ko 2024-05-27T06:13:56.130 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-27T06:13:56.130 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 63113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-27T06:13:56.130 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/ 2024-05-27T06:13:56.130 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 386801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/libfc.ko 2024-05-27T06:13:56.130 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 178169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi.ko 2024-05-27T06:13:56.131 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 64801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-27T06:13:56.131 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/ 2024-05-27T06:13:56.131 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 273953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/libsas.ko 2024-05-27T06:13:56.131 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/ 2024-05-27T06:13:56.131 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 2735913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-27T06:13:56.131 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/ 2024-05-27T06:13:56.131 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 88521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-27T06:13:56.131 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-27T06:13:56.131 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 389089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-27T06:13:56.131 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 104761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid.ko 2024-05-27T06:13:56.131 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/ 2024-05-27T06:13:56.131 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 836897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-27T06:13:56.131 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/ 2024-05-27T06:13:56.132 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 158705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-27T06:13:56.132 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 96529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvumi.ko 2024-05-27T06:13:56.132 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/ 2024-05-27T06:13:56.132 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 101609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-05-27T06:13:56.132 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-05-27T06:13:56.132 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-05-27T06:13:56.132 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-05-27T06:13:56.132 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/ 2024-05-27T06:13:56.132 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 443713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-27T06:13:56.132 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 152025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pmcraid.ko 2024-05-27T06:13:56.132 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ppa.ko 2024-05-27T06:13:56.132 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 66969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla1280.ko 2024-05-27T06:13:56.132 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/ 2024-05-27T06:13:56.132 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 2324713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-27T06:13:56.183 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 103593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-27T06:13:56.183 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/ 2024-05-27T06:13:56.183 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 697281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-27T06:13:56.183 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qlogicfas408.ko 2024-05-27T06:13:56.183 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/raid_class.ko 2024-05-27T06:13:56.183 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 322857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_debug.ko 2024-05-27T06:13:56.183 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 219849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-27T06:13:56.183 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 357145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-27T06:13:56.183 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 121177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-27T06:13:56.183 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 93473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-27T06:13:56.184 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 55393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-27T06:13:56.184 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ses.ko 2024-05-27T06:13:56.184 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 138113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/st.ko 2024-05-27T06:13:56.184 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 57393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/stex.ko 2024-05-27T06:13:56.184 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/ 2024-05-27T06:13:56.184 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 205001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-27T06:13:56.184 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 55465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/virtio_scsi.ko 2024-05-27T06:13:56.184 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 59113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-27T06:13:56.184 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 48769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/wd719x.ko 2024-05-27T06:13:56.184 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 59409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/xen-scsifront.ko 2024-05-27T06:13:56.184 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ 2024-05-27T06:13:56.184 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 174865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ssb.ko 2024-05-27T06:13:56.184 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/ 2024-05-27T06:13:56.185 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/ 2024-05-27T06:13:56.185 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 920073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-27T06:13:56.185 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/ 2024-05-27T06:13:56.185 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 60313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-27T06:13:56.185 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 48121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_file.ko 2024-05-27T06:13:56.185 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 54225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_iblock.ko 2024-05-27T06:13:56.185 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1170873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_mod.ko 2024-05-27T06:13:56.185 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 51889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_pscsi.ko 2024-05-27T06:13:56.185 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 149777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_user.ko 2024-05-27T06:13:56.185 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/ 2024-05-27T06:13:56.185 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 90033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-27T06:13:56.185 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/ 2024-05-27T06:13:56.185 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/ 2024-05-27T06:13:56.186 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/ 2024-05-27T06:13:56.186 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-27T06:13:56.186 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-27T06:13:56.186 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-27T06:13:56.186 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-27T06:13:56.186 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-27T06:13:56.186 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-27T06:13:56.186 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-27T06:13:56.186 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-27T06:13:56.186 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-27T06:13:56.186 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-27T06:13:56.186 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-27T06:13:56.186 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-27T06:13:56.187 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 45993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-27T06:13:56.187 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-27T06:13:56.187 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-27T06:13:56.187 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-05-27T06:13:56.187 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-27T06:13:56.187 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-27T06:13:56.187 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-27T06:13:56.187 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ 2024-05-27T06:13:56.187 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ 2024-05-27T06:13:56.187 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 99289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-27T06:13:56.187 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 69721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/moxa.ko 2024-05-27T06:13:56.187 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 61641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/mxser.ko 2024-05-27T06:13:56.187 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 134329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_gsm.ko 2024-05-27T06:13:56.187 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_hdlc.ko 2024-05-27T06:13:56.188 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 78961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/nozomi.ko 2024-05-27T06:13:56.188 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/ 2024-05-27T06:13:56.188 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/ 2024-05-27T06:13:56.188 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-05-27T06:13:56.188 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 65113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-27T06:13:56.188 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-05-27T06:13:56.188 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/altera_uart.ko 2024-05-27T06:13:56.188 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/arc_uart.ko 2024-05-27T06:13:56.188 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 91593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-05-27T06:13:56.188 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/ 2024-05-27T06:13:56.188 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 120553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-27T06:13:56.188 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/rp2.ko 2024-05-27T06:13:56.188 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 65633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/sc16is7xx.ko 2024-05-27T06:13:56.189 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/ 2024-05-27T06:13:56.189 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ 2024-05-27T06:13:56.189 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 693057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-27T06:13:56.189 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ 2024-05-27T06:13:56.189 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-27T06:13:56.189 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-05-27T06:13:56.189 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/ 2024-05-27T06:13:56.189 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 55609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio.ko 2024-05-27T06:13:56.189 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_aec.ko 2024-05-27T06:13:56.189 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_cif.ko 2024-05-27T06:13:56.189 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_dmem_genirq.ko 2024-05-27T06:13:56.189 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_mf624.ko 2024-05-27T06:13:56.189 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_netx.ko 2024-05-27T06:13:56.189 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pci_generic.ko 2024-05-27T06:13:56.190 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-05-27T06:13:56.190 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_sercos3.ko 2024-05-27T06:13:56.190 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/ 2024-05-27T06:13:56.190 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/c67x00/ 2024-05-27T06:13:56.190 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 90297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/c67x00/c67x00.ko 2024-05-27T06:13:56.190 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ 2024-05-27T06:13:56.190 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 189169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-05-27T06:13:56.190 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-05-27T06:13:56.190 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-05-27T06:13:56.190 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-05-27T06:13:56.190 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-05-27T06:13:56.190 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/ 2024-05-27T06:13:56.190 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 101537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-acm.ko 2024-05-27T06:13:56.191 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 63017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-27T06:13:56.191 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 56713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usblp.ko 2024-05-27T06:13:56.191 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 107409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usbtmc.ko 2024-05-27T06:13:56.191 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/common/ 2024-05-27T06:13:56.191 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/common/ulpi.ko 2024-05-27T06:13:56.191 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc2/ 2024-05-27T06:13:56.191 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-05-27T06:13:56.191 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/ 2024-05-27T06:13:56.191 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-05-27T06:13:56.191 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-05-27T06:13:56.191 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 575217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/dwc3.ko 2024-05-27T06:13:56.191 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/ 2024-05-27T06:13:56.191 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/ 2024-05-27T06:13:56.192 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 72241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/u_ether.ko 2024-05-27T06:13:56.192 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 61945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/u_serial.ko 2024-05-27T06:13:56.192 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-05-27T06:13:56.192 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 49729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-05-27T06:13:56.192 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-05-27T06:13:56.192 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-05-27T06:13:56.192 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 131513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-05-27T06:13:56.192 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 62313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-05-27T06:13:56.192 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 146601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-05-27T06:13:56.192 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 70569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-05-27T06:13:56.192 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-05-27T06:13:56.192 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-05-27T06:13:56.192 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 70009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-05-27T06:13:56.192 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 101233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-05-27T06:13:56.193 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-05-27T06:13:56.193 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 71241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-05-27T06:13:56.193 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 84929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-05-27T06:13:56.193 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/ 2024-05-27T06:13:56.193 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-05-27T06:13:56.193 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-05-27T06:13:56.193 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-05-27T06:13:56.193 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-05-27T06:13:56.193 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-05-27T06:13:56.193 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-05-27T06:13:56.193 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-05-27T06:13:56.193 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-05-27T06:13:56.193 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-05-27T06:13:56.194 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-05-27T06:13:56.194 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-05-27T06:13:56.194 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-05-27T06:13:56.194 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 78065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-05-27T06:13:56.194 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-05-27T06:13:56.194 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 204009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/libcomposite.ko 2024-05-27T06:13:56.194 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/ 2024-05-27T06:13:56.194 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-05-27T06:13:56.194 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/bdc/ 2024-05-27T06:13:56.194 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 182537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-05-27T06:13:56.194 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 45537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-05-27T06:13:56.194 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 66505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-05-27T06:13:56.194 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 85209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-05-27T06:13:56.195 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 69305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-05-27T06:13:56.195 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 90305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/net2272.ko 2024-05-27T06:13:56.195 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 90353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/net2280.ko 2024-05-27T06:13:56.195 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 94833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-05-27T06:13:56.195 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 80513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-05-27T06:13:56.195 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 87457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-05-27T06:13:56.195 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 95433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-05-27T06:13:56.195 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 195953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-05-27T06:13:56.195 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/ 2024-05-27T06:13:56.195 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/bcma-hcd.ko 2024-05-27T06:13:56.195 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 108313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/isp116x-hcd.ko 2024-05-27T06:13:56.195 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 104433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-05-27T06:13:56.195 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 102265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-05-27T06:13:56.196 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 60097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-27T06:13:56.196 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811_cs.ko 2024-05-27T06:13:56.196 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/ssb-hcd.ko 2024-05-27T06:13:56.196 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-05-27T06:13:56.196 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/ 2024-05-27T06:13:56.196 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/mdc800.ko 2024-05-27T06:13:56.196 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/microtek.ko 2024-05-27T06:13:56.196 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ 2024-05-27T06:13:56.196 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 47345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/adutux.ko 2024-05-27T06:13:56.196 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/appledisplay.ko 2024-05-27T06:13:56.196 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-05-27T06:13:56.196 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/cytherm.ko 2024-05-27T06:13:56.196 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ehset.ko 2024-05-27T06:13:56.196 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi26.ko 2024-05-27T06:13:56.197 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi62.ko 2024-05-27T06:13:56.197 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ezusb.ko 2024-05-27T06:13:56.197 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/idmouse.ko 2024-05-27T06:13:56.197 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 42721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/iowarrior.ko 2024-05-27T06:13:56.197 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-27T06:13:56.197 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 42233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ldusb.ko 2024-05-27T06:13:56.197 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 42225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/legousbtower.ko 2024-05-27T06:13:56.197 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/lvstest.ko 2024-05-27T06:13:56.197 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/ 2024-05-27T06:13:56.197 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 85305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-27T06:13:56.197 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-27T06:13:56.197 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usb3503.ko 2024-05-27T06:13:56.197 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usblcd.ko 2024-05-27T06:13:56.197 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-27T06:13:56.198 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 84257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbtest.ko 2024-05-27T06:13:56.198 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 52057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/uss720.ko 2024-05-27T06:13:56.198 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/yurex.ko 2024-05-27T06:13:56.198 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/mon/ 2024-05-27T06:13:56.198 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 91505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/mon/usbmon.ko 2024-05-27T06:13:56.198 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/musb/ 2024-05-27T06:13:56.198 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 396169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/musb/musb_hdrc.ko 2024-05-27T06:13:56.198 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/ 2024-05-27T06:13:56.198 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-generic.ko 2024-05-27T06:13:56.198 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-05-27T06:13:56.198 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-isp1301.ko 2024-05-27T06:13:56.198 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-tahvo.ko 2024-05-27T06:13:56.198 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ 2024-05-27T06:13:56.199 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/aircable.ko 2024-05-27T06:13:56.199 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ark3116.ko 2024-05-27T06:13:56.199 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-27T06:13:56.199 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 44321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ch341.ko 2024-05-27T06:13:56.199 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 79673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cp210x.ko 2024-05-27T06:13:56.199 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cyberjack.ko 2024-05-27T06:13:56.199 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 66865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-27T06:13:56.199 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 58321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-27T06:13:56.199 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/empeg.ko 2024-05-27T06:13:56.199 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 53001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/f81232.ko 2024-05-27T06:13:56.199 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 188601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-27T06:13:56.199 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 61481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-27T06:13:56.199 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 152297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-27T06:13:56.200 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 142825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_ti.ko 2024-05-27T06:13:56.200 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 69209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipaq.ko 2024-05-27T06:13:56.200 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipw.ko 2024-05-27T06:13:56.200 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ir-usb.ko 2024-05-27T06:13:56.200 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 66353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-27T06:13:56.200 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 122321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan.ko 2024-05-27T06:13:56.200 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-27T06:13:56.200 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-27T06:13:56.200 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-27T06:13:56.200 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mct_u232.ko 2024-05-27T06:13:56.200 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/metro-usb.ko 2024-05-27T06:13:56.200 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 79673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7720.ko 2024-05-27T06:13:56.200 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 89961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7840.ko 2024-05-27T06:13:56.200 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 65065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mxuport.ko 2024-05-27T06:13:56.201 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/navman.ko 2024-05-27T06:13:56.201 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/omninet.ko 2024-05-27T06:13:56.201 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/opticon.ko 2024-05-27T06:13:56.201 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 197201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/option.ko 2024-05-27T06:13:56.201 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 45329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/oti6858.ko 2024-05-27T06:13:56.201 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 61753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/pl2303.ko 2024-05-27T06:13:56.201 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcaux.ko 2024-05-27T06:13:56.201 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 39977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcserial.ko 2024-05-27T06:13:56.201 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/quatech2.ko 2024-05-27T06:13:56.201 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/safe_serial.ko 2024-05-27T06:13:56.201 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 59337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/sierra.ko 2024-05-27T06:13:56.201 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-27T06:13:56.201 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ssu100.ko 2024-05-27T06:13:56.202 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/symbolserial.ko 2024-05-27T06:13:56.202 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 70489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-27T06:13:56.202 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-27T06:13:56.202 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_debug.ko 2024-05-27T06:13:56.202 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 39313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-27T06:13:56.202 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 151121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usbserial.ko 2024-05-27T06:13:56.202 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/visor.ko 2024-05-27T06:13:56.202 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/whiteheat.ko 2024-05-27T06:13:56.202 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/wishbone-serial.ko 2024-05-27T06:13:56.202 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-27T06:13:56.202 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ 2024-05-27T06:13:56.202 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 64041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/uas.ko 2024-05-27T06:13:56.202 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-27T06:13:56.203 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-27T06:13:56.203 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-27T06:13:56.203 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-27T06:13:56.203 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-27T06:13:56.203 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-27T06:13:56.203 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-27T06:13:56.203 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-karma.ko 2024-05-27T06:13:56.203 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-27T06:13:56.203 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-27T06:13:56.203 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-27T06:13:56.203 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-27T06:13:56.203 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-27T06:13:56.203 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 201145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/usb-storage.ko 2024-05-27T06:13:56.204 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/ 2024-05-27T06:13:56.204 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 76025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-27T06:13:56.204 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 85233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-27T06:13:56.204 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 122233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-27T06:13:56.204 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/ 2024-05-27T06:13:56.204 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/ 2024-05-27T06:13:56.204 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 206897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-27T06:13:56.204 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-27T06:13:56.204 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 134241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio.ko 2024-05-27T06:13:56.204 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 93665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-27T06:13:56.204 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/ 2024-05-27T06:13:56.204 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 138641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost.ko 2024-05-27T06:13:56.204 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-27T06:13:56.204 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 71273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_net.ko 2024-05-27T06:13:56.205 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 107897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_scsi.ko 2024-05-27T06:13:56.205 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/ 2024-05-27T06:13:56.205 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/ 2024-05-27T06:13:56.205 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-05-27T06:13:56.205 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/aat2870_bl.ko 2024-05-27T06:13:56.205 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/adp5520_bl.ko 2024-05-27T06:13:56.205 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/adp8860_bl.ko 2024-05-27T06:13:56.205 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 51737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/adp8870_bl.ko 2024-05-27T06:13:56.205 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/apple_bl.ko 2024-05-27T06:13:56.205 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/as3711_bl.ko 2024-05-27T06:13:56.205 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/bd6107.ko 2024-05-27T06:13:56.205 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/da903x_bl.ko 2024-05-27T06:13:56.205 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/da9052_bl.ko 2024-05-27T06:13:56.205 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/gpio_backlight.ko 2024-05-27T06:13:56.206 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/kb3886_bl.ko 2024-05-27T06:13:56.206 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lcd.ko 2024-05-27T06:13:56.206 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lm3533_bl.ko 2024-05-27T06:13:56.206 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lm3639_bl.ko 2024-05-27T06:13:56.206 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lv5207lp.ko 2024-05-27T06:13:56.206 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/max8925_bl.ko 2024-05-27T06:13:56.206 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/pandora_bl.ko 2024-05-27T06:13:56.206 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-05-27T06:13:56.206 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-27T06:13:56.206 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/wm831x_bl.ko 2024-05-27T06:13:56.206 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/ 2024-05-27T06:13:56.206 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ 2024-05-27T06:13:56.206 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2482.ko 2024-05-27T06:13:56.207 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 46793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2490.ko 2024-05-27T06:13:56.207 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/matrox_w1.ko 2024-05-27T06:13:56.207 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/w1-gpio.ko 2024-05-27T06:13:56.207 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/ 2024-05-27T06:13:56.207 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-27T06:13:56.207 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-27T06:13:56.207 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-27T06:13:56.207 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-27T06:13:56.207 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-27T06:13:56.207 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-27T06:13:56.207 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-27T06:13:56.207 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-27T06:13:56.207 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-27T06:13:56.207 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-27T06:13:56.208 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 70361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-27T06:13:56.208 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 129409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/wire.ko 2024-05-27T06:13:56.208 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ 2024-05-27T06:13:56.208 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/acquirewdt.ko 2024-05-27T06:13:56.208 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/advantechwdt.ko 2024-05-27T06:13:56.208 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-27T06:13:56.208 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-27T06:13:56.208 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/cpu5wdt.ko 2024-05-27T06:13:56.208 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/da9052_wdt.ko 2024-05-27T06:13:56.208 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/da9055_wdt.ko 2024-05-27T06:13:56.208 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/da9063_wdt.ko 2024-05-27T06:13:56.208 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/dw_wdt.ko 2024-05-27T06:13:56.208 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/eurotechwdt.ko 2024-05-27T06:13:56.209 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-27T06:13:56.209 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/hpwdt.ko 2024-05-27T06:13:56.209 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/i6300esb.ko 2024-05-27T06:13:56.209 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-27T06:13:56.209 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-27T06:13:56.209 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ib700wdt.ko 2024-05-27T06:13:56.209 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ibmasr.ko 2024-05-27T06:13:56.209 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-27T06:13:56.209 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-27T06:13:56.209 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it87_wdt.ko 2024-05-27T06:13:56.209 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/kempld_wdt.ko 2024-05-27T06:13:56.209 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/machzwd.ko 2024-05-27T06:13:56.209 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/mena21_wdt.ko 2024-05-27T06:13:56.209 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-05-27T06:13:56.210 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/nv_tco.ko 2024-05-27T06:13:56.210 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-05-27T06:13:56.210 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pc87413_wdt.ko 2024-05-27T06:13:56.210 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 46945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-27T06:13:56.210 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-27T06:13:56.210 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/retu_wdt.ko 2024-05-27T06:13:56.210 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-05-27T06:13:56.210 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-05-27T06:13:56.210 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-27T06:13:56.210 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sc1200wdt.ko 2024-05-27T06:13:56.210 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-27T06:13:56.210 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-05-27T06:13:56.210 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/softdog.ko 2024-05-27T06:13:56.211 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-27T06:13:56.211 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/twl4030_wdt.ko 2024-05-27T06:13:56.211 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/via_wdt.ko 2024-05-27T06:13:56.211 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-27T06:13:56.211 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-27T06:13:56.211 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-27T06:13:56.211 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wafer5823wdt.ko 2024-05-27T06:13:56.211 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wdt_pci.ko 2024-05-27T06:13:56.211 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wm831x_wdt.ko 2024-05-27T06:13:56.211 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wm8350_wdt.ko 2024-05-27T06:13:56.211 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/xen_wdt.ko 2024-05-27T06:13:56.211 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/ 2024-05-27T06:13:56.211 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-evtchn.ko 2024-05-27T06:13:56.211 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntalloc.ko 2024-05-27T06:13:56.212 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 55705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntdev.ko 2024-05-27T06:13:56.212 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/ 2024-05-27T06:13:56.212 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 213865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-27T06:13:56.212 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 47673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-privcmd.ko 2024-05-27T06:13:56.212 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 85705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-scsiback.ko 2024-05-27T06:13:56.212 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/ 2024-05-27T06:13:56.212 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-27T06:13:56.212 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ 2024-05-27T06:13:56.212 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/ 2024-05-27T06:13:56.212 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 194449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/9p.ko 2024-05-27T06:13:56.212 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/adfs/ 2024-05-27T06:13:56.212 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 78049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/adfs/adfs.ko 2024-05-27T06:13:56.212 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/ 2024-05-27T06:13:56.213 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 197801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/affs.ko 2024-05-27T06:13:56.213 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/afs/ 2024-05-27T06:13:56.213 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1260937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/afs/kafs.ko 2024-05-27T06:13:56.213 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/autofs/ 2024-05-27T06:13:56.213 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 127337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/autofs/autofs4.ko 2024-05-27T06:13:56.213 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/ 2024-05-27T06:13:56.213 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 80481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/befs.ko 2024-05-27T06:13:56.213 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/bfs/ 2024-05-27T06:13:56.213 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 50457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/bfs/bfs.ko 2024-05-27T06:13:56.213 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 45553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/binfmt_misc.ko 2024-05-27T06:13:56.213 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/ 2024-05-27T06:13:56.213 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 4491713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/btrfs.ko 2024-05-27T06:13:56.214 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/ 2024-05-27T06:13:56.214 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 376801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/cachefiles.ko 2024-05-27T06:13:56.214 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ 2024-05-27T06:13:56.214 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1586617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ceph.ko 2024-05-27T06:13:56.214 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/ 2024-05-27T06:13:56.214 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 130017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/coda.ko 2024-05-27T06:13:56.214 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/configfs/ 2024-05-27T06:13:56.214 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 139049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/configfs/configfs.ko 2024-05-27T06:13:56.214 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/ 2024-05-27T06:13:56.214 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/cramfs.ko 2024-05-27T06:13:56.214 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/ 2024-05-27T06:13:56.214 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 813137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/dlm.ko 2024-05-27T06:13:56.215 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/efs/ 2024-05-27T06:13:56.215 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 46377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/efs/efs.ko 2024-05-27T06:13:56.215 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/ 2024-05-27T06:13:56.215 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1906713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/f2fs.ko 2024-05-27T06:13:56.215 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/ 2024-05-27T06:13:56.215 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/msdos.ko 2024-05-27T06:13:56.215 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/freevxfs/ 2024-05-27T06:13:56.215 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 52265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/freevxfs/freevxfs.ko 2024-05-27T06:13:56.215 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/ 2024-05-27T06:13:56.215 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/cuse.ko 2024-05-27T06:13:56.215 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/ 2024-05-27T06:13:56.215 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1486393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/gfs2.ko 2024-05-27T06:13:56.215 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/ 2024-05-27T06:13:56.215 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 183217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/hfs.ko 2024-05-27T06:13:56.216 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/ 2024-05-27T06:13:56.216 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 281993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/hfsplus.ko 2024-05-27T06:13:56.216 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hpfs/ 2024-05-27T06:13:56.216 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 248945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hpfs/hpfs.ko 2024-05-27T06:13:56.216 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/ 2024-05-27T06:13:56.216 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 92985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/isofs.ko 2024-05-27T06:13:56.216 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/ 2024-05-27T06:13:56.216 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 532953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/jfs.ko 2024-05-27T06:13:56.216 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/ 2024-05-27T06:13:56.216 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 361281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/lockd.ko 2024-05-27T06:13:56.216 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/ 2024-05-27T06:13:56.216 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 112569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/minix.ko 2024-05-27T06:13:56.216 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/ 2024-05-27T06:13:56.217 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 591625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/netfs.ko 2024-05-27T06:13:56.217 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/ 2024-05-27T06:13:56.217 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/ 2024-05-27T06:13:56.217 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 102537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-27T06:13:56.217 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/ 2024-05-27T06:13:56.217 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 74337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-27T06:13:56.217 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/ 2024-05-27T06:13:56.217 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 147673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-27T06:13:56.217 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1320377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfs.ko 2024-05-27T06:13:56.217 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 82089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv2.ko 2024-05-27T06:13:56.217 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 151617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv3.ko 2024-05-27T06:13:56.217 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 2518385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv4.ko 2024-05-27T06:13:56.217 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/ 2024-05-27T06:13:56.217 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/grace.ko 2024-05-27T06:13:56.218 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/nfs_acl.ko 2024-05-27T06:13:56.218 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/ 2024-05-27T06:13:56.218 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 2021969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/nfsd.ko 2024-05-27T06:13:56.218 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/ 2024-05-27T06:13:56.218 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 733969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/nilfs2.ko 2024-05-27T06:13:56.218 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/ 2024-05-27T06:13:56.218 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-celtic.ko 2024-05-27T06:13:56.218 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-centeuro.ko 2024-05-27T06:13:56.218 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-croatian.ko 2024-05-27T06:13:56.218 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-cyrillic.ko 2024-05-27T06:13:56.218 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-gaelic.ko 2024-05-27T06:13:56.218 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-greek.ko 2024-05-27T06:13:56.218 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-iceland.ko 2024-05-27T06:13:56.219 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-inuit.ko 2024-05-27T06:13:56.219 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-roman.ko 2024-05-27T06:13:56.219 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-romanian.ko 2024-05-27T06:13:56.219 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-turkish.ko 2024-05-27T06:13:56.219 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ascii.ko 2024-05-27T06:13:56.219 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1250.ko 2024-05-27T06:13:56.219 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1251.ko 2024-05-27T06:13:56.219 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1255.ko 2024-05-27T06:13:56.219 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp737.ko 2024-05-27T06:13:56.219 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp775.ko 2024-05-27T06:13:56.219 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp850.ko 2024-05-27T06:13:56.219 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp852.ko 2024-05-27T06:13:56.219 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp855.ko 2024-05-27T06:13:56.220 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp857.ko 2024-05-27T06:13:56.220 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp860.ko 2024-05-27T06:13:56.220 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp861.ko 2024-05-27T06:13:56.220 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp862.ko 2024-05-27T06:13:56.220 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp863.ko 2024-05-27T06:13:56.220 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp864.ko 2024-05-27T06:13:56.220 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp865.ko 2024-05-27T06:13:56.220 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp866.ko 2024-05-27T06:13:56.220 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp869.ko 2024-05-27T06:13:56.220 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp874.ko 2024-05-27T06:13:56.220 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 95617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp932.ko 2024-05-27T06:13:56.220 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 144201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp936.ko 2024-05-27T06:13:56.220 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 167129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp949.ko 2024-05-27T06:13:56.220 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 119505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp950.ko 2024-05-27T06:13:56.221 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_euc-jp.ko 2024-05-27T06:13:56.221 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-1.ko 2024-05-27T06:13:56.221 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-13.ko 2024-05-27T06:13:56.221 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-14.ko 2024-05-27T06:13:56.221 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-15.ko 2024-05-27T06:13:56.221 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-2.ko 2024-05-27T06:13:56.221 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-3.ko 2024-05-27T06:13:56.221 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-4.ko 2024-05-27T06:13:56.221 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-5.ko 2024-05-27T06:13:56.221 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-6.ko 2024-05-27T06:13:56.221 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-7.ko 2024-05-27T06:13:56.221 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-9.ko 2024-05-27T06:13:56.221 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-r.ko 2024-05-27T06:13:56.222 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-ru.ko 2024-05-27T06:13:56.222 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-u.ko 2024-05-27T06:13:56.222 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-27T06:13:56.222 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_utf8.ko 2024-05-27T06:13:56.222 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ntfs3/ 2024-05-27T06:13:56.222 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 634457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ntfs3/ntfs3.ko 2024-05-27T06:13:56.222 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ 2024-05-27T06:13:56.222 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ 2024-05-27T06:13:56.222 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 302033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-27T06:13:56.222 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ 2024-05-27T06:13:56.222 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 548057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-27T06:13:56.222 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ 2024-05-27T06:13:56.222 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 66345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-27T06:13:56.223 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 3245449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2.ko 2024-05-27T06:13:56.223 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-27T06:13:56.223 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 39305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-27T06:13:56.223 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-27T06:13:56.223 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/omfs/ 2024-05-27T06:13:56.223 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 67465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/omfs/omfs.ko 2024-05-27T06:13:56.223 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/ 2024-05-27T06:13:56.223 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 462817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/overlay.ko 2024-05-27T06:13:56.223 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ 2024-05-27T06:13:56.223 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 67961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ramoops.ko 2024-05-27T06:13:56.223 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx4/ 2024-05-27T06:13:56.223 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx4/qnx4.ko 2024-05-27T06:13:56.223 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx6/ 2024-05-27T06:13:56.223 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 56073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx6/qnx6.ko 2024-05-27T06:13:56.224 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/ 2024-05-27T06:13:56.224 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/quota_tree.ko 2024-05-27T06:13:56.224 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/quota_v1.ko 2024-05-27T06:13:56.224 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/quota_v2.ko 2024-05-27T06:13:56.224 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/ 2024-05-27T06:13:56.224 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 684713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/reiserfs.ko 2024-05-27T06:13:56.224 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/ 2024-05-27T06:13:56.224 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/romfs.ko 2024-05-27T06:13:56.224 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/ 2024-05-27T06:13:56.224 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/ 2024-05-27T06:13:56.224 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 3350841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/cifs.ko 2024-05-27T06:13:56.224 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/ 2024-05-27T06:13:56.224 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_arc4.ko 2024-05-27T06:13:56.225 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_md4.ko 2024-05-27T06:13:56.225 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/ 2024-05-27T06:13:56.225 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 164145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/squashfs.ko 2024-05-27T06:13:56.225 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/ 2024-05-27T06:13:56.225 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 115865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/sysv.ko 2024-05-27T06:13:56.225 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/ 2024-05-27T06:13:56.225 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 309937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/udf.ko 2024-05-27T06:13:56.225 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ 2024-05-27T06:13:56.225 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 198185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ufs.ko 2024-05-27T06:13:56.225 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/ 2024-05-27T06:13:56.225 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 5192193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/xfs.ko 2024-05-27T06:13:56.225 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/ 2024-05-27T06:13:56.225 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/locking/ 2024-05-27T06:13:56.226 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 97617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/locking/locktorture.ko 2024-05-27T06:13:56.226 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/time/ 2024-05-27T06:13:56.226 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/time/test_udelay.ko 2024-05-27T06:13:56.226 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 72657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/torture.ko 2024-05-27T06:13:56.226 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ 2024-05-27T06:13:56.226 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc-itu-t.ko 2024-05-27T06:13:56.226 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc7.ko 2024-05-27T06:13:56.226 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc8.ko 2024-05-27T06:13:56.226 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/ 2024-05-27T06:13:56.226 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libarc4.ko 2024-05-27T06:13:56.226 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libdes.ko 2024-05-27T06:13:56.226 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/interval_tree_test.ko 2024-05-27T06:13:56.226 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/libcrc32c.ko 2024-05-27T06:13:56.227 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lru_cache.ko 2024-05-27T06:13:56.227 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/ 2024-05-27T06:13:56.227 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4_compress.ko 2024-05-27T06:13:56.227 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4hc_compress.ko 2024-05-27T06:13:56.227 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/ 2024-05-27T06:13:56.227 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/cordic.ko 2024-05-27T06:13:56.227 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/memory-notifier-error-inject.ko 2024-05-27T06:13:56.227 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/notifier-error-inject.ko 2024-05-27T06:13:56.227 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/percpu_test.ko 2024-05-27T06:13:56.227 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/pm-notifier-error-inject.ko 2024-05-27T06:13:56.227 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/ 2024-05-27T06:13:56.227 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 151945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/raid6_pq.ko 2024-05-27T06:13:56.227 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/rbtree_test.ko 2024-05-27T06:13:56.228 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/ 2024-05-27T06:13:56.228 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-27T06:13:56.228 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test-kstrtox.ko 2024-05-27T06:13:56.228 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 4912433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_bpf.ko 2024-05-27T06:13:56.228 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 61161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_firmware.ko 2024-05-27T06:13:56.228 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_module.ko 2024-05-27T06:13:56.228 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_user_copy.ko 2024-05-27T06:13:56.228 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_bm.ko 2024-05-27T06:13:56.228 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_fsm.ko 2024-05-27T06:13:56.228 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_kmp.ko 2024-05-27T06:13:56.228 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/xz/ 2024-05-27T06:13:56.228 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/xz/xz_dec_test.ko 2024-05-27T06:13:56.228 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/mm/ 2024-05-27T06:13:56.228 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/mm/hwpoison-inject.ko 2024-05-27T06:13:56.229 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ 2024-05-27T06:13:56.229 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/ 2024-05-27T06:13:56.229 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 66945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/6lowpan.ko 2024-05-27T06:13:56.229 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_dest.ko 2024-05-27T06:13:56.229 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_fragment.ko 2024-05-27T06:13:56.229 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_hop.ko 2024-05-27T06:13:56.229 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-27T06:13:56.229 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_mobility.ko 2024-05-27T06:13:56.229 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_routing.ko 2024-05-27T06:13:56.229 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_udp.ko 2024-05-27T06:13:56.229 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/ 2024-05-27T06:13:56.229 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/garp.ko 2024-05-27T06:13:56.229 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 42289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/mrp.ko 2024-05-27T06:13:56.230 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/p8022.ko 2024-05-27T06:13:56.230 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/psnap.ko 2024-05-27T06:13:56.230 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/stp.ko 2024-05-27T06:13:56.230 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/ 2024-05-27T06:13:56.230 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 106697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/8021q.ko 2024-05-27T06:13:56.230 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/ 2024-05-27T06:13:56.230 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 236769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet.ko 2024-05-27T06:13:56.230 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 44441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_fd.ko 2024-05-27T06:13:56.230 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_rdma.ko 2024-05-27T06:13:56.230 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 39553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_virtio.ko 2024-05-27T06:13:56.230 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/ 2024-05-27T06:13:56.230 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 879593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/batman-adv.ko 2024-05-27T06:13:56.230 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/ 2024-05-27T06:13:56.231 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 85225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/br_netfilter.ko 2024-05-27T06:13:56.231 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1031177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/bridge.ko 2024-05-27T06:13:56.231 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ 2024-05-27T06:13:56.231 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-27T06:13:56.231 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-27T06:13:56.231 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-27T06:13:56.231 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-27T06:13:56.231 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-27T06:13:56.231 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-27T06:13:56.231 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-27T06:13:56.231 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-27T06:13:56.231 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-27T06:13:56.231 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-27T06:13:56.231 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-27T06:13:56.232 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-27T06:13:56.232 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-27T06:13:56.232 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-27T06:13:56.232 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-27T06:13:56.232 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-27T06:13:56.232 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-27T06:13:56.232 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-27T06:13:56.232 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-27T06:13:56.232 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-27T06:13:56.232 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 70521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtables.ko 2024-05-27T06:13:56.232 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-27T06:13:56.232 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-27T06:13:56.232 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/ 2024-05-27T06:13:56.233 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1243369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/libceph.ko 2024-05-27T06:13:56.233 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/core/ 2024-05-27T06:13:56.233 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 153793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/core/pktgen.ko 2024-05-27T06:13:56.233 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/ 2024-05-27T06:13:56.233 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 244825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp.ko 2024-05-27T06:13:56.233 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_diag.ko 2024-05-27T06:13:56.233 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 71025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv4.ko 2024-05-27T06:13:56.233 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 74985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv6.ko 2024-05-27T06:13:56.233 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/ 2024-05-27T06:13:56.233 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 507649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/dsa_core.ko 2024-05-27T06:13:56.233 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_brcm.ko 2024-05-27T06:13:56.233 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_dsa.ko 2024-05-27T06:13:56.233 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_none.ko 2024-05-27T06:13:56.233 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_trailer.ko 2024-05-27T06:13:56.234 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/hsr/ 2024-05-27T06:13:56.234 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 128577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/hsr/hsr.ko 2024-05-27T06:13:56.234 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ 2024-05-27T06:13:56.234 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ 2024-05-27T06:13:56.234 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 55481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-27T06:13:56.234 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 357369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154.ko 2024-05-27T06:13:56.234 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 59385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-27T06:13:56.260 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ 2024-05-27T06:13:56.261 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ah4.ko 2024-05-27T06:13:56.261 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 46409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/esp4.ko 2024-05-27T06:13:56.261 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 60217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/fou.ko 2024-05-27T06:13:56.261 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/gre.ko 2024-05-27T06:13:56.261 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 65657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/inet_diag.ko 2024-05-27T06:13:56.261 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 75481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_gre.ko 2024-05-27T06:13:56.261 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 77713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_tunnel.ko 2024-05-27T06:13:56.261 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_vti.ko 2024-05-27T06:13:56.261 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipcomp.ko 2024-05-27T06:13:56.261 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipip.ko 2024-05-27T06:13:56.261 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ 2024-05-27T06:13:56.261 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 45513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-27T06:13:56.261 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-27T06:13:56.262 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-27T06:13:56.262 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 50161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ip_tables.ko 2024-05-27T06:13:56.262 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-27T06:13:56.262 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-05-27T06:13:56.262 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-27T06:13:56.262 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-27T06:13:56.262 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-27T06:13:56.262 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-05-27T06:13:56.262 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-27T06:13:56.262 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-27T06:13:56.262 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-27T06:13:56.262 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-27T06:13:56.263 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-27T06:13:56.263 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-27T06:13:56.263 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-27T06:13:56.263 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-27T06:13:56.263 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-27T06:13:56.263 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-05-27T06:13:56.263 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-27T06:13:56.263 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-27T06:13:56.263 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-27T06:13:56.263 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-27T06:13:56.263 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-27T06:13:56.263 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_bic.ko 2024-05-27T06:13:56.263 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_dctcp.ko 2024-05-27T06:13:56.263 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_diag.ko 2024-05-27T06:13:56.264 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_highspeed.ko 2024-05-27T06:13:56.264 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_htcp.ko 2024-05-27T06:13:56.264 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_hybla.ko 2024-05-27T06:13:56.264 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_illinois.ko 2024-05-27T06:13:56.264 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_lp.ko 2024-05-27T06:13:56.264 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_scalable.ko 2024-05-27T06:13:56.264 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_vegas.ko 2024-05-27T06:13:56.264 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_veno.ko 2024-05-27T06:13:56.264 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_westwood.ko 2024-05-27T06:13:56.264 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_yeah.ko 2024-05-27T06:13:56.264 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tunnel4.ko 2024-05-27T06:13:56.264 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_diag.ko 2024-05-27T06:13:56.264 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 54425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_tunnel.ko 2024-05-27T06:13:56.265 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-27T06:13:56.265 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ 2024-05-27T06:13:56.265 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ah6.ko 2024-05-27T06:13:56.265 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 47425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/esp6.ko 2024-05-27T06:13:56.265 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/fou6.ko 2024-05-27T06:13:56.265 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 103169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_gre.ko 2024-05-27T06:13:56.265 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 118873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_tunnel.ko 2024-05-27T06:13:56.265 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-27T06:13:56.265 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 71081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_vti.ko 2024-05-27T06:13:56.265 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ipcomp6.ko 2024-05-27T06:13:56.265 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/mip6.ko 2024-05-27T06:13:56.265 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ 2024-05-27T06:13:56.265 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 50729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-27T06:13:56.265 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-05-27T06:13:56.266 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-27T06:13:56.266 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-27T06:13:56.266 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-27T06:13:56.266 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-27T06:13:56.266 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-27T06:13:56.266 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-27T06:13:56.266 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-27T06:13:56.266 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-27T06:13:56.266 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-27T06:13:56.266 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-27T06:13:56.266 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-27T06:13:56.266 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-27T06:13:56.267 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-27T06:13:56.267 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-27T06:13:56.267 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-27T06:13:56.267 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 46297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-27T06:13:56.267 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-27T06:13:56.267 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-27T06:13:56.267 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-27T06:13:56.267 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-27T06:13:56.267 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-27T06:13:56.267 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-27T06:13:56.267 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-27T06:13:56.267 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 94081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/sit.ko 2024-05-27T06:13:56.267 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/tunnel6.ko 2024-05-27T06:13:56.267 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-27T06:13:56.268 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/key/ 2024-05-27T06:13:56.268 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 106361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/key/af_key.ko 2024-05-27T06:13:56.268 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/ 2024-05-27T06:13:56.268 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 153209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_core.ko 2024-05-27T06:13:56.268 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-27T06:13:56.268 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_eth.ko 2024-05-27T06:13:56.268 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip.ko 2024-05-27T06:13:56.268 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 44985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip6.ko 2024-05-27T06:13:56.268 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 42041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_netlink.ko 2024-05-27T06:13:56.268 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 66233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ppp.ko 2024-05-27T06:13:56.268 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/lapb/ 2024-05-27T06:13:56.268 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 63321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/lapb/lapb.ko 2024-05-27T06:13:56.268 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/ 2024-05-27T06:13:56.269 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc.ko 2024-05-27T06:13:56.269 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 332817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc2.ko 2024-05-27T06:13:56.269 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/ 2024-05-27T06:13:56.269 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 388817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/mac802154.ko 2024-05-27T06:13:56.269 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/ 2024-05-27T06:13:56.269 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/mpls_gso.ko 2024-05-27T06:13:56.269 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ 2024-05-27T06:13:56.269 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ 2024-05-27T06:13:56.269 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 147729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set.ko 2024-05-27T06:13:56.269 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-27T06:13:56.269 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-27T06:13:56.269 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-27T06:13:56.269 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 124033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-27T06:13:56.269 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 124337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-27T06:13:56.270 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 126673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-27T06:13:56.270 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 126465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-27T06:13:56.270 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 137825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-27T06:13:56.270 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 72345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-27T06:13:56.270 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 133673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-27T06:13:56.270 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 139065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-27T06:13:56.270 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 138257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-27T06:13:56.270 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 136169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-27T06:13:56.270 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 139889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-27T06:13:56.270 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-27T06:13:56.270 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ 2024-05-27T06:13:56.270 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 534033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-27T06:13:56.270 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-27T06:13:56.271 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-27T06:13:56.271 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-27T06:13:56.271 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-27T06:13:56.271 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-27T06:13:56.271 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-27T06:13:56.271 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-27T06:13:56.271 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-27T06:13:56.271 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-27T06:13:56.271 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-27T06:13:56.271 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-27T06:13:56.271 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-27T06:13:56.271 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-27T06:13:56.271 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 55209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conncount.ko 2024-05-27T06:13:56.271 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 496713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack.ko 2024-05-27T06:13:56.272 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-27T06:13:56.272 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-27T06:13:56.272 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-27T06:13:56.272 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 134361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-27T06:13:56.272 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-27T06:13:56.272 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-27T06:13:56.272 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 140793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-27T06:13:56.272 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-27T06:13:56.272 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-27T06:13:56.272 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 79865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-27T06:13:56.272 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-27T06:13:56.272 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-27T06:13:56.272 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-27T06:13:56.273 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 117385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table.ko 2024-05-27T06:13:56.273 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-27T06:13:56.273 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 46097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_log_syslog.ko 2024-05-27T06:13:56.273 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 118337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat.ko 2024-05-27T06:13:56.273 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-27T06:13:56.273 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-27T06:13:56.273 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_irc.ko 2024-05-27T06:13:56.273 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_sip.ko 2024-05-27T06:13:56.273 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-27T06:13:56.273 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 53385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-27T06:13:56.273 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 811705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_tables.ko 2024-05-27T06:13:56.273 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 53041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink.ko 2024-05-27T06:13:56.273 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-27T06:13:56.273 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-05-27T06:13:56.274 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 49289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_log.ko 2024-05-27T06:13:56.274 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-27T06:13:56.274 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 65137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-27T06:13:56.274 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_chain_nat.ko 2024-05-27T06:13:56.274 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_compat.ko 2024-05-27T06:13:56.274 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 50649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_ct.ko 2024-05-27T06:13:56.274 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-27T06:13:56.274 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fib.ko 2024-05-27T06:13:56.274 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-27T06:13:56.274 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_hash.ko 2024-05-27T06:13:56.274 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_limit.ko 2024-05-27T06:13:56.274 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_log.ko 2024-05-27T06:13:56.274 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_masq.ko 2024-05-27T06:13:56.275 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_nat.ko 2024-05-27T06:13:56.275 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_numgen.ko 2024-05-27T06:13:56.275 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_osf.ko 2024-05-27T06:13:56.275 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_queue.ko 2024-05-27T06:13:56.275 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_redir.ko 2024-05-27T06:13:56.275 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject.ko 2024-05-27T06:13:56.275 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject_inet.ko 2024-05-27T06:13:56.275 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_socket.ko 2024-05-27T06:13:56.275 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_synproxy.ko 2024-05-27T06:13:56.275 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_tproxy.ko 2024-05-27T06:13:56.275 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 108385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/x_tables.ko 2024-05-27T06:13:56.275 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_AUDIT.ko 2024-05-27T06:13:56.275 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-27T06:13:56.276 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-27T06:13:56.276 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-27T06:13:56.276 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CT.ko 2024-05-27T06:13:56.276 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_DSCP.ko 2024-05-27T06:13:56.276 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HL.ko 2024-05-27T06:13:56.276 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HMARK.ko 2024-05-27T06:13:56.276 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 45209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-27T06:13:56.276 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LED.ko 2024-05-27T06:13:56.276 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LOG.ko 2024-05-27T06:13:56.276 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-27T06:13:56.276 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NETMAP.ko 2024-05-27T06:13:56.276 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFLOG.ko 2024-05-27T06:13:56.276 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-27T06:13:56.277 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_RATEEST.ko 2024-05-27T06:13:56.277 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-27T06:13:56.277 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_SECMARK.ko 2024-05-27T06:13:56.277 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-27T06:13:56.277 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-27T06:13:56.277 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TEE.ko 2024-05-27T06:13:56.277 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TPROXY.ko 2024-05-27T06:13:56.277 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TRACE.ko 2024-05-27T06:13:56.277 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_addrtype.ko 2024-05-27T06:13:56.277 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_bpf.ko 2024-05-27T06:13:56.277 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cgroup.ko 2024-05-27T06:13:56.277 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cluster.ko 2024-05-27T06:13:56.277 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_comment.ko 2024-05-27T06:13:56.277 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connbytes.ko 2024-05-27T06:13:56.278 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlabel.ko 2024-05-27T06:13:56.278 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlimit.ko 2024-05-27T06:13:56.278 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connmark.ko 2024-05-27T06:13:56.278 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_conntrack.ko 2024-05-27T06:13:56.278 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cpu.ko 2024-05-27T06:13:56.278 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dccp.ko 2024-05-27T06:13:56.278 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_devgroup.ko 2024-05-27T06:13:56.278 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dscp.ko 2024-05-27T06:13:56.278 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ecn.ko 2024-05-27T06:13:56.278 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_esp.ko 2024-05-27T06:13:56.278 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 52809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hashlimit.ko 2024-05-27T06:13:56.278 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_helper.ko 2024-05-27T06:13:56.278 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hl.ko 2024-05-27T06:13:56.279 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipcomp.ko 2024-05-27T06:13:56.279 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_iprange.ko 2024-05-27T06:13:56.279 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipvs.ko 2024-05-27T06:13:56.279 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_l2tp.ko 2024-05-27T06:13:56.279 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_length.ko 2024-05-27T06:13:56.279 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_limit.ko 2024-05-27T06:13:56.279 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mac.ko 2024-05-27T06:13:56.279 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mark.ko 2024-05-27T06:13:56.279 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_multiport.ko 2024-05-27T06:13:56.279 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nat.ko 2024-05-27T06:13:56.279 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nfacct.ko 2024-05-27T06:13:56.279 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_osf.ko 2024-05-27T06:13:56.279 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_owner.ko 2024-05-27T06:13:56.280 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_physdev.ko 2024-05-27T06:13:56.280 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_pkttype.ko 2024-05-27T06:13:56.280 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_policy.ko 2024-05-27T06:13:56.280 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_quota.ko 2024-05-27T06:13:56.280 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_rateest.ko 2024-05-27T06:13:56.280 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_realm.ko 2024-05-27T06:13:56.280 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_recent.ko 2024-05-27T06:13:56.280 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_sctp.ko 2024-05-27T06:13:56.280 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_set.ko 2024-05-27T06:13:56.280 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_socket.ko 2024-05-27T06:13:56.280 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_state.ko 2024-05-27T06:13:56.280 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_statistic.ko 2024-05-27T06:13:56.280 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_string.ko 2024-05-27T06:13:56.281 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpmss.ko 2024-05-27T06:13:56.281 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpudp.ko 2024-05-27T06:13:56.281 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_time.ko 2024-05-27T06:13:56.281 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_u32.ko 2024-05-27T06:13:56.281 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/ 2024-05-27T06:13:56.281 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/netlink_diag.ko 2024-05-27T06:13:56.281 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/ 2024-05-27T06:13:56.281 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/nsh.ko 2024-05-27T06:13:56.281 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/ 2024-05-27T06:13:56.281 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 488457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/openvswitch.ko 2024-05-27T06:13:56.281 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-geneve.ko 2024-05-27T06:13:56.281 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-gre.ko 2024-05-27T06:13:56.281 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-vxlan.ko 2024-05-27T06:13:56.281 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/ 2024-05-27T06:13:56.282 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/af_packet_diag.ko 2024-05-27T06:13:56.282 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/phonet/ 2024-05-27T06:13:56.282 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 141993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/phonet/phonet.ko 2024-05-27T06:13:56.282 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 68801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/phonet/pn_pep.ko 2024-05-27T06:13:56.282 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/ 2024-05-27T06:13:56.282 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 318537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds.ko 2024-05-27T06:13:56.282 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 202249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_rdma.ko 2024-05-27T06:13:56.282 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 85073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_tcp.ko 2024-05-27T06:13:56.282 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rxrpc/ 2024-05-27T06:13:56.282 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1028129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rxrpc/rxrpc.ko 2024-05-27T06:13:56.282 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/ 2024-05-27T06:13:56.282 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_csum.ko 2024-05-27T06:13:56.283 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_gact.ko 2024-05-27T06:13:56.283 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 45401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_mirred.ko 2024-05-27T06:13:56.283 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_nat.ko 2024-05-27T06:13:56.283 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 53457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_pedit.ko 2024-05-27T06:13:56.283 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_police.ko 2024-05-27T06:13:56.283 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_simple.ko 2024-05-27T06:13:56.283 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_skbedit.ko 2024-05-27T06:13:56.283 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 45665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_vlan.ko 2024-05-27T06:13:56.283 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_basic.ko 2024-05-27T06:13:56.283 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_bpf.ko 2024-05-27T06:13:56.283 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_cgroup.ko 2024-05-27T06:13:56.283 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_flow.ko 2024-05-27T06:13:56.283 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 39593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_fw.ko 2024-05-27T06:13:56.283 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 49313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_route.ko 2024-05-27T06:13:56.284 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 79137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_u32.ko 2024-05-27T06:13:56.284 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_cmp.ko 2024-05-27T06:13:56.284 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_ipset.ko 2024-05-27T06:13:56.284 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 48777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_meta.ko 2024-05-27T06:13:56.284 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_nbyte.ko 2024-05-27T06:13:56.284 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_text.ko 2024-05-27T06:13:56.284 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_u32.ko 2024-05-27T06:13:56.284 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_choke.ko 2024-05-27T06:13:56.284 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_codel.ko 2024-05-27T06:13:56.284 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_drr.ko 2024-05-27T06:13:56.284 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq.ko 2024-05-27T06:13:56.284 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 39169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq_codel.ko 2024-05-27T06:13:56.284 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 42881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_gred.ko 2024-05-27T06:13:56.285 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 62809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hfsc.ko 2024-05-27T06:13:56.285 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hhf.ko 2024-05-27T06:13:56.285 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 81825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_htb.ko 2024-05-27T06:13:56.285 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_ingress.ko 2024-05-27T06:13:56.285 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio.ko 2024-05-27T06:13:56.285 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio_lib.ko 2024-05-27T06:13:56.285 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_multiq.ko 2024-05-27T06:13:56.285 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 44785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_netem.ko 2024-05-27T06:13:56.285 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_pie.ko 2024-05-27T06:13:56.285 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_plug.ko 2024-05-27T06:13:56.285 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_prio.ko 2024-05-27T06:13:56.285 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 60241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_qfq.ko 2024-05-27T06:13:56.285 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_red.ko 2024-05-27T06:13:56.286 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfb.ko 2024-05-27T06:13:56.286 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfq.ko 2024-05-27T06:13:56.286 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_tbf.ko 2024-05-27T06:13:56.286 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_teql.ko 2024-05-27T06:13:56.286 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/ 2024-05-27T06:13:56.286 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1187153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp.ko 2024-05-27T06:13:56.286 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp_diag.ko 2024-05-27T06:13:56.286 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/ 2024-05-27T06:13:56.286 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/ 2024-05-27T06:13:56.286 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 432225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-27T06:13:56.286 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 70081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-27T06:13:56.286 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1940753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/sunrpc.ko 2024-05-27T06:13:56.286 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/ 2024-05-27T06:13:56.287 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 889729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-27T06:13:56.287 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/ 2024-05-27T06:13:56.287 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1122273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc.ko 2024-05-27T06:13:56.287 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc_diag.ko 2024-05-27T06:13:56.287 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/ 2024-05-27T06:13:56.287 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/unix_diag.ko 2024-05-27T06:13:56.287 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/ 2024-05-27T06:13:56.287 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 105601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-27T06:13:56.287 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 90249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-27T06:13:56.287 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 123745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock.ko 2024-05-27T06:13:56.287 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-27T06:13:56.287 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-27T06:13:56.287 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/x25/ 2024-05-27T06:13:56.288 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 165777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/x25/x25.ko 2024-05-27T06:13:56.288 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/ 2024-05-27T06:13:56.288 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_algo.ko 2024-05-27T06:13:56.288 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-27T06:13:56.288 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 131857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_user.ko 2024-05-27T06:13:56.288 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 646387 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.alias 2024-05-27T06:13:56.288 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 630543 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.alias.bin 2024-05-27T06:13:56.288 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7706 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin 2024-05-27T06:13:56.288 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin.alias.bin 2024-05-27T06:13:56.288 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9941 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin.bin 2024-05-27T06:13:56.288 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 70990 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin.modinfo 2024-05-27T06:13:56.288 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 146985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.dep 2024-05-27T06:13:56.288 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 232892 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.dep.bin 2024-05-27T06:13:56.289 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 210 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.devname 2024-05-27T06:13:56.289 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 72627 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.order 2024-05-27T06:13:56.289 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 879 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.softdep 2024-05-27T06:13:56.289 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 258450 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.symbols 2024-05-27T06:13:56.289 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 313019 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.symbols.bin 2024-05-27T06:13:56.289 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/ 2024-05-27T06:13:56.289 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/share/ 2024-05-27T06:13:56.289 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/share/doc/ 2024-05-27T06:13:56.289 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/share/doc/linux-image-6.9.0-gb9459a26b088/ 2024-05-27T06:13:56.289 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 171 2024-05-23 11:07 ./usr/share/doc/linux-image-6.9.0-gb9459a26b088/changelog.Debian.gz 2024-05-27T06:13:56.289 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 691 2024-05-23 11:07 ./usr/share/doc/linux-image-6.9.0-gb9459a26b088/copyright 2024-05-27T06:13:56.294 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-gb9459a26b088 2024-05-27T06:13:56.294 INFO:teuthology.task.kernel:searching for kernel 6.9.0-gb9459a26b088 2024-05-27T06:13:56.294 DEBUG:teuthology.orchestra.run.smithi087:> egrep '(submenu|menuentry.*6.9.0-gb9459a26b088).*{' /boot/grub/grub.cfg 2024-05-27T06:13:56.308 INFO:teuthology.orchestra.run.smithi087.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-27T06:13:56.308 INFO:teuthology.orchestra.run.smithi087.stdout: menuentry 'Ubuntu, with Linux 6.9.0-gb9459a26b088' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-gb9459a26b088-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-27T06:13:56.308 INFO:teuthology.orchestra.run.smithi087.stdout: menuentry 'Ubuntu, with Linux 6.9.0-gb9459a26b088 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-gb9459a26b088-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-27T06:13:56.308 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-05-27T06:13:56.308 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-gb9459a26b088 2024-05-27T06:13:56.309 DEBUG:teuthology.orchestra.run.smithi087:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-05-27T06:13:56.352 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi087.front.sepia.ceph.com to complete... 2024-05-27T06:13:56.752 INFO:teuthology.orchestra.run.smithi087.stderr:Sourcing file `/etc/default/grub' 2024-05-27T06:13:56.753 INFO:teuthology.orchestra.run.smithi087.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-27T06:13:56.778 INFO:teuthology.orchestra.run.smithi087.stderr:Generating grub configuration file ... 2024-05-27T06:13:56.994 INFO:teuthology.orchestra.run.smithi087.stderr:Found linux image: /boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-27T06:13:57.000 INFO:teuthology.orchestra.run.smithi087.stderr:Found initrd image: /boot/initrd.img-6.9.0-gb9459a26b088 2024-05-27T06:13:57.232 INFO:teuthology.orchestra.run.smithi087.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-27T06:13:57.237 INFO:teuthology.orchestra.run.smithi087.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-27T06:13:57.276 INFO:teuthology.orchestra.run.smithi087.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-27T06:13:57.281 INFO:teuthology.orchestra.run.smithi087.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-27T06:13:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-27T06:13:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-27T06:13:57.387 INFO:teuthology.orchestra.run.smithi087.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-27T06:13:57.410 INFO:teuthology.orchestra.run.smithi087.stderr:done 2024-05-27T06:14:24.258 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-27T06:14:24.259 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-05-27T06:14:24.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T06:14:28.518 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-27T06:14:28.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-05-27T06:14:28.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T06:14:42.722 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-05-27T06:14:47.070 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-05-27T06:14:51.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-05-27T06:14:51.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T06:14:54.782 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-05-27T06:14:56.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-05-27T06:14:56.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T06:14:59.138 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-05-27T06:15:06.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-05-27T06:15:06.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T06:15:11.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-05-27T06:15:11.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T06:15:25.214 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-05-27T06:15:29.570 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-05-27T06:15:40.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-05-27T06:15:40.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T06:15:41.112 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-05-27T06:15:42.240 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-05-27T06:15:42.241 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.9.0-gb9459a26b088"... 2024-05-27T06:15:42.241 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-05-27T06:15:42.290 INFO:teuthology.orchestra.run.smithi149.stdout:6.9.0-gb9459a26b088 2024-05-27T06:15:42.291 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-gb9459a26b088 vs 6.9.0-gb9459a26b088 2024-05-27T06:15:42.291 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-27T06:15:42.291 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-27T06:15:43.291 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-27T06:15:43.292 DEBUG:teuthology.orchestra.run.smithi149:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-27T06:15:43.835 INFO:teuthology.orchestra.run.smithi149.stdout:ttyS1 2024-05-27T06:15:43.882 DEBUG:teuthology.parallel:result is None 2024-05-27T06:15:44.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-05-27T06:15:44.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T06:15:44.954 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-05-27T06:15:46.279 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-05-27T06:15:46.279 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.9.0-gb9459a26b088"... 2024-05-27T06:15:46.279 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-05-27T06:15:46.330 INFO:teuthology.orchestra.run.smithi087.stdout:6.9.0-gb9459a26b088 2024-05-27T06:15:46.331 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-gb9459a26b088 vs 6.9.0-gb9459a26b088 2024-05-27T06:15:46.331 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-27T06:15:46.331 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-27T06:15:47.332 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-27T06:15:47.332 DEBUG:teuthology.orchestra.run.smithi087:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-27T06:15:47.718 INFO:teuthology.orchestra.run.smithi087.stdout:ttyS1 2024-05-27T06:15:47.776 DEBUG:teuthology.parallel:result is None 2024-05-27T06:15:47.776 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-27T06:15:47.783 INFO:teuthology.task.internal:Creating test directory... 2024-05-27T06:15:47.783 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-27T06:15:47.786 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-27T06:15:47.795 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-27T06:15:47.807 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-27T06:15:47.820 INFO:teuthology.task.internal:Creating archive directory... 2024-05-27T06:15:47.820 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-27T06:15:47.838 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-27T06:15:47.866 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-27T06:15:47.876 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-27T06:15:47.877 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-27T06:15:47.906 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-27T06:15:47.937 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-27T06:15:47.942 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-27T06:15:47.950 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-27T06:15:47.955 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-27T06:15:47.957 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-27T06:15:47.971 INFO:teuthology.task.internal:Configuring sudo... 2024-05-27T06:15:47.971 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-27T06:15:48.001 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-27T06:15:48.022 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-27T06:15:48.035 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-27T06:15:48.035 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-27T06:15:48.062 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-27T06:15:48.070 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-27T06:15:48.114 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-27T06:15:48.163 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:15:48.163 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-27T06:15:48.234 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-27T06:15:48.243 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-27T06:15:48.295 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:15:48.295 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-27T06:15:48.377 DEBUG:teuthology.orchestra.run.smithi087:> sudo service rsyslog restart 2024-05-27T06:15:48.381 DEBUG:teuthology.orchestra.run.smithi149:> sudo service rsyslog restart 2024-05-27T06:15:48.517 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-27T06:15:48.525 INFO:teuthology.task.internal:Starting timer... 2024-05-27T06:15:48.525 INFO:teuthology.run_tasks:Running task pcp... 2024-05-27T06:15:48.542 INFO:teuthology.run_tasks:Running task selinux... 2024-05-27T06:15:48.556 DEBUG:teuthology.task.selinux:Excluding smithi087: OS 'ubuntu' does not support SELinux 2024-05-27T06:15:48.556 DEBUG:teuthology.task.selinux:Excluding smithi149: OS 'ubuntu' does not support SELinux 2024-05-27T06:15:48.556 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-27T06:15:48.556 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-05-27T06:15:48.556 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-27T06:15:48.557 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-27T06:15:48.571 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-27T06:15:48.584 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-27T06:15:48.585 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi087.front.sepia.ceph.com,smithi149.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-27T06:23:30.458 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi087.front.sepia.ceph.com'), Remote(name='ubuntu@smithi149.front.sepia.ceph.com')] 2024-05-27T06:23:30.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-05-27T06:23:30.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T06:23:30.544 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-05-27T06:23:30.665 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-05-27T06:23:30.665 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-05-27T06:23:30.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T06:23:30.746 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-05-27T06:23:30.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-05-27T06:23:30.837 INFO:teuthology.run_tasks:Running task clock... 2024-05-27T06:23:30.848 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-27T06:23:30.848 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-27T06:23:30.848 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-27T06:23:30.853 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-27T06:23:30.854 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-27T06:23:30.886 INFO:teuthology.orchestra.run.smithi087.stdout:27 May 06:23:30 ntpd[17558]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-27T06:23:30.886 INFO:teuthology.orchestra.run.smithi087.stdout:27 May 06:23:30 ntpd[17558]: Command line: ntpd -gq 2024-05-27T06:23:30.887 INFO:teuthology.orchestra.run.smithi087.stdout:27 May 06:23:30 ntpd[17558]: ---------------------------------------------------- 2024-05-27T06:23:30.887 INFO:teuthology.orchestra.run.smithi087.stdout:27 May 06:23:30 ntpd[17558]: ntp-4 is maintained by Network Time Foundation, 2024-05-27T06:23:30.887 INFO:teuthology.orchestra.run.smithi087.stdout:27 May 06:23:30 ntpd[17558]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-27T06:23:30.887 INFO:teuthology.orchestra.run.smithi087.stdout:27 May 06:23:30 ntpd[17558]: corporation. Support and training for ntp-4 are 2024-05-27T06:23:30.887 INFO:teuthology.orchestra.run.smithi087.stdout:27 May 06:23:30 ntpd[17558]: available at https://www.nwtime.org/support 2024-05-27T06:23:30.887 INFO:teuthology.orchestra.run.smithi087.stdout:27 May 06:23:30 ntpd[17558]: ---------------------------------------------------- 2024-05-27T06:23:30.888 INFO:teuthology.orchestra.run.smithi087.stdout:27 May 06:23:30 ntpd[17558]: proto: precision = 0.042 usec (-24) 2024-05-27T06:23:30.888 INFO:teuthology.orchestra.run.smithi087.stdout:27 May 06:23:30 ntpd[17558]: basedate set to 2022-02-04 2024-05-27T06:23:30.889 INFO:teuthology.orchestra.run.smithi087.stdout:27 May 06:23:30 ntpd[17558]: gps base set to 2022-02-06 (week 2196) 2024-05-27T06:23:30.889 INFO:teuthology.orchestra.run.smithi087.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-27T06:23:30.889 INFO:teuthology.orchestra.run.smithi087.stdout:27 May 06:23:30 ntpd[17558]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-27T06:23:30.890 INFO:teuthology.orchestra.run.smithi087.stdout:27 May 06:23:30 ntpd[17558]: restrict ::: KOD does nothing without LIMITED. 2024-05-27T06:23:30.890 INFO:teuthology.orchestra.run.smithi087.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-27T06:23:30.891 INFO:teuthology.orchestra.run.smithi087.stdout:27 May 06:23:30 ntpd[17558]: Listen and drop on 0 v6wildcard [::]:123 2024-05-27T06:23:30.891 INFO:teuthology.orchestra.run.smithi087.stdout:27 May 06:23:30 ntpd[17558]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-27T06:23:30.891 INFO:teuthology.orchestra.run.smithi087.stdout:27 May 06:23:30 ntpd[17558]: Listen normally on 2 lo 127.0.0.1:123 2024-05-27T06:23:30.891 INFO:teuthology.orchestra.run.smithi087.stdout:27 May 06:23:30 ntpd[17558]: Listen normally on 3 enp3s0f1 172.21.15.87:123 2024-05-27T06:23:30.891 INFO:teuthology.orchestra.run.smithi087.stdout:27 May 06:23:30 ntpd[17558]: Listen normally on 4 lo [::1]:123 2024-05-27T06:23:30.891 INFO:teuthology.orchestra.run.smithi087.stdout:27 May 06:23:30 ntpd[17558]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d5f5%5]:123 2024-05-27T06:23:30.891 INFO:teuthology.orchestra.run.smithi087.stdout:27 May 06:23:30 ntpd[17558]: Listening on routing socket on fd #22 for interface updates 2024-05-27T06:23:30.916 INFO:teuthology.orchestra.run.smithi149.stdout:27 May 06:23:30 ntpd[17584]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-27T06:23:30.916 INFO:teuthology.orchestra.run.smithi149.stdout:27 May 06:23:30 ntpd[17584]: Command line: ntpd -gq 2024-05-27T06:23:30.916 INFO:teuthology.orchestra.run.smithi149.stdout:27 May 06:23:30 ntpd[17584]: ---------------------------------------------------- 2024-05-27T06:23:30.916 INFO:teuthology.orchestra.run.smithi149.stdout:27 May 06:23:30 ntpd[17584]: ntp-4 is maintained by Network Time Foundation, 2024-05-27T06:23:30.916 INFO:teuthology.orchestra.run.smithi149.stdout:27 May 06:23:30 ntpd[17584]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-27T06:23:30.916 INFO:teuthology.orchestra.run.smithi149.stdout:27 May 06:23:30 ntpd[17584]: corporation. Support and training for ntp-4 are 2024-05-27T06:23:30.916 INFO:teuthology.orchestra.run.smithi149.stdout:27 May 06:23:30 ntpd[17584]: available at https://www.nwtime.org/support 2024-05-27T06:23:30.916 INFO:teuthology.orchestra.run.smithi149.stdout:27 May 06:23:30 ntpd[17584]: ---------------------------------------------------- 2024-05-27T06:23:30.917 INFO:teuthology.orchestra.run.smithi149.stdout:27 May 06:23:30 ntpd[17584]: proto: precision = 0.042 usec (-24) 2024-05-27T06:23:30.918 INFO:teuthology.orchestra.run.smithi149.stdout:27 May 06:23:30 ntpd[17584]: basedate set to 2022-02-04 2024-05-27T06:23:30.918 INFO:teuthology.orchestra.run.smithi149.stdout:27 May 06:23:30 ntpd[17584]: gps base set to 2022-02-06 (week 2196) 2024-05-27T06:23:30.918 INFO:teuthology.orchestra.run.smithi149.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-27T06:23:30.919 INFO:teuthology.orchestra.run.smithi149.stdout:27 May 06:23:30 ntpd[17584]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-27T06:23:30.919 INFO:teuthology.orchestra.run.smithi149.stdout:27 May 06:23:30 ntpd[17584]: restrict ::: KOD does nothing without LIMITED. 2024-05-27T06:23:30.919 INFO:teuthology.orchestra.run.smithi149.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-27T06:23:30.920 INFO:teuthology.orchestra.run.smithi149.stdout:27 May 06:23:30 ntpd[17584]: Listen and drop on 0 v6wildcard [::]:123 2024-05-27T06:23:30.920 INFO:teuthology.orchestra.run.smithi149.stdout:27 May 06:23:30 ntpd[17584]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-27T06:23:30.920 INFO:teuthology.orchestra.run.smithi149.stdout:27 May 06:23:30 ntpd[17584]: Listen normally on 2 lo 127.0.0.1:123 2024-05-27T06:23:30.920 INFO:teuthology.orchestra.run.smithi149.stdout:27 May 06:23:30 ntpd[17584]: Listen normally on 3 enp3s0f1 172.21.15.149:123 2024-05-27T06:23:30.920 INFO:teuthology.orchestra.run.smithi149.stdout:27 May 06:23:30 ntpd[17584]: Listen normally on 4 lo [::1]:123 2024-05-27T06:23:30.921 INFO:teuthology.orchestra.run.smithi149.stdout:27 May 06:23:30 ntpd[17584]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7d57%5]:123 2024-05-27T06:23:30.921 INFO:teuthology.orchestra.run.smithi149.stdout:27 May 06:23:30 ntpd[17584]: Listening on routing socket on fd #22 for interface updates 2024-05-27T06:23:31.887 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:31 ntpd[17558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:31.887 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:31 ntpd[17558]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:31.887 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:31 ntpd[17558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:31.887 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:31 ntpd[17558]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:31.887 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:31 ntpd[17558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:31.888 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:31 ntpd[17558]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:31.888 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:31 ntpd[17558]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-27T06:23:31.888 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:31 ntpd[17558]: can't open /var/log/ntpstats/peerstats.20240527: Permission denied 2024-05-27T06:23:31.916 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:31 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:31.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:31 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:31.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:31 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:31.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:31 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:31.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:31 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:31.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:31 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:31.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:31 ntpd[17584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-27T06:23:31.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:31 ntpd[17584]: can't open /var/log/ntpstats/peerstats.20240527: Permission denied 2024-05-27T06:23:32.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:32 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:32.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:32 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:32.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:32 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:32.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:32 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:32.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:32 ntpd[17584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-27T06:23:32.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:32 ntpd[17584]: can't open /var/log/ntpstats/peerstats.20240527: Permission denied 2024-05-27T06:23:33.887 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:33 ntpd[17558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:33.887 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:33 ntpd[17558]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:33.887 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:33 ntpd[17558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:33.887 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:33 ntpd[17558]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:33.888 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:33 ntpd[17558]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-27T06:23:33.888 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:33 ntpd[17558]: can't open /var/log/ntpstats/peerstats.20240527: Permission denied 2024-05-27T06:23:33.916 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:33 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:33.916 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:33 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:33.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:33 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:33.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:33 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:33.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:33 ntpd[17584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-27T06:23:33.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:33 ntpd[17584]: can't open /var/log/ntpstats/peerstats.20240527: Permission denied 2024-05-27T06:23:34.888 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:34 ntpd[17558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:34.888 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:34 ntpd[17558]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:34.888 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:34 ntpd[17558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:34.888 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:34 ntpd[17558]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:34.888 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:34 ntpd[17558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:34.888 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:34 ntpd[17558]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:34.888 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:34 ntpd[17558]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-27T06:23:34.888 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:34 ntpd[17558]: can't open /var/log/ntpstats/peerstats.20240527: Permission denied 2024-05-27T06:23:34.888 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:34 ntpd[17558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:34.888 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:34 ntpd[17558]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:34.889 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:34 ntpd[17558]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-27T06:23:34.889 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:34 ntpd[17558]: can't open /var/log/ntpstats/peerstats.20240527: Permission denied 2024-05-27T06:23:34.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:34 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:34.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:34 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:34.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:34 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:34.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:34 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:34.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:34 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:34.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:34 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:34.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:34 ntpd[17584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-27T06:23:34.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:34 ntpd[17584]: can't open /var/log/ntpstats/peerstats.20240527: Permission denied 2024-05-27T06:23:34.918 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:34 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:34.918 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:34 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:34.918 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:34 ntpd[17584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-27T06:23:34.918 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:34 ntpd[17584]: can't open /var/log/ntpstats/peerstats.20240527: Permission denied 2024-05-27T06:23:35.887 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:35 ntpd[17558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:35.887 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:35 ntpd[17558]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:35.887 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:35 ntpd[17558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:35.887 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:35 ntpd[17558]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:35.887 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:35 ntpd[17558]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-27T06:23:35.887 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:35 ntpd[17558]: can't open /var/log/ntpstats/peerstats.20240527: Permission denied 2024-05-27T06:23:35.916 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:35 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:35.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:35 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:35.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:35 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:35.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:35 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:35.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:35 ntpd[17584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-27T06:23:35.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:35 ntpd[17584]: can't open /var/log/ntpstats/peerstats.20240527: Permission denied 2024-05-27T06:23:36.887 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:36 ntpd[17558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:36.887 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:36 ntpd[17558]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:36.888 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:36 ntpd[17558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:36.888 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:36 ntpd[17558]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:36.888 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:36 ntpd[17558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:36.888 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:36 ntpd[17558]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:36.888 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:36 ntpd[17558]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-27T06:23:36.888 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:36 ntpd[17558]: can't open /var/log/ntpstats/peerstats.20240527: Permission denied 2024-05-27T06:23:36.888 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:36 ntpd[17558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:36.888 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:36 ntpd[17558]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:36.888 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:36 ntpd[17558]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-27T06:23:36.888 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:36 ntpd[17558]: can't open /var/log/ntpstats/peerstats.20240527: Permission denied 2024-05-27T06:23:36.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:36 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:36.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:36 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:36.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:36 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:36.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:36 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:36.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:36 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:36.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:36 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:36.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:36 ntpd[17584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-27T06:23:36.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:36 ntpd[17584]: can't open /var/log/ntpstats/peerstats.20240527: Permission denied 2024-05-27T06:23:36.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:36 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:36.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:36 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:36.918 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:36 ntpd[17584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-27T06:23:36.918 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:36 ntpd[17584]: can't open /var/log/ntpstats/peerstats.20240527: Permission denied 2024-05-27T06:23:37.887 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:37 ntpd[17558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:37.887 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:37 ntpd[17558]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:37.887 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:37 ntpd[17558]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:37.887 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:37 ntpd[17558]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:37.887 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:37 ntpd[17558]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-27T06:23:37.887 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:37 ntpd[17558]: can't open /var/log/ntpstats/peerstats.20240527: Permission denied 2024-05-27T06:23:37.888 INFO:teuthology.orchestra.run.smithi087.stdout:27 May 06:23:37 ntpd[17558]: ntpd: time slew +0.000136 s 2024-05-27T06:23:37.888 INFO:teuthology.orchestra.run.smithi087.stdout:ntpd: time slew +0.000136s 2024-05-27T06:23:37.888 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:37 ntpd[17558]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-27T06:23:37.888 INFO:teuthology.orchestra.run.smithi087.stderr:27 May 06:23:37 ntpd[17558]: can't open /var/log/ntpstats/loopstats.20240527: Permission denied 2024-05-27T06:23:37.916 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:37 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:37.916 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:37 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:37.916 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:37 ntpd[17584]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-27T06:23:37.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:37 ntpd[17584]: can't open /var/log/ntpstats/rawstats.20240527: Permission denied 2024-05-27T06:23:37.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:37 ntpd[17584]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-27T06:23:37.917 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:37 ntpd[17584]: can't open /var/log/ntpstats/peerstats.20240527: Permission denied 2024-05-27T06:23:37.917 INFO:teuthology.orchestra.run.smithi149.stdout:27 May 06:23:37 ntpd[17584]: ntpd: time slew -0.001860 s 2024-05-27T06:23:37.917 INFO:teuthology.orchestra.run.smithi149.stdout:ntpd: time slew -0.001860s 2024-05-27T06:23:37.918 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:37 ntpd[17584]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-27T06:23:37.918 INFO:teuthology.orchestra.run.smithi149.stderr:27 May 06:23:37 ntpd[17584]: can't open /var/log/ntpstats/loopstats.20240527: Permission denied 2024-05-27T06:23:38.001 INFO:teuthology.orchestra.run.smithi087.stdout: remote refid st t when poll reach delay offset jitter 2024-05-27T06:23:38.001 INFO:teuthology.orchestra.run.smithi087.stdout:============================================================================== 2024-05-27T06:23:38.001 INFO:teuthology.orchestra.run.smithi087.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-27T06:23:38.001 INFO:teuthology.orchestra.run.smithi087.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-27T06:23:38.002 INFO:teuthology.orchestra.run.smithi087.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-27T06:23:38.002 INFO:teuthology.orchestra.run.smithi087.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-27T06:23:38.021 INFO:teuthology.orchestra.run.smithi149.stdout: remote refid st t when poll reach delay offset jitter 2024-05-27T06:23:38.021 INFO:teuthology.orchestra.run.smithi149.stdout:============================================================================== 2024-05-27T06:23:38.021 INFO:teuthology.orchestra.run.smithi149.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-27T06:23:38.021 INFO:teuthology.orchestra.run.smithi149.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-27T06:23:38.021 INFO:teuthology.orchestra.run.smithi149.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-27T06:23:38.021 INFO:teuthology.orchestra.run.smithi149.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-27T06:23:38.022 INFO:teuthology.run_tasks:Running task install... 2024-05-27T06:23:38.033 DEBUG:teuthology.task.install:project ceph 2024-05-27T06:23:38.033 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '38f9d900c83c63799fbdbe61acc9a11b0d3554a6'}} 2024-05-27T06:23:38.034 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '38f9d900c83c63799fbdbe61acc9a11b0d3554a6'} 2024-05-27T06:23:38.034 INFO:teuthology.task.install:Using flavor: default 2024-05-27T06:23:38.039 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-27T06:23:38.039 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-27T06:23:38.040 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-key list | grep Ceph 2024-05-27T06:23:38.040 DEBUG:teuthology.orchestra.run.smithi149:> sudo apt-key list | grep Ceph 2024-05-27T06:23:38.144 INFO:teuthology.orchestra.run.smithi087.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-27T06:23:38.167 INFO:teuthology.orchestra.run.smithi149.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-27T06:23:38.194 INFO:teuthology.orchestra.run.smithi087.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-27T06:23:38.195 INFO:teuthology.orchestra.run.smithi087.stdout:uid [ unknown] Ceph.com (release key) 2024-05-27T06:23:38.196 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-27T06:23:38.196 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-27T06:23:38.196 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=38f9d900c83c63799fbdbe61acc9a11b0d3554a6 2024-05-27T06:23:38.218 INFO:teuthology.orchestra.run.smithi149.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-27T06:23:38.218 INFO:teuthology.orchestra.run.smithi149.stdout:uid [ unknown] Ceph.com (release key) 2024-05-27T06:23:38.219 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-27T06:23:38.219 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-27T06:23:38.219 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=38f9d900c83c63799fbdbe61acc9a11b0d3554a6 2024-05-27T06:23:38.362 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default/ 2024-05-27T06:23:38.363 INFO:teuthology.task.install.deb:Package version is 19.0.0-3872-g38f9d900-1jammy 2024-05-27T06:23:38.476 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:23:38.477 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-27T06:23:38.496 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get update 2024-05-27T06:23:38.538 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default/ 2024-05-27T06:23:38.538 INFO:teuthology.task.install.deb:Package version is 19.0.0-3872-g38f9d900-1jammy 2024-05-27T06:23:38.652 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:23:38.652 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-27T06:23:38.672 DEBUG:teuthology.orchestra.run.smithi149:> sudo apt-get update 2024-05-27T06:23:38.686 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-27T06:23:38.697 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-27T06:23:38.701 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-27T06:23:38.721 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-27T06:23:38.796 INFO:teuthology.orchestra.run.smithi087.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy InRelease 2024-05-27T06:23:38.842 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-27T06:23:38.887 INFO:teuthology.orchestra.run.smithi087.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-27T06:23:38.937 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-05-27T06:23:38.986 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-27T06:23:38.987 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-27T06:23:39.011 INFO:teuthology.orchestra.run.smithi149.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy InRelease 2024-05-27T06:23:39.038 INFO:teuthology.orchestra.run.smithi087.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,397 B] 2024-05-27T06:23:39.056 INFO:teuthology.orchestra.run.smithi149.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-27T06:23:39.057 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-27T06:23:39.105 INFO:teuthology.orchestra.run.smithi149.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-27T06:23:39.139 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-27T06:23:39.154 INFO:teuthology.orchestra.run.smithi149.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,397 B] 2024-05-27T06:23:39.214 INFO:teuthology.orchestra.run.smithi149.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-05-27T06:23:39.273 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 29.1 kB in 1s (52.5 kB/s) 2024-05-27T06:23:39.577 INFO:teuthology.orchestra.run.smithi149.stdout:Fetched 29.1 kB in 1s (42.9 kB/s) 2024-05-27T06:23:40.262 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-05-27T06:23:40.276 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3872-g38f9d900-1jammy cephadm=19.0.0-3872-g38f9d900-1jammy ceph-mds=19.0.0-3872-g38f9d900-1jammy ceph-mgr=19.0.0-3872-g38f9d900-1jammy ceph-common=19.0.0-3872-g38f9d900-1jammy ceph-fuse=19.0.0-3872-g38f9d900-1jammy ceph-test=19.0.0-3872-g38f9d900-1jammy ceph-volume=19.0.0-3872-g38f9d900-1jammy radosgw=19.0.0-3872-g38f9d900-1jammy python3-rados=19.0.0-3872-g38f9d900-1jammy python3-rgw=19.0.0-3872-g38f9d900-1jammy python3-cephfs=19.0.0-3872-g38f9d900-1jammy python3-rbd=19.0.0-3872-g38f9d900-1jammy libcephfs2=19.0.0-3872-g38f9d900-1jammy libcephfs-dev=19.0.0-3872-g38f9d900-1jammy librados2=19.0.0-3872-g38f9d900-1jammy librbd1=19.0.0-3872-g38f9d900-1jammy rbd-fuse=19.0.0-3872-g38f9d900-1jammy python3-cephfs=19.0.0-3872-g38f9d900-1jammy cephfs-shell=19.0.0-3872-g38f9d900-1jammy cephfs-top=19.0.0-3872-g38f9d900-1jammy cephfs-mirror=19.0.0-3872-g38f9d900-1jammy 2024-05-27T06:23:40.350 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-05-27T06:23:40.526 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2024-05-27T06:23:40.526 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2024-05-27T06:23:40.576 INFO:teuthology.orchestra.run.smithi149.stdout:Reading package lists... 2024-05-27T06:23:40.591 DEBUG:teuthology.orchestra.run.smithi149:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3872-g38f9d900-1jammy cephadm=19.0.0-3872-g38f9d900-1jammy ceph-mds=19.0.0-3872-g38f9d900-1jammy ceph-mgr=19.0.0-3872-g38f9d900-1jammy ceph-common=19.0.0-3872-g38f9d900-1jammy ceph-fuse=19.0.0-3872-g38f9d900-1jammy ceph-test=19.0.0-3872-g38f9d900-1jammy ceph-volume=19.0.0-3872-g38f9d900-1jammy radosgw=19.0.0-3872-g38f9d900-1jammy python3-rados=19.0.0-3872-g38f9d900-1jammy python3-rgw=19.0.0-3872-g38f9d900-1jammy python3-cephfs=19.0.0-3872-g38f9d900-1jammy python3-rbd=19.0.0-3872-g38f9d900-1jammy libcephfs2=19.0.0-3872-g38f9d900-1jammy libcephfs-dev=19.0.0-3872-g38f9d900-1jammy librados2=19.0.0-3872-g38f9d900-1jammy librbd1=19.0.0-3872-g38f9d900-1jammy rbd-fuse=19.0.0-3872-g38f9d900-1jammy python3-cephfs=19.0.0-3872-g38f9d900-1jammy cephfs-shell=19.0.0-3872-g38f9d900-1jammy cephfs-top=19.0.0-3872-g38f9d900-1jammy cephfs-mirror=19.0.0-3872-g38f9d900-1jammy 2024-05-27T06:23:40.666 INFO:teuthology.orchestra.run.smithi149.stdout:Reading package lists... 2024-05-27T06:23:40.699 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages were automatically installed and are no longer required: 2024-05-27T06:23:40.699 INFO:teuthology.orchestra.run.smithi087.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-27T06:23:40.700 INFO:teuthology.orchestra.run.smithi087.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-27T06:23:40.700 INFO:teuthology.orchestra.run.smithi087.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-27T06:23:40.700 INFO:teuthology.orchestra.run.smithi087.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-27T06:23:40.700 INFO:teuthology.orchestra.run.smithi087.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-27T06:23:40.700 INFO:teuthology.orchestra.run.smithi087.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-27T06:23:40.701 INFO:teuthology.orchestra.run.smithi087.stdout:The following additional packages will be installed: 2024-05-27T06:23:40.701 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-27T06:23:40.701 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-27T06:23:40.701 INFO:teuthology.orchestra.run.smithi087.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-27T06:23:40.702 INFO:teuthology.orchestra.run.smithi087.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-27T06:23:40.703 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-27T06:23:40.703 INFO:teuthology.orchestra.run.smithi087.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-27T06:23:40.703 INFO:teuthology.orchestra.run.smithi087.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-27T06:23:40.703 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-27T06:23:40.703 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-27T06:23:40.703 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-05-27T06:23:40.703 INFO:teuthology.orchestra.run.smithi087.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-05-27T06:23:40.703 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-05-27T06:23:40.703 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-05-27T06:23:40.703 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-05-27T06:23:40.704 INFO:teuthology.orchestra.run.smithi087.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-27T06:23:40.704 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-05-27T06:23:40.704 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-05-27T06:23:40.704 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-05-27T06:23:40.704 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-05-27T06:23:40.704 INFO:teuthology.orchestra.run.smithi087.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-05-27T06:23:40.704 INFO:teuthology.orchestra.run.smithi087.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-05-27T06:23:40.704 INFO:teuthology.orchestra.run.smithi087.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-05-27T06:23:40.704 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-05-27T06:23:40.704 INFO:teuthology.orchestra.run.smithi087.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-05-27T06:23:40.705 INFO:teuthology.orchestra.run.smithi087.stdout:Suggested packages: 2024-05-27T06:23:40.705 INFO:teuthology.orchestra.run.smithi087.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-27T06:23:40.705 INFO:teuthology.orchestra.run.smithi087.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-27T06:23:40.705 INFO:teuthology.orchestra.run.smithi087.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-27T06:23:40.705 INFO:teuthology.orchestra.run.smithi087.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-27T06:23:40.705 INFO:teuthology.orchestra.run.smithi087.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-27T06:23:40.705 INFO:teuthology.orchestra.run.smithi087.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-27T06:23:40.705 INFO:teuthology.orchestra.run.smithi087.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-27T06:23:40.705 INFO:teuthology.orchestra.run.smithi087.stdout:Recommended packages: 2024-05-27T06:23:40.705 INFO:teuthology.orchestra.run.smithi087.stdout: btrfs-tools 2024-05-27T06:23:40.850 INFO:teuthology.orchestra.run.smithi149.stdout:Building dependency tree... 2024-05-27T06:23:40.851 INFO:teuthology.orchestra.run.smithi149.stdout:Reading state information... 2024-05-27T06:23:40.859 INFO:teuthology.orchestra.run.smithi087.stdout:The following NEW packages will be installed: 2024-05-27T06:23:40.859 INFO:teuthology.orchestra.run.smithi087.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-27T06:23:40.860 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-27T06:23:40.860 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-05-27T06:23:40.860 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-05-27T06:23:40.861 INFO:teuthology.orchestra.run.smithi087.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-27T06:23:40.861 INFO:teuthology.orchestra.run.smithi087.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-05-27T06:23:40.861 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-05-27T06:23:40.862 INFO:teuthology.orchestra.run.smithi087.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-05-27T06:23:40.862 INFO:teuthology.orchestra.run.smithi087.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-05-27T06:23:40.862 INFO:teuthology.orchestra.run.smithi087.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-05-27T06:23:40.862 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-05-27T06:23:40.862 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-05-27T06:23:40.862 INFO:teuthology.orchestra.run.smithi087.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-05-27T06:23:40.862 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-27T06:23:40.862 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-27T06:23:40.862 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-27T06:23:40.862 INFO:teuthology.orchestra.run.smithi087.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-27T06:23:40.862 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-27T06:23:40.862 INFO:teuthology.orchestra.run.smithi087.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-27T06:23:40.863 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-05-27T06:23:40.863 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-05-27T06:23:40.863 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-27T06:23:40.863 INFO:teuthology.orchestra.run.smithi087.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-27T06:23:40.863 INFO:teuthology.orchestra.run.smithi087.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-27T06:23:40.863 INFO:teuthology.orchestra.run.smithi087.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-27T06:23:40.863 INFO:teuthology.orchestra.run.smithi087.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-27T06:23:40.863 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-05-27T06:23:40.863 INFO:teuthology.orchestra.run.smithi087.stdout: socat unzip xmlstarlet zip 2024-05-27T06:23:40.935 INFO:teuthology.orchestra.run.smithi087.stdout:0 upgraded, 124 newly installed, 0 to remove and 310 not upgraded. 2024-05-27T06:23:40.936 INFO:teuthology.orchestra.run.smithi087.stdout:Need to get 186 MB of archives. 2024-05-27T06:23:40.936 INFO:teuthology.orchestra.run.smithi087.stdout:After this operation, 952 MB of additional disk space will be used. 2024-05-27T06:23:40.936 INFO:teuthology.orchestra.run.smithi087.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-05-27T06:23:40.957 INFO:teuthology.orchestra.run.smithi087.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-27T06:23:40.969 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-05-27T06:23:41.008 INFO:teuthology.orchestra.run.smithi087.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3872-g38f9d900-1jammy [3,527 kB] 2024-05-27T06:23:41.021 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-27T06:23:41.036 INFO:teuthology.orchestra.run.smithi149.stdout:The following packages were automatically installed and are no longer required: 2024-05-27T06:23:41.036 INFO:teuthology.orchestra.run.smithi149.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-27T06:23:41.036 INFO:teuthology.orchestra.run.smithi149.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-27T06:23:41.037 INFO:teuthology.orchestra.run.smithi149.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-27T06:23:41.038 INFO:teuthology.orchestra.run.smithi149.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-27T06:23:41.038 INFO:teuthology.orchestra.run.smithi149.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-27T06:23:41.038 INFO:teuthology.orchestra.run.smithi149.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-27T06:23:41.038 INFO:teuthology.orchestra.run.smithi149.stdout:The following additional packages will be installed: 2024-05-27T06:23:41.038 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-27T06:23:41.038 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-27T06:23:41.038 INFO:teuthology.orchestra.run.smithi149.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-27T06:23:41.038 INFO:teuthology.orchestra.run.smithi149.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-27T06:23:41.040 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-27T06:23:41.040 INFO:teuthology.orchestra.run.smithi149.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-27T06:23:41.040 INFO:teuthology.orchestra.run.smithi149.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-27T06:23:41.040 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-27T06:23:41.040 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-27T06:23:41.040 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-05-27T06:23:41.040 INFO:teuthology.orchestra.run.smithi149.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-05-27T06:23:41.040 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-05-27T06:23:41.040 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-05-27T06:23:41.040 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-05-27T06:23:41.040 INFO:teuthology.orchestra.run.smithi149.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-27T06:23:41.040 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-05-27T06:23:41.041 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-05-27T06:23:41.041 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-05-27T06:23:41.041 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-05-27T06:23:41.041 INFO:teuthology.orchestra.run.smithi149.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-05-27T06:23:41.041 INFO:teuthology.orchestra.run.smithi149.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-05-27T06:23:41.041 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-05-27T06:23:41.041 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-05-27T06:23:41.041 INFO:teuthology.orchestra.run.smithi149.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-05-27T06:23:41.041 INFO:teuthology.orchestra.run.smithi149.stdout:Suggested packages: 2024-05-27T06:23:41.041 INFO:teuthology.orchestra.run.smithi149.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-27T06:23:41.042 INFO:teuthology.orchestra.run.smithi149.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-27T06:23:41.042 INFO:teuthology.orchestra.run.smithi149.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-27T06:23:41.042 INFO:teuthology.orchestra.run.smithi149.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-27T06:23:41.042 INFO:teuthology.orchestra.run.smithi149.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-27T06:23:41.042 INFO:teuthology.orchestra.run.smithi149.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-27T06:23:41.042 INFO:teuthology.orchestra.run.smithi149.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-27T06:23:41.042 INFO:teuthology.orchestra.run.smithi149.stdout:Recommended packages: 2024-05-27T06:23:41.042 INFO:teuthology.orchestra.run.smithi149.stdout: btrfs-tools 2024-05-27T06:23:41.047 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-27T06:23:41.050 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-27T06:23:41.064 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-27T06:23:41.110 INFO:teuthology.orchestra.run.smithi087.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-27T06:23:41.112 INFO:teuthology.orchestra.run.smithi087.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-27T06:23:41.120 INFO:teuthology.orchestra.run.smithi087.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-27T06:23:41.123 INFO:teuthology.orchestra.run.smithi087.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-27T06:23:41.123 INFO:teuthology.orchestra.run.smithi087.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-27T06:23:41.129 INFO:teuthology.orchestra.run.smithi087.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-27T06:23:41.131 INFO:teuthology.orchestra.run.smithi087.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-27T06:23:41.133 INFO:teuthology.orchestra.run.smithi087.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-27T06:23:41.134 INFO:teuthology.orchestra.run.smithi087.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-27T06:23:41.135 INFO:teuthology.orchestra.run.smithi087.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-27T06:23:41.155 INFO:teuthology.orchestra.run.smithi087.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-27T06:23:41.156 INFO:teuthology.orchestra.run.smithi087.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-27T06:23:41.158 INFO:teuthology.orchestra.run.smithi087.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-27T06:23:41.159 INFO:teuthology.orchestra.run.smithi087.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-27T06:23:41.159 INFO:teuthology.orchestra.run.smithi087.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-27T06:23:41.175 INFO:teuthology.orchestra.run.smithi087.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-27T06:23:41.175 INFO:teuthology.orchestra.run.smithi087.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-27T06:23:41.176 INFO:teuthology.orchestra.run.smithi087.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-27T06:23:41.176 INFO:teuthology.orchestra.run.smithi087.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-27T06:23:41.176 INFO:teuthology.orchestra.run.smithi087.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-27T06:23:41.196 INFO:teuthology.orchestra.run.smithi087.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-27T06:23:41.196 INFO:teuthology.orchestra.run.smithi087.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-27T06:23:41.198 INFO:teuthology.orchestra.run.smithi087.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-27T06:23:41.199 INFO:teuthology.orchestra.run.smithi149.stdout:The following NEW packages will be installed: 2024-05-27T06:23:41.199 INFO:teuthology.orchestra.run.smithi149.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-27T06:23:41.199 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-27T06:23:41.199 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-05-27T06:23:41.199 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-05-27T06:23:41.200 INFO:teuthology.orchestra.run.smithi087.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-27T06:23:41.200 INFO:teuthology.orchestra.run.smithi087.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-27T06:23:41.201 INFO:teuthology.orchestra.run.smithi149.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-27T06:23:41.201 INFO:teuthology.orchestra.run.smithi149.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-05-27T06:23:41.201 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-05-27T06:23:41.201 INFO:teuthology.orchestra.run.smithi149.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-05-27T06:23:41.201 INFO:teuthology.orchestra.run.smithi149.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-05-27T06:23:41.201 INFO:teuthology.orchestra.run.smithi149.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-05-27T06:23:41.202 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-05-27T06:23:41.202 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-05-27T06:23:41.202 INFO:teuthology.orchestra.run.smithi149.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-05-27T06:23:41.202 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-27T06:23:41.202 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-27T06:23:41.202 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-27T06:23:41.202 INFO:teuthology.orchestra.run.smithi149.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-27T06:23:41.202 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-27T06:23:41.202 INFO:teuthology.orchestra.run.smithi149.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-27T06:23:41.202 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-05-27T06:23:41.202 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-05-27T06:23:41.202 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-27T06:23:41.202 INFO:teuthology.orchestra.run.smithi149.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-27T06:23:41.202 INFO:teuthology.orchestra.run.smithi149.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-27T06:23:41.203 INFO:teuthology.orchestra.run.smithi149.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-27T06:23:41.203 INFO:teuthology.orchestra.run.smithi149.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-27T06:23:41.203 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-05-27T06:23:41.203 INFO:teuthology.orchestra.run.smithi149.stdout: socat unzip xmlstarlet zip 2024-05-27T06:23:41.216 INFO:teuthology.orchestra.run.smithi087.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-27T06:23:41.217 INFO:teuthology.orchestra.run.smithi087.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-27T06:23:41.217 INFO:teuthology.orchestra.run.smithi087.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-27T06:23:41.218 INFO:teuthology.orchestra.run.smithi087.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-27T06:23:41.219 INFO:teuthology.orchestra.run.smithi087.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-27T06:23:41.237 INFO:teuthology.orchestra.run.smithi087.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-27T06:23:41.237 INFO:teuthology.orchestra.run.smithi087.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-27T06:23:41.242 INFO:teuthology.orchestra.run.smithi087.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-27T06:23:41.242 INFO:teuthology.orchestra.run.smithi087.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-27T06:23:41.243 INFO:teuthology.orchestra.run.smithi087.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-27T06:23:41.257 INFO:teuthology.orchestra.run.smithi087.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-27T06:23:41.259 INFO:teuthology.orchestra.run.smithi087.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-27T06:23:41.261 INFO:teuthology.orchestra.run.smithi087.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-05-27T06:23:41.261 INFO:teuthology.orchestra.run.smithi087.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-27T06:23:41.263 INFO:teuthology.orchestra.run.smithi087.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-27T06:23:41.278 INFO:teuthology.orchestra.run.smithi087.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-27T06:23:41.280 INFO:teuthology.orchestra.run.smithi087.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-27T06:23:41.280 INFO:teuthology.orchestra.run.smithi087.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-27T06:23:41.281 INFO:teuthology.orchestra.run.smithi087.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-27T06:23:41.283 INFO:teuthology.orchestra.run.smithi087.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-27T06:23:41.296 INFO:teuthology.orchestra.run.smithi087.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3872-g38f9d900-1jammy [3,286 kB] 2024-05-27T06:23:41.330 INFO:teuthology.orchestra.run.smithi087.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-27T06:23:41.331 INFO:teuthology.orchestra.run.smithi087.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-27T06:23:41.332 INFO:teuthology.orchestra.run.smithi087.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-27T06:23:41.333 INFO:teuthology.orchestra.run.smithi087.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-27T06:23:41.334 INFO:teuthology.orchestra.run.smithi087.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-27T06:23:41.354 INFO:teuthology.orchestra.run.smithi087.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-27T06:23:41.356 INFO:teuthology.orchestra.run.smithi087.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-27T06:23:41.356 INFO:teuthology.orchestra.run.smithi087.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-27T06:23:41.373 INFO:teuthology.orchestra.run.smithi087.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-27T06:23:41.373 INFO:teuthology.orchestra.run.smithi087.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-27T06:23:41.374 INFO:teuthology.orchestra.run.smithi087.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-27T06:23:41.375 INFO:teuthology.orchestra.run.smithi087.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-27T06:23:41.375 INFO:teuthology.orchestra.run.smithi087.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-27T06:23:41.376 INFO:teuthology.orchestra.run.smithi087.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-27T06:23:41.385 INFO:teuthology.orchestra.run.smithi087.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-27T06:23:41.386 INFO:teuthology.orchestra.run.smithi087.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-27T06:23:41.390 INFO:teuthology.orchestra.run.smithi087.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-27T06:23:41.400 INFO:teuthology.orchestra.run.smithi149.stdout:0 upgraded, 124 newly installed, 0 to remove and 310 not upgraded. 2024-05-27T06:23:41.400 INFO:teuthology.orchestra.run.smithi149.stdout:Need to get 186 MB of archives. 2024-05-27T06:23:41.400 INFO:teuthology.orchestra.run.smithi149.stdout:After this operation, 952 MB of additional disk space will be used. 2024-05-27T06:23:41.400 INFO:teuthology.orchestra.run.smithi149.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-05-27T06:23:41.406 INFO:teuthology.orchestra.run.smithi087.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-27T06:23:41.407 INFO:teuthology.orchestra.run.smithi087.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-27T06:23:41.408 INFO:teuthology.orchestra.run.smithi087.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-27T06:23:41.412 INFO:teuthology.orchestra.run.smithi087.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-27T06:23:41.414 INFO:teuthology.orchestra.run.smithi087.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-05-27T06:23:41.415 INFO:teuthology.orchestra.run.smithi087.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-27T06:23:41.416 INFO:teuthology.orchestra.run.smithi087.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-27T06:23:41.423 INFO:teuthology.orchestra.run.smithi087.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3872-g38f9d900-1jammy [727 kB] 2024-05-27T06:23:41.427 INFO:teuthology.orchestra.run.smithi087.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-27T06:23:41.431 INFO:teuthology.orchestra.run.smithi087.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-27T06:23:41.432 INFO:teuthology.orchestra.run.smithi087.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-27T06:23:41.440 INFO:teuthology.orchestra.run.smithi149.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3872-g38f9d900-1jammy [3,527 kB] 2024-05-27T06:23:41.443 INFO:teuthology.orchestra.run.smithi087.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3872-g38f9d900-1jammy [356 kB] 2024-05-27T06:23:41.447 INFO:teuthology.orchestra.run.smithi087.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-27T06:23:41.447 INFO:teuthology.orchestra.run.smithi087.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-27T06:23:41.448 INFO:teuthology.orchestra.run.smithi087.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-27T06:23:41.449 INFO:teuthology.orchestra.run.smithi087.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-27T06:23:41.450 INFO:teuthology.orchestra.run.smithi087.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3872-g38f9d900-1jammy [32.8 kB] 2024-05-27T06:23:41.450 INFO:teuthology.orchestra.run.smithi087.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-27T06:23:41.451 INFO:teuthology.orchestra.run.smithi087.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-27T06:23:41.458 INFO:teuthology.orchestra.run.smithi087.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-27T06:23:41.459 INFO:teuthology.orchestra.run.smithi087.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3872-g38f9d900-1jammy [180 kB] 2024-05-27T06:23:41.463 INFO:teuthology.orchestra.run.smithi087.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3872-g38f9d900-1jammy [67.5 kB] 2024-05-27T06:23:41.463 INFO:teuthology.orchestra.run.smithi087.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3872-g38f9d900-1jammy [334 kB] 2024-05-27T06:23:41.468 INFO:teuthology.orchestra.run.smithi087.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-27T06:23:41.468 INFO:teuthology.orchestra.run.smithi087.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-27T06:23:41.471 INFO:teuthology.orchestra.run.smithi087.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-27T06:23:41.472 INFO:teuthology.orchestra.run.smithi087.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3872-g38f9d900-1jammy [8,752 kB] 2024-05-27T06:23:41.485 INFO:teuthology.orchestra.run.smithi149.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-27T06:23:41.489 INFO:teuthology.orchestra.run.smithi087.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-27T06:23:41.531 INFO:teuthology.orchestra.run.smithi149.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-05-27T06:23:41.792 INFO:teuthology.orchestra.run.smithi149.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-27T06:23:41.823 INFO:teuthology.orchestra.run.smithi087.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3872-g38f9d900-1jammy [112 kB] 2024-05-27T06:23:41.824 INFO:teuthology.orchestra.run.smithi087.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3872-g38f9d900-1jammy [471 kB] 2024-05-27T06:23:41.842 INFO:teuthology.orchestra.run.smithi087.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3872-g38f9d900-1jammy [28.8 MB] 2024-05-27T06:23:41.899 INFO:teuthology.orchestra.run.smithi149.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-27T06:23:41.915 INFO:teuthology.orchestra.run.smithi149.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-27T06:23:41.968 INFO:teuthology.orchestra.run.smithi149.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-27T06:23:42.149 INFO:teuthology.orchestra.run.smithi149.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-27T06:23:42.158 INFO:teuthology.orchestra.run.smithi149.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-27T06:23:42.163 INFO:teuthology.orchestra.run.smithi149.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3872-g38f9d900-1jammy [3,286 kB] 2024-05-27T06:23:42.187 INFO:teuthology.orchestra.run.smithi149.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-27T06:23:42.196 INFO:teuthology.orchestra.run.smithi149.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-27T06:23:42.361 INFO:teuthology.orchestra.run.smithi149.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-27T06:23:42.689 INFO:teuthology.orchestra.run.smithi149.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3872-g38f9d900-1jammy [727 kB] 2024-05-27T06:23:42.767 INFO:teuthology.orchestra.run.smithi149.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3872-g38f9d900-1jammy [356 kB] 2024-05-27T06:23:42.811 INFO:teuthology.orchestra.run.smithi149.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3872-g38f9d900-1jammy [32.8 kB] 2024-05-27T06:23:42.815 INFO:teuthology.orchestra.run.smithi149.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3872-g38f9d900-1jammy [180 kB] 2024-05-27T06:23:42.842 INFO:teuthology.orchestra.run.smithi149.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3872-g38f9d900-1jammy [67.5 kB] 2024-05-27T06:23:42.846 INFO:teuthology.orchestra.run.smithi149.stdout:Get:20 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3872-g38f9d900-1jammy [334 kB] 2024-05-27T06:23:42.890 INFO:teuthology.orchestra.run.smithi149.stdout:Get:21 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3872-g38f9d900-1jammy [8,752 kB] 2024-05-27T06:23:43.046 INFO:teuthology.orchestra.run.smithi149.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-27T06:23:43.055 INFO:teuthology.orchestra.run.smithi087.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3872-g38f9d900-1jammy [4,915 kB] 2024-05-27T06:23:43.065 INFO:teuthology.orchestra.run.smithi149.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-27T06:23:43.087 INFO:teuthology.orchestra.run.smithi149.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-27T06:23:43.098 INFO:teuthology.orchestra.run.smithi149.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-27T06:23:43.101 INFO:teuthology.orchestra.run.smithi149.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-27T06:23:43.134 INFO:teuthology.orchestra.run.smithi149.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-27T06:23:43.157 INFO:teuthology.orchestra.run.smithi149.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-27T06:23:43.173 INFO:teuthology.orchestra.run.smithi149.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-27T06:23:43.178 INFO:teuthology.orchestra.run.smithi149.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-27T06:23:43.179 INFO:teuthology.orchestra.run.smithi149.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-27T06:23:43.278 INFO:teuthology.orchestra.run.smithi087.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3872-g38f9d900-1jammy [245 kB] 2024-05-27T06:23:43.289 INFO:teuthology.orchestra.run.smithi087.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3872-g38f9d900-1jammy [125 kB] 2024-05-27T06:23:43.294 INFO:teuthology.orchestra.run.smithi087.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3872-g38f9d900-1jammy [1,541 kB] 2024-05-27T06:23:43.350 INFO:teuthology.orchestra.run.smithi149.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-27T06:23:43.359 INFO:teuthology.orchestra.run.smithi087.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3872-g38f9d900-1jammy [6,149 kB] 2024-05-27T06:23:43.434 INFO:teuthology.orchestra.run.smithi149.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-27T06:23:43.455 INFO:teuthology.orchestra.run.smithi149.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-27T06:23:43.515 INFO:teuthology.orchestra.run.smithi149.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-27T06:23:43.558 INFO:teuthology.orchestra.run.smithi149.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-27T06:23:43.579 INFO:teuthology.orchestra.run.smithi149.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-27T06:23:43.602 INFO:teuthology.orchestra.run.smithi149.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-27T06:23:43.604 INFO:teuthology.orchestra.run.smithi087.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3872-g38f9d900-1jammy [22.5 MB] 2024-05-27T06:23:43.773 INFO:teuthology.orchestra.run.smithi149.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-27T06:23:43.789 INFO:teuthology.orchestra.run.smithi149.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-27T06:23:43.796 INFO:teuthology.orchestra.run.smithi149.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-27T06:23:43.801 INFO:teuthology.orchestra.run.smithi149.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-27T06:23:43.986 INFO:teuthology.orchestra.run.smithi149.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-27T06:23:44.070 INFO:teuthology.orchestra.run.smithi149.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-27T06:23:44.085 INFO:teuthology.orchestra.run.smithi149.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-27T06:23:44.260 INFO:teuthology.orchestra.run.smithi149.stdout:Get:46 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3872-g38f9d900-1jammy [112 kB] 2024-05-27T06:23:44.262 INFO:teuthology.orchestra.run.smithi149.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-27T06:23:44.273 INFO:teuthology.orchestra.run.smithi149.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3872-g38f9d900-1jammy [471 kB] 2024-05-27T06:23:44.312 INFO:teuthology.orchestra.run.smithi149.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-27T06:23:44.326 INFO:teuthology.orchestra.run.smithi149.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-27T06:23:44.342 INFO:teuthology.orchestra.run.smithi149.stdout:Get:51 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3872-g38f9d900-1jammy [28.8 MB] 2024-05-27T06:23:44.535 INFO:teuthology.orchestra.run.smithi087.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3872-g38f9d900-1jammy [14.0 kB] 2024-05-27T06:23:44.536 INFO:teuthology.orchestra.run.smithi087.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3872-g38f9d900-1jammy [857 kB] 2024-05-27T06:23:44.566 INFO:teuthology.orchestra.run.smithi087.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3872-g38f9d900-1jammy [2,378 kB] 2024-05-27T06:23:44.571 INFO:teuthology.orchestra.run.smithi149.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-27T06:23:44.571 INFO:teuthology.orchestra.run.smithi149.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-27T06:23:44.578 INFO:teuthology.orchestra.run.smithi149.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-27T06:23:44.582 INFO:teuthology.orchestra.run.smithi149.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-27T06:23:44.599 INFO:teuthology.orchestra.run.smithi149.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-27T06:23:44.667 INFO:teuthology.orchestra.run.smithi087.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3872-g38f9d900-1jammy [792 kB] 2024-05-27T06:23:44.700 INFO:teuthology.orchestra.run.smithi087.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3872-g38f9d900-1jammy [149 kB] 2024-05-27T06:23:44.705 INFO:teuthology.orchestra.run.smithi087.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3872-g38f9d900-1jammy [2,226 kB] 2024-05-27T06:23:44.791 INFO:teuthology.orchestra.run.smithi149.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-05-27T06:23:44.802 INFO:teuthology.orchestra.run.smithi087.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3872-g38f9d900-1jammy [8,625 kB] 2024-05-27T06:23:45.050 INFO:teuthology.orchestra.run.smithi149.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-27T06:23:45.170 INFO:teuthology.orchestra.run.smithi087.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3872-g38f9d900-1jammy [14.2 kB] 2024-05-27T06:23:45.170 INFO:teuthology.orchestra.run.smithi087.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3872-g38f9d900-1jammy [48.1 MB] 2024-05-27T06:23:45.183 INFO:teuthology.orchestra.run.smithi149.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-27T06:23:45.227 INFO:teuthology.orchestra.run.smithi149.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-27T06:23:45.317 INFO:teuthology.orchestra.run.smithi149.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-27T06:23:45.327 INFO:teuthology.orchestra.run.smithi149.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-27T06:23:45.340 INFO:teuthology.orchestra.run.smithi149.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-27T06:23:45.390 INFO:teuthology.orchestra.run.smithi149.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-27T06:23:45.653 INFO:teuthology.orchestra.run.smithi149.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-27T06:23:45.654 INFO:teuthology.orchestra.run.smithi149.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-27T06:23:45.656 INFO:teuthology.orchestra.run.smithi149.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-27T06:23:45.820 INFO:teuthology.orchestra.run.smithi149.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-27T06:23:46.165 INFO:teuthology.orchestra.run.smithi149.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-27T06:23:46.599 INFO:teuthology.orchestra.run.smithi149.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-27T06:23:46.607 INFO:teuthology.orchestra.run.smithi149.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-27T06:23:46.607 INFO:teuthology.orchestra.run.smithi149.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-27T06:23:46.698 INFO:teuthology.orchestra.run.smithi149.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-27T06:23:46.698 INFO:teuthology.orchestra.run.smithi149.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-27T06:23:46.699 INFO:teuthology.orchestra.run.smithi149.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-27T06:23:46.700 INFO:teuthology.orchestra.run.smithi149.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-27T06:23:46.701 INFO:teuthology.orchestra.run.smithi149.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-27T06:23:46.702 INFO:teuthology.orchestra.run.smithi149.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-27T06:23:46.868 INFO:teuthology.orchestra.run.smithi149.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-27T06:23:47.083 INFO:teuthology.orchestra.run.smithi149.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-27T06:23:47.238 INFO:teuthology.orchestra.run.smithi087.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3872-g38f9d900-1jammy [124 kB] 2024-05-27T06:23:47.238 INFO:teuthology.orchestra.run.smithi087.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3872-g38f9d900-1jammy [237 kB] 2024-05-27T06:23:47.241 INFO:teuthology.orchestra.run.smithi087.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3872-g38f9d900-1jammy [33.9 kB] 2024-05-27T06:23:47.241 INFO:teuthology.orchestra.run.smithi087.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3872-g38f9d900-1jammy [23.4 kB] 2024-05-27T06:23:47.241 INFO:teuthology.orchestra.run.smithi087.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3872-g38f9d900-1jammy [38.9 kB] 2024-05-27T06:23:47.242 INFO:teuthology.orchestra.run.smithi087.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3872-g38f9d900-1jammy [17.4 MB] 2024-05-27T06:23:47.412 INFO:teuthology.orchestra.run.smithi149.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-27T06:23:47.458 INFO:teuthology.orchestra.run.smithi149.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-27T06:23:47.487 INFO:teuthology.orchestra.run.smithi149.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-27T06:23:47.500 INFO:teuthology.orchestra.run.smithi149.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-27T06:23:47.543 INFO:teuthology.orchestra.run.smithi149.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-27T06:23:47.568 INFO:teuthology.orchestra.run.smithi149.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-05-27T06:23:47.570 INFO:teuthology.orchestra.run.smithi149.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-27T06:23:47.579 INFO:teuthology.orchestra.run.smithi149.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-27T06:23:47.582 INFO:teuthology.orchestra.run.smithi149.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-27T06:23:47.782 INFO:teuthology.orchestra.run.smithi149.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-27T06:23:47.989 INFO:teuthology.orchestra.run.smithi087.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3872-g38f9d900-1jammy [92.6 kB] 2024-05-27T06:23:48.042 INFO:teuthology.orchestra.run.smithi149.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-27T06:23:48.284 INFO:teuthology.orchestra.run.smithi149.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3872-g38f9d900-1jammy [4,915 kB] 2024-05-27T06:23:48.335 INFO:teuthology.orchestra.run.smithi149.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-27T06:23:48.337 INFO:teuthology.orchestra.run.smithi149.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-27T06:23:48.351 INFO:teuthology.orchestra.run.smithi149.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-27T06:23:48.367 INFO:teuthology.orchestra.run.smithi149.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-27T06:23:48.408 INFO:teuthology.orchestra.run.smithi149.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-27T06:23:48.426 INFO:teuthology.orchestra.run.smithi149.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-27T06:23:48.542 INFO:teuthology.orchestra.run.smithi149.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-27T06:23:48.545 INFO:teuthology.orchestra.run.smithi149.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-27T06:23:48.546 INFO:teuthology.orchestra.run.smithi149.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-27T06:23:48.627 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 186 MB in 7s (26.1 MB/s) 2024-05-27T06:23:48.730 INFO:teuthology.orchestra.run.smithi149.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-27T06:23:48.740 INFO:teuthology.orchestra.run.smithi149.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3872-g38f9d900-1jammy [245 kB] 2024-05-27T06:23:48.759 INFO:teuthology.orchestra.run.smithi149.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3872-g38f9d900-1jammy [125 kB] 2024-05-27T06:23:48.774 INFO:teuthology.orchestra.run.smithi149.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3872-g38f9d900-1jammy [1,541 kB] 2024-05-27T06:23:48.788 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-27T06:23:48.859 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132924 files and directories currently installed.) 2024-05-27T06:23:48.861 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-05-27T06:23:48.895 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-05-27T06:23:48.918 INFO:teuthology.orchestra.run.smithi149.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3872-g38f9d900-1jammy [6,149 kB] 2024-05-27T06:23:49.003 INFO:teuthology.orchestra.run.smithi149.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-27T06:23:49.148 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-27T06:23:49.162 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-27T06:23:49.198 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-27T06:23:49.474 INFO:teuthology.orchestra.run.smithi149.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3872-g38f9d900-1jammy [22.5 MB] 2024-05-27T06:23:49.509 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cmd2. 2024-05-27T06:23:49.523 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-05-27T06:23:49.593 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-05-27T06:23:49.946 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-27T06:23:49.960 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-27T06:23:50.046 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-27T06:23:50.391 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-27T06:23:50.405 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-27T06:23:50.483 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-27T06:23:50.819 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-27T06:23:50.833 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-27T06:23:50.877 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-27T06:23:51.256 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-27T06:23:51.270 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-27T06:23:51.347 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-27T06:23:51.413 INFO:teuthology.orchestra.run.smithi149.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3872-g38f9d900-1jammy [14.0 kB] 2024-05-27T06:23:51.413 INFO:teuthology.orchestra.run.smithi149.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3872-g38f9d900-1jammy [857 kB] 2024-05-27T06:23:51.484 INFO:teuthology.orchestra.run.smithi149.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3872-g38f9d900-1jammy [2,378 kB] 2024-05-27T06:23:51.674 INFO:teuthology.orchestra.run.smithi149.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3872-g38f9d900-1jammy [792 kB] 2024-05-27T06:23:51.752 INFO:teuthology.orchestra.run.smithi149.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3872-g38f9d900-1jammy [149 kB] 2024-05-27T06:23:51.754 INFO:teuthology.orchestra.run.smithi149.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3872-g38f9d900-1jammy [2,226 kB] 2024-05-27T06:23:51.759 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-27T06:23:51.774 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-27T06:23:51.817 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-27T06:23:51.933 INFO:teuthology.orchestra.run.smithi149.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3872-g38f9d900-1jammy [8,625 kB] 2024-05-27T06:23:52.154 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-27T06:23:52.168 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-27T06:23:52.245 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-27T06:23:52.573 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-27T06:23:52.588 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-27T06:23:52.631 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-27T06:23:52.757 INFO:teuthology.orchestra.run.smithi149.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3872-g38f9d900-1jammy [14.2 kB] 2024-05-27T06:23:52.757 INFO:teuthology.orchestra.run.smithi149.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3872-g38f9d900-1jammy [48.1 MB] 2024-05-27T06:23:52.926 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librados2. 2024-05-27T06:23:52.941 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../010-librados2_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:23:52.976 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librados2 (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:23:53.629 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librbd1. 2024-05-27T06:23:53.643 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../011-librbd1_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:23:53.687 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librbd1 (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:23:54.131 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libcephfs2. 2024-05-27T06:23:54.146 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:23:54.190 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libcephfs2 (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:23:54.459 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rados. 2024-05-27T06:23:54.473 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:23:54.517 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rados (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:23:54.786 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-27T06:23:54.801 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3872-g38f9d900-1jammy_all.deb ... 2024-05-27T06:23:54.845 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-ceph-argparse (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:23:55.141 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cephfs. 2024-05-27T06:23:55.154 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:23:55.197 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cephfs (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:23:55.517 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-27T06:23:55.530 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3872-g38f9d900-1jammy_all.deb ... 2024-05-27T06:23:55.575 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-ceph-common (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:23:55.920 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-prettytable. 2024-05-27T06:23:55.933 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-05-27T06:23:55.978 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-27T06:23:56.153 INFO:teuthology.orchestra.run.smithi149.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3872-g38f9d900-1jammy [124 kB] 2024-05-27T06:23:56.154 INFO:teuthology.orchestra.run.smithi149.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3872-g38f9d900-1jammy [237 kB] 2024-05-27T06:23:56.165 INFO:teuthology.orchestra.run.smithi149.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3872-g38f9d900-1jammy [33.9 kB] 2024-05-27T06:23:56.166 INFO:teuthology.orchestra.run.smithi149.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3872-g38f9d900-1jammy [23.4 kB] 2024-05-27T06:23:56.166 INFO:teuthology.orchestra.run.smithi149.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3872-g38f9d900-1jammy [38.9 kB] 2024-05-27T06:23:56.171 INFO:teuthology.orchestra.run.smithi149.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3872-g38f9d900-1jammy [17.4 MB] 2024-05-27T06:23:56.272 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rbd. 2024-05-27T06:23:56.287 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:23:56.339 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rbd (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:23:56.783 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-27T06:23:56.798 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-27T06:23:56.842 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-27T06:23:57.103 INFO:teuthology.orchestra.run.smithi149.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240521.063558-debug/38f9d900c83c63799fbdbe61acc9a11b0d3554a6/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3872-g38f9d900-1jammy [92.6 kB] 2024-05-27T06:23:57.111 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-27T06:23:57.126 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-27T06:23:57.169 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-27T06:23:57.447 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-27T06:23:57.462 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-27T06:23:57.530 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-27T06:23:57.745 INFO:teuthology.orchestra.run.smithi149.stdout:Fetched 186 MB in 16s (11.7 MB/s) 2024-05-27T06:23:57.792 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package lua5.1. 2024-05-27T06:23:57.807 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-27T06:23:57.850 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-27T06:23:57.895 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-27T06:23:57.962 INFO:teuthology.orchestra.run.smithi149.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132924 files and directories currently installed.) 2024-05-27T06:23:57.966 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-05-27T06:23:58.018 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-05-27T06:23:58.178 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package lua-any. 2024-05-27T06:23:58.193 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-05-27T06:23:58.253 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-27T06:23:58.279 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-27T06:23:58.293 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-27T06:23:58.329 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-27T06:23:58.698 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package zip. 2024-05-27T06:23:58.712 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-05-27T06:23:58.756 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking zip (3.0-12build2) ... 2024-05-27T06:23:58.891 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-cmd2. 2024-05-27T06:23:58.915 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-05-27T06:23:59.059 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package unzip. 2024-05-27T06:23:59.074 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-27T06:23:59.109 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-27T06:23:59.132 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-05-27T06:23:59.485 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-27T06:23:59.499 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-27T06:23:59.521 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package luarocks. 2024-05-27T06:23:59.536 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-27T06:23:59.579 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-27T06:23:59.585 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-27T06:23:59.962 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librgw2. 2024-05-27T06:23:59.972 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-27T06:23:59.976 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../027-librgw2_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:23:59.987 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-27T06:24:00.028 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librgw2 (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:00.039 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-27T06:24:00.325 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-27T06:24:00.340 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-27T06:24:00.400 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-27T06:24:00.698 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rgw. 2024-05-27T06:24:00.713 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:00.764 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rgw (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:00.854 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-27T06:24:00.869 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-27T06:24:00.919 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-27T06:24:01.184 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-27T06:24:01.199 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-27T06:24:01.242 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-27T06:24:01.331 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-27T06:24:01.345 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-27T06:24:01.390 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-27T06:24:01.578 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libradosstriper1. 2024-05-27T06:24:01.593 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:01.645 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libradosstriper1 (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:01.726 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-27T06:24:01.741 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-27T06:24:01.792 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-27T06:24:02.162 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-27T06:24:02.177 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-27T06:24:02.190 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-common. 2024-05-27T06:24:02.205 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:02.221 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-27T06:24:02.256 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-common (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:02.573 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package librados2. 2024-05-27T06:24:02.588 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../010-librados2_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:02.632 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking librados2 (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:03.084 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package librbd1. 2024-05-27T06:24:03.099 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../011-librbd1_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:03.134 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking librbd1 (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:03.545 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libcephfs2. 2024-05-27T06:24:03.560 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:03.630 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libcephfs2 (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:03.804 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-base. 2024-05-27T06:24:03.819 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:03.871 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-base (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:03.931 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-rados. 2024-05-27T06:24:03.946 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:03.989 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-rados (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:04.391 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-27T06:24:04.405 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-27T06:24:04.441 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-27T06:24:04.467 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-27T06:24:04.482 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3872-g38f9d900-1jammy_all.deb ... 2024-05-27T06:24:04.525 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-ceph-argparse (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:04.769 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cheroot. 2024-05-27T06:24:04.770 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-cephfs. 2024-05-27T06:24:04.783 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-27T06:24:04.784 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:04.819 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-cephfs (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:04.827 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-27T06:24:05.122 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-27T06:24:05.136 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-27T06:24:05.156 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-27T06:24:05.171 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3872-g38f9d900-1jammy_all.deb ... 2024-05-27T06:24:05.180 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-27T06:24:05.214 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-ceph-common (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:05.483 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-27T06:24:05.498 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-27T06:24:05.566 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-27T06:24:05.567 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-prettytable. 2024-05-27T06:24:05.582 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-05-27T06:24:05.625 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-27T06:24:05.836 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-27T06:24:05.851 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-27T06:24:05.886 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-27T06:24:05.894 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-rbd. 2024-05-27T06:24:05.909 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:05.952 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-rbd (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:06.180 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-tempora. 2024-05-27T06:24:06.195 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-05-27T06:24:06.238 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-27T06:24:06.289 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-27T06:24:06.303 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-27T06:24:06.339 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-27T06:24:06.574 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-portend. 2024-05-27T06:24:06.583 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-27T06:24:06.589 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-05-27T06:24:06.597 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-27T06:24:06.633 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-27T06:24:06.641 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-27T06:24:06.936 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-27T06:24:06.951 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-27T06:24:06.977 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-27T06:24:06.986 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-27T06:24:06.993 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-27T06:24:07.035 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-27T06:24:07.297 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-27T06:24:07.312 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-27T06:24:07.355 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-27T06:24:07.364 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package lua5.1. 2024-05-27T06:24:07.378 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-27T06:24:07.422 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-27T06:24:07.700 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-natsort. 2024-05-27T06:24:07.715 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-05-27T06:24:07.750 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package lua-any. 2024-05-27T06:24:07.759 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-27T06:24:07.764 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-05-27T06:24:07.808 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-27T06:24:08.020 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-logutils. 2024-05-27T06:24:08.035 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-05-27T06:24:08.044 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package zip. 2024-05-27T06:24:08.058 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-05-27T06:24:08.070 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-27T06:24:08.102 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking zip (3.0-12build2) ... 2024-05-27T06:24:08.389 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-27T06:24:08.404 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-27T06:24:08.448 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package unzip. 2024-05-27T06:24:08.448 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-27T06:24:08.462 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-27T06:24:08.506 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-27T06:24:08.903 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-mako. 2024-05-27T06:24:08.917 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-27T06:24:08.918 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package luarocks. 2024-05-27T06:24:08.933 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-27T06:24:08.976 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-27T06:24:08.986 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-27T06:24:09.325 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package librgw2. 2024-05-27T06:24:09.339 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../027-librgw2_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:09.347 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-27T06:24:09.362 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-27T06:24:09.375 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking librgw2 (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:09.414 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-27T06:24:09.767 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-27T06:24:09.782 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-27T06:24:09.858 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-27T06:24:10.028 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-rgw. 2024-05-27T06:24:10.042 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:10.094 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-rgw (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:10.161 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-webob. 2024-05-27T06:24:10.176 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-27T06:24:10.228 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-27T06:24:10.422 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-27T06:24:10.437 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-27T06:24:10.480 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-27T06:24:10.581 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-waitress. 2024-05-27T06:24:10.596 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-27T06:24:10.642 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-27T06:24:10.800 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libradosstriper1. 2024-05-27T06:24:10.815 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:10.850 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libradosstriper1 (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:10.975 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-tempita. 2024-05-27T06:24:10.990 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-27T06:24:11.033 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-27T06:24:11.245 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-common. 2024-05-27T06:24:11.260 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:11.332 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-common (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:11.336 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-paste. 2024-05-27T06:24:11.351 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-27T06:24:11.386 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-27T06:24:11.723 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-27T06:24:11.738 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-27T06:24:11.781 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-27T06:24:12.084 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-27T06:24:12.099 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-27T06:24:12.134 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-27T06:24:12.445 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-webtest. 2024-05-27T06:24:12.460 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-05-27T06:24:12.503 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-27T06:24:12.815 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pecan. 2024-05-27T06:24:12.816 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-base. 2024-05-27T06:24:12.830 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-27T06:24:12.831 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:12.873 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-27T06:24:12.892 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-base (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:13.227 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-certifi. 2024-05-27T06:24:13.242 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-05-27T06:24:13.327 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-27T06:24:13.479 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-27T06:24:13.493 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-27T06:24:13.537 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-27T06:24:13.648 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-idna. 2024-05-27T06:24:13.662 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-05-27T06:24:13.705 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-05-27T06:24:14.649 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-cheroot. 2024-05-27T06:24:14.658 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-urllib3. 2024-05-27T06:24:14.664 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-27T06:24:14.673 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-27T06:24:14.708 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-27T06:24:14.715 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-27T06:24:15.037 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-requests. 2024-05-27T06:24:15.052 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-27T06:24:15.095 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-27T06:24:15.126 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-27T06:24:15.142 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-27T06:24:15.193 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-27T06:24:15.415 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-27T06:24:15.429 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-27T06:24:15.464 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-27T06:24:15.480 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-27T06:24:15.494 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-27T06:24:15.529 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-27T06:24:15.742 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-27T06:24:15.757 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3872-g38f9d900-1jammy_all.deb ... 2024-05-27T06:24:15.800 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:15.857 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-27T06:24:15.872 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-27T06:24:15.915 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-27T06:24:16.202 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-tempora. 2024-05-27T06:24:16.205 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-27T06:24:16.217 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-05-27T06:24:16.219 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:16.259 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-27T06:24:16.263 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:16.525 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-27T06:24:16.539 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-27T06:24:16.571 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-portend. 2024-05-27T06:24:16.574 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-27T06:24:16.586 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-05-27T06:24:16.621 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-27T06:24:16.869 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-openssl. 2024-05-27T06:24:16.882 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-27T06:24:16.884 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-05-27T06:24:16.896 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-27T06:24:16.927 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-27T06:24:16.940 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-27T06:24:17.289 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr. 2024-05-27T06:24:17.303 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:17.322 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-27T06:24:17.331 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-27T06:24:17.346 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:17.384 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-27T06:24:17.733 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mon. 2024-05-27T06:24:17.748 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:17.763 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-natsort. 2024-05-27T06:24:17.776 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-05-27T06:24:17.783 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mon (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:17.813 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-27T06:24:18.133 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-logutils. 2024-05-27T06:24:18.146 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-05-27T06:24:18.191 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-27T06:24:18.378 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-osd. 2024-05-27T06:24:18.393 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:18.428 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-osd (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:18.502 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-27T06:24:18.515 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-27T06:24:18.552 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-27T06:24:18.838 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-mako. 2024-05-27T06:24:18.850 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-27T06:24:18.888 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-27T06:24:19.191 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-27T06:24:19.205 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-27T06:24:19.241 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-27T06:24:19.380 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph. 2024-05-27T06:24:19.395 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../068-ceph_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:19.439 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:19.594 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-27T06:24:19.607 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-27T06:24:19.652 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-27T06:24:19.775 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-fuse. 2024-05-27T06:24:19.790 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:19.833 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-fuse (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:19.955 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-webob. 2024-05-27T06:24:19.968 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-27T06:24:20.013 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-27T06:24:20.212 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mds. 2024-05-27T06:24:20.224 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:20.262 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mds (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:20.550 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-waitress. 2024-05-27T06:24:20.563 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-27T06:24:20.610 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-27T06:24:20.648 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package cephadm. 2024-05-27T06:24:20.665 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../071-cephadm_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:20.706 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking cephadm (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:20.927 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-tempita. 2024-05-27T06:24:20.944 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-27T06:24:20.986 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-27T06:24:21.008 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-27T06:24:21.023 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-27T06:24:21.067 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-27T06:24:21.255 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-paste. 2024-05-27T06:24:21.269 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-27T06:24:21.313 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-27T06:24:21.353 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-27T06:24:21.367 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-27T06:24:21.419 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-27T06:24:21.658 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-27T06:24:21.672 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-27T06:24:21.716 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-27T06:24:22.003 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-27T06:24:22.017 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-27T06:24:22.052 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-27T06:24:22.339 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-webtest. 2024-05-27T06:24:22.341 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-babel. 2024-05-27T06:24:22.353 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-05-27T06:24:22.353 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-27T06:24:22.390 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-27T06:24:22.397 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-27T06:24:22.702 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jinja2. 2024-05-27T06:24:22.708 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pecan. 2024-05-27T06:24:22.715 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-27T06:24:22.722 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-27T06:24:22.760 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-27T06:24:22.791 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-27T06:24:23.097 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-27T06:24:23.109 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3872-g38f9d900-1jammy_all.deb ... 2024-05-27T06:24:23.129 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-certifi. 2024-05-27T06:24:23.143 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-05-27T06:24:23.147 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:23.179 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-27T06:24:23.499 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-27T06:24:23.512 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-05-27T06:24:23.515 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-idna. 2024-05-27T06:24:23.530 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-05-27T06:24:23.549 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-27T06:24:23.574 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-05-27T06:24:23.852 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-routes. 2024-05-27T06:24:23.865 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-27T06:24:23.893 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-urllib3. 2024-05-27T06:24:23.908 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-27T06:24:23.910 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-27T06:24:23.951 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-27T06:24:24.272 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-27T06:24:24.285 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3872-g38f9d900-1jammy_all.deb ... 2024-05-27T06:24:24.297 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-requests. 2024-05-27T06:24:24.311 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-27T06:24:24.330 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:24.354 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-27T06:24:24.649 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-27T06:24:24.663 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-27T06:24:24.707 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-27T06:24:25.027 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-27T06:24:25.041 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3872-g38f9d900-1jammy_all.deb ... 2024-05-27T06:24:25.085 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:25.482 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-27T06:24:25.495 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:25.540 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:25.594 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-27T06:24:25.607 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-27T06:24:25.652 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-27T06:24:25.859 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-27T06:24:25.873 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-27T06:24:25.918 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-27T06:24:26.172 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-joblib. 2024-05-27T06:24:26.185 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-27T06:24:26.222 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-27T06:24:26.245 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-openssl. 2024-05-27T06:24:26.259 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-05-27T06:24:26.303 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-27T06:24:26.550 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-27T06:24:26.563 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-27T06:24:26.573 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr. 2024-05-27T06:24:26.587 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:26.623 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:26.669 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-27T06:24:26.972 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-sklearn. 2024-05-27T06:24:26.985 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-27T06:24:27.018 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mon. 2024-05-27T06:24:27.032 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:27.055 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-27T06:24:27.076 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mon (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:27.663 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-osd. 2024-05-27T06:24:27.674 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:27.681 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-27T06:24:27.694 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3872-g38f9d900-1jammy_all.deb ... 2024-05-27T06:24:27.714 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-osd (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:27.731 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:28.534 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph. 2024-05-27T06:24:28.548 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../068-ceph_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:28.593 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:28.692 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cachetools. 2024-05-27T06:24:28.707 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-05-27T06:24:28.785 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-27T06:24:28.945 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-fuse. 2024-05-27T06:24:28.957 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:28.995 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-fuse (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:29.087 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-27T06:24:29.101 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-27T06:24:29.153 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-27T06:24:29.407 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mds. 2024-05-27T06:24:29.419 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:29.456 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mds (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:29.715 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-27T06:24:29.730 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-27T06:24:29.765 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-27T06:24:29.834 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package cephadm. 2024-05-27T06:24:29.846 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../071-cephadm_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:29.876 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking cephadm (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:30.076 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rsa. 2024-05-27T06:24:30.091 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-05-27T06:24:30.134 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-27T06:24:30.204 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-27T06:24:30.216 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-27T06:24:30.253 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-27T06:24:30.447 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-google-auth. 2024-05-27T06:24:30.458 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-05-27T06:24:30.497 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-27T06:24:30.556 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-27T06:24:30.568 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-27T06:24:30.631 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-27T06:24:30.808 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-27T06:24:30.824 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-27T06:24:30.866 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-27T06:24:31.144 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-websocket. 2024-05-27T06:24:31.159 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-05-27T06:24:31.202 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-27T06:24:31.548 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-27T06:24:31.561 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-27T06:24:31.605 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-27T06:24:31.844 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-babel. 2024-05-27T06:24:31.856 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-27T06:24:31.894 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-27T06:24:32.230 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-jinja2. 2024-05-27T06:24:32.236 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-27T06:24:32.242 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-27T06:24:32.248 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3872-g38f9d900-1jammy_all.deb ... 2024-05-27T06:24:32.280 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-27T06:24:32.310 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:32.614 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-27T06:24:32.626 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-27T06:24:32.633 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-27T06:24:32.645 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3872-g38f9d900-1jammy_all.deb ... 2024-05-27T06:24:32.663 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-27T06:24:32.683 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:32.975 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-27T06:24:32.987 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-27T06:24:33.025 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-27T06:24:33.053 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-27T06:24:33.065 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-05-27T06:24:33.103 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-27T06:24:33.311 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package jq. 2024-05-27T06:24:33.323 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-27T06:24:33.360 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-27T06:24:33.364 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-routes. 2024-05-27T06:24:33.376 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-27T06:24:33.439 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-27T06:24:33.638 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package socat. 2024-05-27T06:24:33.650 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-27T06:24:33.690 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-27T06:24:33.734 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-27T06:24:33.746 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3872-g38f9d900-1jammy_all.deb ... 2024-05-27T06:24:33.775 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:34.016 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package xmlstarlet. 2024-05-27T06:24:34.029 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-27T06:24:34.066 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-27T06:24:34.454 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-test. 2024-05-27T06:24:34.466 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:34.512 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-test (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:35.072 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-27T06:24:35.084 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-27T06:24:35.122 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-27T06:24:35.800 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-joblib. 2024-05-27T06:24:35.815 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-27T06:24:35.858 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-27T06:24:36.245 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-27T06:24:36.258 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-27T06:24:36.380 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-27T06:24:36.708 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-sklearn. 2024-05-27T06:24:36.716 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-volume. 2024-05-27T06:24:36.721 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-27T06:24:36.731 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3872-g38f9d900-1jammy_all.deb ... 2024-05-27T06:24:36.758 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-27T06:24:36.800 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-volume (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:37.262 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-27T06:24:37.275 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:37.328 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking cephfs-mirror (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:37.476 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-27T06:24:37.489 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3872-g38f9d900-1jammy_all.deb ... 2024-05-27T06:24:37.525 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:37.715 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-colorama. 2024-05-27T06:24:37.728 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-05-27T06:24:37.790 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-05-27T06:24:38.051 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package cephfs-shell. 2024-05-27T06:24:38.067 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3872-g38f9d900-1jammy_all.deb ... 2024-05-27T06:24:38.109 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking cephfs-shell (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:38.395 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package cephfs-top. 2024-05-27T06:24:38.409 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3872-g38f9d900-1jammy_all.deb ... 2024-05-27T06:24:38.461 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking cephfs-top (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:38.537 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-cachetools. 2024-05-27T06:24:38.554 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-05-27T06:24:38.595 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-27T06:24:38.798 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-27T06:24:38.812 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:38.839 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-27T06:24:38.854 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-27T06:24:38.864 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libcephfs-dev (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:38.914 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-27T06:24:39.226 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-27T06:24:39.240 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-27T06:24:39.250 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-27T06:24:39.265 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-27T06:24:39.284 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-27T06:24:39.317 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-27T06:24:39.612 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-rsa. 2024-05-27T06:24:39.627 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-05-27T06:24:39.670 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-27T06:24:39.885 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-27T06:24:39.900 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-05-27T06:24:39.954 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-27T06:24:39.999 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-google-auth. 2024-05-27T06:24:40.014 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-05-27T06:24:40.057 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-27T06:24:40.292 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package nvme-cli. 2024-05-27T06:24:40.306 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-27T06:24:40.341 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-27T06:24:40.419 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-27T06:24:40.434 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-27T06:24:40.477 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-27T06:24:40.747 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package pkg-config. 2024-05-27T06:24:40.762 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-27T06:24:40.788 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-websocket. 2024-05-27T06:24:40.803 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-05-27T06:24:40.805 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-27T06:24:40.876 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-27T06:24:41.066 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-27T06:24:41.080 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-27T06:24:41.157 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-27T06:24:41.391 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-27T06:24:41.406 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-27T06:24:41.441 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-27T06:24:41.594 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-27T06:24:41.608 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-27T06:24:41.652 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-27T06:24:41.963 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pastescript. 2024-05-27T06:24:41.985 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-05-27T06:24:42.029 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-27T06:24:42.146 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-27T06:24:42.160 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3872-g38f9d900-1jammy_all.deb ... 2024-05-27T06:24:42.204 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:42.341 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pluggy. 2024-05-27T06:24:42.355 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-27T06:24:42.399 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-27T06:24:42.507 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-27T06:24:42.521 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-27T06:24:42.565 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-27T06:24:42.711 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-psutil. 2024-05-27T06:24:42.725 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-27T06:24:42.769 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-27T06:24:42.927 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-27T06:24:42.941 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-27T06:24:42.977 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-27T06:24:43.122 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-py. 2024-05-27T06:24:43.136 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-05-27T06:24:43.180 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-27T06:24:43.188 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package jq. 2024-05-27T06:24:43.202 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-27T06:24:43.237 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-27T06:24:43.508 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pygments. 2024-05-27T06:24:43.523 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-27T06:24:43.524 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package socat. 2024-05-27T06:24:43.538 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-27T06:24:43.566 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-27T06:24:43.582 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-27T06:24:43.885 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package xmlstarlet. 2024-05-27T06:24:43.899 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-27T06:24:43.943 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-27T06:24:44.112 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-27T06:24:44.125 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-27T06:24:44.178 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-27T06:24:44.322 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-test. 2024-05-27T06:24:44.336 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:44.381 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-test (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:44.558 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-toml. 2024-05-27T06:24:44.570 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-05-27T06:24:44.648 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-27T06:24:45.018 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pytest. 2024-05-27T06:24:45.032 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-27T06:24:45.084 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-27T06:24:45.413 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-simplejson. 2024-05-27T06:24:45.427 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-27T06:24:45.496 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-27T06:24:45.765 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-27T06:24:45.782 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-27T06:24:45.823 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-27T06:24:46.527 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package radosgw. 2024-05-27T06:24:46.541 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../122-radosgw_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:46.585 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking radosgw (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:46.652 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-volume. 2024-05-27T06:24:46.666 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3872-g38f9d900-1jammy_all.deb ... 2024-05-27T06:24:46.709 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-volume (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:47.080 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-27T06:24:47.094 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:47.163 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking cephfs-mirror (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:47.464 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package rbd-fuse. 2024-05-27T06:24:47.479 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:47.491 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-colorama. 2024-05-27T06:24:47.506 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-05-27T06:24:47.522 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking rbd-fuse (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:47.549 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-05-27T06:24:47.790 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-27T06:24:47.844 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package cephfs-shell. 2024-05-27T06:24:47.858 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3872-g38f9d900-1jammy_all.deb ... 2024-05-27T06:24:47.902 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking cephfs-shell (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:48.077 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-27T06:24:48.171 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package cephfs-top. 2024-05-27T06:24:48.186 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3872-g38f9d900-1jammy_all.deb ... 2024-05-27T06:24:48.221 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking cephfs-top (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:48.253 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-27T06:24:48.440 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-27T06:24:48.455 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:48.507 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libcephfs-dev (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:48.542 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-27T06:24:48.809 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-27T06:24:48.824 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-27T06:24:48.868 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-27T06:24:48.951 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-27T06:24:49.247 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-27T06:24:49.262 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-05-27T06:24:49.305 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-27T06:24:49.609 INFO:teuthology.orchestra.run.smithi087.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-27T06:24:49.651 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package nvme-cli. 2024-05-27T06:24:49.667 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-27T06:24:49.684 INFO:teuthology.orchestra.run.smithi087.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-05-27T06:24:49.734 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-27T06:24:49.956 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up cephadm (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:50.131 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package pkg-config. 2024-05-27T06:24:50.145 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-27T06:24:50.188 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-27T06:24:50.433 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-27T06:24:50.448 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-27T06:24:50.466 INFO:teuthology.orchestra.run.smithi087.stdout:Adding system user cephadm....done 2024-05-27T06:24:50.483 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-27T06:24:50.628 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-27T06:24:50.878 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-27T06:24:50.894 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-27T06:24:50.928 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-27T06:24:50.940 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-27T06:24:51.208 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-27T06:24:51.359 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-27T06:24:51.397 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pastescript. 2024-05-27T06:24:51.412 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-05-27T06:24:51.455 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-27T06:24:51.668 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-27T06:24:51.809 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pluggy. 2024-05-27T06:24:51.824 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-27T06:24:51.867 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-27T06:24:51.936 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-27T06:24:52.062 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-27T06:24:52.178 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-psutil. 2024-05-27T06:24:52.193 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-27T06:24:52.236 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-27T06:24:52.380 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-27T06:24:52.589 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-py. 2024-05-27T06:24:52.604 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-05-27T06:24:52.647 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-27T06:24:52.749 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-27T06:24:53.009 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pygments. 2024-05-27T06:24:53.024 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-27T06:24:53.025 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-05-27T06:24:53.067 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-27T06:24:53.318 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-27T06:24:53.529 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-27T06:24:53.543 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-27T06:24:53.587 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-27T06:24:53.661 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-27T06:24:53.940 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-toml. 2024-05-27T06:24:53.953 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-05-27T06:24:53.998 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-27T06:24:54.012 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-27T06:24:54.305 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-27T06:24:54.318 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pytest. 2024-05-27T06:24:54.332 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-27T06:24:54.368 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-27T06:24:54.573 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-27T06:24:54.704 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-simplejson. 2024-05-27T06:24:54.718 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-27T06:24:54.763 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-27T06:24:54.840 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-ceph-argparse (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:55.048 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-27T06:24:55.063 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-27T06:24:55.107 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-27T06:24:55.158 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-27T06:24:55.317 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-27T06:24:55.468 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-05-27T06:24:55.761 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-27T06:24:55.778 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package radosgw. 2024-05-27T06:24:55.791 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../122-radosgw_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:55.835 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking radosgw (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:55.887 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-27T06:24:56.188 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-27T06:24:56.590 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-27T06:24:56.618 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-27T06:24:56.699 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-27T06:24:56.722 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package rbd-fuse. 2024-05-27T06:24:56.737 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3872-g38f9d900-1jammy_amd64.deb ... 2024-05-27T06:24:56.780 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking rbd-fuse (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:56.875 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-27T06:24:57.090 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-27T06:24:57.285 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-27T06:24:57.352 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-27T06:24:57.436 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-27T06:24:57.461 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-27T06:24:57.695 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-27T06:24:57.745 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-27T06:24:58.021 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-27T06:24:58.108 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-27T06:24:58.339 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up zip (3.0-12build2) ... 2024-05-27T06:24:58.473 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-27T06:24:58.655 INFO:teuthology.orchestra.run.smithi149.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-27T06:24:58.692 INFO:teuthology.orchestra.run.smithi149.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-05-27T06:24:58.738 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up cephadm (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:24:59.184 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-27T06:24:59.289 INFO:teuthology.orchestra.run.smithi149.stdout:Adding system user cephadm....done 2024-05-27T06:24:59.410 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-27T06:24:59.476 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-27T06:24:59.627 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-27T06:24:59.678 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-27T06:24:59.778 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-27T06:24:59.921 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-27T06:25:00.047 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-27T06:25:00.112 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-27T06:25:00.331 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-27T06:25:00.608 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-27T06:25:00.725 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-27T06:25:00.897 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-27T06:25:01.035 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-27T06:25:01.249 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-27T06:25:01.387 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-27T06:25:01.651 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-27T06:25:01.673 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-05-27T06:25:01.949 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-27T06:25:01.952 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-05-27T06:25:02.250 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-27T06:25:02.278 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-27T06:25:02.485 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-27T06:25:02.646 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-27T06:25:02.736 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-27T06:25:02.964 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-27T06:25:03.029 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-27T06:25:03.090 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-ceph-common (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:03.297 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-ceph-argparse (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:03.417 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-05-27T06:25:03.573 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-27T06:25:03.708 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-27T06:25:03.776 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-27T06:25:03.833 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-05-27T06:25:04.093 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-27T06:25:04.244 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-27T06:25:04.529 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-27T06:25:04.937 INFO:teuthology.orchestra.run.smithi149.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-27T06:25:04.992 INFO:teuthology.orchestra.run.smithi149.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-27T06:25:05.057 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-27T06:25:05.173 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-27T06:25:05.218 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-27T06:25:05.308 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-27T06:25:05.442 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-27T06:25:05.593 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-27T06:25:05.694 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-27T06:25:05.760 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-27T06:25:05.886 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-27T06:25:05.961 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-27T06:25:06.012 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-27T06:25:06.229 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-27T06:25:06.372 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-27T06:25:06.572 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up zip (3.0-12build2) ... 2024-05-27T06:25:06.657 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-27T06:25:06.764 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-27T06:25:06.907 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-27T06:25:07.033 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-27T06:25:07.351 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-27T06:25:07.475 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-27T06:25:07.627 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-27T06:25:07.743 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-27T06:25:07.894 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-27T06:25:07.912 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-27T06:25:08.070 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-27T06:25:08.188 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-27T06:25:08.413 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-27T06:25:08.455 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-27T06:25:08.723 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-27T06:25:08.839 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-27T06:25:08.840 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-27T06:25:09.115 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-27T06:25:09.134 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-27T06:25:09.259 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-27T06:25:09.508 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-27T06:25:09.569 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-27T06:25:09.810 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-05-27T06:25:09.912 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-27T06:25:10.144 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-27T06:25:10.188 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-27T06:25:10.313 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-27T06:25:10.440 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-27T06:25:10.521 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-27T06:25:10.545 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-27T06:25:10.783 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-27T06:25:10.822 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-27T06:25:10.909 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-27T06:25:10.947 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-ceph-common (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:11.292 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-05-27T06:25:11.318 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-27T06:25:11.619 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-27T06:25:11.660 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-27T06:25:11.770 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-27T06:25:12.063 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-27T06:25:12.189 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-27T06:25:12.507 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-27T06:25:12.825 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-27T06:25:12.882 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-27T06:25:13.117 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-27T06:25:13.118 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-27T06:25:13.260 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-27T06:25:13.354 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-27T06:25:13.536 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-27T06:25:13.630 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-27T06:25:13.662 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-27T06:25:13.788 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-27T06:25:13.881 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-27T06:25:14.131 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-27T06:25:14.141 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-27T06:25:14.399 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-27T06:25:14.567 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-27T06:25:14.683 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-27T06:25:14.826 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-27T06:25:14.860 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-27T06:25:15.169 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-27T06:25:15.221 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-27T06:25:15.330 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librados2 (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:15.439 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:15.445 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-27T06:25:15.566 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-27T06:25:15.738 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-27T06:25:15.927 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libcephfs2 (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:16.053 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libradosstriper1 (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:16.056 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-27T06:25:16.179 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-27T06:25:16.332 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-27T06:25:16.480 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librbd1 (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:16.598 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-modules-core (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:16.617 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-27T06:25:16.707 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-fuse (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:16.751 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-27T06:25:16.942 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-27T06:25:16.942 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-27T06:25:17.019 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-27T06:25:17.169 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-27T06:25:17.471 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-27T06:25:17.558 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libcephfs-dev (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:17.718 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rados (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:17.805 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-27T06:25:17.843 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librgw2 (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:17.969 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up cephfs-top (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:18.081 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-27T06:25:18.095 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-27T06:25:18.224 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-27T06:25:18.350 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-27T06:25:18.472 INFO:teuthology.orchestra.run.smithi149.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-27T06:25:18.719 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-27T06:25:18.870 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-27T06:25:19.288 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-27T06:25:19.399 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rbd (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:19.525 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up rbd-fuse (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:19.580 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-27T06:25:19.660 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rgw (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:19.757 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-27T06:25:19.785 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cephfs (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:19.911 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up cephfs-shell (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:20.038 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-common (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:20.041 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-27T06:25:20.183 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-27T06:25:20.535 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-27T06:25:20.565 INFO:teuthology.orchestra.run.smithi087.stdout:Adding group ceph....done 2024-05-27T06:25:20.870 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-27T06:25:21.016 INFO:teuthology.orchestra.run.smithi087.stdout:Adding system user ceph....done 2024-05-27T06:25:21.179 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-27T06:25:21.260 INFO:teuthology.orchestra.run.smithi087.stdout:Setting system user ceph properties....done 2024-05-27T06:25:21.275 INFO:teuthology.orchestra.run.smithi087.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-27T06:25:21.416 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-27T06:25:21.418 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-27T06:25:21.717 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-27T06:25:21.803 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-27T06:25:22.193 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-27T06:25:22.496 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up cephfs-mirror (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:22.511 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-27T06:25:22.704 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-27T06:25:22.704 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-27T06:25:22.938 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-27T06:25:23.256 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-27T06:25:23.298 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-test (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:23.399 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up radosgw (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:23.617 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-27T06:25:23.759 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up librados2 (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:23.906 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-27T06:25:23.906 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-27T06:25:23.910 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:24.061 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-27T06:25:24.481 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libcephfs2 (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:24.542 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-base (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:24.632 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libradosstriper1 (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:24.758 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-27T06:25:24.925 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-27T06:25:25.093 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up librbd1 (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:25.244 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr-modules-core (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:25.395 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-fuse (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:25.610 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mds (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:25.646 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-27T06:25:25.646 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-27T06:25:25.868 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-27T06:25:25.868 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-27T06:25:26.305 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libcephfs-dev (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:26.456 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-rados (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:26.514 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:26.607 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up librgw2 (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:26.741 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up cephfs-top (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:26.744 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-27T06:25:26.744 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-27T06:25:26.901 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-27T06:25:27.393 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-osd (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:27.709 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-27T06:25:27.709 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-27T06:25:28.230 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-rbd (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:28.335 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:28.372 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up rbd-fuse (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:28.462 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:28.498 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-rgw (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:28.604 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mon (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:28.632 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-cephfs (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:28.804 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-27T06:25:28.805 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-27T06:25:28.833 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up cephfs-shell (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:28.985 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-common (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:29.447 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-cephadm (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:29.623 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:29.638 INFO:teuthology.orchestra.run.smithi149.stdout:Adding group ceph....done 2024-05-27T06:25:29.774 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-dashboard (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:29.950 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-volume (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:30.008 INFO:teuthology.orchestra.run.smithi149.stdout:Adding system user ceph....done 2024-05-27T06:25:30.191 INFO:teuthology.orchestra.run.smithi149.stdout:Setting system user ceph properties....done 2024-05-27T06:25:30.212 INFO:teuthology.orchestra.run.smithi149.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-27T06:25:30.328 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-27T06:25:30.354 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-27T06:25:30.437 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-27T06:25:30.605 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-27T06:25:30.739 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-27T06:25:31.444 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up cephfs-mirror (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:31.669 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-27T06:25:31.670 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-27T06:25:31.931 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-27T06:25:32.430 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-test (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:32.581 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up radosgw (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:32.636 INFO:teuthology.orchestra.run.smithi087.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-27T06:25:32.641 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-27T06:25:32.715 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-05-27T06:25:32.890 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2024-05-27T06:25:32.891 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2024-05-27T06:25:33.065 INFO:teuthology.orchestra.run.smithi087.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-05-27T06:25:33.065 INFO:teuthology.orchestra.run.smithi087.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-05-27T06:25:33.065 INFO:teuthology.orchestra.run.smithi087.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-05-27T06:25:33.065 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages were automatically installed and are no longer required: 2024-05-27T06:25:33.065 INFO:teuthology.orchestra.run.smithi087.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-27T06:25:33.065 INFO:teuthology.orchestra.run.smithi087.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-27T06:25:33.065 INFO:teuthology.orchestra.run.smithi087.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-27T06:25:33.065 INFO:teuthology.orchestra.run.smithi087.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-27T06:25:33.066 INFO:teuthology.orchestra.run.smithi087.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-27T06:25:33.066 INFO:teuthology.orchestra.run.smithi087.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-27T06:25:33.067 INFO:teuthology.orchestra.run.smithi087.stdout:The following additional packages will be installed: 2024-05-27T06:25:33.067 INFO:teuthology.orchestra.run.smithi087.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-05-27T06:25:33.067 INFO:teuthology.orchestra.run.smithi087.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-05-27T06:25:33.067 INFO:teuthology.orchestra.run.smithi087.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-05-27T06:25:33.067 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-05-27T06:25:33.067 INFO:teuthology.orchestra.run.smithi087.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-27T06:25:33.068 INFO:teuthology.orchestra.run.smithi087.stdout:Suggested packages: 2024-05-27T06:25:33.068 INFO:teuthology.orchestra.run.smithi087.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-05-27T06:25:33.068 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-05-27T06:25:33.069 INFO:teuthology.orchestra.run.smithi087.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-05-27T06:25:33.123 INFO:teuthology.orchestra.run.smithi087.stdout:The following NEW packages will be installed: 2024-05-27T06:25:33.124 INFO:teuthology.orchestra.run.smithi087.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-05-27T06:25:33.124 INFO:teuthology.orchestra.run.smithi087.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-05-27T06:25:33.124 INFO:teuthology.orchestra.run.smithi087.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-05-27T06:25:33.124 INFO:teuthology.orchestra.run.smithi087.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-05-27T06:25:33.124 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-05-27T06:25:33.124 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-05-27T06:25:33.124 INFO:teuthology.orchestra.run.smithi087.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-27T06:25:33.125 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages will be upgraded: 2024-05-27T06:25:33.126 INFO:teuthology.orchestra.run.smithi087.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-05-27T06:25:33.157 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-27T06:25:33.157 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-27T06:25:33.212 INFO:teuthology.orchestra.run.smithi087.stdout:4 upgraded, 39 newly installed, 0 to remove and 306 not upgraded. 2024-05-27T06:25:33.212 INFO:teuthology.orchestra.run.smithi087.stdout:Need to get 55.7 MB of archives. 2024-05-27T06:25:33.212 INFO:teuthology.orchestra.run.smithi087.stdout:After this operation, 202 MB of additional disk space will be used. 2024-05-27T06:25:33.212 INFO:teuthology.orchestra.run.smithi087.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-05-27T06:25:33.394 INFO:teuthology.orchestra.run.smithi087.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-05-27T06:25:33.399 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-05-27T06:25:33.432 INFO:teuthology.orchestra.run.smithi087.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-05-27T06:25:33.433 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-05-27T06:25:33.433 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-05-27T06:25:33.441 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-05-27T06:25:33.442 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-05-27T06:25:33.444 INFO:teuthology.orchestra.run.smithi087.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-05-27T06:25:33.445 INFO:teuthology.orchestra.run.smithi087.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-05-27T06:25:33.445 INFO:teuthology.orchestra.run.smithi087.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-05-27T06:25:33.446 INFO:teuthology.orchestra.run.smithi087.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-05-27T06:25:33.457 INFO:teuthology.orchestra.run.smithi087.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-05-27T06:25:33.458 INFO:teuthology.orchestra.run.smithi087.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-05-27T06:25:33.458 INFO:teuthology.orchestra.run.smithi087.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-05-27T06:25:33.478 INFO:teuthology.orchestra.run.smithi087.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-05-27T06:25:33.759 INFO:teuthology.orchestra.run.smithi087.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-05-27T06:25:33.761 INFO:teuthology.orchestra.run.smithi087.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-05-27T06:25:33.761 INFO:teuthology.orchestra.run.smithi087.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-05-27T06:25:33.763 INFO:teuthology.orchestra.run.smithi087.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-05-27T06:25:33.764 INFO:teuthology.orchestra.run.smithi087.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-05-27T06:25:33.768 INFO:teuthology.orchestra.run.smithi087.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-05-27T06:25:33.770 INFO:teuthology.orchestra.run.smithi087.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-05-27T06:25:33.777 INFO:teuthology.orchestra.run.smithi087.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-05-27T06:25:33.778 INFO:teuthology.orchestra.run.smithi087.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-05-27T06:25:33.801 INFO:teuthology.orchestra.run.smithi087.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-05-27T06:25:33.811 INFO:teuthology.orchestra.run.smithi087.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-05-27T06:25:33.822 INFO:teuthology.orchestra.run.smithi087.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-05-27T06:25:33.849 INFO:teuthology.orchestra.run.smithi087.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-05-27T06:25:33.853 INFO:teuthology.orchestra.run.smithi087.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-05-27T06:25:33.853 INFO:teuthology.orchestra.run.smithi087.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-05-27T06:25:33.854 INFO:teuthology.orchestra.run.smithi087.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-05-27T06:25:33.855 INFO:teuthology.orchestra.run.smithi087.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-05-27T06:25:33.866 INFO:teuthology.orchestra.run.smithi087.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-05-27T06:25:33.869 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-base (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:33.874 INFO:teuthology.orchestra.run.smithi087.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-05-27T06:25:34.098 INFO:teuthology.orchestra.run.smithi087.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-05-27T06:25:34.099 INFO:teuthology.orchestra.run.smithi087.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-05-27T06:25:34.099 INFO:teuthology.orchestra.run.smithi087.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-05-27T06:25:34.099 INFO:teuthology.orchestra.run.smithi087.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-05-27T06:25:34.100 INFO:teuthology.orchestra.run.smithi087.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-05-27T06:25:34.100 INFO:teuthology.orchestra.run.smithi087.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-05-27T06:25:34.116 INFO:teuthology.orchestra.run.smithi087.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-05-27T06:25:34.116 INFO:teuthology.orchestra.run.smithi087.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-05-27T06:25:34.430 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-27T06:25:34.494 INFO:teuthology.orchestra.run.smithi087.stdout:Preconfiguring packages ... 2024-05-27T06:25:34.654 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 55.7 MB in 1s (56.7 MB/s) 2024-05-27T06:25:34.966 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140920 files and directories currently installed.) 2024-05-27T06:25:34.970 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-27T06:25:35.154 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-27T06:25:35.220 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mds (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:35.728 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-05-27T06:25:35.878 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-27T06:25:35.879 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-27T06:25:36.539 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:36.769 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-27T06:25:36.769 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-27T06:25:36.806 INFO:teuthology.orchestra.run.smithi087.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-05-27T06:25:37.074 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package flex. 2024-05-27T06:25:37.143 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140920 files and directories currently installed.) 2024-05-27T06:25:37.146 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-05-27T06:25:37.206 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking flex (2.6.4-8build2) ... 2024-05-27T06:25:37.416 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-osd (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:37.650 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-27T06:25:37.751 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-27T06:25:37.751 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-27T06:25:37.928 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-05-27T06:25:38.294 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-27T06:25:38.426 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:38.602 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:38.770 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mon (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:38.882 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140993 files and directories currently installed.) 2024-05-27T06:25:38.885 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-27T06:25:38.995 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-27T06:25:38.995 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-27T06:25:39.010 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-27T06:25:39.439 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-27T06:25:39.592 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-27T06:25:39.646 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr-cephadm (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:39.830 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:39.907 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-27T06:25:39.973 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr-dashboard (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:40.116 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-volume (19.0.0-3872-g38f9d900-1jammy) ... 2024-05-27T06:25:40.317 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package bison. 2024-05-27T06:25:40.393 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140993 files and directories currently installed.) 2024-05-27T06:25:40.397 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-05-27T06:25:40.444 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-05-27T06:25:40.502 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-27T06:25:40.628 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-27T06:25:40.805 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-27T06:25:40.828 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-27T06:25:40.842 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-05-27T06:25:40.886 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-05-27T06:25:41.222 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package dump. 2024-05-27T06:25:41.237 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-05-27T06:25:41.280 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking dump (0.4b47-3) ... 2024-05-27T06:25:41.568 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package indent. 2024-05-27T06:25:41.580 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-27T06:25:41.583 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-05-27T06:25:41.626 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-27T06:25:41.845 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-27T06:25:41.860 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-05-27T06:25:41.894 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-27T06:25:42.282 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-27T06:25:42.298 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-05-27T06:25:42.338 INFO:teuthology.orchestra.run.smithi149.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-27T06:25:42.342 DEBUG:teuthology.orchestra.run.smithi149:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-27T06:25:42.348 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-27T06:25:42.416 INFO:teuthology.orchestra.run.smithi149.stdout:Reading package lists... 2024-05-27T06:25:42.595 INFO:teuthology.orchestra.run.smithi149.stdout:Building dependency tree... 2024-05-27T06:25:42.596 INFO:teuthology.orchestra.run.smithi149.stdout:Reading state information... 2024-05-27T06:25:42.661 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-27T06:25:42.677 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-05-27T06:25:42.728 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-05-27T06:25:42.769 INFO:teuthology.orchestra.run.smithi149.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-05-27T06:25:42.769 INFO:teuthology.orchestra.run.smithi149.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-05-27T06:25:42.769 INFO:teuthology.orchestra.run.smithi149.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-05-27T06:25:42.769 INFO:teuthology.orchestra.run.smithi149.stdout:The following packages were automatically installed and are no longer required: 2024-05-27T06:25:42.769 INFO:teuthology.orchestra.run.smithi149.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-27T06:25:42.769 INFO:teuthology.orchestra.run.smithi149.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-27T06:25:42.769 INFO:teuthology.orchestra.run.smithi149.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-27T06:25:42.770 INFO:teuthology.orchestra.run.smithi149.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-27T06:25:42.770 INFO:teuthology.orchestra.run.smithi149.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-27T06:25:42.770 INFO:teuthology.orchestra.run.smithi149.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-27T06:25:42.770 INFO:teuthology.orchestra.run.smithi149.stdout:The following additional packages will be installed: 2024-05-27T06:25:42.771 INFO:teuthology.orchestra.run.smithi149.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-05-27T06:25:42.771 INFO:teuthology.orchestra.run.smithi149.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-05-27T06:25:42.771 INFO:teuthology.orchestra.run.smithi149.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-05-27T06:25:42.771 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-05-27T06:25:42.771 INFO:teuthology.orchestra.run.smithi149.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-27T06:25:42.772 INFO:teuthology.orchestra.run.smithi149.stdout:Suggested packages: 2024-05-27T06:25:42.772 INFO:teuthology.orchestra.run.smithi149.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-05-27T06:25:42.773 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-05-27T06:25:42.773 INFO:teuthology.orchestra.run.smithi149.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-05-27T06:25:42.827 INFO:teuthology.orchestra.run.smithi149.stdout:The following NEW packages will be installed: 2024-05-27T06:25:42.828 INFO:teuthology.orchestra.run.smithi149.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-05-27T06:25:42.828 INFO:teuthology.orchestra.run.smithi149.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-05-27T06:25:42.829 INFO:teuthology.orchestra.run.smithi149.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-05-27T06:25:42.829 INFO:teuthology.orchestra.run.smithi149.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-05-27T06:25:42.829 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-05-27T06:25:42.829 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-05-27T06:25:42.829 INFO:teuthology.orchestra.run.smithi149.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-27T06:25:42.830 INFO:teuthology.orchestra.run.smithi149.stdout:The following packages will be upgraded: 2024-05-27T06:25:42.830 INFO:teuthology.orchestra.run.smithi149.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-05-27T06:25:43.015 INFO:teuthology.orchestra.run.smithi149.stdout:4 upgraded, 39 newly installed, 0 to remove and 306 not upgraded. 2024-05-27T06:25:43.015 INFO:teuthology.orchestra.run.smithi149.stdout:Need to get 55.7 MB of archives. 2024-05-27T06:25:43.015 INFO:teuthology.orchestra.run.smithi149.stdout:After this operation, 202 MB of additional disk space will be used. 2024-05-27T06:25:43.015 INFO:teuthology.orchestra.run.smithi149.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-05-27T06:25:43.098 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libfl2:amd64. 2024-05-27T06:25:43.113 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-05-27T06:25:43.156 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-05-27T06:25:43.408 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-05-27T06:25:43.424 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-05-27T06:25:43.466 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-27T06:25:43.658 INFO:teuthology.orchestra.run.smithi149.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-05-27T06:25:43.674 INFO:teuthology.orchestra.run.smithi149.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-05-27T06:25:43.794 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libjson-perl. 2024-05-27T06:25:43.799 INFO:teuthology.orchestra.run.smithi149.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-05-27T06:25:43.800 INFO:teuthology.orchestra.run.smithi149.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-05-27T06:25:43.801 INFO:teuthology.orchestra.run.smithi149.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-05-27T06:25:43.810 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-05-27T06:25:43.830 INFO:teuthology.orchestra.run.smithi149.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-05-27T06:25:43.831 INFO:teuthology.orchestra.run.smithi149.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-05-27T06:25:43.835 INFO:teuthology.orchestra.run.smithi149.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-05-27T06:25:43.837 INFO:teuthology.orchestra.run.smithi149.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-05-27T06:25:43.837 INFO:teuthology.orchestra.run.smithi149.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-05-27T06:25:43.861 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-05-27T06:25:44.003 INFO:teuthology.orchestra.run.smithi149.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-05-27T06:25:44.214 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libllvm14:amd64. 2024-05-27T06:25:44.230 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-05-27T06:25:44.272 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-27T06:25:44.295 INFO:teuthology.orchestra.run.smithi149.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-05-27T06:25:44.306 INFO:teuthology.orchestra.run.smithi149.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-05-27T06:25:44.311 INFO:teuthology.orchestra.run.smithi149.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-05-27T06:25:44.395 INFO:teuthology.orchestra.run.smithi149.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-05-27T06:25:45.369 INFO:teuthology.orchestra.run.smithi149.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-05-27T06:25:45.371 INFO:teuthology.orchestra.run.smithi149.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-05-27T06:25:45.371 INFO:teuthology.orchestra.run.smithi149.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-05-27T06:25:45.398 INFO:teuthology.orchestra.run.smithi149.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-05-27T06:25:45.398 INFO:teuthology.orchestra.run.smithi149.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-05-27T06:25:45.403 INFO:teuthology.orchestra.run.smithi149.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-05-27T06:25:45.568 INFO:teuthology.orchestra.run.smithi149.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-05-27T06:25:45.700 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-27T06:25:45.716 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-27T06:25:45.767 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-27T06:25:46.053 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-27T06:25:46.068 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-27T06:25:46.103 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-27T06:25:46.173 INFO:teuthology.orchestra.run.smithi149.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-05-27T06:25:46.173 INFO:teuthology.orchestra.run.smithi149.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-05-27T06:25:46.353 INFO:teuthology.orchestra.run.smithi149.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-05-27T06:25:46.353 INFO:teuthology.orchestra.run.smithi149.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-05-27T06:25:46.392 INFO:teuthology.orchestra.run.smithi149.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-05-27T06:25:46.430 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-27T06:25:46.446 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-27T06:25:46.449 INFO:teuthology.orchestra.run.smithi149.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-05-27T06:25:46.455 INFO:teuthology.orchestra.run.smithi149.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-05-27T06:25:46.455 INFO:teuthology.orchestra.run.smithi149.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-05-27T06:25:46.456 INFO:teuthology.orchestra.run.smithi149.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-05-27T06:25:46.457 INFO:teuthology.orchestra.run.smithi149.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-05-27T06:25:46.488 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-27T06:25:46.662 INFO:teuthology.orchestra.run.smithi149.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-05-27T06:25:46.816 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-27T06:25:46.832 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-05-27T06:25:46.874 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-27T06:25:47.087 INFO:teuthology.orchestra.run.smithi149.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-05-27T06:25:47.244 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-27T06:25:47.260 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-05-27T06:25:47.302 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-27T06:25:47.605 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-27T06:25:47.621 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-27T06:25:47.655 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-27T06:25:47.837 INFO:teuthology.orchestra.run.smithi149.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-05-27T06:25:47.837 INFO:teuthology.orchestra.run.smithi149.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-05-27T06:25:47.837 INFO:teuthology.orchestra.run.smithi149.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-05-27T06:25:47.837 INFO:teuthology.orchestra.run.smithi149.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-05-27T06:25:47.837 INFO:teuthology.orchestra.run.smithi149.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-05-27T06:25:47.838 INFO:teuthology.orchestra.run.smithi149.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-05-27T06:25:47.867 INFO:teuthology.orchestra.run.smithi149.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-05-27T06:25:47.868 INFO:teuthology.orchestra.run.smithi149.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-05-27T06:25:47.991 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-27T06:25:48.007 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-27T06:25:48.049 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-27T06:25:48.248 INFO:teuthology.orchestra.run.smithi149.stdout:Preconfiguring packages ... 2024-05-27T06:25:48.344 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-27T06:25:48.359 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-27T06:25:48.402 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-27T06:25:48.414 INFO:teuthology.orchestra.run.smithi149.stdout:Fetched 55.7 MB in 5s (11.1 MB/s) 2024-05-27T06:25:48.637 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-27T06:25:48.653 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-27T06:25:48.687 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-27T06:25:48.702 INFO:teuthology.orchestra.run.smithi149.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140920 files and directories currently installed.) 2024-05-27T06:25:48.706 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-27T06:25:48.880 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-27T06:25:49.208 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-27T06:25:49.223 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-05-27T06:25:49.266 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-05-27T06:25:49.531 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-05-27T06:25:49.627 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package modemmanager. 2024-05-27T06:25:49.643 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-27T06:25:49.685 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-27T06:25:50.417 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package network-manager. 2024-05-27T06:25:50.432 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-05-27T06:25:50.491 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-05-27T06:25:50.636 INFO:teuthology.orchestra.run.smithi149.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-05-27T06:25:50.952 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package flex. 2024-05-27T06:25:51.022 INFO:teuthology.orchestra.run.smithi149.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140920 files and directories currently installed.) 2024-05-27T06:25:51.026 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-05-27T06:25:51.067 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking flex (2.6.4-8build2) ... 2024-05-27T06:25:51.099 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ppp. 2024-05-27T06:25:51.114 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-05-27T06:25:51.487 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-05-27T06:25:51.554 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-27T06:25:51.723 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-05-27T06:25:51.845 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package pptp-linux. 2024-05-27T06:25:51.859 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-05-27T06:25:51.903 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-05-27T06:25:52.114 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-27T06:25:52.128 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-05-27T06:25:52.162 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-27T06:25:52.172 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-05-27T06:25:52.500 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-27T06:25:52.515 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-05-27T06:25:52.558 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql-client-common (238) ... 2024-05-27T06:25:52.879 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql-client-14. 2024-05-27T06:25:52.894 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-27T06:25:52.937 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-27T06:25:53.038 INFO:teuthology.orchestra.run.smithi149.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140993 files and directories currently installed.) 2024-05-27T06:25:53.042 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-27T06:25:53.164 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-27T06:25:53.491 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql-common. 2024-05-27T06:25:53.506 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-05-27T06:25:53.567 INFO:teuthology.orchestra.run.smithi087.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-27T06:25:53.568 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-27T06:25:53.606 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql-common (238) ... 2024-05-27T06:25:53.696 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-27T06:25:53.978 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-27T06:25:54.073 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql-14. 2024-05-27T06:25:54.087 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-27T06:25:54.134 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-27T06:25:54.388 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package bison. 2024-05-27T06:25:54.460 INFO:teuthology.orchestra.run.smithi149.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140993 files and directories currently installed.) 2024-05-27T06:25:54.464 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-05-27T06:25:54.507 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-05-27T06:25:54.982 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-27T06:25:54.997 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-05-27T06:25:55.041 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-05-27T06:25:55.259 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql. 2024-05-27T06:25:55.274 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-05-27T06:25:55.326 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql (14+238) ... 2024-05-27T06:25:55.377 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package dump. 2024-05-27T06:25:55.393 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-05-27T06:25:55.427 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking dump (0.4b47-3) ... 2024-05-27T06:25:55.636 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql-client. 2024-05-27T06:25:55.651 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-05-27T06:25:55.703 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql-client (14+238) ... 2024-05-27T06:25:55.714 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package indent. 2024-05-27T06:25:55.729 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-05-27T06:25:55.772 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-27T06:25:56.005 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-27T06:25:56.020 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-05-27T06:25:56.072 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql-contrib (14+238) ... 2024-05-27T06:25:56.075 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-27T06:25:56.091 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-05-27T06:25:56.134 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-27T06:25:56.429 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-27T06:25:56.440 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package tcl8.6. 2024-05-27T06:25:56.445 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-05-27T06:25:56.456 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-05-27T06:25:56.479 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-27T06:25:56.507 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-27T06:25:56.757 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-27T06:25:56.773 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-05-27T06:25:56.815 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-05-27T06:25:57.143 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libfl2:amd64. 2024-05-27T06:25:57.159 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-05-27T06:25:57.227 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-05-27T06:25:57.326 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package tcl. 2024-05-27T06:25:57.342 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-05-27T06:25:57.398 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-05-27T06:25:57.471 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-05-27T06:25:57.487 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-05-27T06:25:57.521 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-27T06:25:57.740 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libjson-perl. 2024-05-27T06:25:57.746 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package wpasupplicant. 2024-05-27T06:25:57.756 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-05-27T06:25:57.762 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-05-27T06:25:57.798 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-05-27T06:25:57.804 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-27T06:25:58.150 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-27T06:25:58.166 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-05-27T06:25:58.208 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-05-27T06:25:58.270 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libllvm14:amd64. 2024-05-27T06:25:58.286 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-05-27T06:25:58.328 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-27T06:25:58.645 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-27T06:25:58.660 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-05-27T06:25:58.719 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-27T06:25:59.046 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql-client-common (238) ... 2024-05-27T06:25:59.250 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up flex (2.6.4-8build2) ... 2024-05-27T06:25:59.376 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-27T06:25:59.502 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-27T06:25:59.628 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-05-27T06:25:59.698 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-27T06:25:59.714 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-27T06:25:59.748 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-27T06:25:59.787 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-27T06:25:59.913 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-27T06:26:00.000 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-27T06:26:00.016 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-27T06:26:00.075 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-27T06:26:00.411 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-27T06:26:00.427 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-27T06:26:00.469 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-27T06:26:00.839 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-27T06:26:00.855 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-05-27T06:26:00.868 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-27T06:26:00.889 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-27T06:26:00.960 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-27T06:26:01.175 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-27T06:26:01.192 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-05-27T06:26:01.234 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-27T06:26:01.337 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-27T06:26:01.337 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-27T06:26:01.612 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-27T06:26:01.628 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-27T06:26:01.670 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-27T06:26:02.013 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-27T06:26:02.131 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-27T06:26:02.147 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-27T06:26:02.147 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-05-27T06:26:02.189 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-27T06:26:02.273 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-27T06:26:02.416 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-05-27T06:26:02.468 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-27T06:26:02.484 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-27T06:26:02.517 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-27T06:26:02.542 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-05-27T06:26:02.668 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-05-27T06:26:02.795 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-27T06:26:02.802 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-27T06:26:02.810 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-27T06:26:02.853 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-27T06:26:02.919 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-05-27T06:26:03.407 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-27T06:26:03.423 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-05-27T06:26:03.457 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-05-27T06:26:03.583 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-27T06:26:03.709 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up dump (0.4b47-3) ... 2024-05-27T06:26:03.793 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package modemmanager. 2024-05-27T06:26:03.803 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-27T06:26:03.809 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-27T06:26:03.869 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-27T06:26:03.873 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-27T06:26:03.995 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-27T06:26:04.154 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up tcl (8.6.11+1build2) ... 2024-05-27T06:26:04.280 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libjson-perl (4.04000-1) ... 2024-05-27T06:26:04.406 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-05-27T06:26:04.442 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package network-manager. 2024-05-27T06:26:04.458 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-05-27T06:26:04.495 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-05-27T06:26:04.499 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-05-27T06:26:04.557 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-27T06:26:04.666 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-27T06:26:04.843 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-27T06:26:05.010 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-27T06:26:05.136 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-05-27T06:26:05.201 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ppp. 2024-05-27T06:26:05.216 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-05-27T06:26:05.304 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql-client (14+238) ... 2024-05-27T06:26:05.430 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-05-27T06:26:05.572 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-05-27T06:26:05.906 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package pptp-linux. 2024-05-27T06:26:05.921 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-05-27T06:26:05.956 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-05-27T06:26:06.022 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:06.022 INFO:teuthology.orchestra.run.smithi087.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-27T06:26:06.022 INFO:teuthology.orchestra.run.smithi087.stdout:which means they are currently configured by ifupdown: 2024-05-27T06:26:06.022 INFO:teuthology.orchestra.run.smithi087.stdout:- enp3s0f1 2024-05-27T06:26:06.022 INFO:teuthology.orchestra.run.smithi087.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-27T06:26:06.023 INFO:teuthology.orchestra.run.smithi087.stdout:remove their configuration from /etc/network/interfaces. 2024-05-27T06:26:06.023 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:06.154 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-27T06:26:06.192 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-27T06:26:06.207 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-05-27T06:26:06.250 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-05-27T06:26:06.576 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-27T06:26:06.579 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-27T06:26:06.594 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-05-27T06:26:06.637 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking postgresql-client-common (238) ... 2024-05-27T06:26:06.941 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package postgresql-client-14. 2024-05-27T06:26:06.956 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-27T06:26:06.989 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-27T06:26:06.991 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-27T06:26:07.587 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package postgresql-common. 2024-05-27T06:26:07.602 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-05-27T06:26:07.664 INFO:teuthology.orchestra.run.smithi149.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-27T06:26:07.702 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking postgresql-common (238) ... 2024-05-27T06:26:07.874 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-27T06:26:08.025 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-27T06:26:08.168 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-05-27T06:26:08.212 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package postgresql-14. 2024-05-27T06:26:08.226 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-27T06:26:08.273 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-27T06:26:08.302 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql-common (238) ... 2024-05-27T06:26:09.326 INFO:teuthology.orchestra.run.smithi087.stdout:Adding user postgres to group ssl-cert 2024-05-27T06:26:09.423 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package postgresql. 2024-05-27T06:26:09.438 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-05-27T06:26:09.481 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking postgresql (14+238) ... 2024-05-27T06:26:09.565 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:09.565 INFO:teuthology.orchestra.run.smithi087.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-27T06:26:09.742 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package postgresql-client. 2024-05-27T06:26:09.757 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-05-27T06:26:09.792 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking postgresql-client (14+238) ... 2024-05-27T06:26:09.825 INFO:teuthology.orchestra.run.smithi087.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-27T06:26:09.825 INFO:teuthology.orchestra.run.smithi087.stdout:Removing obsolete dictionary files: 2024-05-27T06:26:09.994 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-27T06:26:10.006 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-05-27T06:26:10.044 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking postgresql-contrib (14+238) ... 2024-05-27T06:26:10.389 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package tcl8.6. 2024-05-27T06:26:10.404 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-05-27T06:26:10.446 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-27T06:26:10.499 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-27T06:26:10.741 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package tcl. 2024-05-27T06:26:10.755 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-05-27T06:26:10.803 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-05-27T06:26:11.003 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-27T06:26:11.144 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package wpasupplicant. 2024-05-27T06:26:11.157 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-05-27T06:26:11.202 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-27T06:26:11.334 INFO:teuthology.orchestra.run.smithi087.stdout:Creating new PostgreSQL cluster 14/main ... 2024-05-27T06:26:11.348 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-05-27T06:26:11.403 INFO:teuthology.orchestra.run.smithi087.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-27T06:26:11.403 INFO:teuthology.orchestra.run.smithi087.stdout:This user must also own the server process. 2024-05-27T06:26:11.404 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:11.404 INFO:teuthology.orchestra.run.smithi087.stdout:The database cluster will be initialized with locale "en_US". 2024-05-27T06:26:11.404 INFO:teuthology.orchestra.run.smithi087.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-27T06:26:11.404 INFO:teuthology.orchestra.run.smithi087.stdout:The default text search configuration will be set to "english". 2024-05-27T06:26:11.404 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:11.404 INFO:teuthology.orchestra.run.smithi087.stdout:Data page checksums are disabled. 2024-05-27T06:26:11.404 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:11.404 INFO:teuthology.orchestra.run.smithi087.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-05-27T06:26:11.405 INFO:teuthology.orchestra.run.smithi087.stdout:creating subdirectories ... ok 2024-05-27T06:26:11.405 INFO:teuthology.orchestra.run.smithi087.stdout:selecting dynamic shared memory implementation ... posix 2024-05-27T06:26:11.428 INFO:teuthology.orchestra.run.smithi087.stdout:selecting default max_connections ... 100 2024-05-27T06:26:11.462 INFO:teuthology.orchestra.run.smithi087.stdout:selecting default shared_buffers ... 128MB 2024-05-27T06:26:11.476 INFO:teuthology.orchestra.run.smithi087.stdout:selecting default time zone ... Etc/UTC 2024-05-27T06:26:11.477 INFO:teuthology.orchestra.run.smithi087.stdout:creating configuration files ... ok 2024-05-27T06:26:11.581 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-27T06:26:11.596 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-05-27T06:26:11.641 INFO:teuthology.orchestra.run.smithi087.stdout:running bootstrap script ... ok 2024-05-27T06:26:11.673 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-05-27T06:26:12.160 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-27T06:26:12.174 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-05-27T06:26:12.235 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-27T06:26:12.272 INFO:teuthology.orchestra.run.smithi087.stdout:performing post-bootstrap initialization ... ok 2024-05-27T06:26:12.570 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up postgresql-client-common (238) ... 2024-05-27T06:26:12.782 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up flex (2.6.4-8build2) ... 2024-05-27T06:26:12.834 INFO:teuthology.orchestra.run.smithi087.stdout:syncing data to disk ... ok 2024-05-27T06:26:12.952 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-27T06:26:13.085 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-27T06:26:13.185 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-05-27T06:26:13.303 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-27T06:26:13.334 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-27T06:26:13.821 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-27T06:26:14.777 INFO:teuthology.orchestra.run.smithi149.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-27T06:26:14.869 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-27T06:26:15.264 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-27T06:26:15.265 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-27T06:26:16.005 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-27T06:26:16.131 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-05-27T06:26:16.257 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-27T06:26:16.408 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-05-27T06:26:16.410 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-27T06:26:16.534 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-05-27T06:26:16.536 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql-contrib (14+238) ... 2024-05-27T06:26:16.644 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-05-27T06:26:16.662 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql (14+238) ... 2024-05-27T06:26:16.753 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-27T06:26:16.788 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-27T06:26:16.862 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-05-27T06:26:16.914 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-27T06:26:17.199 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-27T06:26:17.199 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-27T06:26:17.543 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-27T06:26:17.669 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up dump (0.4b47-3) ... 2024-05-27T06:26:17.756 INFO:teuthology.orchestra.run.smithi149.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-27T06:26:17.812 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-27T06:26:17.938 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-27T06:26:17.982 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-27T06:26:18.064 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up tcl (8.6.11+1build2) ... 2024-05-27T06:26:18.075 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-27T06:26:18.210 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libjson-perl (4.04000-1) ... 2024-05-27T06:26:18.341 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-05-27T06:26:18.418 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-27T06:26:18.431 INFO:teuthology.orchestra.run.smithi149.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-05-27T06:26:18.501 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-27T06:26:18.570 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-27T06:26:18.619 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-27T06:26:18.770 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-27T06:26:18.921 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-27T06:26:19.048 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-05-27T06:26:19.224 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up postgresql-client (14+238) ... 2024-05-27T06:26:19.358 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-05-27T06:26:19.981 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:19.982 INFO:teuthology.orchestra.run.smithi149.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-27T06:26:19.982 INFO:teuthology.orchestra.run.smithi149.stdout:which means they are currently configured by ifupdown: 2024-05-27T06:26:19.982 INFO:teuthology.orchestra.run.smithi149.stdout:- enp3s0f1 2024-05-27T06:26:19.982 INFO:teuthology.orchestra.run.smithi149.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-27T06:26:19.982 INFO:teuthology.orchestra.run.smithi149.stdout:remove their configuration from /etc/network/interfaces. 2024-05-27T06:26:19.982 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:19.989 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-05-27T06:26:20.089 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-27T06:26:20.112 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-27T06:26:20.537 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-27T06:26:20.622 INFO:teuthology.orchestra.run.smithi087.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-27T06:26:20.629 DEBUG:teuthology.parallel:result is None 2024-05-27T06:26:20.966 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-27T06:26:21.686 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-27T06:26:21.837 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-27T06:26:21.963 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-05-27T06:26:22.114 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up postgresql-common (238) ... 2024-05-27T06:26:23.124 INFO:teuthology.orchestra.run.smithi149.stdout:Adding user postgres to group ssl-cert 2024-05-27T06:26:23.382 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:23.382 INFO:teuthology.orchestra.run.smithi149.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-27T06:26:23.687 INFO:teuthology.orchestra.run.smithi149.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-27T06:26:23.687 INFO:teuthology.orchestra.run.smithi149.stdout:Removing obsolete dictionary files: 2024-05-27T06:26:24.431 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-27T06:26:24.924 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-27T06:26:25.278 INFO:teuthology.orchestra.run.smithi149.stdout:Creating new PostgreSQL cluster 14/main ... 2024-05-27T06:26:25.297 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-05-27T06:26:25.351 INFO:teuthology.orchestra.run.smithi149.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-27T06:26:25.351 INFO:teuthology.orchestra.run.smithi149.stdout:This user must also own the server process. 2024-05-27T06:26:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:25.351 INFO:teuthology.orchestra.run.smithi149.stdout:The database cluster will be initialized with locale "en_US". 2024-05-27T06:26:25.351 INFO:teuthology.orchestra.run.smithi149.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-27T06:26:25.351 INFO:teuthology.orchestra.run.smithi149.stdout:The default text search configuration will be set to "english". 2024-05-27T06:26:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:25.351 INFO:teuthology.orchestra.run.smithi149.stdout:Data page checksums are disabled. 2024-05-27T06:26:25.351 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:25.352 INFO:teuthology.orchestra.run.smithi149.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-05-27T06:26:25.352 INFO:teuthology.orchestra.run.smithi149.stdout:creating subdirectories ... ok 2024-05-27T06:26:25.352 INFO:teuthology.orchestra.run.smithi149.stdout:selecting dynamic shared memory implementation ... posix 2024-05-27T06:26:25.375 INFO:teuthology.orchestra.run.smithi149.stdout:selecting default max_connections ... 100 2024-05-27T06:26:25.409 INFO:teuthology.orchestra.run.smithi149.stdout:selecting default shared_buffers ... 128MB 2024-05-27T06:26:25.423 INFO:teuthology.orchestra.run.smithi149.stdout:selecting default time zone ... Etc/UTC 2024-05-27T06:26:25.424 INFO:teuthology.orchestra.run.smithi149.stdout:creating configuration files ... ok 2024-05-27T06:26:25.592 INFO:teuthology.orchestra.run.smithi149.stdout:running bootstrap script ... ok 2024-05-27T06:26:26.260 INFO:teuthology.orchestra.run.smithi149.stdout:performing post-bootstrap initialization ... ok 2024-05-27T06:26:26.816 INFO:teuthology.orchestra.run.smithi149.stdout:syncing data to disk ... ok 2024-05-27T06:26:27.352 INFO:teuthology.orchestra.run.smithi149.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-27T06:26:30.457 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-27T06:26:30.591 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up postgresql-contrib (14+238) ... 2024-05-27T06:26:30.701 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up postgresql (14+238) ... 2024-05-27T06:26:30.802 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-27T06:26:30.928 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-27T06:26:31.190 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-27T06:26:31.190 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-27T06:26:31.906 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-27T06:26:32.006 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-27T06:26:32.341 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-27T06:26:32.510 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-27T06:26:34.072 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-05-27T06:26:34.172 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-27T06:26:34.737 INFO:teuthology.orchestra.run.smithi149.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-27T06:26:34.744 DEBUG:teuthology.parallel:result is None 2024-05-27T06:26:34.745 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=38f9d900c83c63799fbdbe61acc9a11b0d3554a6 2024-05-27T06:26:34.898 DEBUG:teuthology.orchestra.run.smithi087:> dpkg-query -W -f '${Version}' ceph 2024-05-27T06:26:34.922 INFO:teuthology.orchestra.run.smithi087.stdout:19.0.0-3872-g38f9d900-1jammy 2024-05-27T06:26:34.923 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3872-g38f9d900-1jammy 2024-05-27T06:26:34.923 INFO:teuthology.task.install:The correct ceph version 19.0.0-3872-g38f9d900-1jammy is installed. 2024-05-27T06:26:34.924 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=38f9d900c83c63799fbdbe61acc9a11b0d3554a6 2024-05-27T06:26:35.068 DEBUG:teuthology.orchestra.run.smithi149:> dpkg-query -W -f '${Version}' ceph 2024-05-27T06:26:35.090 INFO:teuthology.orchestra.run.smithi149.stdout:19.0.0-3872-g38f9d900-1jammy 2024-05-27T06:26:35.091 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3872-g38f9d900-1jammy 2024-05-27T06:26:35.091 INFO:teuthology.task.install:The correct ceph version 19.0.0-3872-g38f9d900-1jammy is installed. 2024-05-27T06:26:35.093 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-27T06:26:35.093 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:26:35.093 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-27T06:26:35.115 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:26:35.115 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-27T06:26:35.155 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-27T06:26:35.155 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:26:35.155 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/daemon-helper 2024-05-27T06:26:35.176 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-27T06:26:35.240 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:26:35.240 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/daemon-helper 2024-05-27T06:26:35.259 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-27T06:26:35.319 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-27T06:26:35.319 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:26:35.319 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-27T06:26:35.340 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-27T06:26:35.404 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:26:35.404 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-27T06:26:35.423 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-27T06:26:35.482 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-27T06:26:35.483 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:26:35.483 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/stdin-killer 2024-05-27T06:26:35.504 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-27T06:26:35.568 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:26:35.568 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/stdin-killer 2024-05-27T06:26:35.587 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-27T06:26:35.647 INFO:teuthology.run_tasks:Running task ceph... 2024-05-27T06:26:35.723 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-27T06:26:35.724 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 777 /var/log/ceph 2024-05-27T06:26:35.727 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 777 /var/log/ceph 2024-05-27T06:26:35.746 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-27T06:26:35.746 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-27T06:26:35.791 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-27T06:26:35.810 INFO:tasks.ceph:Creating extra log directories... 2024-05-27T06:26:35.810 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-27T06:26:35.854 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-27T06:26:35.879 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-27T06:26:35.879 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-27T06:26:35.879 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-27T06:26:35.880 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:26:35.880 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-27T06:26:35.924 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-27T06:26:36.017 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:26:36.017 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-27T06:26:36.025 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-27T06:26:36.123 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-27T06:26:36.123 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-27T06:26:36.124 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-05-27_05:52:49-fs-wip-vshankar-testing-20240521.063558-debug-testing-default-smithi/7727605', 'branch': 'wip-vshankar-testing-20240521.063558-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/pool-perm}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7727605', 'kernel': {'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'vshankar-2024-05-27_05:52:49-fs-wip-vshankar-testing-20240521.063558-debug-testing-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20240521.063558-debug'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '38f9d900c83c63799fbdbe61acc9a11b0d3554a6'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '38f9d900c83c63799fbdbe61acc9a11b0d3554a6'}}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20240521.063558-debug', 'sha1': '38f9d900c83c63799fbdbe61acc9a11b0d3554a6'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 2499, 'sha1': '38f9d900c83c63799fbdbe61acc9a11b0d3554a6', 'sleep_before_teardown': 0, 'subset': '573/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20240521.063558-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_38f9d900c83c63799fbdbe61acc9a11b0d3554a6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '38f9d900c83c63799fbdbe61acc9a11b0d3554a6', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi087.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJbukeYSjVtTr5Q+0l6edl9id0cmP/M/Srjwdg2OqY8HHoLFYnseZ00vYsVs76i0sYz+AFJd4HGZozswGVOm7d4=', 'smithi149.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDgI/iRWa6+Aj5bQXkyFu1rIY38vkrI/8NwUInDOdaAMoLX0fNqYIUBcgnPz7oMMB0xESpjSaMBcCueIm7lbPxI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '38f9d900c83c63799fbdbe61acc9a11b0d3554a6'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '38f9d900c83c63799fbdbe61acc9a11b0d3554a6', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_pool_perm']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e7ae7580c417d6ab27fda98fecadca5d9f85d63e', 'timestamp': '2024-05-27_05:52:49', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841'} 2024-05-27T06:26:36.124 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-27T06:26:36.127 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-27T06:26:36.168 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/run/ceph 2024-05-27T06:26:36.178 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/run/ceph 2024-05-27T06:26:36.232 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:26:36.232 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/scratch_devs of=/dev/stdout 2024-05-27T06:26:36.249 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-27T06:26:36.249 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_1 2024-05-27T06:26:36.300 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-27T06:26:36.300 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T06:26:36.301 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 896 Links: 1 2024-05-27T06:26:36.301 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T06:26:36.301 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-05-27 06:19:55.774155286 +0000 2024-05-27T06:26:36.301 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-05-27 06:19:55.470158002 +0000 2024-05-27T06:26:36.301 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-05-27 06:19:55.470158002 +0000 2024-05-27T06:26:36.301 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-05-27 06:19:55.470158002 +0000 2024-05-27T06:26:36.301 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-27T06:26:36.363 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-05-27T06:26:36.363 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-05-27T06:26:36.363 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000683969 s, 749 kB/s 2024-05-27T06:26:36.365 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-27T06:26:36.419 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_2 2024-05-27T06:26:36.468 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-27T06:26:36.468 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T06:26:36.468 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 915 Links: 1 2024-05-27T06:26:36.469 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T06:26:36.469 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-05-27 06:19:56.342150214 +0000 2024-05-27T06:26:36.469 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-05-27 06:19:56.090152464 +0000 2024-05-27T06:26:36.469 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-05-27 06:19:56.090152464 +0000 2024-05-27T06:26:36.469 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-05-27 06:19:56.090152464 +0000 2024-05-27T06:26:36.469 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-27T06:26:36.530 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-05-27T06:26:36.530 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-05-27T06:26:36.531 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.00039092 s, 1.3 MB/s 2024-05-27T06:26:36.532 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-27T06:26:36.586 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_3 2024-05-27T06:26:36.636 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-27T06:26:36.636 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T06:26:36.636 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 930 Links: 1 2024-05-27T06:26:36.636 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T06:26:36.636 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-05-27 06:19:56.642147533 +0000 2024-05-27T06:26:36.636 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-05-27 06:19:56.638147569 +0000 2024-05-27T06:26:36.636 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-05-27 06:19:56.638147569 +0000 2024-05-27T06:26:36.636 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-05-27 06:19:56.638147569 +0000 2024-05-27T06:26:36.637 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-27T06:26:36.698 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-05-27T06:26:36.699 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-05-27T06:26:36.699 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.00038454 s, 1.3 MB/s 2024-05-27T06:26:36.701 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-27T06:26:36.754 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_4 2024-05-27T06:26:36.804 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-27T06:26:36.804 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T06:26:36.804 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 950 Links: 1 2024-05-27T06:26:36.804 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T06:26:36.804 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-05-27 06:19:57.406140710 +0000 2024-05-27T06:26:36.804 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-05-27 06:19:57.138143103 +0000 2024-05-27T06:26:36.805 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-05-27 06:19:57.138143103 +0000 2024-05-27T06:26:36.805 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-05-27 06:19:57.138143103 +0000 2024-05-27T06:26:36.805 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-27T06:26:36.866 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-05-27T06:26:36.866 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-05-27T06:26:36.866 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000394136 s, 1.3 MB/s 2024-05-27T06:26:36.868 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-27T06:26:36.922 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-27T06:26:36.922 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:26:36.922 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/scratch_devs of=/dev/stdout 2024-05-27T06:26:36.931 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-27T06:26:36.931 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_1 2024-05-27T06:26:36.983 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-27T06:26:36.984 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T06:26:36.984 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 878 Links: 1 2024-05-27T06:26:36.984 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T06:26:36.984 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-05-27 06:20:00.748864543 +0000 2024-05-27T06:26:36.984 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-05-27 06:20:00.480866937 +0000 2024-05-27T06:26:36.985 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-05-27 06:20:00.480866937 +0000 2024-05-27T06:26:36.985 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-05-27 06:20:00.480866937 +0000 2024-05-27T06:26:36.985 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-27T06:26:37.044 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-05-27T06:26:37.044 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-05-27T06:26:37.044 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000668752 s, 766 kB/s 2024-05-27T06:26:37.046 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-27T06:26:37.099 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_2 2024-05-27T06:26:37.149 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-27T06:26:37.149 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T06:26:37.149 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 896 Links: 1 2024-05-27T06:26:37.149 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T06:26:37.149 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-05-27 06:20:01.276859827 +0000 2024-05-27T06:26:37.149 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-05-27 06:20:01.012862185 +0000 2024-05-27T06:26:37.149 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-05-27 06:20:01.012862185 +0000 2024-05-27T06:26:37.149 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-05-27 06:20:01.012862185 +0000 2024-05-27T06:26:37.149 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-27T06:26:37.211 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-05-27T06:26:37.211 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-05-27T06:26:37.211 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000395442 s, 1.3 MB/s 2024-05-27T06:26:37.213 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-27T06:26:37.266 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_3 2024-05-27T06:26:37.316 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-27T06:26:37.317 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T06:26:37.317 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 911 Links: 1 2024-05-27T06:26:37.317 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T06:26:37.317 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-05-27 06:20:01.864854575 +0000 2024-05-27T06:26:37.317 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-05-27 06:20:01.604856897 +0000 2024-05-27T06:26:37.317 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-05-27 06:20:01.604856897 +0000 2024-05-27T06:26:37.317 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-05-27 06:20:01.604856897 +0000 2024-05-27T06:26:37.317 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-27T06:26:37.379 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-05-27T06:26:37.379 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-05-27T06:26:37.379 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.00039331 s, 1.3 MB/s 2024-05-27T06:26:37.381 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-27T06:26:37.435 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_4 2024-05-27T06:26:37.485 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-27T06:26:37.485 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T06:26:37.485 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 930 Links: 1 2024-05-27T06:26:37.485 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T06:26:37.485 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-05-27 06:20:02.420849608 +0000 2024-05-27T06:26:37.485 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-05-27 06:20:02.140852110 +0000 2024-05-27T06:26:37.485 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-05-27 06:20:02.140852110 +0000 2024-05-27T06:26:37.485 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-05-27 06:20:02.140852110 +0000 2024-05-27T06:26:37.485 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-27T06:26:37.547 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-05-27T06:26:37.547 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-05-27T06:26:37.547 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000382853 s, 1.3 MB/s 2024-05-27T06:26:37.549 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-27T06:26:37.604 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-27T06:26:37.604 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-27T06:26:37.604 INFO:tasks.ceph:Generating config... 2024-05-27T06:26:37.605 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-27T06:26:37.606 INFO:tasks.ceph:[client] debug client = 20 2024-05-27T06:26:37.606 INFO:tasks.ceph:[client] debug ms = 1 2024-05-27T06:26:37.606 INFO:tasks.ceph:[client] pid file = 2024-05-27T06:26:37.606 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-27T06:26:37.606 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-27T06:26:37.606 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-27T06:26:37.606 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-27T06:26:37.606 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-27T06:26:37.606 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-27T06:26:37.606 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-27T06:26:37.606 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-27T06:26:37.606 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-27T06:26:37.607 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-27T06:26:37.607 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-27T06:26:37.607 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-27T06:26:37.607 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-27T06:26:37.607 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-27T06:26:37.607 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-27T06:26:37.607 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-27T06:26:37.607 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-27T06:26:37.607 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-27T06:26:37.607 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-27T06:26:37.607 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-27T06:26:37.607 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-27T06:26:37.607 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-27T06:26:37.607 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-05-27T06:26:37.607 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-05-27T06:26:37.608 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-27T06:26:37.608 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-27T06:26:37.608 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-05-27T06:26:37.608 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-27T06:26:37.608 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-27T06:26:37.608 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-27T06:26:37.608 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-27T06:26:37.608 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-27T06:26:37.608 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-27T06:26:37.608 INFO:tasks.ceph:Setting up mon.a... 2024-05-27T06:26:37.609 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-27T06:26:37.666 INFO:teuthology.orchestra.run.smithi087.stdout:creating /etc/ceph/ceph.keyring 2024-05-27T06:26:37.681 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-27T06:26:37.737 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-27T06:26:37.756 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.87'), ('mon.b', '172.21.15.149'), ('mon.c', '[v2:172.21.15.149:3301,v1:172.21.15.149:6790]')] 2024-05-27T06:26:37.757 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.87,172.21.15.149,[v2:172.21.15.149:3301,v1:172.21.15.149:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-27T06:26:37.758 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:26:37.758 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-27T06:26:37.808 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.87 --add b 172.21.15.149 --addv c '[v2:172.21.15.149:3301,v1:172.21.15.149:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-27T06:26:37.907 INFO:teuthology.orchestra.run.smithi087.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-27T06:26:37.907 INFO:teuthology.orchestra.run.smithi087.stdout:monmaptool: generated fsid 0412686d-4f35-45cc-b082-ef9741c1aff5 2024-05-27T06:26:37.907 INFO:teuthology.orchestra.run.smithi087.stdout:setting min_mon_release = quincy 2024-05-27T06:26:37.907 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 0 2024-05-27T06:26:37.908 INFO:teuthology.orchestra.run.smithi087.stdout:fsid 0412686d-4f35-45cc-b082-ef9741c1aff5 2024-05-27T06:26:37.908 INFO:teuthology.orchestra.run.smithi087.stdout:last_changed 2024-05-27T06:26:37.914622+0000 2024-05-27T06:26:37.908 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-05-27T06:26:37.914622+0000 2024-05-27T06:26:37.908 INFO:teuthology.orchestra.run.smithi087.stdout:min_mon_release 17 (quincy) 2024-05-27T06:26:37.908 INFO:teuthology.orchestra.run.smithi087.stdout:election_strategy: 1 2024-05-27T06:26:37.908 INFO:teuthology.orchestra.run.smithi087.stdout:0: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.a 2024-05-27T06:26:37.908 INFO:teuthology.orchestra.run.smithi087.stdout:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-05-27T06:26:37.908 INFO:teuthology.orchestra.run.smithi087.stdout:2: [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] mon.c 2024-05-27T06:26:37.908 INFO:teuthology.orchestra.run.smithi087.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-27T06:26:37.911 DEBUG:teuthology.orchestra.run.smithi087:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-27T06:26:37.920 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0412686d-4f35-45cc-b082-ef9741c1aff5... 2024-05-27T06:26:37.920 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-27T06:26:37.966 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-27T06:26:38.006 INFO:teuthology.orchestra.run.smithi087.stdout:[global] 2024-05-27T06:26:38.006 INFO:teuthology.orchestra.run.smithi087.stdout: chdir = "" 2024-05-27T06:26:38.006 INFO:teuthology.orchestra.run.smithi087.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-27T06:26:38.006 INFO:teuthology.orchestra.run.smithi087.stdout: auth supported = cephx 2024-05-27T06:26:38.006 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.006 INFO:teuthology.orchestra.run.smithi087.stdout: filestore xattr use omap = true 2024-05-27T06:26:38.006 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.006 INFO:teuthology.orchestra.run.smithi087.stdout: mon clock drift allowed = 1.000 2024-05-27T06:26:38.007 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.007 INFO:teuthology.orchestra.run.smithi087.stdout: osd crush chooseleaf type = 0 2024-05-27T06:26:38.007 INFO:teuthology.orchestra.run.smithi087.stdout: auth debug = true 2024-05-27T06:26:38.007 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.007 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on old message = true 2024-05-27T06:26:38.007 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on bug = true 2024-05-27T06:26:38.007 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.007 INFO:teuthology.orchestra.run.smithi087.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-27T06:26:38.007 INFO:teuthology.orchestra.run.smithi087.stdout: mon pg warn max object skew = 0 2024-05-27T06:26:38.007 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.007 INFO:teuthology.orchestra.run.smithi087.stdout: # disable pg_autoscaler by default for new pools 2024-05-27T06:26:38.007 INFO:teuthology.orchestra.run.smithi087.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-27T06:26:38.007 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.008 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default size = 2 2024-05-27T06:26:38.008 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.008 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow primary affinity = true 2024-05-27T06:26:38.008 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow pg remap = true 2024-05-27T06:26:38.008 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on legacy crush tunables = false 2024-05-27T06:26:38.008 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on crush straw calc version zero = false 2024-05-27T06:26:38.008 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on no sortbitwise = false 2024-05-27T06:26:38.008 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on osd down out interval zero = false 2024-05-27T06:26:38.008 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on too few osds = false 2024-05-27T06:26:38.008 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-27T06:26:38.008 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-27T06:26:38.008 INFO:teuthology.orchestra.run.smithi087.stdout: mon_allow_pool_size_one = true 2024-05-27T06:26:38.008 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.009 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-27T06:26:38.009 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.009 INFO:teuthology.orchestra.run.smithi087.stdout: osd default data pool replay window = 5 2024-05-27T06:26:38.009 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.009 INFO:teuthology.orchestra.run.smithi087.stdout: mon allow pool delete = true 2024-05-27T06:26:38.009 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.009 INFO:teuthology.orchestra.run.smithi087.stdout: mon cluster log file level = debug 2024-05-27T06:26:38.009 INFO:teuthology.orchestra.run.smithi087.stdout: debug asserts on shutdown = true 2024-05-27T06:26:38.009 INFO:teuthology.orchestra.run.smithi087.stdout: mon health detail to clog = false 2024-05-27T06:26:38.009 INFO:teuthology.orchestra.run.smithi087.stdout: mon host = "172.21.15.87,172.21.15.149,[v2:172.21.15.149:3301,v1:172.21.15.149:6790]" 2024-05-27T06:26:38.009 INFO:teuthology.orchestra.run.smithi087.stdout: fsid = 0412686d-4f35-45cc-b082-ef9741c1aff5 2024-05-27T06:26:38.009 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.009 INFO:teuthology.orchestra.run.smithi087.stdout:[osd] 2024-05-27T06:26:38.009 INFO:teuthology.orchestra.run.smithi087.stdout: osd journal size = 100 2024-05-27T06:26:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub load threshold = 5.0 2024-05-27T06:26:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub max interval = 600 2024-05-27T06:26:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: osd mclock profile = high_recovery_ops 2024-05-27T06:26:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: osd recover clone overlap = true 2024-05-27T06:26:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: osd recovery max chunk = 1048576 2024-05-27T06:26:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug shutdown = true 2024-05-27T06:26:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug op order = true 2024-05-27T06:26:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug verify stray on activate = true 2024-05-27T06:26:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug trim objects = true 2024-05-27T06:26:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.011 INFO:teuthology.orchestra.run.smithi087.stdout: osd open classes on start = true 2024-05-27T06:26:38.011 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug pg log writeout = true 2024-05-27T06:26:38.011 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.011 INFO:teuthology.orchestra.run.smithi087.stdout: osd deep scrub update digest min age = 30 2024-05-27T06:26:38.011 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.011 INFO:teuthology.orchestra.run.smithi087.stdout: osd map max advance = 10 2024-05-27T06:26:38.011 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.011 INFO:teuthology.orchestra.run.smithi087.stdout: journal zero on create = true 2024-05-27T06:26:38.011 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.011 INFO:teuthology.orchestra.run.smithi087.stdout: filestore ondisk finisher threads = 3 2024-05-27T06:26:38.011 INFO:teuthology.orchestra.run.smithi087.stdout: filestore apply finisher threads = 3 2024-05-27T06:26:38.011 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.011 INFO:teuthology.orchestra.run.smithi087.stdout: bdev debug aio = true 2024-05-27T06:26:38.012 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug misdirected ops = true 2024-05-27T06:26:38.012 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore block size = 96636764160 2024-05-27T06:26:38.012 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore fsck on mount = True 2024-05-27T06:26:38.012 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluefs = 20 2024-05-27T06:26:38.012 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluestore = 20 2024-05-27T06:26:38.012 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-05-27T06:26:38.012 INFO:teuthology.orchestra.run.smithi087.stdout: debug osd = 20 2024-05-27T06:26:38.012 INFO:teuthology.orchestra.run.smithi087.stdout: debug rocksdb = 10 2024-05-27T06:26:38.012 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd backfillfull_ratio = 0.85 2024-05-27T06:26:38.012 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd full ratio = 0.9 2024-05-27T06:26:38.012 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd nearfull ratio = 0.8 2024-05-27T06:26:38.012 INFO:teuthology.orchestra.run.smithi087.stdout: osd failsafe full ratio = 0.95 2024-05-27T06:26:38.012 INFO:teuthology.orchestra.run.smithi087.stdout: osd objectstore = bluestore 2024-05-27T06:26:38.013 INFO:teuthology.orchestra.run.smithi087.stdout: osd op complaint time = 180 2024-05-27T06:26:38.013 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.013 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr] 2024-05-27T06:26:38.013 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-05-27T06:26:38.013 INFO:teuthology.orchestra.run.smithi087.stdout: debug mgr = 20 2024-05-27T06:26:38.013 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2024-05-27T06:26:38.013 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2024-05-27T06:26:38.013 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2024-05-27T06:26:38.013 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2024-05-27T06:26:38.013 INFO:teuthology.orchestra.run.smithi087.stdout: mgr/telemetry/nag = false 2024-05-27T06:26:38.013 INFO:teuthology.orchestra.run.smithi087.stdout: debug client = 20 2024-05-27T06:26:38.013 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.013 INFO:teuthology.orchestra.run.smithi087.stdout:[mon] 2024-05-27T06:26:38.013 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-05-27T06:26:38.014 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2024-05-27T06:26:38.014 INFO:teuthology.orchestra.run.smithi087.stdout: debug paxos = 20 2024-05-27T06:26:38.014 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2024-05-27T06:26:38.014 INFO:teuthology.orchestra.run.smithi087.stdout: mon data avail warn = 5 2024-05-27T06:26:38.014 INFO:teuthology.orchestra.run.smithi087.stdout: mon mgr mkfs grace = 240 2024-05-27T06:26:38.014 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2024-05-27T06:26:38.014 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd reporter subtree level = osd 2024-05-27T06:26:38.014 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd prime pg temp = true 2024-05-27T06:26:38.014 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2024-05-27T06:26:38.014 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.014 INFO:teuthology.orchestra.run.smithi087.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-27T06:26:38.014 INFO:teuthology.orchestra.run.smithi087.stdout: auth mon ticket ttl = 660 # 11m 2024-05-27T06:26:38.015 INFO:teuthology.orchestra.run.smithi087.stdout: auth service ticket ttl = 240 # 4m 2024-05-27T06:26:38.015 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.015 INFO:teuthology.orchestra.run.smithi087.stdout: # don't complain about insecure global_id in the test suite 2024-05-27T06:26:38.015 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-27T06:26:38.015 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-27T06:26:38.015 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.015 INFO:teuthology.orchestra.run.smithi087.stdout: # 1m isn't quite enough 2024-05-27T06:26:38.015 INFO:teuthology.orchestra.run.smithi087.stdout: mon_down_mkfs_grace = 2m 2024-05-27T06:26:38.015 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.015 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_filestore_osds = false 2024-05-27T06:26:38.015 INFO:teuthology.orchestra.run.smithi087.stdout: mon down mkfs grace = 300 2024-05-27T06:26:38.015 INFO:teuthology.orchestra.run.smithi087.stdout: mon op complaint time = 120 2024-05-27T06:26:38.015 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:26:38.015 INFO:teuthology.orchestra.run.smithi087.stdout:[client] 2024-05-27T06:26:38.016 INFO:teuthology.orchestra.run.smithi087.stdout: rgw cache enabled = true 2024-05-27T06:26:38.016 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable ops log = true 2024-05-27T06:26:38.016 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable usage log = true 2024-05-27T06:26:38.016 INFO:teuthology.orchestra.run.smithi087.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-27T06:26:38.016 INFO:teuthology.orchestra.run.smithi087.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-27T06:26:38.016 INFO:teuthology.orchestra.run.smithi087.stdout: client mount timeout = 600 2024-05-27T06:26:38.016 INFO:teuthology.orchestra.run.smithi087.stdout: debug client = 20 2024-05-27T06:26:38.016 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-05-27T06:26:38.016 INFO:teuthology.orchestra.run.smithi087.stdout: pid file = "" 2024-05-27T06:26:38.016 INFO:teuthology.orchestra.run.smithi087.stdout: rados mon op timeout = 900 2024-05-27T06:26:38.016 INFO:teuthology.orchestra.run.smithi087.stdout: rados osd op timeout = 900 2024-05-27T06:26:38.016 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.a] 2024-05-27T06:26:38.016 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.b] 2024-05-27T06:26:38.016 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.c] 2024-05-27T06:26:38.017 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a] 2024-05-27T06:26:38.017 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.c] 2024-05-27T06:26:38.017 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.b] 2024-05-27T06:26:38.017 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.d] 2024-05-27T06:26:38.017 INFO:teuthology.orchestra.run.smithi087.stdout:[mds] 2024-05-27T06:26:38.017 INFO:teuthology.orchestra.run.smithi087.stdout: debug mds = 20 2024-05-27T06:26:38.017 INFO:teuthology.orchestra.run.smithi087.stdout: debug mds balancer = 20 2024-05-27T06:26:38.017 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-05-27T06:26:38.017 INFO:teuthology.orchestra.run.smithi087.stdout: mds debug frag = True 2024-05-27T06:26:38.017 INFO:teuthology.orchestra.run.smithi087.stdout: mds debug scatterstat = True 2024-05-27T06:26:38.018 INFO:teuthology.orchestra.run.smithi087.stdout: mds op complaint time = 180 2024-05-27T06:26:38.018 INFO:teuthology.orchestra.run.smithi087.stdout: mds verify scatter = True 2024-05-27T06:26:38.018 INFO:teuthology.orchestra.run.smithi087.stdout: osd op complaint time = 180 2024-05-27T06:26:38.018 INFO:teuthology.orchestra.run.smithi087.stdout: rados mon op timeout = 900 2024-05-27T06:26:38.018 INFO:teuthology.orchestra.run.smithi087.stdout: rados osd op timeout = 900 2024-05-27T06:26:38.018 INFO:teuthology.orchestra.run.smithi149.stdout:[global] 2024-05-27T06:26:38.018 INFO:teuthology.orchestra.run.smithi149.stdout: chdir = "" 2024-05-27T06:26:38.019 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-27T06:26:38.019 INFO:teuthology.orchestra.run.smithi149.stdout: auth supported = cephx 2024-05-27T06:26:38.019 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.019 INFO:teuthology.orchestra.run.smithi149.stdout: filestore xattr use omap = true 2024-05-27T06:26:38.019 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.019 INFO:teuthology.orchestra.run.smithi149.stdout: mon clock drift allowed = 1.000 2024-05-27T06:26:38.019 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.019 INFO:teuthology.orchestra.run.smithi149.stdout: osd crush chooseleaf type = 0 2024-05-27T06:26:38.019 INFO:teuthology.orchestra.run.smithi149.stdout: auth debug = true 2024-05-27T06:26:38.019 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.019 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on old message = true 2024-05-27T06:26:38.020 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on bug = true 2024-05-27T06:26:38.020 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.020 INFO:teuthology.orchestra.run.smithi149.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-27T06:26:38.020 INFO:teuthology.orchestra.run.smithi149.stdout: mon pg warn max object skew = 0 2024-05-27T06:26:38.020 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.020 INFO:teuthology.orchestra.run.smithi149.stdout: # disable pg_autoscaler by default for new pools 2024-05-27T06:26:38.020 INFO:teuthology.orchestra.run.smithi149.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-27T06:26:38.020 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.020 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default size = 2 2024-05-27T06:26:38.020 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.020 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow primary affinity = true 2024-05-27T06:26:38.020 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow pg remap = true 2024-05-27T06:26:38.020 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on legacy crush tunables = false 2024-05-27T06:26:38.020 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on crush straw calc version zero = false 2024-05-27T06:26:38.021 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on no sortbitwise = false 2024-05-27T06:26:38.021 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on osd down out interval zero = false 2024-05-27T06:26:38.021 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on too few osds = false 2024-05-27T06:26:38.021 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-27T06:26:38.021 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-27T06:26:38.021 INFO:teuthology.orchestra.run.smithi149.stdout: mon_allow_pool_size_one = true 2024-05-27T06:26:38.021 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.021 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-27T06:26:38.021 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.021 INFO:teuthology.orchestra.run.smithi149.stdout: osd default data pool replay window = 5 2024-05-27T06:26:38.022 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.022 INFO:teuthology.orchestra.run.smithi149.stdout: mon allow pool delete = true 2024-05-27T06:26:38.022 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.022 INFO:teuthology.orchestra.run.smithi149.stdout: mon cluster log file level = debug 2024-05-27T06:26:38.022 INFO:teuthology.orchestra.run.smithi149.stdout: debug asserts on shutdown = true 2024-05-27T06:26:38.022 INFO:teuthology.orchestra.run.smithi149.stdout: mon health detail to clog = false 2024-05-27T06:26:38.022 INFO:teuthology.orchestra.run.smithi149.stdout: mon host = "172.21.15.87,172.21.15.149,[v2:172.21.15.149:3301,v1:172.21.15.149:6790]" 2024-05-27T06:26:38.022 INFO:teuthology.orchestra.run.smithi149.stdout: fsid = 0412686d-4f35-45cc-b082-ef9741c1aff5 2024-05-27T06:26:38.022 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.022 INFO:teuthology.orchestra.run.smithi149.stdout:[osd] 2024-05-27T06:26:38.022 INFO:teuthology.orchestra.run.smithi149.stdout: osd journal size = 100 2024-05-27T06:26:38.022 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.023 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub load threshold = 5.0 2024-05-27T06:26:38.023 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub max interval = 600 2024-05-27T06:26:38.023 INFO:teuthology.orchestra.run.smithi149.stdout: osd mclock profile = high_recovery_ops 2024-05-27T06:26:38.023 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.023 INFO:teuthology.orchestra.run.smithi149.stdout: osd recover clone overlap = true 2024-05-27T06:26:38.023 INFO:teuthology.orchestra.run.smithi149.stdout: osd recovery max chunk = 1048576 2024-05-27T06:26:38.023 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.023 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug shutdown = true 2024-05-27T06:26:38.023 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug op order = true 2024-05-27T06:26:38.023 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug verify stray on activate = true 2024-05-27T06:26:38.023 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug trim objects = true 2024-05-27T06:26:38.024 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.024 INFO:teuthology.orchestra.run.smithi149.stdout: osd open classes on start = true 2024-05-27T06:26:38.024 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug pg log writeout = true 2024-05-27T06:26:38.024 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.024 INFO:teuthology.orchestra.run.smithi149.stdout: osd deep scrub update digest min age = 30 2024-05-27T06:26:38.024 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.024 INFO:teuthology.orchestra.run.smithi149.stdout: osd map max advance = 10 2024-05-27T06:26:38.024 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.024 INFO:teuthology.orchestra.run.smithi149.stdout: journal zero on create = true 2024-05-27T06:26:38.024 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.024 INFO:teuthology.orchestra.run.smithi149.stdout: filestore ondisk finisher threads = 3 2024-05-27T06:26:38.024 INFO:teuthology.orchestra.run.smithi149.stdout: filestore apply finisher threads = 3 2024-05-27T06:26:38.025 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.025 INFO:teuthology.orchestra.run.smithi149.stdout: bdev debug aio = true 2024-05-27T06:26:38.025 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug misdirected ops = true 2024-05-27T06:26:38.025 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore block size = 96636764160 2024-05-27T06:26:38.025 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore fsck on mount = True 2024-05-27T06:26:38.025 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluefs = 20 2024-05-27T06:26:38.025 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluestore = 20 2024-05-27T06:26:38.025 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-05-27T06:26:38.025 INFO:teuthology.orchestra.run.smithi149.stdout: debug osd = 20 2024-05-27T06:26:38.025 INFO:teuthology.orchestra.run.smithi149.stdout: debug rocksdb = 10 2024-05-27T06:26:38.025 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd backfillfull_ratio = 0.85 2024-05-27T06:26:38.025 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd full ratio = 0.9 2024-05-27T06:26:38.025 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd nearfull ratio = 0.8 2024-05-27T06:26:38.026 INFO:teuthology.orchestra.run.smithi149.stdout: osd failsafe full ratio = 0.95 2024-05-27T06:26:38.026 INFO:teuthology.orchestra.run.smithi149.stdout: osd objectstore = bluestore 2024-05-27T06:26:38.026 INFO:teuthology.orchestra.run.smithi149.stdout: osd op complaint time = 180 2024-05-27T06:26:38.026 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.026 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr] 2024-05-27T06:26:38.026 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-05-27T06:26:38.026 INFO:teuthology.orchestra.run.smithi149.stdout: debug mgr = 20 2024-05-27T06:26:38.026 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2024-05-27T06:26:38.026 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2024-05-27T06:26:38.026 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2024-05-27T06:26:38.026 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2024-05-27T06:26:38.026 INFO:teuthology.orchestra.run.smithi149.stdout: mgr/telemetry/nag = false 2024-05-27T06:26:38.026 INFO:teuthology.orchestra.run.smithi149.stdout: debug client = 20 2024-05-27T06:26:38.027 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.027 INFO:teuthology.orchestra.run.smithi149.stdout:[mon] 2024-05-27T06:26:38.027 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-05-27T06:26:38.027 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2024-05-27T06:26:38.027 INFO:teuthology.orchestra.run.smithi149.stdout: debug paxos = 20 2024-05-27T06:26:38.027 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2024-05-27T06:26:38.027 INFO:teuthology.orchestra.run.smithi149.stdout: mon data avail warn = 5 2024-05-27T06:26:38.027 INFO:teuthology.orchestra.run.smithi149.stdout: mon mgr mkfs grace = 240 2024-05-27T06:26:38.027 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2024-05-27T06:26:38.027 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd reporter subtree level = osd 2024-05-27T06:26:38.027 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd prime pg temp = true 2024-05-27T06:26:38.027 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2024-05-27T06:26:38.027 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.028 INFO:teuthology.orchestra.run.smithi149.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-27T06:26:38.028 INFO:teuthology.orchestra.run.smithi149.stdout: auth mon ticket ttl = 660 # 11m 2024-05-27T06:26:38.028 INFO:teuthology.orchestra.run.smithi149.stdout: auth service ticket ttl = 240 # 4m 2024-05-27T06:26:38.028 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.028 INFO:teuthology.orchestra.run.smithi149.stdout: # don't complain about insecure global_id in the test suite 2024-05-27T06:26:38.028 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-27T06:26:38.028 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-27T06:26:38.028 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.028 INFO:teuthology.orchestra.run.smithi149.stdout: # 1m isn't quite enough 2024-05-27T06:26:38.028 INFO:teuthology.orchestra.run.smithi149.stdout: mon_down_mkfs_grace = 2m 2024-05-27T06:26:38.028 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.028 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_filestore_osds = false 2024-05-27T06:26:38.028 INFO:teuthology.orchestra.run.smithi149.stdout: mon down mkfs grace = 300 2024-05-27T06:26:38.029 INFO:teuthology.orchestra.run.smithi149.stdout: mon op complaint time = 120 2024-05-27T06:26:38.029 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-05-27T06:26:38.029 INFO:teuthology.orchestra.run.smithi149.stdout:[client] 2024-05-27T06:26:38.029 INFO:teuthology.orchestra.run.smithi149.stdout: rgw cache enabled = true 2024-05-27T06:26:38.029 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable ops log = true 2024-05-27T06:26:38.029 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable usage log = true 2024-05-27T06:26:38.029 INFO:teuthology.orchestra.run.smithi149.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-27T06:26:38.029 INFO:teuthology.orchestra.run.smithi149.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-27T06:26:38.029 INFO:teuthology.orchestra.run.smithi149.stdout: client mount timeout = 600 2024-05-27T06:26:38.029 INFO:teuthology.orchestra.run.smithi149.stdout: debug client = 20 2024-05-27T06:26:38.029 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-05-27T06:26:38.029 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = "" 2024-05-27T06:26:38.029 INFO:teuthology.orchestra.run.smithi149.stdout: rados mon op timeout = 900 2024-05-27T06:26:38.030 INFO:teuthology.orchestra.run.smithi149.stdout: rados osd op timeout = 900 2024-05-27T06:26:38.030 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.a] 2024-05-27T06:26:38.030 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.b] 2024-05-27T06:26:38.030 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.c] 2024-05-27T06:26:38.030 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2024-05-27T06:26:38.030 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.c] 2024-05-27T06:26:38.030 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.b] 2024-05-27T06:26:38.030 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.d] 2024-05-27T06:26:38.030 INFO:teuthology.orchestra.run.smithi149.stdout:[mds] 2024-05-27T06:26:38.030 INFO:teuthology.orchestra.run.smithi149.stdout: debug mds = 20 2024-05-27T06:26:38.030 INFO:teuthology.orchestra.run.smithi149.stdout: debug mds balancer = 20 2024-05-27T06:26:38.030 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-05-27T06:26:38.031 INFO:teuthology.orchestra.run.smithi149.stdout: mds debug frag = True 2024-05-27T06:26:38.031 INFO:teuthology.orchestra.run.smithi149.stdout: mds debug scatterstat = True 2024-05-27T06:26:38.031 INFO:teuthology.orchestra.run.smithi149.stdout: mds op complaint time = 180 2024-05-27T06:26:38.031 INFO:teuthology.orchestra.run.smithi149.stdout: mds verify scatter = True 2024-05-27T06:26:38.031 INFO:teuthology.orchestra.run.smithi149.stdout: osd op complaint time = 180 2024-05-27T06:26:38.031 INFO:teuthology.orchestra.run.smithi149.stdout: rados mon op timeout = 900 2024-05-27T06:26:38.031 INFO:teuthology.orchestra.run.smithi149.stdout: rados osd op timeout = 900 2024-05-27T06:26:38.032 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-27T06:26:38.033 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-27T06:26:38.145 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-27T06:26:38.145 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:26:38.146 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-27T06:26:38.154 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:26:38.154 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-27T06:26:38.206 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi087.front.sepia.ceph.com 2024-05-27T06:26:38.206 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:26:38.206 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-27T06:26:38.206 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-27T06:26:38.278 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:26:38.278 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-27T06:26:38.327 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi149.front.sepia.ceph.com 2024-05-27T06:26:38.328 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:26:38.328 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-27T06:26:38.328 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-27T06:26:38.363 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:26:38.363 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-27T06:26:38.454 INFO:tasks.ceph:Setting up mon nodes... 2024-05-27T06:26:38.454 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-27T06:26:38.454 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-27T06:26:38.519 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-27T06:26:38.525 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-27T06:26:38.596 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-27T06:26:38.616 INFO:tasks.ceph:Setting up mds nodes... 2024-05-27T06:26:38.616 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-27T06:26:38.679 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-27T06:26:38.684 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-27T06:26:38.704 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-27T06:26:38.810 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-27T06:26:38.818 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-27T06:26:38.837 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-27T06:26:38.908 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-27T06:26:38.913 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-27T06:26:38.933 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-27T06:26:39.041 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-27T06:26:39.046 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-27T06:26:39.066 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-27T06:26:39.066 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-27T06:26:39.118 INFO:teuthology.orchestra.run.smithi087.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-27T06:26:39.135 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-05-27T06:26:39.186 INFO:teuthology.orchestra.run.smithi087.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-05-27T06:26:39.203 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-27T06:26:39.254 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-27T06:26:39.272 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-05-27T06:26:39.323 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-05-27T06:26:39.341 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-27T06:26:39.341 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-27T06:26:39.341 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-27T06:26:39.360 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-27T06:26:39.360 INFO:tasks.ceph:role: osd.0 2024-05-27T06:26:39.360 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com 2024-05-27T06:26:39.360 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-27T06:26:39.429 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-27T06:26:39.429 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-27T06:26:39.429 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-27T06:26:39.430 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-27T06:26:39.430 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-27T06:26:39.430 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-05-27T06:26:39.430 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-27T06:26:39.430 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-27T06:26:39.430 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-27T06:26:39.430 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-27T06:26:39.813 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-05-27T06:26:39.815 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-05-27T06:26:39.815 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-27T06:26:39.916 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-27T06:26:39.931 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2024-05-27T06:26:39.932 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T06:26:39.933 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-27T06:26:39.995 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-27T06:26:39.995 INFO:tasks.ceph:role: osd.1 2024-05-27T06:26:39.995 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi087.front.sepia.ceph.com 2024-05-27T06:26:39.995 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-27T06:26:40.067 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-27T06:26:40.067 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-27T06:26:40.067 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-27T06:26:40.067 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-27T06:26:40.067 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-27T06:26:40.067 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-05-27T06:26:40.068 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-27T06:26:40.068 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-27T06:26:40.068 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-27T06:26:40.068 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-27T06:26:40.462 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-05-27T06:26:40.464 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-05-27T06:26:40.465 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-27T06:26:40.582 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-27T06:26:40.598 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2024-05-27T06:26:40.599 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T06:26:40.600 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-27T06:26:40.663 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-27T06:26:40.663 INFO:tasks.ceph:role: osd.2 2024-05-27T06:26:40.663 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi087.front.sepia.ceph.com 2024-05-27T06:26:40.663 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-27T06:26:40.734 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-27T06:26:40.734 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-27T06:26:40.734 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-27T06:26:40.734 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-27T06:26:40.734 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-27T06:26:40.734 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-05-27T06:26:40.734 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-27T06:26:40.734 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-27T06:26:40.734 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-27T06:26:40.734 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-27T06:26:41.150 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-05-27T06:26:41.152 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-05-27T06:26:41.152 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-27T06:26:41.296 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-27T06:26:41.313 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2024-05-27T06:26:41.314 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T06:26:41.314 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-27T06:26:41.379 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-27T06:26:41.380 INFO:tasks.ceph:role: osd.3 2024-05-27T06:26:41.380 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi087.front.sepia.ceph.com 2024-05-27T06:26:41.380 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-27T06:26:41.455 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-27T06:26:41.455 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-27T06:26:41.455 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-27T06:26:41.456 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-27T06:26:41.456 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-27T06:26:41.456 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-05-27T06:26:41.456 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-27T06:26:41.456 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-27T06:26:41.456 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-27T06:26:41.456 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-27T06:26:41.812 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-05-27T06:26:41.815 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-05-27T06:26:41.815 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-27T06:26:41.894 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-27T06:26:41.953 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2024-05-27T06:26:41.953 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T06:26:41.954 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-27T06:26:42.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:26:42.102+0000 7f423e0d47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-27T06:26:42.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:26:42.106+0000 7f423e0d47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-27T06:26:42.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:26:42.106+0000 7f423e0d47c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-27T06:26:42.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:26:42.106+0000 7f423e0d47c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-27T06:26:42.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:26:42.106+0000 7f423e0d47c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-27T06:26:42.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:26:42.110+0000 7f423e0d47c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-27T06:26:45.177 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-27T06:26:45.197 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-27T06:26:45.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:26:45.314+0000 7f7f6bb3c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-27T06:26:45.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:26:45.314+0000 7f7f6bb3c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-27T06:26:45.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:26:45.314+0000 7f7f6bb3c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-27T06:26:45.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:26:45.314+0000 7f7f6bb3c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-27T06:26:45.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:26:45.314+0000 7f7f6bb3c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-27T06:26:45.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:26:45.314+0000 7f7f6bb3c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-27T06:26:48.361 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-27T06:26:48.382 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-27T06:26:48.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:26:48.494+0000 7f44c2def7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-27T06:26:48.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:26:48.494+0000 7f44c2def7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-27T06:26:48.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:26:48.494+0000 7f44c2def7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-27T06:26:48.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:26:48.494+0000 7f44c2def7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-27T06:26:48.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:26:48.494+0000 7f44c2def7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-27T06:26:48.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:26:48.494+0000 7f44c2def7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-27T06:26:51.547 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-27T06:26:51.569 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-27T06:26:51.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:26:51.690+0000 7fd6ef2127c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-27T06:26:51.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:26:51.690+0000 7fd6ef2127c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-27T06:26:51.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:26:51.690+0000 7fd6ef2127c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-27T06:26:51.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:26:51.690+0000 7fd6ef2127c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-27T06:26:51.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:26:51.690+0000 7fd6ef2127c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-27T06:26:51.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:26:51.694+0000 7fd6ef2127c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-27T06:26:54.747 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-27T06:26:54.767 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-27T06:26:54.789 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-27T06:26:54.789 INFO:tasks.ceph:role: osd.4 2024-05-27T06:26:54.789 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com 2024-05-27T06:26:54.789 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-27T06:26:54.861 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-27T06:26:54.861 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-27T06:26:54.861 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-27T06:26:54.862 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-27T06:26:54.862 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-27T06:26:54.862 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-05-27T06:26:54.862 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-27T06:26:54.862 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-27T06:26:54.862 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-27T06:26:54.862 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-27T06:26:55.263 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-05-27T06:26:55.266 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-05-27T06:26:55.266 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-27T06:26:55.364 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-27T06:26:55.381 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: /sbin/restorecon: command not found 2024-05-27T06:26:55.382 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T06:26:55.383 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-27T06:26:55.448 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-27T06:26:55.448 INFO:tasks.ceph:role: osd.5 2024-05-27T06:26:55.449 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com 2024-05-27T06:26:55.449 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-27T06:26:55.520 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-27T06:26:55.520 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-27T06:26:55.520 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-27T06:26:55.520 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-27T06:26:55.520 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-27T06:26:55.521 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-05-27T06:26:55.521 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-27T06:26:55.521 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-27T06:26:55.521 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-27T06:26:55.521 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-27T06:26:55.923 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-05-27T06:26:55.927 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-05-27T06:26:55.927 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-27T06:26:56.051 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-27T06:26:56.068 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: /sbin/restorecon: command not found 2024-05-27T06:26:56.069 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T06:26:56.069 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-27T06:26:56.136 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-27T06:26:56.136 INFO:tasks.ceph:role: osd.6 2024-05-27T06:26:56.136 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com 2024-05-27T06:26:56.137 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-27T06:26:56.212 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-27T06:26:56.212 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-27T06:26:56.212 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-27T06:26:56.212 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-27T06:26:56.212 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-27T06:26:56.213 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-05-27T06:26:56.213 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-27T06:26:56.213 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-27T06:26:56.213 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-27T06:26:56.213 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-27T06:26:56.630 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-05-27T06:26:56.633 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-05-27T06:26:56.633 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-27T06:26:56.767 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-27T06:26:56.785 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: /sbin/restorecon: command not found 2024-05-27T06:26:56.786 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T06:26:56.786 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-27T06:26:56.853 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-27T06:26:56.853 INFO:tasks.ceph:role: osd.7 2024-05-27T06:26:56.853 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com 2024-05-27T06:26:56.853 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-27T06:26:56.924 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-27T06:26:56.924 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-27T06:26:56.924 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-27T06:26:56.925 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-27T06:26:56.925 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-27T06:26:56.925 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-05-27T06:26:56.925 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-27T06:26:56.925 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-27T06:26:56.925 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-27T06:26:56.925 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-27T06:26:57.289 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-05-27T06:26:57.292 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-05-27T06:26:57.292 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-27T06:26:57.387 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-27T06:26:57.403 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: /sbin/restorecon: command not found 2024-05-27T06:26:57.404 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T06:26:57.405 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-27T06:26:57.551 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:26:57.554+0000 7f47323c07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-27T06:26:57.555 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:26:57.558+0000 7f47323c07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-27T06:26:57.555 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:26:57.558+0000 7f47323c07c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-27T06:26:57.555 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:26:57.558+0000 7f47323c07c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-27T06:26:57.555 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:26:57.558+0000 7f47323c07c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-27T06:26:57.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:26:57.566+0000 7f47323c07c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-27T06:27:00.623 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-27T06:27:00.644 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-27T06:27:00.757 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:00.762+0000 7f49884577c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-27T06:27:00.758 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:00.762+0000 7f49884577c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-27T06:27:00.758 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:00.762+0000 7f49884577c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-27T06:27:00.758 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:00.762+0000 7f49884577c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-27T06:27:00.758 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:00.762+0000 7f49884577c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-27T06:27:00.759 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:00.762+0000 7f49884577c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-27T06:27:03.821 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-27T06:27:03.842 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-27T06:27:03.947 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:03.949+0000 7f0ca43827c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-27T06:27:03.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:03.949+0000 7f0ca43827c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-27T06:27:03.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:03.949+0000 7f0ca43827c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-27T06:27:03.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:03.949+0000 7f0ca43827c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-27T06:27:03.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:03.949+0000 7f0ca43827c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-27T06:27:03.949 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:03.953+0000 7f0ca43827c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-27T06:27:06.126 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T06:27:06.129 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T06:27:07.001 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-27T06:27:07.021 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-27T06:27:07.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:07.133+0000 7fba143da7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-27T06:27:07.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:07.133+0000 7fba143da7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-27T06:27:07.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:07.133+0000 7fba143da7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-27T06:27:07.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:07.133+0000 7fba143da7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-27T06:27:07.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:07.133+0000 7fba143da7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-27T06:27:07.132 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:07.133+0000 7fba143da7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-27T06:27:10.184 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-27T06:27:10.205 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-27T06:27:10.205 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:27:10.206 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-27T06:27:10.228 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:27:10.228 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-27T06:27:10.292 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:27:10.292 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-27T06:27:10.356 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:27:10.356 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-27T06:27:10.420 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:27:10.421 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-27T06:27:10.484 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:27:10.484 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-27T06:27:10.548 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:27:10.548 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-27T06:27:10.611 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:27:10.612 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-27T06:27:10.634 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:27:10.634 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-27T06:27:10.697 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:27:10.697 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-27T06:27:10.761 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:27:10.761 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-27T06:27:10.825 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:27:10.825 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-27T06:27:10.888 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:27:10.888 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-27T06:27:10.952 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:27:10.952 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-27T06:27:11.017 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:27:11.017 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-27T06:27:11.026 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:27:11.026 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-05-27T06:27:11.076 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:27:11.076 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-27T06:27:11.085 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:27:11.085 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-05-27T06:27:11.136 INFO:tasks.ceph:Adding keys to all mons... 2024-05-27T06:27:11.136 DEBUG:teuthology.orchestra.run.smithi087:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-27T06:27:11.139 DEBUG:teuthology.orchestra.run.smithi149:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-27T06:27:11.184 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr.y] 2024-05-27T06:27:11.184 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCeJ1RmMh1fHxAAV0EJocBVjB0EIzmInIZFVw== 2024-05-27T06:27:11.184 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a] 2024-05-27T06:27:11.184 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCeJ1RmervxKBAAoI8i952fjbs3eqb1PTsgIw== 2024-05-27T06:27:11.184 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.c] 2024-05-27T06:27:11.184 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCeJ1RmHqu/MBAAL1h8SSHzJkmv2qutGkSlpw== 2024-05-27T06:27:11.184 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.0] 2024-05-27T06:27:11.184 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCiJ1RmVDNWBhAA1OmU3UT0GCj5L+VKhDGH7g== 2024-05-27T06:27:11.184 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.1] 2024-05-27T06:27:11.184 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQClJ1RmoDbTEhAAUG495eGC9Oj4rJ6FUu8fuw== 2024-05-27T06:27:11.185 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.2] 2024-05-27T06:27:11.185 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCoJ1RmKRaYHRAAxvkg0738G5fXJkSs7Op5hg== 2024-05-27T06:27:11.185 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.3] 2024-05-27T06:27:11.185 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCrJ1RmILNKKRAAnZgVA/Egm8DHMZ/2YQqmHA== 2024-05-27T06:27:11.185 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr.x] 2024-05-27T06:27:11.185 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCeJ1Rmf+/gIxAA4Spz0TeMdwjCMfsfGi1+lQ== 2024-05-27T06:27:11.185 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.b] 2024-05-27T06:27:11.185 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCeJ1RmUgx4NhAAG6bWGMQa3nvZwlrIuqIoPw== 2024-05-27T06:27:11.185 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.d] 2024-05-27T06:27:11.185 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCfJ1RmkhfMAhAAh2P/KsxH6TjNuN1lcdi34g== 2024-05-27T06:27:11.185 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.4] 2024-05-27T06:27:11.185 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCxJ1RmlldAIRAAE7xPqjOhCXGBy8R8SetoAQ== 2024-05-27T06:27:11.185 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.5] 2024-05-27T06:27:11.185 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQC0J1RmctJ5LRAAJNyV09Axs44PTvNsplmyjg== 2024-05-27T06:27:11.185 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.6] 2024-05-27T06:27:11.186 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQC3J1RmMU3QOBAAxSaigZ2H/6Rh/9zzFjD2EQ== 2024-05-27T06:27:11.186 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.7] 2024-05-27T06:27:11.186 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQC7J1RmhVUWCBAAsehamp4zjDXhU3shpMkqrQ== 2024-05-27T06:27:11.186 INFO:teuthology.orchestra.run.smithi087.stdout:[client.0] 2024-05-27T06:27:11.186 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCfJ1RmAld8BxAAigqU2F3mGXtAfw0L9Bfp2A== 2024-05-27T06:27:11.186 INFO:teuthology.orchestra.run.smithi087.stdout:[client.2] 2024-05-27T06:27:11.186 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCfJ1RmUByHCxAASgfa8jGPseHppkHqVMb++Q== 2024-05-27T06:27:11.186 INFO:teuthology.orchestra.run.smithi087.stdout:[client.1] 2024-05-27T06:27:11.186 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCfJ1RmZDSHDxAAv5a4tqOVEtCQpM2NLf/Hhw== 2024-05-27T06:27:11.186 INFO:teuthology.orchestra.run.smithi087.stdout:[client.3] 2024-05-27T06:27:11.186 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCfJ1Rm2gSgExAAzkY0fRetTrfU8VqBpP3GJQ== 2024-05-27T06:27:11.198 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.y] 2024-05-27T06:27:11.198 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCeJ1RmMh1fHxAAV0EJocBVjB0EIzmInIZFVw== 2024-05-27T06:27:11.198 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2024-05-27T06:27:11.198 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCeJ1RmervxKBAAoI8i952fjbs3eqb1PTsgIw== 2024-05-27T06:27:11.198 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.c] 2024-05-27T06:27:11.199 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCeJ1RmHqu/MBAAL1h8SSHzJkmv2qutGkSlpw== 2024-05-27T06:27:11.199 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.0] 2024-05-27T06:27:11.199 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCiJ1RmVDNWBhAA1OmU3UT0GCj5L+VKhDGH7g== 2024-05-27T06:27:11.199 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.1] 2024-05-27T06:27:11.199 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQClJ1RmoDbTEhAAUG495eGC9Oj4rJ6FUu8fuw== 2024-05-27T06:27:11.199 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.2] 2024-05-27T06:27:11.199 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCoJ1RmKRaYHRAAxvkg0738G5fXJkSs7Op5hg== 2024-05-27T06:27:11.199 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.3] 2024-05-27T06:27:11.199 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCrJ1RmILNKKRAAnZgVA/Egm8DHMZ/2YQqmHA== 2024-05-27T06:27:11.199 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.x] 2024-05-27T06:27:11.199 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCeJ1Rmf+/gIxAA4Spz0TeMdwjCMfsfGi1+lQ== 2024-05-27T06:27:11.199 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.b] 2024-05-27T06:27:11.199 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCeJ1RmUgx4NhAAG6bWGMQa3nvZwlrIuqIoPw== 2024-05-27T06:27:11.199 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.d] 2024-05-27T06:27:11.199 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCfJ1RmkhfMAhAAh2P/KsxH6TjNuN1lcdi34g== 2024-05-27T06:27:11.200 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.4] 2024-05-27T06:27:11.200 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCxJ1RmlldAIRAAE7xPqjOhCXGBy8R8SetoAQ== 2024-05-27T06:27:11.200 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.5] 2024-05-27T06:27:11.200 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQC0J1RmctJ5LRAAJNyV09Axs44PTvNsplmyjg== 2024-05-27T06:27:11.200 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.6] 2024-05-27T06:27:11.200 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQC3J1RmMU3QOBAAxSaigZ2H/6Rh/9zzFjD2EQ== 2024-05-27T06:27:11.200 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.7] 2024-05-27T06:27:11.200 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQC7J1RmhVUWCBAAsehamp4zjDXhU3shpMkqrQ== 2024-05-27T06:27:11.200 INFO:teuthology.orchestra.run.smithi149.stdout:[client.0] 2024-05-27T06:27:11.200 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCfJ1RmAld8BxAAigqU2F3mGXtAfw0L9Bfp2A== 2024-05-27T06:27:11.200 INFO:teuthology.orchestra.run.smithi149.stdout:[client.2] 2024-05-27T06:27:11.200 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCfJ1RmUByHCxAASgfa8jGPseHppkHqVMb++Q== 2024-05-27T06:27:11.200 INFO:teuthology.orchestra.run.smithi149.stdout:[client.1] 2024-05-27T06:27:11.200 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCfJ1RmZDSHDxAAv5a4tqOVEtCQpM2NLf/Hhw== 2024-05-27T06:27:11.200 INFO:teuthology.orchestra.run.smithi149.stdout:[client.3] 2024-05-27T06:27:11.200 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCfJ1Rm2gSgExAAzkY0fRetTrfU8VqBpP3GJQ== 2024-05-27T06:27:11.201 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-27T06:27:11.231 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-27T06:27:11.319 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-27T06:27:11.322 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-27T06:27:11.390 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-27T06:27:11.393 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-27T06:27:11.461 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T06:27:11.465 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T06:27:11.529 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T06:27:11.532 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T06:27:11.596 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T06:27:11.599 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T06:27:11.663 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T06:27:11.666 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T06:27:11.730 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-27T06:27:11.733 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-27T06:27:11.798 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-27T06:27:11.801 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-27T06:27:11.868 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-27T06:27:11.871 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-27T06:27:11.938 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T06:27:11.941 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T06:27:12.005 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T06:27:12.008 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T06:27:12.072 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T06:27:12.075 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T06:27:12.139 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T06:27:12.142 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T06:27:12.206 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-27T06:27:12.209 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-27T06:27:12.275 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-27T06:27:12.278 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-27T06:27:12.347 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-27T06:27:12.350 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-27T06:27:12.417 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-27T06:27:12.420 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-27T06:27:12.486 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-27T06:27:12.486 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-27T06:27:12.506 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-27T06:27:12.627 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-27T06:27:12.647 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-27T06:27:12.666 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-27T06:27:12.791 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-27T06:27:12.811 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-27T06:27:12.874 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-27T06:27:13.000 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-27T06:27:13.019 DEBUG:teuthology.orchestra.run.smithi087:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-27T06:27:13.022 DEBUG:teuthology.orchestra.run.smithi149:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-27T06:27:13.071 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-27T06:27:13.072 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-27T06:27:13.072 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-27T06:27:13.075 INFO:tasks.ceph.mon.a:Started 2024-05-27T06:27:13.075 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-27T06:27:13.075 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-27T06:27:13.118 INFO:tasks.ceph.mon.b:Started 2024-05-27T06:27:13.119 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-27T06:27:13.119 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-27T06:27:13.122 INFO:tasks.ceph.mon.c:Started 2024-05-27T06:27:13.122 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-27T06:27:13.122 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-27T06:27:13.122 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-27T06:27:13.125 INFO:tasks.ceph.mgr.y:Started 2024-05-27T06:27:13.125 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-27T06:27:13.125 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-27T06:27:13.128 INFO:tasks.ceph.mgr.x:Started 2024-05-27T06:27:13.128 INFO:tasks.ceph:Setting crush tunables to default 2024-05-27T06:27:13.129 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd crush tunables default 2024-05-27T06:27:13.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.281+0000 7fe369000640 1 Processor -- start 2024-05-27T06:27:13.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.281+0000 7fe369000640 1 -- start start 2024-05-27T06:27:13.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.285+0000 7fe369000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe3640d1610 0x7fe36406f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:13.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.285+0000 7fe369000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe3640cf130 0x7fe3640d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:13.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.285+0000 7fe369000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3640ce3e0 con 0x7fe3640d20a0 2024-05-27T06:27:13.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.285+0000 7fe369000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fe3640d1410 con 0x7fe3640d1610 2024-05-27T06:27:13.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.285+0000 7fe369000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe3640d24b0 con 0x7fe3640cf130 2024-05-27T06:27:13.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.285+0000 7fe361e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe3640d1610 0x7fe36406f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:13.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.285+0000 7fe361e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe3640d1610 0x7fe36406f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57044/0 (socket says 172.21.15.87:57044) 2024-05-27T06:27:13.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.285+0000 7fe361e00640 1 -- 172.21.15.87:0/3334231115 learned_addr learned my addr 172.21.15.87:0/3334231115 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:13.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.285+0000 7fe361e00640 1 -- 172.21.15.87:0/3334231115 >> v2:172.21.15.87:3300/0 conn(0x7fe3640d1610 msgr2=0x7fe36406f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-27T06:27:13.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.285+0000 7fe361e00640 1 -- 172.21.15.87:0/3334231115 >> v2:172.21.15.87:3300/0 conn(0x7fe3640d1610 msgr2=0x7fe36406f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-27T06:27:13.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.285+0000 7fe361e00640 1 --2- 172.21.15.87:0/3334231115 >> v2:172.21.15.87:3300/0 conn(0x7fe3640d1610 0x7fe36406f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-27T06:27:13.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.285+0000 7fe35be00640 1 --2- 172.21.15.87:0/3334231115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe3640cf130 0x7fe3640d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:13.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.285+0000 7fe361e00640 1 --2- 172.21.15.87:0/3334231115 >> v2:172.21.15.87:3300/0 conn(0x7fe3640d1610 0x7fe36406f920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-27T06:27:13.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.285+0000 7fe35be00640 1 -- 172.21.15.87:0/3334231115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe3640cf130 msgr2=0x7fe3640d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-27T06:27:13.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.285+0000 7fe35be00640 1 -- 172.21.15.87:0/3334231115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe3640cf130 msgr2=0x7fe3640d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-27T06:27:13.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.285+0000 7fe35be00640 1 --2- 172.21.15.87:0/3334231115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe3640cf130 0x7fe3640d1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-27T06:27:13.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.285+0000 7fe35be00640 1 --2- 172.21.15.87:0/3334231115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe3640cf130 0x7fe3640d1b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-27T06:27:13.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.433+0000 7fe361400640 1 -- 172.21.15.87:0/3334231115 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2569757321 0 0) 0x7fe3640ce3e0 con 0x7fe3640d20a0 2024-05-27T06:27:13.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.433+0000 7fe361400640 1 -- 172.21.15.87:0/3334231115 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe348003530 con 0x7fe3640d20a0 2024-05-27T06:27:13.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.441+0000 7fe361400640 1 -- 172.21.15.87:0/3334231115 <== mon.1 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 483953941 0 0) 0x7fe348003530 con 0x7fe3640d20a0 2024-05-27T06:27:13.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.441+0000 7fe361400640 1 -- 172.21.15.87:0/3334231115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe3640cf130 msgr2=0x7fe3640d1b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-27T06:27:13.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.441+0000 7fe361400640 1 --2- 172.21.15.87:0/3334231115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe3640cf130 0x7fe3640d1b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:13.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.441+0000 7fe361400640 1 -- 172.21.15.87:0/3334231115 >> v2:172.21.15.87:3300/0 conn(0x7fe3640d1610 msgr2=0x7fe36406f920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-27T06:27:13.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.441+0000 7fe361400640 1 --2- 172.21.15.87:0/3334231115 >> v2:172.21.15.87:3300/0 conn(0x7fe3640d1610 0x7fe36406f920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:13.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.441+0000 7fe361400640 1 -- 172.21.15.87:0/3334231115 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3640ce650 con 0x7fe3640d20a0 2024-05-27T06:27:13.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.441+0000 7fe361400640 1 -- 172.21.15.87:0/3334231115 <== mon.1 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7fe35c001a80 con 0x7fe3640d20a0 2024-05-27T06:27:13.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.441+0000 7fe361400640 1 -- 172.21.15.87:0/3334231115 >> v1:172.21.15.149:6789/0 conn(0x7fe3640d20a0 legacy=0x7fe3640b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:13.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.441+0000 7fe361400640 1 --2- 172.21.15.87:0/3334231115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe348003a60 0x7fe348003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:13.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.441+0000 7fe361400640 1 --2- 172.21.15.87:0/3334231115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe3640cf130 0x7fe348004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:13.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.441+0000 7fe361400640 1 --2- 172.21.15.87:0/3334231115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe348004d50 0x7fe348005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:13.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.441+0000 7fe361400640 1 -- 172.21.15.87:0/3334231115 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe3640d1410 con 0x7fe348004d50 2024-05-27T06:27:13.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.441+0000 7fe361400640 1 -- 172.21.15.87:0/3334231115 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe3640d24b0 con 0x7fe348003a60 2024-05-27T06:27:13.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.441+0000 7fe361400640 1 -- 172.21.15.87:0/3334231115 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe34800bc30 con 0x7fe3640cf130 2024-05-27T06:27:13.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.441+0000 7fe361e00640 1 --2- 172.21.15.87:0/3334231115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe348003a60 0x7fe348003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:13.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.441+0000 7fe362800640 1 --2- 172.21.15.87:0/3334231115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe348004d50 0x7fe348005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:13.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.441+0000 7fe35be00640 1 --2- 172.21.15.87:0/3334231115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe3640cf130 0x7fe348004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:13.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.441+0000 7fe362800640 1 -- 172.21.15.87:0/3334231115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe3640cf130 msgr2=0x7fe348004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:13.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.441+0000 7fe362800640 1 --2- 172.21.15.87:0/3334231115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe3640cf130 0x7fe348004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:13.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.441+0000 7fe362800640 1 -- 172.21.15.87:0/3334231115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe348003a60 msgr2=0x7fe348003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:13.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.441+0000 7fe362800640 1 --2- 172.21.15.87:0/3334231115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe348003a60 0x7fe348003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:13.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.441+0000 7fe362800640 1 -- 172.21.15.87:0/3334231115 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe348003530 con 0x7fe348004d50 2024-05-27T06:27:13.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.441+0000 7fe361e00640 1 --2- 172.21.15.87:0/3334231115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe348003a60 0x7fe348003ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:27:13.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.445+0000 7fe362800640 1 --2- 172.21.15.87:0/3334231115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe348004d50 0x7fe348005220 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe35c00c490 tx=0x7fe35c01cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879193fcaed15317 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:13.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.445+0000 7fe361400640 1 -- 172.21.15.87:0/3334231115 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35c00c0e0 con 0x7fe348004d50 2024-05-27T06:27:13.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.445+0000 7fe361400640 1 -- 172.21.15.87:0/3334231115 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe35c0a9070 con 0x7fe348004d50 2024-05-27T06:27:13.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.445+0000 7fe361400640 1 -- 172.21.15.87:0/3334231115 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35c0a5e60 con 0x7fe348004d50 2024-05-27T06:27:13.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.445+0000 7fe369000640 1 -- 172.21.15.87:0/3334231115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe348004d50 msgr2=0x7fe348005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:13.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.445+0000 7fe369000640 1 --2- 172.21.15.87:0/3334231115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe348004d50 0x7fe348005220 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe35c00c490 tx=0x7fe35c01cec0 comp rx=0 tx=0).stop 2024-05-27T06:27:13.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.445+0000 7fe362800640 1 -- 172.21.15.87:0/3334231115 reap_dead start 2024-05-27T06:27:13.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.445+0000 7fe369000640 1 -- 172.21.15.87:0/3334231115 shutdown_connections 2024-05-27T06:27:13.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.445+0000 7fe369000640 1 -- 172.21.15.87:0/3334231115 >> 172.21.15.87:0/3334231115 conn(0x7fe3640d3580 msgr2=0x7fe3640d3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:13.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.445+0000 7fe369000640 1 -- 172.21.15.87:0/3334231115 shutdown_connections 2024-05-27T06:27:13.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.445+0000 7fe369000640 1 -- 172.21.15.87:0/3334231115 wait complete. 2024-05-27T06:27:13.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.449+0000 7fe369000640 1 Processor -- start 2024-05-27T06:27:13.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.449+0000 7fe369000640 1 -- start start 2024-05-27T06:27:13.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.449+0000 7fe369000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe3640cd3a0 0x7fe3641f6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:13.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.449+0000 7fe369000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe364161b60 0x7fe364161f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:13.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.449+0000 7fe369000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3641f9aa0 0x7fe3641f9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:13.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.449+0000 7fe369000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe364070020 con 0x7fe364161b60 2024-05-27T06:27:13.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.449+0000 7fe369000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe3640cec10 con 0x7fe3641f9aa0 2024-05-27T06:27:13.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.449+0000 7fe369000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe3640cf540 con 0x7fe3640cd3a0 2024-05-27T06:27:13.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.453+0000 7fe362800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3641f9aa0 0x7fe3641f9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:13.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.453+0000 7fe361e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe3640cd3a0 0x7fe3641f6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:13.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.453+0000 7fe362800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3641f9aa0 0x7fe3641f9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:50412/0 (socket says 172.21.15.87:50412) 2024-05-27T06:27:13.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.453+0000 7fe362800640 1 -- 172.21.15.87:0/1935264485 learned_addr learned my addr 172.21.15.87:0/1935264485 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:13.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.453+0000 7fe35be00640 1 --2- 172.21.15.87:0/1935264485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe364161b60 0x7fe364161f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:13.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.453+0000 7fe361e00640 1 -- 172.21.15.87:0/1935264485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3641f9aa0 msgr2=0x7fe3641f9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:13.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.453+0000 7fe361e00640 1 --2- 172.21.15.87:0/1935264485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3641f9aa0 0x7fe3641f9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:13.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.453+0000 7fe361e00640 1 -- 172.21.15.87:0/1935264485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe364161b60 msgr2=0x7fe364161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:13.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.453+0000 7fe361e00640 1 --2- 172.21.15.87:0/1935264485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe364161b60 0x7fe364161f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:13.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.453+0000 7fe361e00640 1 -- 172.21.15.87:0/1935264485 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe36406a4c0 con 0x7fe3640cd3a0 2024-05-27T06:27:13.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.453+0000 7fe361e00640 1 --2- 172.21.15.87:0/1935264485 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe3640cd3a0 0x7fe3641f6d20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe354010890 tx=0x7fe354010d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:13.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.453+0000 7fe35a000640 1 -- 172.21.15.87:0/1935264485 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe354004440 con 0x7fe3640cd3a0 2024-05-27T06:27:13.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.453+0000 7fe35a000640 1 -- 172.21.15.87:0/1935264485 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe35401b070 con 0x7fe3640cd3a0 2024-05-27T06:27:13.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.453+0000 7fe369000640 1 -- 172.21.15.87:0/1935264485 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3641624b0 con 0x7fe3640cd3a0 2024-05-27T06:27:13.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.453+0000 7fe35a000640 1 -- 172.21.15.87:0/1935264485 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35400e8b0 con 0x7fe3640cd3a0 2024-05-27T06:27:13.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.453+0000 7fe369000640 1 -- 172.21.15.87:0/1935264485 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe36414ec90 con 0x7fe3640cd3a0 2024-05-27T06:27:13.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.453+0000 7fe35a000640 1 -- 172.21.15.87:0/1935264485 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe35400ea50 con 0x7fe3640cd3a0 2024-05-27T06:27:13.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.453+0000 7fe35a000640 1 -- 172.21.15.87:0/1935264485 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe354020460 con 0x7fe3640cd3a0 2024-05-27T06:27:13.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.453+0000 7fe369000640 1 -- 172.21.15.87:0/1935264485 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe36406aa30 con 0x7fe3640cd3a0 2024-05-27T06:27:13.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.457+0000 7fe35a000640 1 -- 172.21.15.87:0/1935264485 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fe3641624b0 con 0x7fe3640cd3a0 2024-05-27T06:27:13.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.521+0000 7fe369000640 1 -- 172.21.15.87:0/1935264485 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fe36406e7e0 con 0x7fe3640cd3a0 2024-05-27T06:27:13.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.525+0000 7fe35a000640 1 -- 172.21.15.87:0/1935264485 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fe354003620 con 0x7fe3640cd3a0 2024-05-27T06:27:13.523 INFO:teuthology.orchestra.run.smithi087.stderr:adjusted tunables profile to default 2024-05-27T06:27:13.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.525+0000 7fe369000640 1 -- 172.21.15.87:0/1935264485 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe3640cd3a0 msgr2=0x7fe3641f6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:13.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.525+0000 7fe369000640 1 --2- 172.21.15.87:0/1935264485 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe3640cd3a0 0x7fe3641f6d20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe354010890 tx=0x7fe354010d50 comp rx=0 tx=0).stop 2024-05-27T06:27:13.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.525+0000 7fe369000640 1 -- 172.21.15.87:0/1935264485 shutdown_connections 2024-05-27T06:27:13.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.525+0000 7fe369000640 1 --2- 172.21.15.87:0/1935264485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3641f9aa0 0x7fe3641f9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:13.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.525+0000 7fe369000640 1 --2- 172.21.15.87:0/1935264485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe364161b60 0x7fe364161f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:13.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.525+0000 7fe369000640 1 --2- 172.21.15.87:0/1935264485 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe3640cd3a0 0x7fe3641f6d20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:13.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.525+0000 7fe369000640 1 -- 172.21.15.87:0/1935264485 >> 172.21.15.87:0/1935264485 conn(0x7fe3640d3580 msgr2=0x7fe3640b8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:13.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.525+0000 7fe369000640 1 -- 172.21.15.87:0/1935264485 shutdown_connections 2024-05-27T06:27:13.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:13.525+0000 7fe369000640 1 -- 172.21.15.87:0/1935264485 wait complete. 2024-05-27T06:27:13.544 INFO:tasks.ceph:check_enable_crimson: False 2024-05-27T06:27:13.544 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-27T06:27:13.545 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:27:13.545 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-27T06:27:13.564 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:27:13.564 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-27T06:27:13.627 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:27:13.627 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-27T06:27:13.645 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-27T06:27:13.649+0000 7f3ce6c84180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-27T06:27:13.661 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-27T06:27:13.665+0000 7f1306c66180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-27T06:27:13.664 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:27:13.664 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-27T06:27:13.724 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:27:13.724 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-27T06:27:13.744 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:27:13.744 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-27T06:27:13.807 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:27:13.807 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-27T06:27:13.867 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:27:13.867 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-27T06:27:13.928 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 1942691b-9f09-45e6-9661-e5537bda358d 0 2024-05-27T06:27:14.115 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.117+0000 7f1beb400640 1 Processor -- start 2024-05-27T06:27:14.115 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.117+0000 7f1beb400640 1 -- start start 2024-05-27T06:27:14.117 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.121+0000 7f1beb400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1be40b43b0 0x7f1be40b69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:14.117 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.121+0000 7f1beb400640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1be415e370 con 0x7f1be40ce100 2024-05-27T06:27:14.117 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.121+0000 7f1beb400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1be40b3310 con 0x7f1be40b47c0 2024-05-27T06:27:14.117 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.121+0000 7f1beb400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f1be40b35f0 con 0x7f1be40b43b0 2024-05-27T06:27:14.117 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.121+0000 7f1be3e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f1be40b47c0 0x7f1be40b6f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44978/0 (socket says 172.21.15.149:44978) 2024-05-27T06:27:14.117 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.121+0000 7f1be3e00640 1 -- 172.21.15.149:0/4017357288 learned_addr learned my addr 172.21.15.149:0/4017357288 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-05-27T06:27:14.118 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.121+0000 7f1be8a00640 1 --2- 172.21.15.149:0/4017357288 >> v2:172.21.15.87:3300/0 conn(0x7f1be40b43b0 0x7f1be40b69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:14.118 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.121+0000 7f1be3400640 1 -- 172.21.15.149:0/4017357288 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 489840032 0 0) 0x7f1be40b3310 con 0x7f1be40b47c0 2024-05-27T06:27:14.118 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.121+0000 7f1be3400640 1 -- 172.21.15.149:0/4017357288 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bcc003530 con 0x7f1be40b47c0 2024-05-27T06:27:14.118 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.121+0000 7f1be8a00640 1 -- 172.21.15.149:0/4017357288 >> v1:172.21.15.149:6789/0 conn(0x7f1be40b47c0 legacy=0x7f1be40b6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:14.119 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.121+0000 7f1be8a00640 1 -- 172.21.15.149:0/4017357288 >> v1:172.21.15.87:6789/0 conn(0x7f1be40ce100 legacy=0x7f1be40ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:14.119 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.121+0000 7f1be3400640 1 -- 172.21.15.149:0/4017357288 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3381826689 0 0) 0x7f1be415e370 con 0x7f1be40ce100 2024-05-27T06:27:14.119 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.121+0000 7f1be8a00640 1 -- 172.21.15.149:0/4017357288 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be40b38d0 con 0x7f1be40b43b0 2024-05-27T06:27:14.120 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.125+0000 7f1be8a00640 1 --2- 172.21.15.149:0/4017357288 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1be40b43b0 0x7f1be40b69f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80097c0 tx=0x7f1bd801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d20e850a264a7e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:14.121 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.125+0000 7f1be3400640 1 -- 172.21.15.149:0/4017357288 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd80b0070 con 0x7f1be40b43b0 2024-05-27T06:27:14.121 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.125+0000 7f1be3400640 1 -- 172.21.15.149:0/4017357288 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd80ab600 con 0x7f1be40b43b0 2024-05-27T06:27:14.121 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.125+0000 7f1be3400640 1 -- 172.21.15.149:0/4017357288 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd80ab9d0 con 0x7f1be40b43b0 2024-05-27T06:27:14.122 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.125+0000 7f1beb400640 1 -- 172.21.15.149:0/4017357288 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1be40b43b0 msgr2=0x7f1be40b69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:14.122 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.125+0000 7f1beb400640 1 --2- 172.21.15.149:0/4017357288 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1be40b43b0 0x7f1be40b69f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80097c0 tx=0x7f1bd801c410 comp rx=0 tx=0).stop 2024-05-27T06:27:14.122 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.125+0000 7f1beb400640 1 -- 172.21.15.149:0/4017357288 shutdown_connections 2024-05-27T06:27:14.122 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.125+0000 7f1beb400640 1 --2- 172.21.15.149:0/4017357288 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1be40b43b0 0x7f1be40b69f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.122 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.125+0000 7f1beb400640 1 -- 172.21.15.149:0/4017357288 >> 172.21.15.149:0/4017357288 conn(0x7f1be40d3580 msgr2=0x7f1be40d3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:14.123 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.125+0000 7f1beb400640 1 -- 172.21.15.149:0/4017357288 shutdown_connections 2024-05-27T06:27:14.123 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.125+0000 7f1beb400640 1 -- 172.21.15.149:0/4017357288 wait complete. 2024-05-27T06:27:14.124 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.125+0000 7f1beb400640 1 Processor -- start 2024-05-27T06:27:14.124 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.129+0000 7f1beb400640 1 -- start start 2024-05-27T06:27:14.127 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.129+0000 7f1beb400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1be40b43b0 0x7f1be40cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:14.127 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.129+0000 7f1beb400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1be40b47c0 0x7f1be4157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:14.127 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.129+0000 7f1beb400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1be40ce100 0x7f1be41515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:14.127 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.129+0000 7f1beb400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1be416c760 con 0x7f1be40b47c0 2024-05-27T06:27:14.127 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.129+0000 7f1beb400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1be416c5e0 con 0x7f1be40ce100 2024-05-27T06:27:14.127 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.129+0000 7f1beb400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1be416c8e0 con 0x7f1be40b43b0 2024-05-27T06:27:14.127 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.129+0000 7f1be8a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1be40b43b0 0x7f1be40cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:14.128 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.129+0000 7f1be8a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1be40b43b0 0x7f1be40cd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:42542/0 (socket says 172.21.15.149:42542) 2024-05-27T06:27:14.128 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.129+0000 7f1be8a00640 1 -- 172.21.15.149:0/4186269427 learned_addr learned my addr 172.21.15.149:0/4186269427 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-05-27T06:27:14.128 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.129+0000 7f1be9400640 1 --2- 172.21.15.149:0/4186269427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1be40ce100 0x7f1be41515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:14.128 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.129+0000 7f1be3e00640 1 --2- 172.21.15.149:0/4186269427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1be40b47c0 0x7f1be4157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:14.128 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.129+0000 7f1be8a00640 1 -- 172.21.15.149:0/4186269427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1be40ce100 msgr2=0x7f1be41515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:14.128 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.129+0000 7f1be8a00640 1 --2- 172.21.15.149:0/4186269427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1be40ce100 0x7f1be41515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.128 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.129+0000 7f1be8a00640 1 -- 172.21.15.149:0/4186269427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1be40b47c0 msgr2=0x7f1be4157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:14.128 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.129+0000 7f1be8a00640 1 --2- 172.21.15.149:0/4186269427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1be40b47c0 0x7f1be4157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.128 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.129+0000 7f1be8a00640 1 -- 172.21.15.149:0/4186269427 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be415eec0 con 0x7f1be40b43b0 2024-05-27T06:27:14.128 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.129+0000 7f1be3e00640 1 --2- 172.21.15.149:0/4186269427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1be40b47c0 0x7f1be4157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:27:14.128 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.129+0000 7f1be8a00640 1 --2- 172.21.15.149:0/4186269427 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1be40b43b0 0x7f1be40cd2e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80ae040 tx=0x7f1bd801ac50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:14.129 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.129+0000 7f1be0c00640 1 -- 172.21.15.149:0/4186269427 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd80bb020 con 0x7f1be40b43b0 2024-05-27T06:27:14.129 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.129+0000 7f1be0c00640 1 -- 172.21.15.149:0/4186269427 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd80b1040 con 0x7f1be40b43b0 2024-05-27T06:27:14.129 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.129+0000 7f1be0c00640 1 -- 172.21.15.149:0/4186269427 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd80b0050 con 0x7f1be40b43b0 2024-05-27T06:27:14.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.129+0000 7f1beb400640 1 -- 172.21.15.149:0/4186269427 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1be415e720 con 0x7f1be40b43b0 2024-05-27T06:27:14.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.129+0000 7f1beb400640 1 -- 172.21.15.149:0/4186269427 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1be415ded0 con 0x7f1be40b43b0 2024-05-27T06:27:14.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.133+0000 7f1be0c00640 1 -- 172.21.15.149:0/4186269427 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1bd80be070 con 0x7f1be40b43b0 2024-05-27T06:27:14.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.133+0000 7f1be0c00640 1 -- 172.21.15.149:0/4186269427 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f1bd80b5b10 con 0x7f1be40b43b0 2024-05-27T06:27:14.130 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.133+0000 7f1beb400640 1 -- 172.21.15.149:0/4186269427 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1be406aa30 con 0x7f1be40b43b0 2024-05-27T06:27:14.130 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-27T06:27:14.133+0000 7f3ce6c84180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-27T06:27:14.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.133+0000 7f1be0c00640 1 -- 172.21.15.149:0/4186269427 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f1bd80c4080 con 0x7f1be40b43b0 2024-05-27T06:27:14.198 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.201+0000 7f1beb400640 1 -- 172.21.15.149:0/4186269427 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1942691b-9f09-45e6-9661-e5537bda358d", "id": 0} v 0) -- 0x7f1be40d1870 con 0x7f1be40b43b0 2024-05-27T06:27:14.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.205+0000 7f1be0c00640 1 -- 172.21.15.149:0/4186269427 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1942691b-9f09-45e6-9661-e5537bda358d", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f1bd8016090 con 0x7f1be40b43b0 2024-05-27T06:27:14.203 INFO:teuthology.orchestra.run.smithi149.stdout:0 2024-05-27T06:27:14.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.205+0000 7f1beb400640 1 -- 172.21.15.149:0/4186269427 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1be40b43b0 msgr2=0x7f1be40cd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:14.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.205+0000 7f1beb400640 1 --2- 172.21.15.149:0/4186269427 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1be40b43b0 0x7f1be40cd2e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80ae040 tx=0x7f1bd801ac50 comp rx=0 tx=0).stop 2024-05-27T06:27:14.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.205+0000 7f1beb400640 1 -- 172.21.15.149:0/4186269427 shutdown_connections 2024-05-27T06:27:14.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.205+0000 7f1beb400640 1 --2- 172.21.15.149:0/4186269427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1be40ce100 0x7f1be41515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.205+0000 7f1beb400640 1 --2- 172.21.15.149:0/4186269427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1be40b47c0 0x7f1be4157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.205+0000 7f1beb400640 1 --2- 172.21.15.149:0/4186269427 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1be40b43b0 0x7f1be40cd2e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.205+0000 7f1beb400640 1 -- 172.21.15.149:0/4186269427 >> 172.21.15.149:0/4186269427 conn(0x7f1be40d3580 msgr2=0x7f1be40702d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:14.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.205+0000 7f1beb400640 1 -- 172.21.15.149:0/4186269427 shutdown_connections 2024-05-27T06:27:14.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.205+0000 7f1beb400640 1 -- 172.21.15.149:0/4186269427 wait complete. 2024-05-27T06:27:14.212 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-27T06:27:14.213+0000 7f1306c66180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-27T06:27:14.223 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 34ceb0c9-288b-4037-b12b-7cf8b62d050a 1 2024-05-27T06:27:14.346 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-27T06:27:14.349+0000 7f3ce6c84180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-27T06:27:14.370 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.373+0000 7f91b7000640 1 Processor -- start 2024-05-27T06:27:14.370 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.373+0000 7f91b7000640 1 -- start start 2024-05-27T06:27:14.373 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.373+0000 7f91b7000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91b00ce4d0 0x7f91b0161800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:14.373 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.373+0000 7f91b7000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f91b00ce8e0 0x7f91b0161d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:14.373 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.373+0000 7f91b7000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91b00b8480 con 0x7f91b00c8300 2024-05-27T06:27:14.373 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.373+0000 7f91b7000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f91b00b73e0 con 0x7f91b00ce8e0 2024-05-27T06:27:14.373 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.373+0000 7f91b7000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f91b00b76c0 con 0x7f91b00ce4d0 2024-05-27T06:27:14.373 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.373+0000 7f91afe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91b00ce4d0 0x7f91b0161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:14.373 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.373+0000 7f91b5000640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f91b00c8300 0x7f91b00c8710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44982/0 (socket says 172.21.15.149:44982) 2024-05-27T06:27:14.373 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.373+0000 7f91b5000640 1 -- 172.21.15.149:0/2723744616 learned_addr learned my addr 172.21.15.149:0/2723744616 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-05-27T06:27:14.374 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.377+0000 7f91a7400640 1 --2- 172.21.15.149:0/2723744616 >> v2:172.21.15.87:3300/0 conn(0x7f91b00ce8e0 0x7f91b0161d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:14.374 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.377+0000 7f91afe00640 1 -- 172.21.15.149:0/2723744616 >> v2:172.21.15.87:3300/0 conn(0x7f91b00ce8e0 msgr2=0x7f91b0161d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:14.374 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.377+0000 7f91af400640 1 -- 172.21.15.149:0/2723744616 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2606607041 0 0) 0x7f91b00b8480 con 0x7f91b00c8300 2024-05-27T06:27:14.374 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.377+0000 7f91afe00640 1 --2- 172.21.15.149:0/2723744616 >> v2:172.21.15.87:3300/0 conn(0x7f91b00ce8e0 0x7f91b0161d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.374 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.377+0000 7f91afe00640 1 -- 172.21.15.149:0/2723744616 >> v1:172.21.15.149:6789/0 conn(0x7f91b00c8300 legacy=0x7f91b00c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:14.374 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.377+0000 7f91afe00640 1 -- 172.21.15.149:0/2723744616 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b00b79a0 con 0x7f91b00ce4d0 2024-05-27T06:27:14.376 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.377+0000 7f91afe00640 1 --2- 172.21.15.149:0/2723744616 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91b00ce4d0 0x7f91b0161800 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f91a00097c0 tx=0x7f91a001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4d32151ef17f216 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:14.376 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.377+0000 7f91af400640 1 -- 172.21.15.149:0/2723744616 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a00a7070 con 0x7f91b00ce4d0 2024-05-27T06:27:14.376 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.377+0000 7f91af400640 1 -- 172.21.15.149:0/2723744616 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a00b0070 con 0x7f91b00ce4d0 2024-05-27T06:27:14.376 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.377+0000 7f91af400640 1 -- 172.21.15.149:0/2723744616 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a00ab890 con 0x7f91b00ce4d0 2024-05-27T06:27:14.377 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.381+0000 7f91b7000640 1 -- 172.21.15.149:0/2723744616 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91b00ce4d0 msgr2=0x7f91b0161800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:14.377 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.381+0000 7f91b7000640 1 --2- 172.21.15.149:0/2723744616 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91b00ce4d0 0x7f91b0161800 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f91a00097c0 tx=0x7f91a001c470 comp rx=0 tx=0).stop 2024-05-27T06:27:14.377 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.381+0000 7f91b7000640 1 -- 172.21.15.149:0/2723744616 shutdown_connections 2024-05-27T06:27:14.377 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.381+0000 7f91b7000640 1 --2- 172.21.15.149:0/2723744616 >> v2:172.21.15.87:3300/0 conn(0x7f91b00ce8e0 0x7f91b0161d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.377 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.381+0000 7f91b7000640 1 --2- 172.21.15.149:0/2723744616 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91b00ce4d0 0x7f91b0161800 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.377 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.381+0000 7f91b7000640 1 -- 172.21.15.149:0/2723744616 >> 172.21.15.149:0/2723744616 conn(0x7f91b00712e0 msgr2=0x7f91b00716f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:14.377 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.381+0000 7f91b7000640 1 -- 172.21.15.149:0/2723744616 shutdown_connections 2024-05-27T06:27:14.377 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.381+0000 7f91b7000640 1 -- 172.21.15.149:0/2723744616 wait complete. 2024-05-27T06:27:14.379 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.381+0000 7f91b7000640 1 Processor -- start 2024-05-27T06:27:14.380 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.381+0000 7f91b7000640 1 -- start start 2024-05-27T06:27:14.383 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.385+0000 7f91b7000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91b00c8300 0x7f91b015e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:14.383 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.385+0000 7f91b7000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91b00ce4d0 0x7f91b0157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:14.383 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.385+0000 7f91b7000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91b00ce8e0 0x7f91b014c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:14.384 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.385+0000 7f91b7000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f91b00c8e20 con 0x7f91b00ce8e0 2024-05-27T06:27:14.384 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.385+0000 7f91b7000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f91b0072190 con 0x7f91b00c8300 2024-05-27T06:27:14.384 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.385+0000 7f91b7000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f91b00c8fa0 con 0x7f91b00ce4d0 2024-05-27T06:27:14.384 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.385+0000 7f91a7400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91b00ce4d0 0x7f91b0157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:14.384 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.385+0000 7f91a7400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91b00ce4d0 0x7f91b0157670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:42572/0 (socket says 172.21.15.149:42572) 2024-05-27T06:27:14.384 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.385+0000 7f91a7400640 1 -- 172.21.15.149:0/4046477625 learned_addr learned my addr 172.21.15.149:0/4046477625 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-05-27T06:27:14.384 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.385+0000 7f91afe00640 1 --2- 172.21.15.149:0/4046477625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91b00c8300 0x7f91b015e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:14.384 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.385+0000 7f91b5000640 1 --2- 172.21.15.149:0/4046477625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91b00ce8e0 0x7f91b014c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:14.384 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.385+0000 7f91afe00640 1 -- 172.21.15.149:0/4046477625 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91b00ce4d0 msgr2=0x7f91b0157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:14.384 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.385+0000 7f91afe00640 1 --2- 172.21.15.149:0/4046477625 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91b00ce4d0 0x7f91b0157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.384 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.385+0000 7f91afe00640 1 -- 172.21.15.149:0/4046477625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91b00ce8e0 msgr2=0x7f91b014c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:14.384 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.385+0000 7f91afe00640 1 --2- 172.21.15.149:0/4046477625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91b00ce8e0 0x7f91b014c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.384 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.385+0000 7f91afe00640 1 -- 172.21.15.149:0/4046477625 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b0155f90 con 0x7f91b00c8300 2024-05-27T06:27:14.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.385+0000 7f91afe00640 1 --2- 172.21.15.149:0/4046477625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91b00c8300 0x7f91b015e930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f91a00ac000 tx=0x7f91a001acb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:14.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.385+0000 7f91acc00640 1 -- 172.21.15.149:0/4046477625 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a00bf610 con 0x7f91b00c8300 2024-05-27T06:27:14.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.385+0000 7f91acc00640 1 -- 172.21.15.149:0/4046477625 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a00bf7f0 con 0x7f91b00c8300 2024-05-27T06:27:14.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.385+0000 7f91acc00640 1 -- 172.21.15.149:0/4046477625 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a00bfbe0 con 0x7f91b00c8300 2024-05-27T06:27:14.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.385+0000 7f91b7000640 1 -- 172.21.15.149:0/4046477625 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91b0156490 con 0x7f91b00c8300 2024-05-27T06:27:14.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.385+0000 7f91b7000640 1 -- 172.21.15.149:0/4046477625 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91b0156a50 con 0x7f91b00c8300 2024-05-27T06:27:14.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.385+0000 7f91acc00640 1 -- 172.21.15.149:0/4046477625 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f91a00bd020 con 0x7f91b00c8300 2024-05-27T06:27:14.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.385+0000 7f91acc00640 1 -- 172.21.15.149:0/4046477625 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f91a00c87a0 con 0x7f91b00c8300 2024-05-27T06:27:14.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.385+0000 7f91b7000640 1 -- 172.21.15.149:0/4046477625 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91b006aa30 con 0x7f91b00c8300 2024-05-27T06:27:14.386 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.389+0000 7f91acc00640 1 -- 172.21.15.149:0/4046477625 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f91a0016090 con 0x7f91b00c8300 2024-05-27T06:27:14.446 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-27T06:27:14.449+0000 7f1306c66180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-27T06:27:14.455 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.457+0000 7f91b7000640 1 -- 172.21.15.149:0/4046477625 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "34ceb0c9-288b-4037-b12b-7cf8b62d050a", "id": 1} v 0) -- 0x7f91b015c990 con 0x7f91b00c8300 2024-05-27T06:27:14.460 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.465+0000 7f91acc00640 1 -- 172.21.15.149:0/4046477625 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "34ceb0c9-288b-4037-b12b-7cf8b62d050a", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f91a00cd020 con 0x7f91b00c8300 2024-05-27T06:27:14.461 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-05-27T06:27:14.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.465+0000 7f91b7000640 1 -- 172.21.15.149:0/4046477625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91b00c8300 msgr2=0x7f91b015e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:14.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.465+0000 7f91b7000640 1 --2- 172.21.15.149:0/4046477625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91b00c8300 0x7f91b015e930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f91a00ac000 tx=0x7f91a001acb0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.465+0000 7f91b7000640 1 -- 172.21.15.149:0/4046477625 shutdown_connections 2024-05-27T06:27:14.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.465+0000 7f91b7000640 1 --2- 172.21.15.149:0/4046477625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91b00ce8e0 0x7f91b014c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.465+0000 7f91b7000640 1 --2- 172.21.15.149:0/4046477625 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91b00ce4d0 0x7f91b0157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.465+0000 7f91b7000640 1 --2- 172.21.15.149:0/4046477625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91b00c8300 0x7f91b015e930 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.465+0000 7f91b7000640 1 -- 172.21.15.149:0/4046477625 >> 172.21.15.149:0/4046477625 conn(0x7f91b00712e0 msgr2=0x7f91b015f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:14.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.465+0000 7f91b7000640 1 -- 172.21.15.149:0/4046477625 shutdown_connections 2024-05-27T06:27:14.462 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.465+0000 7f91b7000640 1 -- 172.21.15.149:0/4046477625 wait complete. 2024-05-27T06:27:14.481 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new cfcce718-4b57-41ae-850c-2aeb821a9d85 2 2024-05-27T06:27:14.628 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.629+0000 7fed8f200640 1 Processor -- start 2024-05-27T06:27:14.629 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.633+0000 7fed8f200640 1 -- start start 2024-05-27T06:27:14.630 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.633+0000 7fed8f200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fed880d1610 0x7fed8806f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:14.630 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.633+0000 7fed8f200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed880ce3e0 con 0x7fed880d2270 2024-05-27T06:27:14.630 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.633+0000 7fed8f200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed880d1410 con 0x7fed880cf130 2024-05-27T06:27:14.631 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.633+0000 7fed8f200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fed880ce650 con 0x7fed880d1610 2024-05-27T06:27:14.631 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.633+0000 7fed87e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fed880d1610 0x7fed8806f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:14.631 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.633+0000 7fed7fe00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fed880cf130 0x7fed880d1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:44998/0 (socket says 172.21.15.149:44998) 2024-05-27T06:27:14.631 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.633+0000 7fed7fe00640 1 -- 172.21.15.149:0/2653513488 learned_addr learned my addr 172.21.15.149:0/2653513488 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-05-27T06:27:14.631 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.633+0000 7fed87e00640 1 -- 172.21.15.149:0/2653513488 >> v1:172.21.15.149:6789/0 conn(0x7fed880cf130 legacy=0x7fed880d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:14.631 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.633+0000 7fed87e00640 1 -- 172.21.15.149:0/2653513488 >> v1:172.21.15.87:6789/0 conn(0x7fed880d2270 legacy=0x7fed880b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:14.631 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.633+0000 7fed87e00640 1 -- 172.21.15.149:0/2653513488 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed880ce930 con 0x7fed880d1610 2024-05-27T06:27:14.634 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.637+0000 7fed87e00640 1 --2- 172.21.15.149:0/2653513488 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed880d1610 0x7fed8806f920 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fed780097c0 tx=0x7fed7801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f5d70e961ca81d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:14.634 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.637+0000 7fed87400640 1 -- 172.21.15.149:0/2653513488 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed780aa620 con 0x7fed880d1610 2024-05-27T06:27:14.634 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.637+0000 7fed87400640 1 -- 172.21.15.149:0/2653513488 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed780af070 con 0x7fed880d1610 2024-05-27T06:27:14.634 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.637+0000 7fed87400640 1 -- 172.21.15.149:0/2653513488 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed780aa9e0 con 0x7fed880d1610 2024-05-27T06:27:14.635 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.637+0000 7fed8f200640 1 -- 172.21.15.149:0/2653513488 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed880d1610 msgr2=0x7fed8806f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:14.635 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.637+0000 7fed8f200640 1 --2- 172.21.15.149:0/2653513488 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed880d1610 0x7fed8806f920 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fed780097c0 tx=0x7fed7801c4a0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.635 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.637+0000 7fed8f200640 1 -- 172.21.15.149:0/2653513488 shutdown_connections 2024-05-27T06:27:14.635 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.637+0000 7fed8f200640 1 --2- 172.21.15.149:0/2653513488 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed880d1610 0x7fed8806f920 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.635 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.637+0000 7fed8f200640 1 -- 172.21.15.149:0/2653513488 >> 172.21.15.149:0/2653513488 conn(0x7fed880d3580 msgr2=0x7fed880d3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:14.635 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.637+0000 7fed8f200640 1 -- 172.21.15.149:0/2653513488 shutdown_connections 2024-05-27T06:27:14.635 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.637+0000 7fed8f200640 1 -- 172.21.15.149:0/2653513488 wait complete. 2024-05-27T06:27:14.637 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.641+0000 7fed8f200640 1 Processor -- start 2024-05-27T06:27:14.637 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.641+0000 7fed8f200640 1 -- start start 2024-05-27T06:27:14.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.641+0000 7fed8f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed880cf130 0x7fed880ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:14.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.641+0000 7fed8f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed880d1610 0x7fed88152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:14.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.641+0000 7fed8f200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed88159130 0x7fed88159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:14.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.641+0000 7fed8f200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fed8816e800 con 0x7fed88159130 2024-05-27T06:27:14.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.641+0000 7fed8f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fed880b39c0 con 0x7fed880d1610 2024-05-27T06:27:14.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.641+0000 7fed8f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fed8816e980 con 0x7fed880cf130 2024-05-27T06:27:14.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.641+0000 7fed87e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed880cf130 0x7fed880ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:14.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.641+0000 7fed7fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed880d1610 0x7fed88152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:14.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.641+0000 7fed87e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed880cf130 0x7fed880ae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:42588/0 (socket says 172.21.15.149:42588) 2024-05-27T06:27:14.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.641+0000 7fed87e00640 1 -- 172.21.15.149:0/3827439651 learned_addr learned my addr 172.21.15.149:0/3827439651 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-05-27T06:27:14.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.641+0000 7fed8d200640 1 --2- 172.21.15.149:0/3827439651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed88159130 0x7fed88159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:14.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.641+0000 7fed7fe00640 1 -- 172.21.15.149:0/3827439651 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed880cf130 msgr2=0x7fed880ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:14.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.641+0000 7fed7fe00640 1 --2- 172.21.15.149:0/3827439651 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed880cf130 0x7fed880ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.641+0000 7fed7fe00640 1 -- 172.21.15.149:0/3827439651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed88159130 msgr2=0x7fed88159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:14.641 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.641+0000 7fed7fe00640 1 --2- 172.21.15.149:0/3827439651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed88159130 0x7fed88159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.641 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.641+0000 7fed7fe00640 1 -- 172.21.15.149:0/3827439651 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed88159a80 con 0x7fed880d1610 2024-05-27T06:27:14.641 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.641+0000 7fed87e00640 1 --2- 172.21.15.149:0/3827439651 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed880cf130 0x7fed880ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:27:14.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.641+0000 7fed7fe00640 1 --2- 172.21.15.149:0/3827439651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed880d1610 0x7fed88152a70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fed7000c370 tx=0x7fed7000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:14.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.641+0000 7fed84c00640 1 -- 172.21.15.149:0/3827439651 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed70017070 con 0x7fed880d1610 2024-05-27T06:27:14.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.641+0000 7fed84c00640 1 -- 172.21.15.149:0/3827439651 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed700074e0 con 0x7fed880d1610 2024-05-27T06:27:14.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.641+0000 7fed8f200640 1 -- 172.21.15.149:0/3827439651 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed88152fb0 con 0x7fed880d1610 2024-05-27T06:27:14.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.641+0000 7fed84c00640 1 -- 172.21.15.149:0/3827439651 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed700059b0 con 0x7fed880d1610 2024-05-27T06:27:14.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.645+0000 7fed8f200640 1 -- 172.21.15.149:0/3827439651 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed881536c0 con 0x7fed880d1610 2024-05-27T06:27:14.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.645+0000 7fed84c00640 1 -- 172.21.15.149:0/3827439651 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fed7001a070 con 0x7fed880d1610 2024-05-27T06:27:14.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.645+0000 7fed84c00640 1 -- 172.21.15.149:0/3827439651 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fed70005b50 con 0x7fed880d1610 2024-05-27T06:27:14.642 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.645+0000 7fed8f200640 1 -- 172.21.15.149:0/3827439651 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed88153430 con 0x7fed880d1610 2024-05-27T06:27:14.644 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.645+0000 7fed84c00640 1 -- 172.21.15.149:0/3827439651 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fed88159a80 con 0x7fed880d1610 2024-05-27T06:27:14.710 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.713+0000 7fed8f200640 1 -- 172.21.15.149:0/3827439651 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cfcce718-4b57-41ae-850c-2aeb821a9d85", "id": 2} v 0) -- 0x7fed8806aa30 con 0x7fed880d1610 2024-05-27T06:27:14.716 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.717+0000 7fed84c00640 1 -- 172.21.15.149:0/3827439651 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cfcce718-4b57-41ae-850c-2aeb821a9d85", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fed880d1410 con 0x7fed880d1610 2024-05-27T06:27:14.716 INFO:teuthology.orchestra.run.smithi149.stdout:2 2024-05-27T06:27:14.717 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.721+0000 7fed8f200640 1 -- 172.21.15.149:0/3827439651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed880d1610 msgr2=0x7fed88152a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:14.717 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.721+0000 7fed8f200640 1 --2- 172.21.15.149:0/3827439651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed880d1610 0x7fed88152a70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fed7000c370 tx=0x7fed7000c830 comp rx=0 tx=0).stop 2024-05-27T06:27:14.717 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.721+0000 7fed8f200640 1 -- 172.21.15.149:0/3827439651 shutdown_connections 2024-05-27T06:27:14.718 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.721+0000 7fed8f200640 1 --2- 172.21.15.149:0/3827439651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed88159130 0x7fed88159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.718 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.721+0000 7fed8f200640 1 --2- 172.21.15.149:0/3827439651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed880d1610 0x7fed88152a70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.718 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.721+0000 7fed8f200640 1 --2- 172.21.15.149:0/3827439651 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed880cf130 0x7fed880ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.718 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.721+0000 7fed8f200640 1 -- 172.21.15.149:0/3827439651 >> 172.21.15.149:0/3827439651 conn(0x7fed880d3580 msgr2=0x7fed880b64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:14.718 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.721+0000 7fed8f200640 1 -- 172.21.15.149:0/3827439651 shutdown_connections 2024-05-27T06:27:14.718 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.721+0000 7fed8f200640 1 -- 172.21.15.149:0/3827439651 wait complete. 2024-05-27T06:27:14.736 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 251dbcf6-28c4-42a5-9c5f-c2e460c367f9 3 2024-05-27T06:27:14.884 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.885+0000 7f0d86800640 1 Processor -- start 2024-05-27T06:27:14.885 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.885+0000 7f0d86800640 1 -- start start 2024-05-27T06:27:14.887 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.889+0000 7f0d86800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0d800b47c0 0x7f0d800b7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:14.887 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.889+0000 7f0d86800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0d800ce100 0x7f0d800ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:14.887 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.889+0000 7f0d86800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d8015e370 con 0x7f0d800b43b0 2024-05-27T06:27:14.887 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.889+0000 7f0d86800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f0d800b3310 con 0x7f0d800ce100 2024-05-27T06:27:14.887 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.889+0000 7f0d86800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f0d800b35f0 con 0x7f0d800b47c0 2024-05-27T06:27:14.887 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.889+0000 7f0d7ea00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0d800b47c0 0x7f0d800b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:14.887 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.889+0000 7f0d7ea00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0d800b47c0 0x7f0d800b7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:54966/0 (socket says 172.21.15.149:54966) 2024-05-27T06:27:14.887 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.889+0000 7f0d7ea00640 1 -- 172.21.15.149:0/3415726799 learned_addr learned my addr 172.21.15.149:0/3415726799 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-05-27T06:27:14.887 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.889+0000 7f0d7fe00640 1 --2- 172.21.15.149:0/3415726799 >> v2:172.21.15.87:3300/0 conn(0x7f0d800ce100 0x7f0d800ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:14.888 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.889+0000 7f0d7ea00640 1 -- 172.21.15.149:0/3415726799 >> v2:172.21.15.87:3300/0 conn(0x7f0d800ce100 msgr2=0x7f0d800ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:14.888 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.889+0000 7f0d7ea00640 1 --2- 172.21.15.149:0/3415726799 >> v2:172.21.15.87:3300/0 conn(0x7f0d800ce100 0x7f0d800ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.888 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.889+0000 7f0d7ea00640 1 -- 172.21.15.149:0/3415726799 >> v1:172.21.15.87:6789/0 conn(0x7f0d800b43b0 legacy=0x7f0d800b69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:14.888 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.889+0000 7f0d7ea00640 1 -- 172.21.15.149:0/3415726799 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d800b38d0 con 0x7f0d800b47c0 2024-05-27T06:27:14.888 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.889+0000 7f0d7fe00640 1 --2- 172.21.15.149:0/3415726799 >> v2:172.21.15.87:3300/0 conn(0x7f0d800ce100 0x7f0d800ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:27:14.890 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.893+0000 7f0d7ea00640 1 --2- 172.21.15.149:0/3415726799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d800b47c0 0x7f0d800b7100 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0d80073df0 tx=0x7f0d6c01c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a49659f9038322fe server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:14.890 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.893+0000 7f0d7e000640 1 -- 172.21.15.149:0/3415726799 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c0b0070 con 0x7f0d800b47c0 2024-05-27T06:27:14.890 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.893+0000 7f0d7e000640 1 -- 172.21.15.149:0/3415726799 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d6c0ab600 con 0x7f0d800b47c0 2024-05-27T06:27:14.890 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.893+0000 7f0d7e000640 1 -- 172.21.15.149:0/3415726799 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c0ab9d0 con 0x7f0d800b47c0 2024-05-27T06:27:14.891 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.893+0000 7f0d86800640 1 -- 172.21.15.149:0/3415726799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d800b47c0 msgr2=0x7f0d800b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:14.891 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.893+0000 7f0d86800640 1 --2- 172.21.15.149:0/3415726799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d800b47c0 0x7f0d800b7100 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0d80073df0 tx=0x7f0d6c01c490 comp rx=0 tx=0).stop 2024-05-27T06:27:14.892 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.893+0000 7f0d86800640 1 -- 172.21.15.149:0/3415726799 shutdown_connections 2024-05-27T06:27:14.892 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.893+0000 7f0d86800640 1 --2- 172.21.15.149:0/3415726799 >> v2:172.21.15.87:3300/0 conn(0x7f0d800ce100 0x7f0d800ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.892 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.893+0000 7f0d86800640 1 --2- 172.21.15.149:0/3415726799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d800b47c0 0x7f0d800b7100 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.892 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.893+0000 7f0d86800640 1 -- 172.21.15.149:0/3415726799 >> 172.21.15.149:0/3415726799 conn(0x7f0d800d3580 msgr2=0x7f0d800d3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:14.892 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.893+0000 7f0d86800640 1 -- 172.21.15.149:0/3415726799 shutdown_connections 2024-05-27T06:27:14.892 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.893+0000 7f0d86800640 1 -- 172.21.15.149:0/3415726799 wait complete. 2024-05-27T06:27:14.895 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.897+0000 7f0d86800640 1 Processor -- start 2024-05-27T06:27:14.895 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.897+0000 7f0d86800640 1 -- start start 2024-05-27T06:27:14.898 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.901+0000 7f0d86800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0d800b43b0 0x7f0d8015ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:14.898 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.901+0000 7f0d86800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d800b47c0 0x7f0d80156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:14.898 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.901+0000 7f0d86800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d800ce100 0x7f0d80156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:14.899 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.901+0000 7f0d86800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0d80162930 con 0x7f0d800b47c0 2024-05-27T06:27:14.899 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.901+0000 7f0d86800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0d801627b0 con 0x7f0d800ce100 2024-05-27T06:27:14.899 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.901+0000 7f0d86800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0d8016b5d0 con 0x7f0d800b43b0 2024-05-27T06:27:14.899 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.901+0000 7f0d7f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0d800b43b0 0x7f0d8015ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:14.899 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.901+0000 7f0d7f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0d800b43b0 0x7f0d8015ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:42602/0 (socket says 172.21.15.149:42602) 2024-05-27T06:27:14.899 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.901+0000 7f0d7f400640 1 -- 172.21.15.149:0/331839199 learned_addr learned my addr 172.21.15.149:0/331839199 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-05-27T06:27:14.899 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.901+0000 7f0d7fe00640 1 --2- 172.21.15.149:0/331839199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d800ce100 0x7f0d80156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:14.899 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.901+0000 7f0d7ea00640 1 --2- 172.21.15.149:0/331839199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d800b47c0 0x7f0d80156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:14.899 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.901+0000 7f0d7fe00640 1 -- 172.21.15.149:0/331839199 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0d800b43b0 msgr2=0x7f0d8015ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:14.899 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.901+0000 7f0d7fe00640 1 --2- 172.21.15.149:0/331839199 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0d800b43b0 0x7f0d8015ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.899 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.901+0000 7f0d7fe00640 1 -- 172.21.15.149:0/331839199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d800b47c0 msgr2=0x7f0d80156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:14.899 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.901+0000 7f0d7fe00640 1 --2- 172.21.15.149:0/331839199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d800b47c0 0x7f0d80156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.900 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.901+0000 7f0d7fe00640 1 -- 172.21.15.149:0/331839199 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d8015c1e0 con 0x7f0d800ce100 2024-05-27T06:27:14.900 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.901+0000 7f0d7f400640 1 --2- 172.21.15.149:0/331839199 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0d800b43b0 0x7f0d8015ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:27:14.900 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.901+0000 7f0d7fe00640 1 --2- 172.21.15.149:0/331839199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d800ce100 0x7f0d80156280 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0d78007d70 tx=0x7f0d7800d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:14.901 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.901+0000 7f0d77400640 1 -- 172.21.15.149:0/331839199 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7801a070 con 0x7f0d800ce100 2024-05-27T06:27:14.901 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.901+0000 7f0d77400640 1 -- 172.21.15.149:0/331839199 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d780039a0 con 0x7f0d800ce100 2024-05-27T06:27:14.901 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.901+0000 7f0d86800640 1 -- 172.21.15.149:0/331839199 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d8015c4c0 con 0x7f0d800ce100 2024-05-27T06:27:14.901 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.901+0000 7f0d77400640 1 -- 172.21.15.149:0/331839199 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d78003d90 con 0x7f0d800ce100 2024-05-27T06:27:14.901 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.901+0000 7f0d86800640 1 -- 172.21.15.149:0/331839199 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d8015ca80 con 0x7f0d800ce100 2024-05-27T06:27:14.901 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.901+0000 7f0d77400640 1 -- 172.21.15.149:0/331839199 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0d7801d070 con 0x7f0d800ce100 2024-05-27T06:27:14.901 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.901+0000 7f0d77400640 1 -- 172.21.15.149:0/331839199 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f0d780044c0 con 0x7f0d800ce100 2024-05-27T06:27:14.901 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.901+0000 7f0d86800640 1 -- 172.21.15.149:0/331839199 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d8006aa30 con 0x7f0d800ce100 2024-05-27T06:27:14.902 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.905+0000 7f0d77400640 1 -- 172.21.15.149:0/331839199 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f0d78024070 con 0x7f0d800ce100 2024-05-27T06:27:14.964 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-27T06:27:14.965+0000 7f3ce6c84180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-27T06:27:14.969 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.973+0000 7f0d86800640 1 -- 172.21.15.149:0/331839199 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "251dbcf6-28c4-42a5-9c5f-c2e460c367f9", "id": 3} v 0) -- 0x7f0d800d1870 con 0x7f0d800ce100 2024-05-27T06:27:14.975 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.977+0000 7f0d77400640 1 -- 172.21.15.149:0/331839199 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "251dbcf6-28c4-42a5-9c5f-c2e460c367f9", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f0d78010070 con 0x7f0d800ce100 2024-05-27T06:27:14.975 INFO:teuthology.orchestra.run.smithi149.stdout:3 2024-05-27T06:27:14.976 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.977+0000 7f0d86800640 1 -- 172.21.15.149:0/331839199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d800ce100 msgr2=0x7f0d80156280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:14.976 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.977+0000 7f0d86800640 1 --2- 172.21.15.149:0/331839199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d800ce100 0x7f0d80156280 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0d78007d70 tx=0x7f0d7800d4a0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.976 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.977+0000 7f0d86800640 1 -- 172.21.15.149:0/331839199 shutdown_connections 2024-05-27T06:27:14.976 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.977+0000 7f0d86800640 1 --2- 172.21.15.149:0/331839199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d800ce100 0x7f0d80156280 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.977 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.977+0000 7f0d86800640 1 --2- 172.21.15.149:0/331839199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d800b47c0 0x7f0d80156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.977 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.977+0000 7f0d86800640 1 --2- 172.21.15.149:0/331839199 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0d800b43b0 0x7f0d8015ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:14.977 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.977+0000 7f0d86800640 1 -- 172.21.15.149:0/331839199 >> 172.21.15.149:0/331839199 conn(0x7f0d800d3580 msgr2=0x7f0d800702d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:14.977 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.977+0000 7f0d86800640 1 -- 172.21.15.149:0/331839199 shutdown_connections 2024-05-27T06:27:14.977 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:14.977+0000 7f0d86800640 1 -- 172.21.15.149:0/331839199 wait complete. 2024-05-27T06:27:14.996 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new cc155182-8040-4288-ab2d-4879b3082a08 4 2024-05-27T06:27:15.028 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-27T06:27:15.029+0000 7f3ce6c84180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-27T06:27:15.089 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-27T06:27:15.093+0000 7f3ce6c84180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-27T06:27:15.116 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-27T06:27:15.117+0000 7f1306c66180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-27T06:27:15.145 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.149+0000 7fde7e400640 1 Processor -- start 2024-05-27T06:27:15.145 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.149+0000 7fde7e400640 1 -- start start 2024-05-27T06:27:15.148 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.149+0000 7fde7e400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fde780d1610 0x7fde7806f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:15.148 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.149+0000 7fde7e400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde780cf130 0x7fde780d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:15.148 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.149+0000 7fde7e400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fde780d20a0 0x7fde780b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:15.148 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.149+0000 7fde7e400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fde780ce3e0 con 0x7fde780d20a0 2024-05-27T06:27:15.148 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.149+0000 7fde7e400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fde780d1410 con 0x7fde780d1610 2024-05-27T06:27:15.148 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.149+0000 7fde7e400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fde780d24b0 con 0x7fde780cf130 2024-05-27T06:27:15.148 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.149+0000 7fde77400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fde780d1610 0x7fde7806f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:15.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.149+0000 7fde6fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde780cf130 0x7fde780d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:15.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.149+0000 7fde77400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fde780d1610 0x7fde7806f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:54988/0 (socket says 172.21.15.149:54988) 2024-05-27T06:27:15.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.149+0000 7fde77400640 1 -- 172.21.15.149:0/586442899 learned_addr learned my addr 172.21.15.149:0/586442899 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-05-27T06:27:15.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.149+0000 7fde77e00640 1 --2- 172.21.15.149:0/586442899 >> v2:172.21.15.87:3300/0 conn(0x7fde780d20a0 0x7fde780b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:15.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.149+0000 7fde77400640 1 -- 172.21.15.149:0/586442899 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde780cf130 msgr2=0x7fde780d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:15.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.149+0000 7fde77400640 1 --2- 172.21.15.149:0/586442899 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde780cf130 0x7fde780d1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.149+0000 7fde77400640 1 -- 172.21.15.149:0/586442899 >> v2:172.21.15.87:3300/0 conn(0x7fde780d20a0 msgr2=0x7fde780b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:15.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.149+0000 7fde77400640 1 --2- 172.21.15.149:0/586442899 >> v2:172.21.15.87:3300/0 conn(0x7fde780d20a0 0x7fde780b2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.149+0000 7fde77400640 1 -- 172.21.15.149:0/586442899 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde780ce650 con 0x7fde780d1610 2024-05-27T06:27:15.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.149+0000 7fde77e00640 1 --2- 172.21.15.149:0/586442899 >> v2:172.21.15.87:3300/0 conn(0x7fde780d20a0 0x7fde780b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:27:15.150 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.153+0000 7fde77400640 1 --2- 172.21.15.149:0/586442899 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde780d1610 0x7fde7806f920 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fde78074690 tx=0x7fde6801c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=740d0aec385ded26 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:15.151 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.153+0000 7fde76a00640 1 -- 172.21.15.149:0/586442899 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde680aa660 con 0x7fde780d1610 2024-05-27T06:27:15.151 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.153+0000 7fde76a00640 1 -- 172.21.15.149:0/586442899 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde680af070 con 0x7fde780d1610 2024-05-27T06:27:15.151 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.153+0000 7fde76a00640 1 -- 172.21.15.149:0/586442899 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde680aaa20 con 0x7fde780d1610 2024-05-27T06:27:15.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.153+0000 7fde7e400640 1 -- 172.21.15.149:0/586442899 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde780d1610 msgr2=0x7fde7806f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:15.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.153+0000 7fde7e400640 1 --2- 172.21.15.149:0/586442899 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde780d1610 0x7fde7806f920 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fde78074690 tx=0x7fde6801c520 comp rx=0 tx=0).stop 2024-05-27T06:27:15.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.153+0000 7fde7e400640 1 -- 172.21.15.149:0/586442899 shutdown_connections 2024-05-27T06:27:15.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.153+0000 7fde7e400640 1 --2- 172.21.15.149:0/586442899 >> v2:172.21.15.87:3300/0 conn(0x7fde780d20a0 0x7fde780b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.153+0000 7fde7e400640 1 --2- 172.21.15.149:0/586442899 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde780cf130 0x7fde780d1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.153+0000 7fde7e400640 1 --2- 172.21.15.149:0/586442899 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde780d1610 0x7fde7806f920 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.153+0000 7fde7e400640 1 -- 172.21.15.149:0/586442899 >> 172.21.15.149:0/586442899 conn(0x7fde780d3580 msgr2=0x7fde780d3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:15.152 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.153+0000 7fde7e400640 1 -- 172.21.15.149:0/586442899 shutdown_connections 2024-05-27T06:27:15.153 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.153+0000 7fde7e400640 1 -- 172.21.15.149:0/586442899 wait complete. 2024-05-27T06:27:15.154 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.157+0000 7fde7e400640 1 Processor -- start 2024-05-27T06:27:15.154 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.157+0000 7fde7e400640 1 -- start start 2024-05-27T06:27:15.156 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.157+0000 7fde7e400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde780cf130 0x7fde78148960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:15.157 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.157+0000 7fde7e400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde780d1610 0x7fde780b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:15.157 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.157+0000 7fde7e400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde780d20a0 0x7fde781628b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:15.157 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.157+0000 7fde7e400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fde78163c40 con 0x7fde780cf130 2024-05-27T06:27:15.157 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.157+0000 7fde7e400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fde780cf540 con 0x7fde780d1610 2024-05-27T06:27:15.157 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.157+0000 7fde7e400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fde78163dc0 con 0x7fde780d20a0 2024-05-27T06:27:15.157 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.157+0000 7fde77e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde780d20a0 0x7fde781628b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:15.157 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.157+0000 7fde6fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde780d1610 0x7fde780b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:15.157 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.157+0000 7fde77400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde780cf130 0x7fde78148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:15.157 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.157+0000 7fde6fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde780d1610 0x7fde780b1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55004/0 (socket says 172.21.15.149:55004) 2024-05-27T06:27:15.157 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.157+0000 7fde6fe00640 1 -- 172.21.15.149:0/3580814184 learned_addr learned my addr 172.21.15.149:0/3580814184 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-05-27T06:27:15.157 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.157+0000 7fde77400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde780cf130 0x7fde78148960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.149:42248/0 (socket says 172.21.15.149:42248) 2024-05-27T06:27:15.157 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.161+0000 7fde77400640 1 -- 172.21.15.149:0/3580814184 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde780d20a0 msgr2=0x7fde781628b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:15.157 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.161+0000 7fde77400640 1 --2- 172.21.15.149:0/3580814184 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde780d20a0 0x7fde781628b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.158 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.161+0000 7fde77400640 1 -- 172.21.15.149:0/3580814184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde780d1610 msgr2=0x7fde780b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:15.158 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.161+0000 7fde77400640 1 --2- 172.21.15.149:0/3580814184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde780d1610 0x7fde780b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.158 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.161+0000 7fde77400640 1 -- 172.21.15.149:0/3580814184 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde78148ea0 con 0x7fde780cf130 2024-05-27T06:27:15.158 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.161+0000 7fde6fe00640 1 --2- 172.21.15.149:0/3580814184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde780d1610 0x7fde780b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:27:15.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.161+0000 7fde77400640 1 --2- 172.21.15.149:0/3580814184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde780cf130 0x7fde78148960 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fde780d1590 tx=0x7fde6801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:15.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.161+0000 7fde6f400640 1 -- 172.21.15.149:0/3580814184 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde680bd640 con 0x7fde780cf130 2024-05-27T06:27:15.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.161+0000 7fde6f400640 1 -- 172.21.15.149:0/3580814184 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde680bd800 con 0x7fde780cf130 2024-05-27T06:27:15.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.161+0000 7fde7e400640 1 -- 172.21.15.149:0/3580814184 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde780b2250 con 0x7fde780cf130 2024-05-27T06:27:15.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.161+0000 7fde6f400640 1 -- 172.21.15.149:0/3580814184 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde680bdbf0 con 0x7fde780cf130 2024-05-27T06:27:15.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.161+0000 7fde7e400640 1 -- 172.21.15.149:0/3580814184 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde7815b250 con 0x7fde780cf130 2024-05-27T06:27:15.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.161+0000 7fde6f400640 1 -- 172.21.15.149:0/3580814184 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fde680c6780 con 0x7fde780cf130 2024-05-27T06:27:15.159 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.161+0000 7fde6f400640 1 -- 172.21.15.149:0/3580814184 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fde680b3bd0 con 0x7fde780cf130 2024-05-27T06:27:15.160 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.161+0000 7fde7e400640 1 -- 172.21.15.149:0/3580814184 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde7806aa30 con 0x7fde780cf130 2024-05-27T06:27:15.161 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.165+0000 7fde6f400640 1 -- 172.21.15.149:0/3580814184 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fde68016110 con 0x7fde780cf130 2024-05-27T06:27:15.178 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-27T06:27:15.181+0000 7f3ce6c84180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-27T06:27:15.182 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-27T06:27:15.185+0000 7f1306c66180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-27T06:27:15.228 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.229+0000 7fde7e400640 1 -- 172.21.15.149:0/3580814184 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cc155182-8040-4288-ab2d-4879b3082a08", "id": 4} v 0) -- 0x7fde780b2cf0 con 0x7fde780cf130 2024-05-27T06:27:15.232 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.233+0000 7fde6f400640 1 -- 172.21.15.149:0/3580814184 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cc155182-8040-4288-ab2d-4879b3082a08", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fde680bdd90 con 0x7fde780cf130 2024-05-27T06:27:15.232 INFO:teuthology.orchestra.run.smithi149.stdout:4 2024-05-27T06:27:15.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.237+0000 7fde7e400640 1 -- 172.21.15.149:0/3580814184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde780cf130 msgr2=0x7fde78148960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:15.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.237+0000 7fde7e400640 1 --2- 172.21.15.149:0/3580814184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde780cf130 0x7fde78148960 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fde780d1590 tx=0x7fde6801ad60 comp rx=0 tx=0).stop 2024-05-27T06:27:15.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.237+0000 7fde7e400640 1 -- 172.21.15.149:0/3580814184 shutdown_connections 2024-05-27T06:27:15.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.237+0000 7fde7e400640 1 --2- 172.21.15.149:0/3580814184 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde780d20a0 0x7fde781628b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.234 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.237+0000 7fde7e400640 1 --2- 172.21.15.149:0/3580814184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde780d1610 0x7fde780b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.237+0000 7fde7e400640 1 --2- 172.21.15.149:0/3580814184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde780cf130 0x7fde78148960 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.237+0000 7fde7e400640 1 -- 172.21.15.149:0/3580814184 >> 172.21.15.149:0/3580814184 conn(0x7fde780d3580 msgr2=0x7fde780b82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:15.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.237+0000 7fde7e400640 1 -- 172.21.15.149:0/3580814184 shutdown_connections 2024-05-27T06:27:15.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.237+0000 7fde7e400640 1 -- 172.21.15.149:0/3580814184 wait complete. 2024-05-27T06:27:15.239 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-27T06:27:15.241+0000 7f3ce6c84180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-27T06:27:15.245 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-27T06:27:15.249+0000 7f1306c66180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-27T06:27:15.254 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new fc0d13e6-0469-433b-95ec-faed22523759 5 2024-05-27T06:27:15.327 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-27T06:27:15.329+0000 7f3ce6c84180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-27T06:27:15.339 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-27T06:27:15.341+0000 7f1306c66180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-27T06:27:15.390 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-27T06:27:15.393+0000 7f3ce6c84180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-27T06:27:15.401 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.405+0000 7f3352a00640 1 Processor -- start 2024-05-27T06:27:15.401 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.405+0000 7f3352a00640 1 -- start start 2024-05-27T06:27:15.402 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-27T06:27:15.405+0000 7f1306c66180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-27T06:27:15.403 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.405+0000 7f3352a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f334c15cb70 0x7f334c071330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:15.403 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.405+0000 7f3352a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f334c0d14b0 0x7f334c0b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:15.403 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.405+0000 7f3352a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f334c15cf80 con 0x7f334c160f20 2024-05-27T06:27:15.403 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.405+0000 7f3352a00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f334c071b80 con 0x7f334c0d14b0 2024-05-27T06:27:15.403 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.405+0000 7f3352a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f334c071e60 con 0x7f334c15cb70 2024-05-27T06:27:15.404 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.405+0000 7f334be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f334c15cb70 0x7f334c071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:15.404 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.405+0000 7f334b400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f334c160f20 0x7f334c0d0da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45000/0 (socket says 172.21.15.149:45000) 2024-05-27T06:27:15.404 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.405+0000 7f334b400640 1 -- 172.21.15.149:0/1707293009 learned_addr learned my addr 172.21.15.149:0/1707293009 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-05-27T06:27:15.404 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.405+0000 7f3350a00640 1 --2- 172.21.15.149:0/1707293009 >> v2:172.21.15.87:3300/0 conn(0x7f334c0d14b0 0x7f334c0b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:15.404 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.405+0000 7f334aa00640 1 -- 172.21.15.149:0/1707293009 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 152783784 0 0) 0x7f334c15cf80 con 0x7f334c160f20 2024-05-27T06:27:15.404 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.405+0000 7f334aa00640 1 -- 172.21.15.149:0/1707293009 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3330003530 con 0x7f334c160f20 2024-05-27T06:27:15.404 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.405+0000 7f334be00640 1 -- 172.21.15.149:0/1707293009 >> v2:172.21.15.87:3300/0 conn(0x7f334c0d14b0 msgr2=0x7f334c0b5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:15.404 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.405+0000 7f334be00640 1 --2- 172.21.15.149:0/1707293009 >> v2:172.21.15.87:3300/0 conn(0x7f334c0d14b0 0x7f334c0b5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.404 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.405+0000 7f334be00640 1 -- 172.21.15.149:0/1707293009 >> v1:172.21.15.149:6789/0 conn(0x7f334c160f20 legacy=0x7f334c0d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:15.404 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.405+0000 7f334be00640 1 -- 172.21.15.149:0/1707293009 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f334c072140 con 0x7f334c15cb70 2024-05-27T06:27:15.407 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.409+0000 7f334be00640 1 --2- 172.21.15.149:0/1707293009 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f334c15cb70 0x7f334c071330 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f333c0097c0 tx=0x7f333c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87626b1d7f456571 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:15.407 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.409+0000 7f334aa00640 1 -- 172.21.15.149:0/1707293009 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c0b2070 con 0x7f334c15cb70 2024-05-27T06:27:15.407 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.409+0000 7f334aa00640 1 -- 172.21.15.149:0/1707293009 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f333c0ad680 con 0x7f334c15cb70 2024-05-27T06:27:15.407 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.409+0000 7f334aa00640 1 -- 172.21.15.149:0/1707293009 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c0ada30 con 0x7f334c15cb70 2024-05-27T06:27:15.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.409+0000 7f3352a00640 1 -- 172.21.15.149:0/1707293009 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f334c15cb70 msgr2=0x7f334c071330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:15.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.409+0000 7f3352a00640 1 --2- 172.21.15.149:0/1707293009 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f334c15cb70 0x7f334c071330 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f333c0097c0 tx=0x7f333c01c470 comp rx=0 tx=0).stop 2024-05-27T06:27:15.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.409+0000 7f3352a00640 1 -- 172.21.15.149:0/1707293009 shutdown_connections 2024-05-27T06:27:15.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.409+0000 7f3352a00640 1 --2- 172.21.15.149:0/1707293009 >> v2:172.21.15.87:3300/0 conn(0x7f334c0d14b0 0x7f334c0b5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.409+0000 7f3352a00640 1 --2- 172.21.15.149:0/1707293009 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f334c15cb70 0x7f334c071330 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.409+0000 7f3352a00640 1 -- 172.21.15.149:0/1707293009 >> 172.21.15.149:0/1707293009 conn(0x7f334c06fe10 msgr2=0x7f334c070220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:15.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.409+0000 7f3352a00640 1 -- 172.21.15.149:0/1707293009 shutdown_connections 2024-05-27T06:27:15.408 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.409+0000 7f3352a00640 1 -- 172.21.15.149:0/1707293009 wait complete. 2024-05-27T06:27:15.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.413+0000 7f3352a00640 1 Processor -- start 2024-05-27T06:27:15.410 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.413+0000 7f3352a00640 1 -- start start 2024-05-27T06:27:15.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.413+0000 7f3352a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f334c15cb70 0x7f334c14ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:15.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.413+0000 7f3352a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f334c160f20 0x7f334c150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:15.412 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.413+0000 7f3352a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f334c15f650 0x7f334c1510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:15.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.413+0000 7f3352a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f334c0b69a0 con 0x7f334c15f650 2024-05-27T06:27:15.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.413+0000 7f3352a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f334c0b6820 con 0x7f334c160f20 2024-05-27T06:27:15.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.413+0000 7f3352a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f334c16a0c0 con 0x7f334c15cb70 2024-05-27T06:27:15.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.413+0000 7f334be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f334c15cb70 0x7f334c14ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:15.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.413+0000 7f334b400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f334c160f20 0x7f334c150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:15.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.413+0000 7f334be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f334c15cb70 0x7f334c14ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:42628/0 (socket says 172.21.15.149:42628) 2024-05-27T06:27:15.413 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.413+0000 7f334be00640 1 -- 172.21.15.149:0/1889692844 learned_addr learned my addr 172.21.15.149:0/1889692844 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-05-27T06:27:15.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.413+0000 7f3350a00640 1 --2- 172.21.15.149:0/1889692844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f334c15f650 0x7f334c1510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:15.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.413+0000 7f334be00640 1 -- 172.21.15.149:0/1889692844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f334c160f20 msgr2=0x7f334c150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:15.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.413+0000 7f334be00640 1 --2- 172.21.15.149:0/1889692844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f334c160f20 0x7f334c150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.413+0000 7f334be00640 1 -- 172.21.15.149:0/1889692844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f334c15f650 msgr2=0x7f334c1510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:15.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.413+0000 7f334be00640 1 --2- 172.21.15.149:0/1889692844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f334c15f650 0x7f334c1510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.413+0000 7f334be00640 1 -- 172.21.15.149:0/1889692844 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f334c15e740 con 0x7f334c15cb70 2024-05-27T06:27:15.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.413+0000 7f334b400640 1 --2- 172.21.15.149:0/1889692844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f334c160f20 0x7f334c150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:27:15.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.417+0000 7f334be00640 1 --2- 172.21.15.149:0/1889692844 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f334c15cb70 0x7f334c14ed20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f333c0097c0 tx=0x7f333c019210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:15.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.417+0000 7f3343e00640 1 -- 172.21.15.149:0/1889692844 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c0bd070 con 0x7f334c15cb70 2024-05-27T06:27:15.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.417+0000 7f3343e00640 1 -- 172.21.15.149:0/1889692844 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f333c004230 con 0x7f334c15cb70 2024-05-27T06:27:15.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.417+0000 7f3343e00640 1 -- 172.21.15.149:0/1889692844 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c0b2040 con 0x7f334c15cb70 2024-05-27T06:27:15.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.417+0000 7f3352a00640 1 -- 172.21.15.149:0/1889692844 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f334c0b2cc0 con 0x7f334c15cb70 2024-05-27T06:27:15.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.417+0000 7f3352a00640 1 -- 172.21.15.149:0/1889692844 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f334c0b3280 con 0x7f334c15cb70 2024-05-27T06:27:15.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.417+0000 7f3343e00640 1 -- 172.21.15.149:0/1889692844 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f333c0ad8f0 con 0x7f334c15cb70 2024-05-27T06:27:15.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.417+0000 7f3343e00640 1 -- 172.21.15.149:0/1889692844 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f333c0ad600 con 0x7f334c15cb70 2024-05-27T06:27:15.416 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.417+0000 7f3352a00640 1 -- 172.21.15.149:0/1889692844 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f334c06aa30 con 0x7f334c15cb70 2024-05-27T06:27:15.417 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.421+0000 7f3343e00640 1 -- 172.21.15.149:0/1889692844 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f333c0d8ec0 con 0x7f334c15cb70 2024-05-27T06:27:15.485 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.489+0000 7f3352a00640 1 -- 172.21.15.149:0/1889692844 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fc0d13e6-0469-433b-95ec-faed22523759", "id": 5} v 0) -- 0x7f334c068f50 con 0x7f334c15cb70 2024-05-27T06:27:15.491 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.493+0000 7f3343e00640 1 -- 172.21.15.149:0/1889692844 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fc0d13e6-0469-433b-95ec-faed22523759", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f333c0c7070 con 0x7f334c15cb70 2024-05-27T06:27:15.492 INFO:teuthology.orchestra.run.smithi149.stdout:5 2024-05-27T06:27:15.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.493+0000 7f3352a00640 1 -- 172.21.15.149:0/1889692844 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f334c15cb70 msgr2=0x7f334c14ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:15.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.493+0000 7f3352a00640 1 --2- 172.21.15.149:0/1889692844 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f334c15cb70 0x7f334c14ed20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f333c0097c0 tx=0x7f333c019210 comp rx=0 tx=0).stop 2024-05-27T06:27:15.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.497+0000 7f3352a00640 1 -- 172.21.15.149:0/1889692844 shutdown_connections 2024-05-27T06:27:15.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.497+0000 7f3352a00640 1 --2- 172.21.15.149:0/1889692844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f334c15f650 0x7f334c1510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.497+0000 7f3352a00640 1 --2- 172.21.15.149:0/1889692844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f334c160f20 0x7f334c150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.497+0000 7f3352a00640 1 --2- 172.21.15.149:0/1889692844 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f334c15cb70 0x7f334c14ed20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.497+0000 7f3352a00640 1 -- 172.21.15.149:0/1889692844 >> 172.21.15.149:0/1889692844 conn(0x7f334c06fe10 msgr2=0x7f334c158780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:15.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.497+0000 7f3352a00640 1 -- 172.21.15.149:0/1889692844 shutdown_connections 2024-05-27T06:27:15.494 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.497+0000 7f3352a00640 1 -- 172.21.15.149:0/1889692844 wait complete. 2024-05-27T06:27:15.498 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-27T06:27:15.501+0000 7f1306c66180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-27T06:27:15.511 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 565ee760-c17d-429b-a5d6-c343857f0c99 6 2024-05-27T06:27:15.558 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-27T06:27:15.561+0000 7f3ce6c84180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-27T06:27:15.566 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-27T06:27:15.569+0000 7f1306c66180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-27T06:27:15.629 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-27T06:27:15.633+0000 7f3ce6c84180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-27T06:27:15.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.661+0000 7f6984600640 1 Processor -- start 2024-05-27T06:27:15.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.661+0000 7f6984600640 1 -- start start 2024-05-27T06:27:15.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.665+0000 7f6984600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f697c0cdcf0 0x7f697c0ce100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:15.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.665+0000 7f6984600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f697c162260 0x7f697c15d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:15.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.665+0000 7f6984600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f697c0ce640 con 0x7f697c161740 2024-05-27T06:27:15.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.665+0000 7f6984600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f697c0b92b0 con 0x7f697c162260 2024-05-27T06:27:15.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.665+0000 7f6984600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f697c0d3210 con 0x7f697c0cdcf0 2024-05-27T06:27:15.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.665+0000 7f6982600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f697c162260 0x7f697c15d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:15.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.665+0000 7f6981c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f697c0cdcf0 0x7f697c0ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:15.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.665+0000 7f6981200640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f697c161740 0x7f697c161b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45004/0 (socket says 172.21.15.149:45004) 2024-05-27T06:27:15.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.665+0000 7f6981200640 1 -- 172.21.15.149:0/2298197265 learned_addr learned my addr 172.21.15.149:0/2298197265 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-05-27T06:27:15.663 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.665+0000 7f6982600640 1 -- 172.21.15.149:0/2298197265 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f697c0cdcf0 msgr2=0x7f697c0ce100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:15.663 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.665+0000 7f6982600640 1 --2- 172.21.15.149:0/2298197265 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f697c0cdcf0 0x7f697c0ce100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.663 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.665+0000 7f6982600640 1 -- 172.21.15.149:0/2298197265 >> v1:172.21.15.149:6789/0 conn(0x7f697c161740 legacy=0x7f697c161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:15.663 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.665+0000 7f6982600640 1 -- 172.21.15.149:0/2298197265 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f697c0d2170 con 0x7f697c162260 2024-05-27T06:27:15.663 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.665+0000 7f697be00640 1 -- 172.21.15.149:0/2298197265 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1863776602 0 0) 0x7f6968001120 con 0x7f697c161740 2024-05-27T06:27:15.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.669+0000 7f6982600640 1 --2- 172.21.15.149:0/2298197265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f697c162260 0x7f697c15d170 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6974009d90 tx=0x7f697401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29063e668dbd2a82 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:15.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.669+0000 7f697be00640 1 -- 172.21.15.149:0/2298197265 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69740b2070 con 0x7f697c162260 2024-05-27T06:27:15.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.669+0000 7f697be00640 1 -- 172.21.15.149:0/2298197265 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69740a59a0 con 0x7f697c162260 2024-05-27T06:27:15.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.669+0000 7f697be00640 1 -- 172.21.15.149:0/2298197265 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69740a5d70 con 0x7f697c162260 2024-05-27T06:27:15.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.669+0000 7f6984600640 1 -- 172.21.15.149:0/2298197265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f697c162260 msgr2=0x7f697c15d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:15.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.669+0000 7f6984600640 1 --2- 172.21.15.149:0/2298197265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f697c162260 0x7f697c15d170 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6974009d90 tx=0x7f697401c8e0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.669+0000 7f6984600640 1 -- 172.21.15.149:0/2298197265 shutdown_connections 2024-05-27T06:27:15.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.669+0000 7f6984600640 1 --2- 172.21.15.149:0/2298197265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f697c162260 0x7f697c15d170 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.669+0000 7f6984600640 1 --2- 172.21.15.149:0/2298197265 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f697c0cdcf0 0x7f697c0ce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.669+0000 7f6984600640 1 -- 172.21.15.149:0/2298197265 >> 172.21.15.149:0/2298197265 conn(0x7f697c0cffa0 msgr2=0x7f697c0d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:15.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.669+0000 7f6984600640 1 -- 172.21.15.149:0/2298197265 shutdown_connections 2024-05-27T06:27:15.667 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.669+0000 7f6984600640 1 -- 172.21.15.149:0/2298197265 wait complete. 2024-05-27T06:27:15.670 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.673+0000 7f6984600640 1 Processor -- start 2024-05-27T06:27:15.670 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.673+0000 7f6984600640 1 -- start start 2024-05-27T06:27:15.674 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.677+0000 7f6984600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f697c0cdcf0 0x7f697c14d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:15.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.677+0000 7f6984600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f697c161740 0x7f697c15b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:15.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.677+0000 7f6984600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f697c162260 0x7f697c15b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:15.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.677+0000 7f6984600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f697c0b3ca0 con 0x7f697c0cdcf0 2024-05-27T06:27:15.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.677+0000 7f6984600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f697c0d2cf0 con 0x7f697c161740 2024-05-27T06:27:15.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.677+0000 7f6984600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f697c0d1d80 con 0x7f697c162260 2024-05-27T06:27:15.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.677+0000 7f6981200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f697c161740 0x7f697c15b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:15.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.677+0000 7f6982600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f697c162260 0x7f697c15b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:15.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.677+0000 7f6981200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f697c161740 0x7f697c15b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55024/0 (socket says 172.21.15.149:55024) 2024-05-27T06:27:15.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.677+0000 7f6981200640 1 -- 172.21.15.149:0/3385316023 learned_addr learned my addr 172.21.15.149:0/3385316023 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-05-27T06:27:15.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.677+0000 7f6981c00640 1 --2- 172.21.15.149:0/3385316023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f697c0cdcf0 0x7f697c14d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:15.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.677+0000 7f6982600640 1 -- 172.21.15.149:0/3385316023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f697c161740 msgr2=0x7f697c15b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:15.675 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.677+0000 7f6982600640 1 --2- 172.21.15.149:0/3385316023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f697c161740 0x7f697c15b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.676 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.677+0000 7f6982600640 1 -- 172.21.15.149:0/3385316023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f697c0cdcf0 msgr2=0x7f697c14d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:15.676 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.677+0000 7f6982600640 1 --2- 172.21.15.149:0/3385316023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f697c0cdcf0 0x7f697c14d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.676 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.677+0000 7f6982600640 1 -- 172.21.15.149:0/3385316023 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f697c166e40 con 0x7f697c162260 2024-05-27T06:27:15.676 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.677+0000 7f6981200640 1 --2- 172.21.15.149:0/3385316023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f697c161740 0x7f697c15b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:27:15.676 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.677+0000 7f6982600640 1 --2- 172.21.15.149:0/3385316023 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f697c162260 0x7f697c15b6f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f697c0726e0 tx=0x7f69740196e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:15.676 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.677+0000 7f6979600640 1 -- 172.21.15.149:0/3385316023 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69740b2050 con 0x7f697c162260 2024-05-27T06:27:15.676 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.677+0000 7f6979600640 1 -- 172.21.15.149:0/3385316023 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69740b3040 con 0x7f697c162260 2024-05-27T06:27:15.676 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.677+0000 7f6979600640 1 -- 172.21.15.149:0/3385316023 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69740ad870 con 0x7f697c162260 2024-05-27T06:27:15.676 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.677+0000 7f6984600640 1 -- 172.21.15.149:0/3385316023 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f697c167120 con 0x7f697c162260 2024-05-27T06:27:15.676 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.677+0000 7f6984600640 1 -- 172.21.15.149:0/3385316023 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f697c1676e0 con 0x7f697c162260 2024-05-27T06:27:15.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.677+0000 7f6979600640 1 -- 172.21.15.149:0/3385316023 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f69740c0020 con 0x7f697c162260 2024-05-27T06:27:15.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.677+0000 7f6979600640 1 -- 172.21.15.149:0/3385316023 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f69740a58e0 con 0x7f697c162260 2024-05-27T06:27:15.677 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.677+0000 7f6984600640 1 -- 172.21.15.149:0/3385316023 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f697c06aa30 con 0x7f697c162260 2024-05-27T06:27:15.693 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.697+0000 7f6979600640 1 -- 172.21.15.149:0/3385316023 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f69740c7020 con 0x7f697c162260 2024-05-27T06:27:15.743 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-27T06:27:15.745+0000 7f1306c66180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-27T06:27:15.759 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.761+0000 7f6984600640 1 -- 172.21.15.149:0/3385316023 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd new", "uuid": "565ee760-c17d-429b-a5d6-c343857f0c99", "id": 6} v 0) -- 0x7f697c0b94a0 con 0x7f697c162260 2024-05-27T06:27:15.767 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.769+0000 7f6979600640 1 -- 172.21.15.149:0/3385316023 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "565ee760-c17d-429b-a5d6-c343857f0c99", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f6974016560 con 0x7f697c162260 2024-05-27T06:27:15.767 INFO:teuthology.orchestra.run.smithi149.stdout:6 2024-05-27T06:27:15.768 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.769+0000 7f6984600640 1 -- 172.21.15.149:0/3385316023 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f697c162260 msgr2=0x7f697c15b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:15.768 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.769+0000 7f6984600640 1 --2- 172.21.15.149:0/3385316023 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f697c162260 0x7f697c15b6f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f697c0726e0 tx=0x7f69740196e0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.768 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.769+0000 7f6984600640 1 -- 172.21.15.149:0/3385316023 shutdown_connections 2024-05-27T06:27:15.768 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.769+0000 7f6984600640 1 --2- 172.21.15.149:0/3385316023 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f697c162260 0x7f697c15b6f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.769 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.769+0000 7f6984600640 1 --2- 172.21.15.149:0/3385316023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f697c161740 0x7f697c15b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.769 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.769+0000 7f6984600640 1 --2- 172.21.15.149:0/3385316023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f697c0cdcf0 0x7f697c14d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.769 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.769+0000 7f6984600640 1 -- 172.21.15.149:0/3385316023 >> 172.21.15.149:0/3385316023 conn(0x7f697c0cffa0 msgr2=0x7f697c0702d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:15.769 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.769+0000 7f6984600640 1 -- 172.21.15.149:0/3385316023 shutdown_connections 2024-05-27T06:27:15.769 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.769+0000 7f6984600640 1 -- 172.21.15.149:0/3385316023 wait complete. 2024-05-27T06:27:15.788 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new f9a90f18-a438-4836-b4ca-398ab37cc465 7 2024-05-27T06:27:15.819 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-27T06:27:15.821+0000 7f1306c66180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-27T06:27:15.938 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.941+0000 7f6f9a600640 1 Processor -- start 2024-05-27T06:27:15.938 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.941+0000 7f6f9a600640 1 -- start start 2024-05-27T06:27:15.940 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.941+0000 7f6f9a600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6f940b47c0 0x7f6f940b7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:15.940 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.941+0000 7f6f9a600640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f9415e370 con 0x7f6f940ce100 2024-05-27T06:27:15.940 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.941+0000 7f6f9a600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f940b3310 con 0x7f6f940b43b0 2024-05-27T06:27:15.940 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.941+0000 7f6f9a600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f6f940b35f0 con 0x7f6f940b47c0 2024-05-27T06:27:15.940 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.941+0000 7f6f92a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6f940b47c0 0x7f6f940b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:15.941 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.941+0000 7f6f93400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f6f940b43b0 0x7f6f940b69f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:45010/0 (socket says 172.21.15.149:45010) 2024-05-27T06:27:15.941 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.941+0000 7f6f92a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6f940b47c0 0x7f6f940b7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:55032/0 (socket says 172.21.15.149:55032) 2024-05-27T06:27:15.941 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.941+0000 7f6f93400640 1 -- 172.21.15.149:0/773878814 learned_addr learned my addr 172.21.15.149:0/773878814 (peer_addr_for_me v1:172.21.15.149:0/0) 2024-05-27T06:27:15.941 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.945+0000 7f6f92a00640 1 -- 172.21.15.149:0/773878814 >> v1:172.21.15.149:6789/0 conn(0x7f6f940b43b0 legacy=0x7f6f940b69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:15.941 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.945+0000 7f6f92a00640 1 -- 172.21.15.149:0/773878814 >> v1:172.21.15.87:6789/0 conn(0x7f6f940ce100 legacy=0x7f6f940ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:15.941 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.945+0000 7f6f92a00640 1 -- 172.21.15.149:0/773878814 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f940b38d0 con 0x7f6f940b47c0 2024-05-27T06:27:15.943 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.945+0000 7f6f92a00640 1 --2- 172.21.15.149:0/773878814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f940b47c0 0x7f6f940b7100 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6f800097a0 tx=0x7f6f8001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afc788ea6ac054c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:15.944 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.945+0000 7f6f92000640 1 -- 172.21.15.149:0/773878814 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f800b0070 con 0x7f6f940b47c0 2024-05-27T06:27:15.944 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.945+0000 7f6f92000640 1 -- 172.21.15.149:0/773878814 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f800ab600 con 0x7f6f940b47c0 2024-05-27T06:27:15.944 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.945+0000 7f6f92000640 1 -- 172.21.15.149:0/773878814 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f800ab9d0 con 0x7f6f940b47c0 2024-05-27T06:27:15.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.949+0000 7f6f9a600640 1 -- 172.21.15.149:0/773878814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f940b47c0 msgr2=0x7f6f940b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:15.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.949+0000 7f6f9a600640 1 --2- 172.21.15.149:0/773878814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f940b47c0 0x7f6f940b7100 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6f800097a0 tx=0x7f6f8001c3f0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.949+0000 7f6f9a600640 1 -- 172.21.15.149:0/773878814 shutdown_connections 2024-05-27T06:27:15.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.949+0000 7f6f9a600640 1 --2- 172.21.15.149:0/773878814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f940b47c0 0x7f6f940b7100 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.949+0000 7f6f9a600640 1 -- 172.21.15.149:0/773878814 >> 172.21.15.149:0/773878814 conn(0x7f6f940d3580 msgr2=0x7f6f940d3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:15.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.949+0000 7f6f9a600640 1 -- 172.21.15.149:0/773878814 shutdown_connections 2024-05-27T06:27:15.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.949+0000 7f6f9a600640 1 -- 172.21.15.149:0/773878814 wait complete. 2024-05-27T06:27:15.947 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.949+0000 7f6f9a600640 1 Processor -- start 2024-05-27T06:27:15.947 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.949+0000 7f6f9a600640 1 -- start start 2024-05-27T06:27:15.949 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.953+0000 7f6f9a600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f940b43b0 0x7f6f94168880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:15.949 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.953+0000 7f6f9a600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f940b47c0 0x7f6f94155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:15.949 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.953+0000 7f6f9a600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f940ce100 0x7f6f940cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:15.949 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.953+0000 7f6f9a600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9416c760 con 0x7f6f940b43b0 2024-05-27T06:27:15.949 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.953+0000 7f6f9a600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9416c5e0 con 0x7f6f940b47c0 2024-05-27T06:27:15.950 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.953+0000 7f6f9a600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6f9416c8e0 con 0x7f6f940ce100 2024-05-27T06:27:15.950 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.953+0000 7f6f93e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f940ce100 0x7f6f940cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:15.950 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.953+0000 7f6f93400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f940b43b0 0x7f6f94168880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:15.950 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.953+0000 7f6f92a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f940b47c0 0x7f6f94155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:15.950 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.953+0000 7f6f93e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f940ce100 0x7f6f940cc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:42666/0 (socket says 172.21.15.149:42666) 2024-05-27T06:27:15.950 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.953+0000 7f6f93e00640 1 -- 172.21.15.149:0/602845146 learned_addr learned my addr 172.21.15.149:0/602845146 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-05-27T06:27:15.951 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.953+0000 7f6f93e00640 1 -- 172.21.15.149:0/602845146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f940b47c0 msgr2=0x7f6f94155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:15.951 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.953+0000 7f6f93e00640 1 --2- 172.21.15.149:0/602845146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f940b47c0 0x7f6f94155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.951 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.953+0000 7f6f93e00640 1 -- 172.21.15.149:0/602845146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f940b43b0 msgr2=0x7f6f94168880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:15.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.953+0000 7f6f93e00640 1 --2- 172.21.15.149:0/602845146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f940b43b0 0x7f6f94168880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:15.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.953+0000 7f6f93e00640 1 -- 172.21.15.149:0/602845146 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f94167ac0 con 0x7f6f940ce100 2024-05-27T06:27:15.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.953+0000 7f6f93e00640 1 --2- 172.21.15.149:0/602845146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f940ce100 0x7f6f940cc230 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c00c710 tx=0x7f6f8c00cbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:15.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.953+0000 7f6f8b400640 1 -- 172.21.15.149:0/602845146 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c003b80 con 0x7f6f940ce100 2024-05-27T06:27:15.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.953+0000 7f6f8b400640 1 -- 172.21.15.149:0/602845146 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f8c003d20 con 0x7f6f940ce100 2024-05-27T06:27:15.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.953+0000 7f6f9a600640 1 -- 172.21.15.149:0/602845146 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f94167da0 con 0x7f6f940ce100 2024-05-27T06:27:15.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.953+0000 7f6f8b400640 1 -- 172.21.15.149:0/602845146 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c00aa90 con 0x7f6f940ce100 2024-05-27T06:27:15.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.953+0000 7f6f9a600640 1 -- 172.21.15.149:0/602845146 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f94168360 con 0x7f6f940ce100 2024-05-27T06:27:15.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.953+0000 7f6f8b400640 1 -- 172.21.15.149:0/602845146 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6f8c00ac30 con 0x7f6f940ce100 2024-05-27T06:27:15.952 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.953+0000 7f6f8b400640 1 -- 172.21.15.149:0/602845146 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f6f8c0124c0 con 0x7f6f940ce100 2024-05-27T06:27:15.953 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.953+0000 7f6f9a600640 1 -- 172.21.15.149:0/602845146 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f9406f340 con 0x7f6f940ce100 2024-05-27T06:27:15.954 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:15.957+0000 7f6f8b400640 1 -- 172.21.15.149:0/602845146 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f6f8c00ce20 con 0x7f6f940ce100 2024-05-27T06:27:16.019 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:16.021+0000 7f6f9a600640 1 -- 172.21.15.149:0/602845146 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f9a90f18-a438-4836-b4ca-398ab37cc465", "id": 7} v 0) -- 0x7f6f9406aa30 con 0x7f6f940ce100 2024-05-27T06:27:16.030 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:16.033+0000 7f6f8b400640 1 -- 172.21.15.149:0/602845146 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f9a90f18-a438-4836-b4ca-398ab37cc465", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f6f8c0050d0 con 0x7f6f940ce100 2024-05-27T06:27:16.030 INFO:teuthology.orchestra.run.smithi149.stdout:7 2024-05-27T06:27:16.031 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:16.033+0000 7f6f9a600640 1 -- 172.21.15.149:0/602845146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f940ce100 msgr2=0x7f6f940cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:16.031 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:16.033+0000 7f6f9a600640 1 --2- 172.21.15.149:0/602845146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f940ce100 0x7f6f940cc230 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c00c710 tx=0x7f6f8c00cbd0 comp rx=0 tx=0).stop 2024-05-27T06:27:16.032 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:16.033+0000 7f6f9a600640 1 -- 172.21.15.149:0/602845146 shutdown_connections 2024-05-27T06:27:16.032 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:16.033+0000 7f6f9a600640 1 --2- 172.21.15.149:0/602845146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f940ce100 0x7f6f940cc230 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:16.032 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:16.033+0000 7f6f9a600640 1 --2- 172.21.15.149:0/602845146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f940b47c0 0x7f6f94155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:16.032 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:16.033+0000 7f6f9a600640 1 --2- 172.21.15.149:0/602845146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f940b43b0 0x7f6f94168880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:16.032 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:16.033+0000 7f6f9a600640 1 -- 172.21.15.149:0/602845146 >> 172.21.15.149:0/602845146 conn(0x7f6f940d3580 msgr2=0x7f6f940710d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:16.032 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:16.033+0000 7f6f9a600640 1 -- 172.21.15.149:0/602845146 shutdown_connections 2024-05-27T06:27:16.032 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:27:16.033+0000 7f6f9a600640 1 -- 172.21.15.149:0/602845146 wait complete. 2024-05-27T06:27:16.050 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-27T06:27:16.051 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-27T06:27:16.054 INFO:tasks.ceph.osd.0:Started 2024-05-27T06:27:16.054 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-27T06:27:16.054 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-27T06:27:16.057 INFO:tasks.ceph.osd.1:Started 2024-05-27T06:27:16.058 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-27T06:27:16.058 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-27T06:27:16.061 INFO:tasks.ceph.osd.2:Started 2024-05-27T06:27:16.061 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-27T06:27:16.061 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-27T06:27:16.064 INFO:tasks.ceph.osd.3:Started 2024-05-27T06:27:16.065 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-27T06:27:16.065 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-27T06:27:16.095 INFO:tasks.ceph.osd.4:Started 2024-05-27T06:27:16.095 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-27T06:27:16.095 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-27T06:27:16.100 INFO:tasks.ceph.osd.5:Started 2024-05-27T06:27:16.101 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-27T06:27:16.101 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-27T06:27:16.104 INFO:tasks.ceph.osd.6:Started 2024-05-27T06:27:16.104 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-27T06:27:16.104 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-27T06:27:16.107 INFO:tasks.ceph.osd.7:Started 2024-05-27T06:27:16.107 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T06:27:16.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.285+0000 7f72cd600640 1 Processor -- start 2024-05-27T06:27:16.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.285+0000 7f72cd600640 1 -- start start 2024-05-27T06:27:16.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.289+0000 7f72cd600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f72c8072aa0 0x7f72c806d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:16.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.289+0000 7f72cd600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72c80d1e50 0x7f72c80ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:16.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.289+0000 7f72cd600640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72c80cd120 con 0x7f72c8072eb0 2024-05-27T06:27:16.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.289+0000 7f72cd600640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f72c80cdd30 con 0x7f72c8072aa0 2024-05-27T06:27:16.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.289+0000 7f72cd600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f72c80cd400 con 0x7f72c80d1e50 2024-05-27T06:27:16.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.289+0000 7f72c6a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f72c8072aa0 0x7f72c806d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:16.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.289+0000 7f72be000640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f72c8072eb0 0x7f72c80d1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:50966/0 (socket says 172.21.15.87:50966) 2024-05-27T06:27:16.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.289+0000 7f72be000640 1 -- 172.21.15.87:0/1785129478 learned_addr learned my addr 172.21.15.87:0/1785129478 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:27:16.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.289+0000 7f72c7400640 1 --2- 172.21.15.87:0/1785129478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72c80d1e50 0x7f72c80ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:16.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.289+0000 7f72c6a00640 1 -- 172.21.15.87:0/1785129478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72c80d1e50 msgr2=0x7f72c80ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:16.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.289+0000 7f72c6a00640 1 --2- 172.21.15.87:0/1785129478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72c80d1e50 0x7f72c80ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:16.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.289+0000 7f72c6a00640 1 -- 172.21.15.87:0/1785129478 >> v1:172.21.15.87:6789/0 conn(0x7f72c8072eb0 legacy=0x7f72c80d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:16.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.289+0000 7f72c6a00640 1 -- 172.21.15.87:0/1785129478 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c80cd6e0 con 0x7f72c8072aa0 2024-05-27T06:27:16.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.289+0000 7f72c6000640 1 -- 172.21.15.87:0/1785129478 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2396388009 0 0) 0x7f72c80cd120 con 0x7f72c8072eb0 2024-05-27T06:27:16.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.293+0000 7f72c6a00640 1 --2- 172.21.15.87:0/1785129478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72c8072aa0 0x7f72c806d820 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f72b80097c0 tx=0x7f72b801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3f00e9c3ae1c909 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:16.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.293+0000 7f72c6000640 1 -- 172.21.15.87:0/1785129478 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b80aa5f0 con 0x7f72c8072aa0 2024-05-27T06:27:16.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.293+0000 7f72c6000640 1 -- 172.21.15.87:0/1785129478 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b80af070 con 0x7f72c8072aa0 2024-05-27T06:27:16.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.293+0000 7f72c6000640 1 -- 172.21.15.87:0/1785129478 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b80aa9b0 con 0x7f72c8072aa0 2024-05-27T06:27:16.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.293+0000 7f72cd600640 1 -- 172.21.15.87:0/1785129478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72c8072aa0 msgr2=0x7f72c806d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:16.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.293+0000 7f72cd600640 1 --2- 172.21.15.87:0/1785129478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72c8072aa0 0x7f72c806d820 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f72b80097c0 tx=0x7f72b801c470 comp rx=0 tx=0).stop 2024-05-27T06:27:16.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.293+0000 7f72cd600640 1 -- 172.21.15.87:0/1785129478 shutdown_connections 2024-05-27T06:27:16.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.293+0000 7f72cd600640 1 --2- 172.21.15.87:0/1785129478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72c80d1e50 0x7f72c80ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:16.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.293+0000 7f72cd600640 1 --2- 172.21.15.87:0/1785129478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72c8072aa0 0x7f72c806d820 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:16.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.293+0000 7f72cd600640 1 -- 172.21.15.87:0/1785129478 >> 172.21.15.87:0/1785129478 conn(0x7f72c80b46b0 msgr2=0x7f72c80b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:16.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.293+0000 7f72cd600640 1 -- 172.21.15.87:0/1785129478 shutdown_connections 2024-05-27T06:27:16.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.293+0000 7f72cd600640 1 -- 172.21.15.87:0/1785129478 wait complete. 2024-05-27T06:27:16.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.293+0000 7f72cd600640 1 Processor -- start 2024-05-27T06:27:16.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.293+0000 7f72cd600640 1 -- start start 2024-05-27T06:27:16.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.297+0000 7f72cd600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72c8072aa0 0x7f72c815bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:16.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.297+0000 7f72cd600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72c8072eb0 0x7f72c80b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:16.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.297+0000 7f72cd600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72c80d1e50 0x7f72c815ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:16.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.297+0000 7f72cd600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f72c816b230 con 0x7f72c8072aa0 2024-05-27T06:27:16.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.297+0000 7f72cd600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f72c816b0b0 con 0x7f72c80d1e50 2024-05-27T06:27:16.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.297+0000 7f72cd600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f72c816b3b0 con 0x7f72c8072eb0 2024-05-27T06:27:16.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.297+0000 7f72c6a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72c8072aa0 0x7f72c815bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:16.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.297+0000 7f72c6a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72c8072aa0 0x7f72c815bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47918/0 (socket says 172.21.15.87:47918) 2024-05-27T06:27:16.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.297+0000 7f72c6a00640 1 -- 172.21.15.87:0/107291827 learned_addr learned my addr 172.21.15.87:0/107291827 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:16.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.297+0000 7f72be000640 1 --2- 172.21.15.87:0/107291827 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72c8072eb0 0x7f72c80b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:16.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.297+0000 7f72c7400640 1 --2- 172.21.15.87:0/107291827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72c80d1e50 0x7f72c815ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:16.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.297+0000 7f72c6a00640 1 -- 172.21.15.87:0/107291827 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72c8072eb0 msgr2=0x7f72c80b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:16.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.297+0000 7f72c6a00640 1 --2- 172.21.15.87:0/107291827 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72c8072eb0 0x7f72c80b22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:16.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.297+0000 7f72c6a00640 1 -- 172.21.15.87:0/107291827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72c80d1e50 msgr2=0x7f72c815ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:16.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.297+0000 7f72c6a00640 1 --2- 172.21.15.87:0/107291827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72c80d1e50 0x7f72c815ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:16.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.297+0000 7f72c6a00640 1 -- 172.21.15.87:0/107291827 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c81586d0 con 0x7f72c8072aa0 2024-05-27T06:27:16.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.297+0000 7f72c7400640 1 --2- 172.21.15.87:0/107291827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72c80d1e50 0x7f72c815ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:27:16.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.297+0000 7f72c6a00640 1 --2- 172.21.15.87:0/107291827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72c8072aa0 0x7f72c815bcb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f72b801ab20 tx=0x7f72b801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:16.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.297+0000 7f72bf400640 1 -- 172.21.15.87:0/107291827 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b80be610 con 0x7f72c8072aa0 2024-05-27T06:27:16.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.297+0000 7f72bf400640 1 -- 172.21.15.87:0/107291827 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b80be7b0 con 0x7f72c8072aa0 2024-05-27T06:27:16.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.297+0000 7f72bf400640 1 -- 172.21.15.87:0/107291827 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b80beba0 con 0x7f72c8072aa0 2024-05-27T06:27:16.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.297+0000 7f72cd600640 1 -- 172.21.15.87:0/107291827 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c81f9cb0 con 0x7f72c8072aa0 2024-05-27T06:27:16.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.297+0000 7f72cd600640 1 -- 172.21.15.87:0/107291827 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c8158110 con 0x7f72c8072aa0 2024-05-27T06:27:16.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.297+0000 7f72bf400640 1 -- 172.21.15.87:0/107291827 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f72b80bc020 con 0x7f72c8072aa0 2024-05-27T06:27:16.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.297+0000 7f72bf400640 1 -- 172.21.15.87:0/107291827 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f72b80b3520 con 0x7f72c8072aa0 2024-05-27T06:27:16.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.297+0000 7f72cd600640 1 -- 172.21.15.87:0/107291827 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72c806aa30 con 0x7f72c8072aa0 2024-05-27T06:27:16.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.301+0000 7f72bf400640 1 -- 172.21.15.87:0/107291827 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f72b80c5070 con 0x7f72c8072aa0 2024-05-27T06:27:16.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.357+0000 7f72cd600640 1 -- 172.21.15.87:0/107291827 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72c815d920 con 0x7f72c8072aa0 2024-05-27T06:27:16.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.357+0000 7f72bf400640 1 -- 172.21.15.87:0/107291827 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f72b8016090 con 0x7f72c8072aa0 2024-05-27T06:27:16.356 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:27:16.356 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":10,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:27:16.027009+0000","last_up_change":"0.000000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:27:16.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.357+0000 7f72cd600640 1 -- 172.21.15.87:0/107291827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72c8072aa0 msgr2=0x7f72c815bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:16.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.357+0000 7f72cd600640 1 --2- 172.21.15.87:0/107291827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72c8072aa0 0x7f72c815bcb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f72b801ab20 tx=0x7f72b801acb0 comp rx=0 tx=0).stop 2024-05-27T06:27:16.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.357+0000 7f72cd600640 1 -- 172.21.15.87:0/107291827 shutdown_connections 2024-05-27T06:27:16.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.357+0000 7f72cd600640 1 --2- 172.21.15.87:0/107291827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72c80d1e50 0x7f72c815ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:16.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.357+0000 7f72cd600640 1 --2- 172.21.15.87:0/107291827 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72c8072eb0 0x7f72c80b22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:16.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.357+0000 7f72cd600640 1 --2- 172.21.15.87:0/107291827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72c8072aa0 0x7f72c815bcb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:16.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.361+0000 7f72cd600640 1 -- 172.21.15.87:0/107291827 >> 172.21.15.87:0/107291827 conn(0x7f72c80b46b0 msgr2=0x7f72c8073e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:16.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.361+0000 7f72cd600640 1 -- 172.21.15.87:0/107291827 shutdown_connections 2024-05-27T06:27:16.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:16.361+0000 7f72cd600640 1 -- 172.21.15.87:0/107291827 wait complete. 2024-05-27T06:27:16.375 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-27T06:27:16.376 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-27T06:27:16.447 INFO:tasks.ceph.mgr.y.smithi087.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-27T06:27:16.447 INFO:tasks.ceph.mgr.y.smithi087.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-27T06:27:16.447 INFO:tasks.ceph.mgr.y.smithi087.stderr: from numpy import show_config as show_numpy_config 2024-05-27T06:27:16.493 INFO:tasks.ceph.mgr.x.smithi149.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-27T06:27:16.493 INFO:tasks.ceph.mgr.x.smithi149.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-27T06:27:16.493 INFO:tasks.ceph.mgr.x.smithi149.stderr: from numpy import show_config as show_numpy_config 2024-05-27T06:27:16.496 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-27T06:27:16.497+0000 7f3ce6c84180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-27T06:27:16.538 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-27T06:27:16.541+0000 7f1306c66180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-27T06:27:16.645 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-27T06:27:16.649+0000 7f3ce6c84180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-27T06:27:16.686 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-27T06:27:16.689+0000 7f1306c66180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-27T06:27:16.706 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-05-27T06:27:16.709+0000 7f42f73387c0 -1 Falling back to public interface 2024-05-27T06:27:16.722 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-05-27T06:27:16.725+0000 7f6bd4bfd7c0 -1 Falling back to public interface 2024-05-27T06:27:16.738 INFO:tasks.ceph.osd.2.smithi087.stderr:2024-05-27T06:27:16.741+0000 7f445403d7c0 -1 Falling back to public interface 2024-05-27T06:27:16.738 INFO:tasks.ceph.osd.3.smithi087.stderr:2024-05-27T06:27:16.741+0000 7fc00b7d37c0 -1 Falling back to public interface 2024-05-27T06:27:16.738 INFO:tasks.ceph.osd.2.smithi087.stderr:2024-05-27T06:27:16.741+0000 7f4452a00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6816/0: (98) Address already in use 2024-05-27T06:27:16.806 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-05-27T06:27:16.809+0000 7f572cc397c0 -1 Falling back to public interface 2024-05-27T06:27:16.810 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-05-27T06:27:16.813+0000 7fd78caf77c0 -1 Falling back to public interface 2024-05-27T06:27:16.822 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-05-27T06:27:16.825+0000 7f3c308a47c0 -1 Falling back to public interface 2024-05-27T06:27:16.822 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-05-27T06:27:16.825+0000 7fc54288e7c0 -1 Falling back to public interface 2024-05-27T06:27:16.827 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-27T06:27:16.829+0000 7f3ce6c84180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-27T06:27:16.864 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-27T06:27:16.865+0000 7f1306c66180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-27T06:27:16.901 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-27T06:27:16.905+0000 7f3ce6c84180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-27T06:27:16.938 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-27T06:27:16.941+0000 7f1306c66180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-27T06:27:17.052 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-27T06:27:17.053+0000 7f3ce6c84180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-27T06:27:17.088 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-27T06:27:17.089+0000 7f1306c66180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-27T06:27:17.180 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-27T06:27:17.317 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.321+0000 7f238c800640 1 Processor -- start 2024-05-27T06:27:17.317 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.321+0000 7f238c800640 1 -- start start 2024-05-27T06:27:17.319 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.321+0000 7f238c800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f23840d1920 0x7f23840d1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:17.319 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.321+0000 7f238c800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2384163c50 con 0x7f23840d05f0 2024-05-27T06:27:17.319 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.321+0000 7f238c800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2384163f30 con 0x7f238406fd00 2024-05-27T06:27:17.319 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.321+0000 7f238c800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f23840d2270 con 0x7f23840d1920 2024-05-27T06:27:17.319 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.321+0000 7f2389e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f23840d1920 0x7f23840d1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:17.319 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.321+0000 7f2389e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f23840d1920 0x7f23840d1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47926/0 (socket says 172.21.15.87:47926) 2024-05-27T06:27:17.319 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.321+0000 7f2389e00640 1 -- 172.21.15.87:0/2241845025 learned_addr learned my addr 172.21.15.87:0/2241845025 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:17.320 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.321+0000 7f2389e00640 1 -- 172.21.15.87:0/2241845025 >> v1:172.21.15.149:6789/0 conn(0x7f238406fd00 legacy=0x7f2384070110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:17.320 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.321+0000 7f2389e00640 1 -- 172.21.15.87:0/2241845025 >> v1:172.21.15.87:6789/0 conn(0x7f23840d05f0 legacy=0x7f23840d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:17.320 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.321+0000 7f2389e00640 1 -- 172.21.15.87:0/2241845025 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2384164210 con 0x7f23840d1920 2024-05-27T06:27:17.323 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.325+0000 7f2389e00640 1 --2- 172.21.15.87:0/2241845025 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23840d1920 0x7f23840d1d30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2378009870 tx=0x7f237801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f211804eedbb4e46 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:17.323 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.325+0000 7f2388a00640 1 -- 172.21.15.87:0/2241845025 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23780b2070 con 0x7f23840d1920 2024-05-27T06:27:17.323 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.325+0000 7f2388a00640 1 -- 172.21.15.87:0/2241845025 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23780a9070 con 0x7f23840d1920 2024-05-27T06:27:17.323 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.325+0000 7f2388a00640 1 -- 172.21.15.87:0/2241845025 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23780ad880 con 0x7f23840d1920 2024-05-27T06:27:17.324 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.325+0000 7f238c800640 1 -- 172.21.15.87:0/2241845025 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23840d1920 msgr2=0x7f23840d1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:17.324 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.325+0000 7f238c800640 1 --2- 172.21.15.87:0/2241845025 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23840d1920 0x7f23840d1d30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2378009870 tx=0x7f237801c560 comp rx=0 tx=0).stop 2024-05-27T06:27:17.324 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.325+0000 7f238c800640 1 -- 172.21.15.87:0/2241845025 shutdown_connections 2024-05-27T06:27:17.324 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.325+0000 7f238c800640 1 --2- 172.21.15.87:0/2241845025 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23840d1920 0x7f23840d1d30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:17.325 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.325+0000 7f238c800640 1 -- 172.21.15.87:0/2241845025 >> 172.21.15.87:0/2241845025 conn(0x7f23840b4030 msgr2=0x7f23840b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:17.325 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.325+0000 7f238c800640 1 -- 172.21.15.87:0/2241845025 shutdown_connections 2024-05-27T06:27:17.325 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.325+0000 7f238c800640 1 -- 172.21.15.87:0/2241845025 wait complete. 2024-05-27T06:27:17.326 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.329+0000 7f238c800640 1 Processor -- start 2024-05-27T06:27:17.326 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.329+0000 7f238c800640 1 -- start start 2024-05-27T06:27:17.328 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.329+0000 7f238c800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f238406fd00 0x7f23840cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:17.328 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.329+0000 7f238c800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23840d05f0 0x7f238414fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:17.328 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.329+0000 7f238c800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23840d1920 0x7f2384150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:17.328 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.329+0000 7f238c800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f238416e740 con 0x7f23840d05f0 2024-05-27T06:27:17.328 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.329+0000 7f238c800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f238416e5c0 con 0x7f23840d1920 2024-05-27T06:27:17.328 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.329+0000 7f238c800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f238416e8c0 con 0x7f238406fd00 2024-05-27T06:27:17.329 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.329+0000 7f2389400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23840d05f0 0x7f238414fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:17.329 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.329+0000 7f2389400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23840d05f0 0x7f238414fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47942/0 (socket says 172.21.15.87:47942) 2024-05-27T06:27:17.329 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.329+0000 7f238a800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23840d1920 0x7f2384150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:17.329 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.329+0000 7f2389400640 1 -- 172.21.15.87:0/2894363587 learned_addr learned my addr 172.21.15.87:0/2894363587 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:17.329 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.329+0000 7f2389e00640 1 --2- 172.21.15.87:0/2894363587 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f238406fd00 0x7f23840cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:17.331 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.329+0000 7f2389400640 1 -- 172.21.15.87:0/2894363587 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f238406fd00 msgr2=0x7f23840cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:17.331 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.329+0000 7f2389400640 1 --2- 172.21.15.87:0/2894363587 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f238406fd00 0x7f23840cc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:17.331 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.333+0000 7f2389400640 1 -- 172.21.15.87:0/2894363587 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23840d1920 msgr2=0x7f2384150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:17.331 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.333+0000 7f2389400640 1 --2- 172.21.15.87:0/2894363587 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23840d1920 0x7f2384150040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:17.331 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.333+0000 7f2389400640 1 -- 172.21.15.87:0/2894363587 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23840cd920 con 0x7f23840d05f0 2024-05-27T06:27:17.331 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.333+0000 7f238a800640 1 --2- 172.21.15.87:0/2894363587 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23840d1920 0x7f2384150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:27:17.331 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.333+0000 7f2389400640 1 --2- 172.21.15.87:0/2894363587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23840d05f0 0x7f238414fb00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f237400b3c0 tx=0x7f237400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:17.331 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.333+0000 7f237e000640 1 -- 172.21.15.87:0/2894363587 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2374011830 con 0x7f23840d05f0 2024-05-27T06:27:17.331 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.333+0000 7f237e000640 1 -- 172.21.15.87:0/2894363587 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2374016070 con 0x7f23840d05f0 2024-05-27T06:27:17.331 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.333+0000 7f237e000640 1 -- 172.21.15.87:0/2894363587 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2374011c30 con 0x7f23840d05f0 2024-05-27T06:27:17.331 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.333+0000 7f238c800640 1 -- 172.21.15.87:0/2894363587 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f238415d790 con 0x7f23840d05f0 2024-05-27T06:27:17.331 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.333+0000 7f238c800640 1 -- 172.21.15.87:0/2894363587 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23841626c0 con 0x7f23840d05f0 2024-05-27T06:27:17.332 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.333+0000 7f237e000640 1 -- 172.21.15.87:0/2894363587 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f237401b460 con 0x7f23840d05f0 2024-05-27T06:27:17.332 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.333+0000 7f237e000640 1 -- 172.21.15.87:0/2894363587 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f2374011dd0 con 0x7f23840d05f0 2024-05-27T06:27:17.332 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.333+0000 7f238c800640 1 -- 172.21.15.87:0/2894363587 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f238406a2b0 con 0x7f23840d05f0 2024-05-27T06:27:17.333 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.337+0000 7f237e000640 1 -- 172.21.15.87:0/2894363587 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f237401b750 con 0x7f23840d05f0 2024-05-27T06:27:17.390 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.393+0000 7f238c800640 1 -- 172.21.15.87:0/2894363587 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2384160550 con 0x7f23840d05f0 2024-05-27T06:27:17.390 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.393+0000 7f237e000640 1 -- 172.21.15.87:0/2894363587 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f237401b990 con 0x7f23840d05f0 2024-05-27T06:27:17.391 INFO:teuthology.misc.health.smithi087.stdout: 2024-05-27T06:27:17.391 INFO:teuthology.misc.health.smithi087.stdout:{"epoch":10,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:27:16.027009+0000","last_up_change":"0.000000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:27:17.392 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.393+0000 7f238c800640 1 -- 172.21.15.87:0/2894363587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23840d05f0 msgr2=0x7f238414fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:17.392 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.393+0000 7f238c800640 1 --2- 172.21.15.87:0/2894363587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23840d05f0 0x7f238414fb00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f237400b3c0 tx=0x7f237400b880 comp rx=0 tx=0).stop 2024-05-27T06:27:17.392 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.393+0000 7f238c800640 1 -- 172.21.15.87:0/2894363587 shutdown_connections 2024-05-27T06:27:17.392 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.393+0000 7f238c800640 1 --2- 172.21.15.87:0/2894363587 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23840d1920 0x7f2384150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:17.392 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.393+0000 7f238c800640 1 --2- 172.21.15.87:0/2894363587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23840d05f0 0x7f238414fb00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:17.392 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.393+0000 7f238c800640 1 --2- 172.21.15.87:0/2894363587 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f238406fd00 0x7f23840cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:17.392 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.393+0000 7f238c800640 1 -- 172.21.15.87:0/2894363587 >> 172.21.15.87:0/2894363587 conn(0x7f23840b4030 msgr2=0x7f23840cddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:17.392 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.393+0000 7f238c800640 1 -- 172.21.15.87:0/2894363587 shutdown_connections 2024-05-27T06:27:17.392 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:17.393+0000 7f238c800640 1 -- 172.21.15.87:0/2894363587 wait complete. 2024-05-27T06:27:17.409 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-27T06:27:17.760 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-27T06:27:17.761+0000 7f3ce6c84180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-27T06:27:17.789 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-27T06:27:17.793+0000 7f1306c66180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-27T06:27:17.847 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-27T06:27:17.849+0000 7f3ce6c84180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-27T06:27:17.876 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-27T06:27:17.877+0000 7f1306c66180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-27T06:27:18.051 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-27T06:27:18.053+0000 7f3ce6c84180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-27T06:27:18.079 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-27T06:27:18.081+0000 7f1306c66180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-27T06:27:18.136 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-27T06:27:18.137+0000 7f3ce6c84180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-27T06:27:18.163 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-27T06:27:18.165+0000 7f1306c66180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-27T06:27:18.467 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-27T06:27:18.468+0000 7f3ce6c84180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-27T06:27:18.493 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-27T06:27:18.497+0000 7f1306c66180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-27T06:27:18.538 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-27T06:27:18.540+0000 7f3ce6c84180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-27T06:27:18.567 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-05-27T06:27:18.569+0000 7f1306c66180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-27T06:27:19.562 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-27T06:27:19.564+0000 7f3c8c000640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-27T06:27:19.564 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-27T06:27:19.564+0000 7f3c8c000640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-27T06:27:20.582 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-05-27T06:27:20.584+0000 7f42f73387c0 -1 osd.0 0 log_to_monitors true 2024-05-27T06:27:20.686 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-05-27T06:27:20.689+0000 7f572cc397c0 -1 osd.6 0 log_to_monitors true 2024-05-27T06:27:20.719 INFO:tasks.ceph.osd.3.smithi087.stderr:2024-05-27T06:27:20.720+0000 7fc00b7d37c0 -1 osd.3 0 log_to_monitors true 2024-05-27T06:27:20.741 INFO:tasks.ceph.osd.2.smithi087.stderr:2024-05-27T06:27:20.744+0000 7f445403d7c0 -1 osd.2 0 log_to_monitors true 2024-05-27T06:27:20.779 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-05-27T06:27:20.780+0000 7f6bd4bfd7c0 -1 osd.1 0 log_to_monitors true 2024-05-27T06:27:20.816 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-05-27T06:27:20.817+0000 7fd78caf77c0 -1 osd.7 0 log_to_monitors true 2024-05-27T06:27:21.043 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-05-27T06:27:21.045+0000 7fc54288e7c0 -1 osd.4 0 log_to_monitors true 2024-05-27T06:27:21.092 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-05-27T06:27:21.093+0000 7f3c308a47c0 -1 osd.5 0 log_to_monitors true 2024-05-27T06:27:24.216 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-27T06:27:24.449 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.452+0000 7fa006800640 1 Processor -- start 2024-05-27T06:27:24.450 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.452+0000 7fa006800640 1 -- start start 2024-05-27T06:27:24.454 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.452+0000 7fa006800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa0000bab30 0x7fa0000d4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:24.454 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.452+0000 7fa006800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0000d5750 con 0x7fa0000d12b0 2024-05-27T06:27:24.454 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.452+0000 7fa006800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0000d5a30 con 0x7fa0000d4aa0 2024-05-27T06:27:24.454 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.452+0000 7fa006800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fa0000d5d10 con 0x7fa0000bab30 2024-05-27T06:27:24.454 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.452+0000 7f9fff400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fa0000d4aa0 0x7fa0000ba420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.87:36902/0 (socket says 172.21.15.87:36902) 2024-05-27T06:27:24.454 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.452+0000 7f9fff400640 1 -- 172.21.15.87:0/1737011249 learned_addr learned my addr 172.21.15.87:0/1737011249 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:27:24.454 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.456+0000 7f9ffea00640 1 --2- 172.21.15.87:0/1737011249 >> v2:172.21.15.87:3300/0 conn(0x7fa0000bab30 0x7fa0000d4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:24.454 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.456+0000 7f9ffea00640 1 -- 172.21.15.87:0/1737011249 >> v1:172.21.15.149:6789/0 conn(0x7fa0000d4aa0 legacy=0x7fa0000ba420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:24.454 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.456+0000 7f9ffea00640 1 -- 172.21.15.87:0/1737011249 >> v1:172.21.15.87:6789/0 conn(0x7fa0000d12b0 legacy=0x7fa0000d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:24.455 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.456+0000 7f9ffea00640 1 -- 172.21.15.87:0/1737011249 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0000d5ff0 con 0x7fa0000bab30 2024-05-27T06:27:24.459 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.460+0000 7f9ffea00640 1 --2- 172.21.15.87:0/1737011249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0000bab30 0x7fa0000d4eb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9fec013050 tx=0x7f9fec024bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939ee5fb7ba0902a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:24.459 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.460+0000 7f9ffe000640 1 -- 172.21.15.87:0/1737011249 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec0ada80 con 0x7fa0000bab30 2024-05-27T06:27:24.459 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.460+0000 7f9ffe000640 1 -- 172.21.15.87:0/1737011249 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fec0adc20 con 0x7fa0000bab30 2024-05-27T06:27:24.460 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.460+0000 7f9ffe000640 1 -- 172.21.15.87:0/1737011249 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec0110d0 con 0x7fa0000bab30 2024-05-27T06:27:24.461 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.464+0000 7fa006800640 1 -- 172.21.15.87:0/1737011249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0000bab30 msgr2=0x7fa0000d4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:24.461 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.464+0000 7fa006800640 1 --2- 172.21.15.87:0/1737011249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0000bab30 0x7fa0000d4eb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9fec013050 tx=0x7f9fec024bd0 comp rx=0 tx=0).stop 2024-05-27T06:27:24.465 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.464+0000 7fa006800640 1 -- 172.21.15.87:0/1737011249 shutdown_connections 2024-05-27T06:27:24.465 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.464+0000 7fa006800640 1 --2- 172.21.15.87:0/1737011249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0000bab30 0x7fa0000d4eb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:24.465 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.464+0000 7fa006800640 1 -- 172.21.15.87:0/1737011249 >> 172.21.15.87:0/1737011249 conn(0x7fa00009e9c0 msgr2=0x7fa00008cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:24.465 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.464+0000 7fa006800640 1 -- 172.21.15.87:0/1737011249 shutdown_connections 2024-05-27T06:27:24.465 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.464+0000 7fa006800640 1 -- 172.21.15.87:0/1737011249 wait complete. 2024-05-27T06:27:24.465 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.464+0000 7fa006800640 1 Processor -- start 2024-05-27T06:27:24.465 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.468+0000 7fa006800640 1 -- start start 2024-05-27T06:27:24.468 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.468+0000 7fa006800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0000d12b0 0x7fa00020a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:24.468 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.468+0000 7fa006800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0000d4aa0 0x7fa0002036e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:24.469 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.472+0000 7f9ffea00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0000d4aa0 0x7fa0002036e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:24.469 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.472+0000 7f9ffea00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0000d4aa0 0x7fa0002036e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48064/0 (socket says 172.21.15.87:48064) 2024-05-27T06:27:24.469 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.472+0000 7fa006800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa0000d3a50 0x7fa0000d3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:24.470 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.472+0000 7f9fff400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0000d12b0 0x7fa00020a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:24.470 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.472+0000 7f9fff400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0000d12b0 0x7fa00020a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:37660/0 (socket says 172.21.15.87:37660) 2024-05-27T06:27:24.470 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.472+0000 7fa006800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa000072c70 con 0x7fa0000d4aa0 2024-05-27T06:27:24.470 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.472+0000 7fa006800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa000072af0 con 0x7fa0000d12b0 2024-05-27T06:27:24.471 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.472+0000 7f9fff400640 1 -- 172.21.15.87:0/2411543084 learned_addr learned my addr 172.21.15.87:0/2411543084 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:24.471 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.472+0000 7f9fffe00640 1 --2- 172.21.15.87:0/2411543084 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa0000d3a50 0x7fa0000d3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:24.471 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.472+0000 7fa006800640 1 -- 172.21.15.87:0/2411543084 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa000072df0 con 0x7fa0000d3a50 2024-05-27T06:27:24.471 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.472+0000 7f9fffe00640 1 -- 172.21.15.87:0/2411543084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0000d12b0 msgr2=0x7fa00020a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:24.471 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.472+0000 7f9fffe00640 1 --2- 172.21.15.87:0/2411543084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0000d12b0 0x7fa00020a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:24.471 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.472+0000 7f9fffe00640 1 -- 172.21.15.87:0/2411543084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0000d4aa0 msgr2=0x7fa0002036e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:24.471 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.472+0000 7f9fffe00640 1 --2- 172.21.15.87:0/2411543084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0000d4aa0 0x7fa0002036e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:24.472 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.472+0000 7f9fffe00640 1 -- 172.21.15.87:0/2411543084 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa000206510 con 0x7fa0000d3a50 2024-05-27T06:27:24.472 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.472+0000 7f9ffea00640 1 --2- 172.21.15.87:0/2411543084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0000d4aa0 0x7fa0002036e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:27:24.472 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.472+0000 7f9fffe00640 1 --2- 172.21.15.87:0/2411543084 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa0000d3a50 0x7fa0000d3e60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800c700 tx=0x7f9ff800cb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:24.473 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.472+0000 7f9ff7400640 1 -- 172.21.15.87:0/2411543084 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8003b80 con 0x7fa0000d3a50 2024-05-27T06:27:24.473 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.476+0000 7fa006800640 1 -- 172.21.15.87:0/2411543084 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0000d43a0 con 0x7fa0000d3a50 2024-05-27T06:27:24.473 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.476+0000 7fa006800640 1 -- 172.21.15.87:0/2411543084 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa000206780 con 0x7fa0000d3a50 2024-05-27T06:27:24.473 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.476+0000 7f9ff7400640 1 -- 172.21.15.87:0/2411543084 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff8003d20 con 0x7fa0000d3a50 2024-05-27T06:27:24.473 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.476+0000 7f9ff7400640 1 -- 172.21.15.87:0/2411543084 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff80052d0 con 0x7fa0000d3a50 2024-05-27T06:27:24.475 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.476+0000 7fa006800640 1 -- 172.21.15.87:0/2411543084 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fd80052a0 con 0x7fa0000d3a50 2024-05-27T06:27:24.478 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.480+0000 7f9ff7400640 1 -- 172.21.15.87:0/2411543084 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 4) ==== 93151+0+0 (secure 0 0 0) 0x7f9ff8005470 con 0x7fa0000d3a50 2024-05-27T06:27:24.481 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.484+0000 7f9ff7400640 1 --2- 172.21.15.87:0/2411543084 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9fe006f3a0 0x7f9fe00718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:24.482 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.484+0000 7f9ff7400640 1 -- 172.21.15.87:0/2411543084 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f9ff808e3c0 con 0x7fa0000d3a50 2024-05-27T06:27:24.482 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.484+0000 7f9fff400640 1 --2- 172.21.15.87:0/2411543084 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9fe006f3a0 0x7f9fe00718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:24.485 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.488+0000 7f9fff400640 1 --2- 172.21.15.87:0/2411543084 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9fe006f3a0 0x7f9fe00718b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0009370 tx=0x7f9ff0009300 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:24.490 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.492+0000 7f9ff7400640 1 -- 172.21.15.87:0/2411543084 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa0000d43a0 con 0x7fa0000d3a50 2024-05-27T06:27:24.819 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.820+0000 7fa006800640 1 -- 172.21.15.87:0/2411543084 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9fd8005860 con 0x7fa0000d3a50 2024-05-27T06:27:24.836 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.836+0000 7f9ff7400640 1 -- 172.21.15.87:0/2411543084 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f9ff805c110 con 0x7fa0000d3a50 2024-05-27T06:27:24.840 INFO:teuthology.misc.health.smithi087.stdout: 2024-05-27T06:27:24.840 INFO:teuthology.misc.health.smithi087.stdout:{"epoch":12,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:27:22.573627+0000","last_up_change":"0.000000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:27:24.842 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.844+0000 7fa006800640 1 -- 172.21.15.87:0/2411543084 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9fe006f3a0 msgr2=0x7f9fe00718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:24.842 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.844+0000 7fa006800640 1 --2- 172.21.15.87:0/2411543084 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9fe006f3a0 0x7f9fe00718b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0009370 tx=0x7f9ff0009300 comp rx=0 tx=0).stop 2024-05-27T06:27:24.842 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.844+0000 7fa006800640 1 -- 172.21.15.87:0/2411543084 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa0000d3a50 msgr2=0x7fa0000d3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:24.842 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.844+0000 7fa006800640 1 --2- 172.21.15.87:0/2411543084 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa0000d3a50 0x7fa0000d3e60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800c700 tx=0x7f9ff800cb00 comp rx=0 tx=0).stop 2024-05-27T06:27:24.842 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.844+0000 7fa006800640 1 -- 172.21.15.87:0/2411543084 shutdown_connections 2024-05-27T06:27:24.842 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.844+0000 7fa006800640 1 --2- 172.21.15.87:0/2411543084 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9fe006f3a0 0x7f9fe00718b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:24.842 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.844+0000 7fa006800640 1 --2- 172.21.15.87:0/2411543084 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa0000d3a50 0x7fa0000d3e60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:24.842 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.844+0000 7fa006800640 1 --2- 172.21.15.87:0/2411543084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0000d4aa0 0x7fa0002036e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:24.842 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.844+0000 7fa006800640 1 --2- 172.21.15.87:0/2411543084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0000d12b0 0x7fa00020a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:24.842 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.844+0000 7fa006800640 1 -- 172.21.15.87:0/2411543084 >> 172.21.15.87:0/2411543084 conn(0x7fa00009e9c0 msgr2=0x7fa0000b3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:24.845 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.848+0000 7fa006800640 1 -- 172.21.15.87:0/2411543084 shutdown_connections 2024-05-27T06:27:24.846 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:24.848+0000 7fa006800640 1 -- 172.21.15.87:0/2411543084 wait complete. 2024-05-27T06:27:24.877 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-27T06:27:24.960 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-05-27T06:27:24.961+0000 7fc53d800640 -1 osd.4 0 waiting for initial osdmap 2024-05-27T06:27:24.972 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-05-27T06:27:24.969+0000 7fd787a00640 -1 osd.7 0 waiting for initial osdmap 2024-05-27T06:27:25.002 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-05-27T06:27:25.005+0000 7fd77da00640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T06:27:25.003 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-05-27T06:27:25.005+0000 7fc533800640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T06:27:25.014 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-05-27T06:27:25.017+0000 7f5727a00640 -1 osd.6 0 waiting for initial osdmap 2024-05-27T06:27:25.065 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-05-27T06:27:25.069+0000 7f3c2b800640 -1 osd.5 0 waiting for initial osdmap 2024-05-27T06:27:25.070 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-05-27T06:27:25.073+0000 7f571da00640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T06:27:25.094 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-05-27T06:27:25.097+0000 7f3c21800640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T06:27:25.100 INFO:tasks.ceph.osd.3.smithi087.stderr:2024-05-27T06:27:25.100+0000 7fc007000640 -1 osd.3 0 waiting for initial osdmap 2024-05-27T06:27:25.110 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-05-27T06:27:25.112+0000 7f6bd0400640 -1 osd.1 0 waiting for initial osdmap 2024-05-27T06:27:25.134 INFO:tasks.ceph.osd.3.smithi087.stderr:2024-05-27T06:27:25.136+0000 7fbffc600640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T06:27:25.142 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-05-27T06:27:25.144+0000 7f6bc5a00640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T06:27:25.147 INFO:tasks.ceph.osd.2.smithi087.stderr:2024-05-27T06:27:25.148+0000 7f444ee00640 -1 osd.2 0 waiting for initial osdmap 2024-05-27T06:27:25.161 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-05-27T06:27:25.160+0000 7f42f2200640 -1 osd.0 0 waiting for initial osdmap 2024-05-27T06:27:25.178 INFO:tasks.ceph.osd.2.smithi087.stderr:2024-05-27T06:27:25.180+0000 7f4444e00640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T06:27:25.186 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-05-27T06:27:25.188+0000 7f42e8200640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T06:27:31.685 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-27T06:27:31.838 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.840+0000 7f64a8600640 1 Processor -- start 2024-05-27T06:27:31.839 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.840+0000 7f64a8600640 1 -- start start 2024-05-27T06:27:31.840 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.840+0000 7f64a8600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f64a00cd120 0x7f64a0160b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:31.840 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.840+0000 7f64a8600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64a00c7280 0x7f64a00c7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:31.840 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.840+0000 7f64a8600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64a0163950 con 0x7f64a0160770 2024-05-27T06:27:31.840 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.840+0000 7f64a8600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f64a0164710 con 0x7f64a00cd120 2024-05-27T06:27:31.841 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.840+0000 7f64a8600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f64a0161160 con 0x7f64a00c7280 2024-05-27T06:27:31.841 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.840+0000 7f64a5200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f64a00cd120 0x7f64a0160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:31.842 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.844+0000 7f64a6600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64a00c7280 0x7f64a00c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:31.842 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.844+0000 7f64a5c00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f64a0160770 0x7f64a00cca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.87:46174/0 (socket says 172.21.15.87:46174) 2024-05-27T06:27:31.842 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.844+0000 7f64a5c00640 1 -- 172.21.15.87:0/3988922608 learned_addr learned my addr 172.21.15.87:0/3988922608 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:27:31.842 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.844+0000 7f64a5200640 1 -- 172.21.15.87:0/3988922608 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64a00c7280 msgr2=0x7f64a00c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:31.842 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.844+0000 7f64a5200640 1 --2- 172.21.15.87:0/3988922608 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64a00c7280 0x7f64a00c7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:31.842 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.844+0000 7f64a5200640 1 -- 172.21.15.87:0/3988922608 >> v1:172.21.15.149:6789/0 conn(0x7f64a0160770 legacy=0x7f64a00cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:31.842 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.844+0000 7f64a5200640 1 -- 172.21.15.87:0/3988922608 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a0163c30 con 0x7f64a00cd120 2024-05-27T06:27:31.842 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.844+0000 7f649fe00640 1 -- 172.21.15.87:0/3988922608 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1201983794 0 0) 0x7f64a0163950 con 0x7f64a0160770 2024-05-27T06:27:31.844 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.844+0000 7f64a5200640 1 --2- 172.21.15.87:0/3988922608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64a00cd120 0x7f64a0160b80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f648c0097c0 tx=0x7f648c01c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17438130c49fc4ae server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:31.845 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.848+0000 7f649fe00640 1 -- 172.21.15.87:0/3988922608 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648c0b0070 con 0x7f64a00cd120 2024-05-27T06:27:31.845 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.848+0000 7f649fe00640 1 -- 172.21.15.87:0/3988922608 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f648c004230 con 0x7f64a00cd120 2024-05-27T06:27:31.845 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.848+0000 7f649fe00640 1 -- 172.21.15.87:0/3988922608 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648c003620 con 0x7f64a00cd120 2024-05-27T06:27:31.846 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.848+0000 7f64a8600640 1 -- 172.21.15.87:0/3988922608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64a00cd120 msgr2=0x7f64a0160b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:31.846 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.848+0000 7f64a8600640 1 --2- 172.21.15.87:0/3988922608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64a00cd120 0x7f64a0160b80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f648c0097c0 tx=0x7f648c01c350 comp rx=0 tx=0).stop 2024-05-27T06:27:31.846 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.848+0000 7f64a8600640 1 -- 172.21.15.87:0/3988922608 shutdown_connections 2024-05-27T06:27:31.846 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.848+0000 7f64a8600640 1 --2- 172.21.15.87:0/3988922608 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64a00c7280 0x7f64a00c7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:31.846 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.848+0000 7f64a8600640 1 --2- 172.21.15.87:0/3988922608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64a00cd120 0x7f64a0160b80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:31.847 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.848+0000 7f64a8600640 1 -- 172.21.15.87:0/3988922608 >> 172.21.15.87:0/3988922608 conn(0x7f64a00cee40 msgr2=0x7f64a00cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:31.847 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.848+0000 7f64a8600640 1 -- 172.21.15.87:0/3988922608 shutdown_connections 2024-05-27T06:27:31.847 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.848+0000 7f64a8600640 1 -- 172.21.15.87:0/3988922608 wait complete. 2024-05-27T06:27:31.848 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.848+0000 7f64a8600640 1 Processor -- start 2024-05-27T06:27:31.848 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.848+0000 7f64a8600640 1 -- start start 2024-05-27T06:27:31.851 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.852+0000 7f64a8600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64a00c7280 0x7f64a00c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:31.851 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.852+0000 7f64a8600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64a0160770 0x7f64a006f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:31.851 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.852+0000 7f64a8600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64a014ce80 0x7f64a0151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:31.852 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.852+0000 7f64a8600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f64a016cbc0 con 0x7f64a014ce80 2024-05-27T06:27:31.852 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.852+0000 7f64a8600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f64a00d0210 con 0x7f64a00c7280 2024-05-27T06:27:31.852 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.852+0000 7f64a8600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f64a016cd40 con 0x7f64a0160770 2024-05-27T06:27:31.852 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.852+0000 7f64a6600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64a014ce80 0x7f64a0151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:31.852 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.852+0000 7f64a6600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64a014ce80 0x7f64a0151e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49158/0 (socket says 172.21.15.87:49158) 2024-05-27T06:27:31.852 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.852+0000 7f64a6600640 1 -- 172.21.15.87:0/1970706199 learned_addr learned my addr 172.21.15.87:0/1970706199 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:31.852 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.852+0000 7f64a5200640 1 --2- 172.21.15.87:0/1970706199 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64a0160770 0x7f64a006f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:31.852 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.852+0000 7f64a5c00640 1 --2- 172.21.15.87:0/1970706199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64a00c7280 0x7f64a00c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:31.852 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.852+0000 7f64a6600640 1 -- 172.21.15.87:0/1970706199 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64a0160770 msgr2=0x7f64a006f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:31.852 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.852+0000 7f64a6600640 1 --2- 172.21.15.87:0/1970706199 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64a0160770 0x7f64a006f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:31.852 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.852+0000 7f64a6600640 1 -- 172.21.15.87:0/1970706199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64a00c7280 msgr2=0x7f64a00c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:31.852 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.852+0000 7f64a6600640 1 --2- 172.21.15.87:0/1970706199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64a00c7280 0x7f64a00c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:31.852 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.852+0000 7f64a6600640 1 -- 172.21.15.87:0/1970706199 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a014cbf0 con 0x7f64a014ce80 2024-05-27T06:27:31.853 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.852+0000 7f64a6600640 1 --2- 172.21.15.87:0/1970706199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64a014ce80 0x7f64a0151e80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6498009cb0 tx=0x7f649800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:31.853 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.852+0000 7f649d600640 1 -- 172.21.15.87:0/1970706199 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6498018020 con 0x7f64a014ce80 2024-05-27T06:27:31.853 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.852+0000 7f649d600640 1 -- 172.21.15.87:0/1970706199 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6498014480 con 0x7f64a014ce80 2024-05-27T06:27:31.853 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.852+0000 7f64a8600640 1 -- 172.21.15.87:0/1970706199 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64a0150de0 con 0x7f64a014ce80 2024-05-27T06:27:31.853 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.852+0000 7f649d600640 1 -- 172.21.15.87:0/1970706199 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6498014870 con 0x7f64a014ce80 2024-05-27T06:27:31.853 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.852+0000 7f64a8600640 1 -- 172.21.15.87:0/1970706199 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64a01513a0 con 0x7f64a014ce80 2024-05-27T06:27:31.853 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.852+0000 7f64a8600640 1 -- 172.21.15.87:0/1970706199 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64a015d620 con 0x7f64a014ce80 2024-05-27T06:27:31.854 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.856+0000 7f649d600640 1 -- 172.21.15.87:0/1970706199 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f649801b020 con 0x7f64a014ce80 2024-05-27T06:27:31.855 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.856+0000 7f649d600640 1 --2- 172.21.15.87:0/1970706199 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f648006f400 0x7f6480071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:31.855 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.856+0000 7f649d600640 1 -- 172.21.15.87:0/1970706199 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f6498090040 con 0x7f64a014ce80 2024-05-27T06:27:31.855 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.856+0000 7f64a5c00640 1 --2- 172.21.15.87:0/1970706199 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f648006f400 0x7f6480071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:31.855 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.856+0000 7f64a5c00640 1 --2- 172.21.15.87:0/1970706199 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f648006f400 0x7f6480071910 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6494000f70 tx=0x7f6494007df0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:31.859 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:31.860+0000 7f649d600640 1 -- 172.21.15.87:0/1970706199 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f6498022030 con 0x7f64a014ce80 2024-05-27T06:27:32.016 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:32.016+0000 7f64a8600640 1 -- 172.21.15.87:0/1970706199 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f64a006a2b0 con 0x7f64a014ce80 2024-05-27T06:27:32.018 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:32.020+0000 7f649d600640 1 -- 172.21.15.87:0/1970706199 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12872 (secure 0 0 0) 0x7f6498063030 con 0x7f64a014ce80 2024-05-27T06:27:32.018 INFO:teuthology.misc.health.smithi087.stdout: 2024-05-27T06:27:32.018 INFO:teuthology.misc.health.smithi087.stdout:{"epoch":16,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:27:29.013051+0000","last_up_change":"2024-05-27T06:27:25.988592+0000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T06:27:26.590191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6801","nonce":3674824716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6803","nonce":3674824716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6807","nonce":3674824716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6805","nonce":3674824716}]},"public_addr":"172.21.15.87:6801/3674824716","cluster_addr":"172.21.15.87:6803/3674824716","heartbeat_back_addr":"172.21.15.87:6807/3674824716","heartbeat_front_addr":"172.21.15.87:6805/3674824716","state":["exists","up"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6809","nonce":2443981288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6811","nonce":2443981288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6815","nonce":2443981288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6813","nonce":2443981288}]},"public_addr":"172.21.15.87:6809/2443981288","cluster_addr":"172.21.15.87:6811/2443981288","heartbeat_back_addr":"172.21.15.87:6815/2443981288","heartbeat_front_addr":"172.21.15.87:6813/2443981288","state":["exists","up"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6819","nonce":1441249238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6823","nonce":1441249238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6831","nonce":1441249238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6825","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6827","nonce":1441249238}]},"public_addr":"172.21.15.87:6819/1441249238","cluster_addr":"172.21.15.87:6823/1441249238","heartbeat_back_addr":"172.21.15.87:6831/1441249238","heartbeat_front_addr":"172.21.15.87:6827/1441249238","state":["exists","up"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6818","nonce":1173805234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6822","nonce":1173805234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6829","nonce":1173805234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6826","nonce":1173805234}]},"public_addr":"172.21.15.87:6818/1173805234","cluster_addr":"172.21.15.87:6822/1173805234","heartbeat_back_addr":"172.21.15.87:6829/1173805234","heartbeat_front_addr":"172.21.15.87:6826/1173805234","state":["exists","up"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6819","nonce":1551871079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6823","nonce":1551871079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6831","nonce":1551871079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6827","nonce":1551871079}]},"public_addr":"172.21.15.149:6819/1551871079","cluster_addr":"172.21.15.149:6823/1551871079","heartbeat_back_addr":"172.21.15.149:6831/1551871079","heartbeat_front_addr":"172.21.15.149:6827/1551871079","state":["exists","up"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6818","nonce":582864816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6822","nonce":582864816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6830","nonce":582864816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6826","nonce":582864816}]},"public_addr":"172.21.15.149:6818/582864816","cluster_addr":"172.21.15.149:6822/582864816","heartbeat_back_addr":"172.21.15.149:6830/582864816","heartbeat_front_addr":"172.21.15.149:6826/582864816","state":["exists","up"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6801","nonce":531351314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6803","nonce":531351314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6807","nonce":531351314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6805","nonce":531351314}]},"public_addr":"172.21.15.149:6801/531351314","cluster_addr":"172.21.15.149:6803/531351314","heartbeat_back_addr":"172.21.15.149:6807/531351314","heartbeat_front_addr":"172.21.15.149:6805/531351314","state":["exists","up"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6809","nonce":1171039913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6811","nonce":1171039913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6815","nonce":1171039913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6813","nonce":1171039913}]},"public_addr":"172.21.15.149:6809/1171039913","cluster_addr":"172.21.15.149:6811/1171039913","heartbeat_back_addr":"172.21.15.149:6815/1171039913","heartbeat_front_addr":"172.21.15.149:6813/1171039913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.589776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.819787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.767566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.683842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.038885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.120319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.687007+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.812832+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:27:32.020 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:32.020+0000 7f64a8600640 1 -- 172.21.15.87:0/1970706199 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f648006f400 msgr2=0x7f6480071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:32.020 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:32.020+0000 7f64a8600640 1 --2- 172.21.15.87:0/1970706199 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f648006f400 0x7f6480071910 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6494000f70 tx=0x7f6494007df0 comp rx=0 tx=0).stop 2024-05-27T06:27:32.020 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:32.020+0000 7f64a8600640 1 -- 172.21.15.87:0/1970706199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64a014ce80 msgr2=0x7f64a0151e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:32.020 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:32.020+0000 7f64a8600640 1 --2- 172.21.15.87:0/1970706199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64a014ce80 0x7f64a0151e80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6498009cb0 tx=0x7f649800c490 comp rx=0 tx=0).stop 2024-05-27T06:27:32.020 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:32.020+0000 7f64a8600640 1 -- 172.21.15.87:0/1970706199 shutdown_connections 2024-05-27T06:27:32.020 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:32.020+0000 7f64a8600640 1 --2- 172.21.15.87:0/1970706199 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f648006f400 0x7f6480071910 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:32.020 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:32.020+0000 7f64a8600640 1 --2- 172.21.15.87:0/1970706199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64a014ce80 0x7f64a0151e80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:32.020 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:32.020+0000 7f64a8600640 1 --2- 172.21.15.87:0/1970706199 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64a0160770 0x7f64a006f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:32.020 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:32.020+0000 7f64a8600640 1 --2- 172.21.15.87:0/1970706199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64a00c7280 0x7f64a00c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:32.021 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:32.020+0000 7f64a8600640 1 -- 172.21.15.87:0/1970706199 >> 172.21.15.87:0/1970706199 conn(0x7f64a00cee40 msgr2=0x7f64a00689d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:32.021 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:32.020+0000 7f64a8600640 1 -- 172.21.15.87:0/1970706199 shutdown_connections 2024-05-27T06:27:32.021 INFO:teuthology.misc.health.smithi087.stderr:2024-05-27T06:27:32.020+0000 7f64a8600640 1 -- 172.21.15.87:0/1970706199 wait complete. 2024-05-27T06:27:32.039 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-27T06:27:32.039 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-27T06:27:32.040 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-27T06:27:32.040 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-27T06:27:32.043 INFO:tasks.ceph.mds.a:Started 2024-05-27T06:27:32.043 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-27T06:27:32.043 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-27T06:27:32.046 INFO:tasks.ceph.mds.c:Started 2024-05-27T06:27:32.046 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-27T06:27:32.046 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-27T06:27:32.049 INFO:tasks.ceph.mds.b:Started 2024-05-27T06:27:32.049 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-27T06:27:32.050 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-27T06:27:32.052 INFO:tasks.ceph.mds.d:Started 2024-05-27T06:27:32.053 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-27T06:27:32.053 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T06:27:32.162 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-05-27T06:27:32.164 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-05-27T06:27:32.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.204+0000 7f90cf200640 1 Processor -- start 2024-05-27T06:27:32.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.204+0000 7f90cf200640 1 -- start start 2024-05-27T06:27:32.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.208+0000 7f90cf200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90d00d26f0 0x7f90d00ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:32.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.208+0000 7f90cf200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f90d00b7940 0x7f90d0169700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:32.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.208+0000 7f90cf200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90d00ccee0 con 0x7f90d00ce430 2024-05-27T06:27:32.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.208+0000 7f90cf200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f90d00ca540 con 0x7f90d00b7940 2024-05-27T06:27:32.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.208+0000 7f90cf200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f90d00cd1c0 con 0x7f90d00d26f0 2024-05-27T06:27:32.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.208+0000 7f90c5400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90d00d26f0 0x7f90d00ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:32.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.208+0000 7f90cde00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f90d00ce430 0x7f90d00d1fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.87:46186/0 (socket says 172.21.15.87:46186) 2024-05-27T06:27:32.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.208+0000 7f90cde00640 1 -- 172.21.15.87:0/261504597 learned_addr learned my addr 172.21.15.87:0/261504597 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:27:32.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.208+0000 7f90ce800640 1 --2- 172.21.15.87:0/261504597 >> v2:172.21.15.149:3300/0 conn(0x7f90d00b7940 0x7f90d0169700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:32.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.208+0000 7f90c5400640 1 -- 172.21.15.87:0/261504597 >> v2:172.21.15.149:3300/0 conn(0x7f90d00b7940 msgr2=0x7f90d0169700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:32.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.208+0000 7f90c5400640 1 --2- 172.21.15.87:0/261504597 >> v2:172.21.15.149:3300/0 conn(0x7f90d00b7940 0x7f90d0169700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:32.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.208+0000 7f90c5400640 1 -- 172.21.15.87:0/261504597 >> v1:172.21.15.149:6789/0 conn(0x7f90d00ce430 legacy=0x7f90d00d1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:32.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.208+0000 7f90c5400640 1 -- 172.21.15.87:0/261504597 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90d00cd4a0 con 0x7f90d00d26f0 2024-05-27T06:27:32.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.212+0000 7f90c5400640 1 --2- 172.21.15.87:0/261504597 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90d00d26f0 0x7f90d00ce840 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f90b80097c0 tx=0x7f90b801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a9a06fde21b528b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:32.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.212+0000 7f90cd400640 1 -- 172.21.15.87:0/261504597 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b80b0070 con 0x7f90d00d26f0 2024-05-27T06:27:32.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.212+0000 7f90cd400640 1 -- 172.21.15.87:0/261504597 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90b80ab600 con 0x7f90d00d26f0 2024-05-27T06:27:32.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.212+0000 7f90cd400640 1 -- 172.21.15.87:0/261504597 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b80ab9d0 con 0x7f90d00d26f0 2024-05-27T06:27:32.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.212+0000 7f90cf200640 1 -- 172.21.15.87:0/261504597 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90d00d26f0 msgr2=0x7f90d00ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:32.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.212+0000 7f90cf200640 1 --2- 172.21.15.87:0/261504597 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90d00d26f0 0x7f90d00ce840 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f90b80097c0 tx=0x7f90b801c4a0 comp rx=0 tx=0).stop 2024-05-27T06:27:32.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.212+0000 7f90cf200640 1 -- 172.21.15.87:0/261504597 shutdown_connections 2024-05-27T06:27:32.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.212+0000 7f90cf200640 1 --2- 172.21.15.87:0/261504597 >> v2:172.21.15.149:3300/0 conn(0x7f90d00b7940 0x7f90d0169700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:32.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.212+0000 7f90cf200640 1 --2- 172.21.15.87:0/261504597 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90d00d26f0 0x7f90d00ce840 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:32.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.212+0000 7f90cf200640 1 -- 172.21.15.87:0/261504597 >> 172.21.15.87:0/261504597 conn(0x7f90d00cfe80 msgr2=0x7f90d00d0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:32.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.212+0000 7f90cf200640 1 -- 172.21.15.87:0/261504597 shutdown_connections 2024-05-27T06:27:32.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.212+0000 7f90cf200640 1 -- 172.21.15.87:0/261504597 wait complete. 2024-05-27T06:27:32.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.212+0000 7f90cf200640 1 Processor -- start 2024-05-27T06:27:32.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.212+0000 7f90cf200640 1 -- start start 2024-05-27T06:27:32.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.216+0000 7f90cf200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90d00b7940 0x7f90d0155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:32.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.216+0000 7f90cf200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90d00ce430 0x7f90d00c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:32.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.216+0000 7f90cf200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90d01582f0 0x7f90d0158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:32.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.216+0000 7f90cf200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f90d016c7f0 con 0x7f90d01582f0 2024-05-27T06:27:32.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.216+0000 7f90cf200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f90d016c670 con 0x7f90d00ce430 2024-05-27T06:27:32.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.216+0000 7f90cf200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f90d016c970 con 0x7f90d00b7940 2024-05-27T06:27:32.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.216+0000 7f90ce800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90d01582f0 0x7f90d0158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:32.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.216+0000 7f90ce800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90d01582f0 0x7f90d0158700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49166/0 (socket says 172.21.15.87:49166) 2024-05-27T06:27:32.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.216+0000 7f90ce800640 1 -- 172.21.15.87:0/1011936009 learned_addr learned my addr 172.21.15.87:0/1011936009 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:32.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.216+0000 7f90cde00640 1 --2- 172.21.15.87:0/1011936009 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90d00b7940 0x7f90d0155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:32.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.216+0000 7f90c5400640 1 --2- 172.21.15.87:0/1011936009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90d00ce430 0x7f90d00c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:32.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.216+0000 7f90ce800640 1 -- 172.21.15.87:0/1011936009 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90d00b7940 msgr2=0x7f90d0155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:32.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.216+0000 7f90ce800640 1 --2- 172.21.15.87:0/1011936009 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90d00b7940 0x7f90d0155770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:32.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.216+0000 7f90ce800640 1 -- 172.21.15.87:0/1011936009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90d00ce430 msgr2=0x7f90d00c6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:32.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.216+0000 7f90ce800640 1 --2- 172.21.15.87:0/1011936009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90d00ce430 0x7f90d00c6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:32.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.216+0000 7f90ce800640 1 -- 172.21.15.87:0/1011936009 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90d0158c40 con 0x7f90d01582f0 2024-05-27T06:27:32.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.216+0000 7f90cde00640 1 --2- 172.21.15.87:0/1011936009 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90d00b7940 0x7f90d0155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:27:32.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.216+0000 7f90c5400640 1 --2- 172.21.15.87:0/1011936009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90d00ce430 0x7f90d00c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:27:32.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.216+0000 7f90ce800640 1 --2- 172.21.15.87:0/1011936009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90d01582f0 0x7f90d0158700 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f90c8009d30 tx=0x7f90c800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:32.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.524+0000 7f90c6a00640 1 -- 172.21.15.87:0/1011936009 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c8018020 con 0x7f90d01582f0 2024-05-27T06:27:32.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.524+0000 7f90c6a00640 1 -- 172.21.15.87:0/1011936009 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c8014480 con 0x7f90d01582f0 2024-05-27T06:27:32.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.524+0000 7f90c6a00640 1 -- 172.21.15.87:0/1011936009 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c8014870 con 0x7f90d01582f0 2024-05-27T06:27:32.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.524+0000 7f90cf200640 1 -- 172.21.15.87:0/1011936009 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90d00c79d0 con 0x7f90d01582f0 2024-05-27T06:27:32.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.524+0000 7f90cf200640 1 -- 172.21.15.87:0/1011936009 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90d00c7f90 con 0x7f90d01582f0 2024-05-27T06:27:32.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.524+0000 7f90cf200640 1 -- 172.21.15.87:0/1011936009 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90d006aa30 con 0x7f90d01582f0 2024-05-27T06:27:32.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.528+0000 7f90c6a00640 1 -- 172.21.15.87:0/1011936009 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f90c801b020 con 0x7f90d01582f0 2024-05-27T06:27:32.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.528+0000 7f90c6a00640 1 --2- 172.21.15.87:0/1011936009 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f90ac06f400 0x7f90ac071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:32.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.528+0000 7f90c6a00640 1 -- 172.21.15.87:0/1011936009 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f90c808fa80 con 0x7f90d01582f0 2024-05-27T06:27:32.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.528+0000 7f90cde00640 1 --2- 172.21.15.87:0/1011936009 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f90ac06f400 0x7f90ac071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:32.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.528+0000 7f90cde00640 1 --2- 172.21.15.87:0/1011936009 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f90ac06f400 0x7f90ac071910 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f90c0000f70 tx=0x7f90c0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:32.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.544+0000 7f90c6a00640 1 -- 172.21.15.87:0/1011936009 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f90c8091e20 con 0x7f90d01582f0 2024-05-27T06:27:32.566 INFO:tasks.ceph.mds.a.smithi087.stdout:starting mds.a at 2024-05-27T06:27:32.570 INFO:tasks.ceph.mds.c.smithi087.stdout:starting mds.c at 2024-05-27T06:27:32.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.740+0000 7f90cf200640 1 -- 172.21.15.87:0/1011936009 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f90d00d2710 con 0x7f90d01582f0 2024-05-27T06:27:32.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.744+0000 7f90c6a00640 1 -- 172.21.15.87:0/1011936009 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f90c8022070 con 0x7f90d01582f0 2024-05-27T06:27:32.742 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:27:32.742 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/437385084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":437385084},{"type":"v1","addr":"172.21.15.149:6833","nonce":437385084}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-27T06:27:32.742 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 2 2024-05-27T06:27:32.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.744+0000 7f90cf200640 1 -- 172.21.15.87:0/1011936009 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f90ac06f400 msgr2=0x7f90ac071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:32.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.744+0000 7f90cf200640 1 --2- 172.21.15.87:0/1011936009 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f90ac06f400 0x7f90ac071910 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f90c0000f70 tx=0x7f90c0009040 comp rx=0 tx=0).stop 2024-05-27T06:27:32.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.744+0000 7f90cf200640 1 -- 172.21.15.87:0/1011936009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90d01582f0 msgr2=0x7f90d0158700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:32.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.744+0000 7f90cf200640 1 --2- 172.21.15.87:0/1011936009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90d01582f0 0x7f90d0158700 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f90c8009d30 tx=0x7f90c800c490 comp rx=0 tx=0).stop 2024-05-27T06:27:32.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.744+0000 7f90cf200640 1 -- 172.21.15.87:0/1011936009 shutdown_connections 2024-05-27T06:27:32.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.744+0000 7f90cf200640 1 --2- 172.21.15.87:0/1011936009 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f90ac06f400 0x7f90ac071910 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:32.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.744+0000 7f90cf200640 1 --2- 172.21.15.87:0/1011936009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90d01582f0 0x7f90d0158700 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:32.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.744+0000 7f90cf200640 1 --2- 172.21.15.87:0/1011936009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90d00ce430 0x7f90d00c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:32.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.744+0000 7f90cf200640 1 --2- 172.21.15.87:0/1011936009 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90d00b7940 0x7f90d0155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:32.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.744+0000 7f90cf200640 1 -- 172.21.15.87:0/1011936009 >> 172.21.15.87:0/1011936009 conn(0x7f90d00cfe80 msgr2=0x7f90d00b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:32.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.744+0000 7f90cf200640 1 -- 172.21.15.87:0/1011936009 shutdown_connections 2024-05-27T06:27:32.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:32.744+0000 7f90cf200640 1 -- 172.21.15.87:0/1011936009 wait complete. 2024-05-27T06:27:34.764 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T06:27:34.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.920+0000 7f6542600640 1 Processor -- start 2024-05-27T06:27:34.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.920+0000 7f6542600640 1 -- start start 2024-05-27T06:27:34.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.920+0000 7f6542600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f653c0b9010 0x7f653c0ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:34.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.920+0000 7f6542600640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f653c0cec90 con 0x7f653c0d2810 2024-05-27T06:27:34.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.920+0000 7f6542600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f653c0d2d60 con 0x7f653c0ce880 2024-05-27T06:27:34.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.920+0000 7f6542600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f653c0707e0 con 0x7f653c0b9010 2024-05-27T06:27:34.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.920+0000 7f653b400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f653c0d2810 0x7f653c15d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57730/0 (socket says 172.21.15.87:57730) 2024-05-27T06:27:34.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653b400640 1 -- 172.21.15.87:0/2265272144 learned_addr learned my addr 172.21.15.87:0/2265272144 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:27:34.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653aa00640 1 --2- 172.21.15.87:0/2265272144 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f653c0b9010 0x7f653c0ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:34.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653a000640 1 -- 172.21.15.87:0/2265272144 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 486001825 0 0) 0x7f652c001120 con 0x7f653c0d2810 2024-05-27T06:27:34.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653a000640 1 -- 172.21.15.87:0/2265272144 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6520003530 con 0x7f653c0d2810 2024-05-27T06:27:34.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653a000640 1 -- 172.21.15.87:0/2265272144 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 437528508 0 0) 0x7f653c0d2d60 con 0x7f653c0ce880 2024-05-27T06:27:34.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653a000640 1 -- 172.21.15.87:0/2265272144 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f652c001120 con 0x7f653c0ce880 2024-05-27T06:27:34.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653a000640 1 -- 172.21.15.87:0/2265272144 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1752302591 0 0) 0x7f6520003530 con 0x7f653c0d2810 2024-05-27T06:27:34.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653a000640 1 -- 172.21.15.87:0/2265272144 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f653c0b9010 msgr2=0x7f653c0ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:34.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653a000640 1 --2- 172.21.15.87:0/2265272144 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f653c0b9010 0x7f653c0ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:34.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653a000640 1 -- 172.21.15.87:0/2265272144 >> v1:172.21.15.149:6789/0 conn(0x7f653c0ce880 legacy=0x7f653c070c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:34.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653a000640 1 -- 172.21.15.87:0/2265272144 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653c0d3040 con 0x7f653c0d2810 2024-05-27T06:27:34.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653a000640 1 -- 172.21.15.87:0/2265272144 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7f652c0018d0 con 0x7f653c0d2810 2024-05-27T06:27:34.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653aa00640 1 --2- 172.21.15.87:0/2265272144 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f653c0b9010 0x7f653c0ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:27:34.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653a000640 1 -- 172.21.15.87:0/2265272144 >> v1:172.21.15.87:6789/0 conn(0x7f653c0d2810 legacy=0x7f653c15d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:34.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653a000640 1 --2- 172.21.15.87:0/2265272144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6520003c90 0x7f65200040e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:34.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653a000640 1 --2- 172.21.15.87:0/2265272144 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f653c0b9010 0x7f6520004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:34.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653a000640 1 --2- 172.21.15.87:0/2265272144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6520004da0 0x7f6520005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:34.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653a000640 1 -- 172.21.15.87:0/2265272144 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f653c0707e0 con 0x7f6520004da0 2024-05-27T06:27:34.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653a000640 1 -- 172.21.15.87:0/2265272144 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f652000bc30 con 0x7f6520003c90 2024-05-27T06:27:34.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653a000640 1 -- 172.21.15.87:0/2265272144 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f652000be30 con 0x7f653c0b9010 2024-05-27T06:27:34.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653be00640 1 --2- 172.21.15.87:0/2265272144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6520004da0 0x7f6520005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:34.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653aa00640 1 --2- 172.21.15.87:0/2265272144 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f653c0b9010 0x7f6520004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:34.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653b400640 1 --2- 172.21.15.87:0/2265272144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6520003c90 0x7f65200040e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:34.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653be00640 1 -- 172.21.15.87:0/2265272144 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f653c0b9010 msgr2=0x7f6520004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:34.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653be00640 1 --2- 172.21.15.87:0/2265272144 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f653c0b9010 0x7f6520004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:34.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653be00640 1 -- 172.21.15.87:0/2265272144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6520003c90 msgr2=0x7f65200040e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:34.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653be00640 1 --2- 172.21.15.87:0/2265272144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6520003c90 0x7f65200040e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:34.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.924+0000 7f653be00640 1 -- 172.21.15.87:0/2265272144 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6520003530 con 0x7f6520004da0 2024-05-27T06:27:34.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.928+0000 7f653be00640 1 --2- 172.21.15.87:0/2265272144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6520004da0 0x7f6520005270 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6534002080 tx=0x7f653401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a946961e8d3bbb24 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:34.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.928+0000 7f653a000640 1 -- 172.21.15.87:0/2265272144 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6534001c50 con 0x7f6520004da0 2024-05-27T06:27:34.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.928+0000 7f653a000640 1 -- 172.21.15.87:0/2265272144 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6534006d60 con 0x7f6520004da0 2024-05-27T06:27:34.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.928+0000 7f653a000640 1 -- 172.21.15.87:0/2265272144 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6534003bc0 con 0x7f6520004da0 2024-05-27T06:27:34.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.928+0000 7f6542600640 1 -- 172.21.15.87:0/2265272144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6520004da0 msgr2=0x7f6520005270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:34.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.928+0000 7f6542600640 1 --2- 172.21.15.87:0/2265272144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6520004da0 0x7f6520005270 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6534002080 tx=0x7f653401c8e0 comp rx=0 tx=0).stop 2024-05-27T06:27:34.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.928+0000 7f653be00640 1 -- 172.21.15.87:0/2265272144 reap_dead start 2024-05-27T06:27:34.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.928+0000 7f6542600640 1 -- 172.21.15.87:0/2265272144 shutdown_connections 2024-05-27T06:27:34.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.928+0000 7f6542600640 1 -- 172.21.15.87:0/2265272144 >> 172.21.15.87:0/2265272144 conn(0x7f653c0d3670 msgr2=0x7f653c0d3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:34.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.928+0000 7f6542600640 1 -- 172.21.15.87:0/2265272144 shutdown_connections 2024-05-27T06:27:34.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.928+0000 7f6542600640 1 -- 172.21.15.87:0/2265272144 wait complete. 2024-05-27T06:27:34.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.928+0000 7f6542600640 1 Processor -- start 2024-05-27T06:27:34.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.928+0000 7f6542600640 1 -- start start 2024-05-27T06:27:34.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.932+0000 7f6542600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6520004da0 0x7f653c0ca720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:34.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.932+0000 7f6542600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f653c159620 0x7f653c0c9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:34.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.932+0000 7f6542600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f653c15a030 0x7f653c15a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:34.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.932+0000 7f6542600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f653c0d1720 con 0x7f653c15a030 2024-05-27T06:27:34.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.932+0000 7f6542600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f653c0d15a0 con 0x7f6520004da0 2024-05-27T06:27:34.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.932+0000 7f6542600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f653c0ce340 con 0x7f653c159620 2024-05-27T06:27:34.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.932+0000 7f653be00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f653c15a030 0x7f653c15a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:34.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.932+0000 7f653be00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f653c15a030 0x7f653c15a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60712/0 (socket says 172.21.15.87:60712) 2024-05-27T06:27:34.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.932+0000 7f653be00640 1 -- 172.21.15.87:0/3539223134 learned_addr learned my addr 172.21.15.87:0/3539223134 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:34.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.932+0000 7f653aa00640 1 --2- 172.21.15.87:0/3539223134 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f653c159620 0x7f653c0c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:34.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.932+0000 7f653b400640 1 --2- 172.21.15.87:0/3539223134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6520004da0 0x7f653c0ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:34.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.932+0000 7f653be00640 1 -- 172.21.15.87:0/3539223134 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f653c159620 msgr2=0x7f653c0c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:34.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.932+0000 7f653be00640 1 --2- 172.21.15.87:0/3539223134 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f653c159620 0x7f653c0c9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:34.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.932+0000 7f653be00640 1 -- 172.21.15.87:0/3539223134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6520004da0 msgr2=0x7f653c0ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:34.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.932+0000 7f653be00640 1 --2- 172.21.15.87:0/3539223134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6520004da0 0x7f653c0ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:34.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.932+0000 7f653be00640 1 -- 172.21.15.87:0/3539223134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653c15a980 con 0x7f653c15a030 2024-05-27T06:27:34.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.932+0000 7f653be00640 1 --2- 172.21.15.87:0/3539223134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f653c15a030 0x7f653c15a440 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6534005040 tx=0x7f6520005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:34.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.932+0000 7f6533400640 1 -- 172.21.15.87:0/3539223134 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6534001c50 con 0x7f653c15a030 2024-05-27T06:27:34.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.932+0000 7f6533400640 1 -- 172.21.15.87:0/3539223134 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6534006b60 con 0x7f653c15a030 2024-05-27T06:27:34.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.932+0000 7f6533400640 1 -- 172.21.15.87:0/3539223134 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6534007da0 con 0x7f653c15a030 2024-05-27T06:27:34.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.932+0000 7f6542600640 1 -- 172.21.15.87:0/3539223134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f653c0cb000 con 0x7f653c15a030 2024-05-27T06:27:34.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.932+0000 7f6542600640 1 -- 172.21.15.87:0/3539223134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f653c0cb5c0 con 0x7f653c15a030 2024-05-27T06:27:34.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.932+0000 7f6542600640 1 -- 172.21.15.87:0/3539223134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f653c06aa30 con 0x7f653c15a030 2024-05-27T06:27:34.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.936+0000 7f6533400640 1 -- 172.21.15.87:0/3539223134 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f65340a64e0 con 0x7f653c15a030 2024-05-27T06:27:34.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.936+0000 7f6533400640 1 --2- 172.21.15.87:0/3539223134 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f651c06f400 0x7f651c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:34.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.936+0000 7f6533400640 1 -- 172.21.15.87:0/3539223134 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f6534128b20 con 0x7f653c15a030 2024-05-27T06:27:34.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.936+0000 7f653b400640 1 --2- 172.21.15.87:0/3539223134 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f651c06f400 0x7f651c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:34.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.936+0000 7f653b400640 1 --2- 172.21.15.87:0/3539223134 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f651c06f400 0x7f651c071910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f652c001060 tx=0x7f652c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:34.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:34.940+0000 7f6533400640 1 -- 172.21.15.87:0/3539223134 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f653c15a980 con 0x7f653c15a030 2024-05-27T06:27:35.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.128+0000 7f6542600640 1 -- 172.21.15.87:0/3539223134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f653c0b3cf0 con 0x7f653c15a030 2024-05-27T06:27:35.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.128+0000 7f6533400640 1 -- 172.21.15.87:0/3539223134 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3864 (secure 0 0 0) 0x7f6534016690 con 0x7f653c15a030 2024-05-27T06:27:35.129 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:27:35.129 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1075024068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1075024068},{"type":"v1","addr":"172.21.15.87:6835","nonce":1075024068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/437385084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":437385084},{"type":"v1","addr":"172.21.15.149:6833","nonce":437385084}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/852280291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":852280291},{"type":"v1","addr":"172.21.15.149:6835","nonce":852280291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1799934036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1799934036},{"type":"v1","addr":"172.21.15.87:6837","nonce":1799934036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-27T06:27:35.129 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 3 2024-05-27T06:27:35.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.132+0000 7f6542600640 1 -- 172.21.15.87:0/3539223134 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f651c06f400 msgr2=0x7f651c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:35.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.132+0000 7f6542600640 1 --2- 172.21.15.87:0/3539223134 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f651c06f400 0x7f651c071910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f652c001060 tx=0x7f652c009040 comp rx=0 tx=0).stop 2024-05-27T06:27:35.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.132+0000 7f6542600640 1 -- 172.21.15.87:0/3539223134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f653c15a030 msgr2=0x7f653c15a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:35.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.132+0000 7f6542600640 1 --2- 172.21.15.87:0/3539223134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f653c15a030 0x7f653c15a440 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6534005040 tx=0x7f6520005840 comp rx=0 tx=0).stop 2024-05-27T06:27:35.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.132+0000 7f6542600640 1 -- 172.21.15.87:0/3539223134 shutdown_connections 2024-05-27T06:27:35.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.132+0000 7f6542600640 1 --2- 172.21.15.87:0/3539223134 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f651c06f400 0x7f651c071910 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:35.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.132+0000 7f6542600640 1 --2- 172.21.15.87:0/3539223134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f653c15a030 0x7f653c15a440 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:35.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.132+0000 7f6542600640 1 --2- 172.21.15.87:0/3539223134 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f653c159620 0x7f653c0c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:35.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.132+0000 7f6542600640 1 --2- 172.21.15.87:0/3539223134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6520004da0 0x7f653c0ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:35.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.132+0000 7f6542600640 1 -- 172.21.15.87:0/3539223134 >> 172.21.15.87:0/3539223134 conn(0x7f653c0d3670 msgr2=0x7f653c0b7460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:35.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.132+0000 7f6542600640 1 -- 172.21.15.87:0/3539223134 shutdown_connections 2024-05-27T06:27:35.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.132+0000 7f6542600640 1 -- 172.21.15.87:0/3539223134 wait complete. 2024-05-27T06:27:35.151 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-27T06:27:35.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.300+0000 7fddb7200640 1 Processor -- start 2024-05-27T06:27:35.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.300+0000 7fddb7200640 1 -- start start 2024-05-27T06:27:35.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.300+0000 7fddb7200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fddb0072aa0 0x7fddb006d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:35.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.300+0000 7fddb7200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddb00cd120 con 0x7fddb00d1e50 2024-05-27T06:27:35.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.300+0000 7fddb7200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddb00cd400 con 0x7fddb0072eb0 2024-05-27T06:27:35.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.300+0000 7fddb7200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fddb00cdd30 con 0x7fddb0072aa0 2024-05-27T06:27:35.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.300+0000 7fddafe00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fddb0072aa0 0x7fddb006d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:35.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.300+0000 7fddb5200640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fddb00d1e50 0x7fddb00ce1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57746/0 (socket says 172.21.15.87:57746) 2024-05-27T06:27:35.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.300+0000 7fddb5200640 1 -- 172.21.15.87:0/2431998935 learned_addr learned my addr 172.21.15.87:0/2431998935 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:27:35.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.300+0000 7fddafe00640 1 -- 172.21.15.87:0/2431998935 >> v1:172.21.15.149:6789/0 conn(0x7fddb0072eb0 legacy=0x7fddb00d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:35.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.300+0000 7fddafe00640 1 -- 172.21.15.87:0/2431998935 >> v1:172.21.15.87:6789/0 conn(0x7fddb00d1e50 legacy=0x7fddb00ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:35.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.300+0000 7fddafe00640 1 -- 172.21.15.87:0/2431998935 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb00cd6e0 con 0x7fddb0072aa0 2024-05-27T06:27:35.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.300+0000 7fddaf400640 1 -- 172.21.15.87:0/2431998935 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4148474362 0 0) 0x7fddb00cd120 con 0x7fddb00d1e50 2024-05-27T06:27:35.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.304+0000 7fddafe00640 1 --2- 172.21.15.87:0/2431998935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddb0072aa0 0x7fddb006d820 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdda00097c0 tx=0x7fdda001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23664a481394f86c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:35.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.304+0000 7fddaf400640 1 -- 172.21.15.87:0/2431998935 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda00aa5f0 con 0x7fddb0072aa0 2024-05-27T06:27:35.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.304+0000 7fddaf400640 1 -- 172.21.15.87:0/2431998935 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda00af070 con 0x7fddb0072aa0 2024-05-27T06:27:35.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.304+0000 7fddaf400640 1 -- 172.21.15.87:0/2431998935 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda00aa9b0 con 0x7fddb0072aa0 2024-05-27T06:27:35.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.304+0000 7fddb7200640 1 -- 172.21.15.87:0/2431998935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddb0072aa0 msgr2=0x7fddb006d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:35.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.304+0000 7fddb7200640 1 --2- 172.21.15.87:0/2431998935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddb0072aa0 0x7fddb006d820 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdda00097c0 tx=0x7fdda001c470 comp rx=0 tx=0).stop 2024-05-27T06:27:35.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.304+0000 7fddb7200640 1 -- 172.21.15.87:0/2431998935 shutdown_connections 2024-05-27T06:27:35.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.304+0000 7fddb7200640 1 --2- 172.21.15.87:0/2431998935 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddb0072aa0 0x7fddb006d820 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:35.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.304+0000 7fddb7200640 1 -- 172.21.15.87:0/2431998935 >> 172.21.15.87:0/2431998935 conn(0x7fddb00b46b0 msgr2=0x7fddb00b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:35.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.304+0000 7fddb7200640 1 -- 172.21.15.87:0/2431998935 shutdown_connections 2024-05-27T06:27:35.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.304+0000 7fddb7200640 1 -- 172.21.15.87:0/2431998935 wait complete. 2024-05-27T06:27:35.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.308+0000 7fddb7200640 1 Processor -- start 2024-05-27T06:27:35.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.308+0000 7fddb7200640 1 -- start start 2024-05-27T06:27:35.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.308+0000 7fddb7200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddb0072aa0 0x7fddb015e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:35.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.308+0000 7fddb7200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddb0072eb0 0x7fddb015fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:35.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.308+0000 7fddb7200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fddb00d1e50 0x7fddb015a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:35.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.308+0000 7fddb7200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fddb016c450 con 0x7fddb0072aa0 2024-05-27T06:27:35.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.308+0000 7fddb7200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fddb016c2d0 con 0x7fddb0072eb0 2024-05-27T06:27:35.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.308+0000 7fddb7200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fddb016c5d0 con 0x7fddb00d1e50 2024-05-27T06:27:35.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.308+0000 7fddafe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddb0072aa0 0x7fddb015e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:35.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.308+0000 7fddafe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddb0072aa0 0x7fddb015e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60724/0 (socket says 172.21.15.87:60724) 2024-05-27T06:27:35.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.308+0000 7fddafe00640 1 -- 172.21.15.87:0/1699494531 learned_addr learned my addr 172.21.15.87:0/1699494531 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:35.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.308+0000 7fddb5200640 1 --2- 172.21.15.87:0/1699494531 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fddb00d1e50 0x7fddb015a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:35.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.308+0000 7fdda7400640 1 --2- 172.21.15.87:0/1699494531 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddb0072eb0 0x7fddb015fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:35.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.308+0000 7fddafe00640 1 -- 172.21.15.87:0/1699494531 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fddb00d1e50 msgr2=0x7fddb015a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:35.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.308+0000 7fddafe00640 1 --2- 172.21.15.87:0/1699494531 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fddb00d1e50 0x7fddb015a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:35.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.308+0000 7fddafe00640 1 -- 172.21.15.87:0/1699494531 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddb0072eb0 msgr2=0x7fddb015fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:35.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.308+0000 7fddafe00640 1 --2- 172.21.15.87:0/1699494531 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddb0072eb0 0x7fddb015fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:35.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.308+0000 7fddafe00640 1 -- 172.21.15.87:0/1699494531 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb015eb60 con 0x7fddb0072aa0 2024-05-27T06:27:35.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.308+0000 7fddafe00640 1 --2- 172.21.15.87:0/1699494531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddb0072aa0 0x7fddb015e310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdda00ac040 tx=0x7fdda001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:35.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.308+0000 7fddacc00640 1 -- 172.21.15.87:0/1699494531 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda00be610 con 0x7fddb0072aa0 2024-05-27T06:27:35.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.308+0000 7fddacc00640 1 -- 172.21.15.87:0/1699494531 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda00be7d0 con 0x7fddb0072aa0 2024-05-27T06:27:35.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.308+0000 7fddacc00640 1 -- 172.21.15.87:0/1699494531 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda00bebc0 con 0x7fddb0072aa0 2024-05-27T06:27:35.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.308+0000 7fddb7200640 1 -- 172.21.15.87:0/1699494531 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddb015ee40 con 0x7fddb0072aa0 2024-05-27T06:27:35.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.308+0000 7fddb7200640 1 -- 172.21.15.87:0/1699494531 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddb015f400 con 0x7fddb0072aa0 2024-05-27T06:27:35.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.312+0000 7fddb7200640 1 -- 172.21.15.87:0/1699494531 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddb0070df0 con 0x7fddb0072aa0 2024-05-27T06:27:35.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.312+0000 7fddacc00640 1 -- 172.21.15.87:0/1699494531 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fdda00bc020 con 0x7fddb0072aa0 2024-05-27T06:27:35.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.312+0000 7fddacc00640 1 --2- 172.21.15.87:0/1699494531 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fdd8c06f400 0x7fdd8c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:35.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.312+0000 7fddacc00640 1 -- 172.21.15.87:0/1699494531 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fdda01299a0 con 0x7fddb0072aa0 2024-05-27T06:27:35.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.312+0000 7fdda7400640 1 --2- 172.21.15.87:0/1699494531 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fdd8c06f400 0x7fdd8c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:35.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.312+0000 7fdda7400640 1 --2- 172.21.15.87:0/1699494531 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fdd8c06f400 0x7fdd8c071910 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fddb00c9f70 tx=0x7fdd98008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:35.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.316+0000 7fddacc00640 1 -- 172.21.15.87:0/1699494531 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fdda0016090 con 0x7fddb0072aa0 2024-05-27T06:27:35.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.476+0000 7fddb7200640 1 -- 172.21.15.87:0/1699494531 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fddb006aa30 con 0x7fddb0072aa0 2024-05-27T06:27:35.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.476+0000 7fddacc00640 1 -- 172.21.15.87:0/1699494531 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7fdda00f6b40 con 0x7fddb0072aa0 2024-05-27T06:27:35.474 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:27:35.474 INFO:teuthology.orchestra.run.smithi087.stdout:[ 2024-05-27T06:27:35.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:27:35.474 INFO:teuthology.orchestra.run.smithi087.stdout: "poolnum": 1, 2024-05-27T06:27:35.474 INFO:teuthology.orchestra.run.smithi087.stdout: "poolname": ".mgr" 2024-05-27T06:27:35.474 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:27:35.474 INFO:teuthology.orchestra.run.smithi087.stdout:] 2024-05-27T06:27:35.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.476+0000 7fddb7200640 1 -- 172.21.15.87:0/1699494531 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fdd8c06f400 msgr2=0x7fdd8c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:35.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.476+0000 7fddb7200640 1 --2- 172.21.15.87:0/1699494531 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fdd8c06f400 0x7fdd8c071910 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fddb00c9f70 tx=0x7fdd98008040 comp rx=0 tx=0).stop 2024-05-27T06:27:35.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.476+0000 7fddb7200640 1 -- 172.21.15.87:0/1699494531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddb0072aa0 msgr2=0x7fddb015e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:35.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.476+0000 7fddb7200640 1 --2- 172.21.15.87:0/1699494531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddb0072aa0 0x7fddb015e310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdda00ac040 tx=0x7fdda001acb0 comp rx=0 tx=0).stop 2024-05-27T06:27:35.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.476+0000 7fddb7200640 1 -- 172.21.15.87:0/1699494531 shutdown_connections 2024-05-27T06:27:35.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.476+0000 7fddb7200640 1 --2- 172.21.15.87:0/1699494531 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fdd8c06f400 0x7fdd8c071910 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:35.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.476+0000 7fddb7200640 1 --2- 172.21.15.87:0/1699494531 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fddb00d1e50 0x7fddb015a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:35.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.476+0000 7fddb7200640 1 --2- 172.21.15.87:0/1699494531 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddb0072eb0 0x7fddb015fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:35.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.476+0000 7fddb7200640 1 --2- 172.21.15.87:0/1699494531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddb0072aa0 0x7fddb015e310 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:35.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.476+0000 7fddb7200640 1 -- 172.21.15.87:0/1699494531 >> 172.21.15.87:0/1699494531 conn(0x7fddb00b46b0 msgr2=0x7fddb00ae190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:35.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.476+0000 7fddb7200640 1 -- 172.21.15.87:0/1699494531 shutdown_connections 2024-05-27T06:27:35.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.476+0000 7fddb7200640 1 -- 172.21.15.87:0/1699494531 wait complete. 2024-05-27T06:27:35.495 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-27T06:27:35.496 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-27T06:27:35.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.648+0000 7fb0cd400640 1 Processor -- start 2024-05-27T06:27:35.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.648+0000 7fb0cd400640 1 -- start start 2024-05-27T06:27:35.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.652+0000 7fb0cd400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb0c80b43b0 0x7fb0c80b69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:35.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.652+0000 7fb0cd400640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0c815e370 con 0x7fb0c80ce100 2024-05-27T06:27:35.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.652+0000 7fb0cd400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0c80b3310 con 0x7fb0c80b47c0 2024-05-27T06:27:35.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.652+0000 7fb0cd400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fb0c80b35f0 con 0x7fb0c80b43b0 2024-05-27T06:27:35.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.652+0000 7fb0c6800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb0c80b43b0 0x7fb0c80b69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:35.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.652+0000 7fb0c7200640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb0c80ce100 0x7fb0c80ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57752/0 (socket says 172.21.15.87:57752) 2024-05-27T06:27:35.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.652+0000 7fb0c7200640 1 -- 172.21.15.87:0/1286135572 learned_addr learned my addr 172.21.15.87:0/1286135572 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:27:35.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.652+0000 7fb0c6800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb0c80b43b0 0x7fb0c80b69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60732/0 (socket says 172.21.15.87:60732) 2024-05-27T06:27:35.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.652+0000 7fb0c6800640 1 -- 172.21.15.87:0/1286135572 >> v1:172.21.15.149:6789/0 conn(0x7fb0c80b47c0 legacy=0x7fb0c80b6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:35.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.652+0000 7fb0c6800640 1 -- 172.21.15.87:0/1286135572 >> v1:172.21.15.87:6789/0 conn(0x7fb0c80ce100 legacy=0x7fb0c80ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:35.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.652+0000 7fb0c6800640 1 -- 172.21.15.87:0/1286135572 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c80b38d0 con 0x7fb0c80b43b0 2024-05-27T06:27:35.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.652+0000 7fb0c6800640 1 --2- 172.21.15.87:0/1286135572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0c80b43b0 0x7fb0c80b69f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80097c0 tx=0x7fb0b801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6301841e653e336 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:35.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.652+0000 7fb0c5e00640 1 -- 172.21.15.87:0/1286135572 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b80b0070 con 0x7fb0c80b43b0 2024-05-27T06:27:35.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.656+0000 7fb0c5e00640 1 -- 172.21.15.87:0/1286135572 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b80ab600 con 0x7fb0c80b43b0 2024-05-27T06:27:35.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.656+0000 7fb0c5e00640 1 -- 172.21.15.87:0/1286135572 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b80ab9d0 con 0x7fb0c80b43b0 2024-05-27T06:27:35.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.656+0000 7fb0cd400640 1 -- 172.21.15.87:0/1286135572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0c80b43b0 msgr2=0x7fb0c80b69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:35.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.656+0000 7fb0cd400640 1 --2- 172.21.15.87:0/1286135572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0c80b43b0 0x7fb0c80b69f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80097c0 tx=0x7fb0b801c410 comp rx=0 tx=0).stop 2024-05-27T06:27:35.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.656+0000 7fb0cd400640 1 -- 172.21.15.87:0/1286135572 shutdown_connections 2024-05-27T06:27:35.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.656+0000 7fb0cd400640 1 --2- 172.21.15.87:0/1286135572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0c80b43b0 0x7fb0c80b69f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:35.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.656+0000 7fb0cd400640 1 -- 172.21.15.87:0/1286135572 >> 172.21.15.87:0/1286135572 conn(0x7fb0c80d3580 msgr2=0x7fb0c80d3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:35.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.656+0000 7fb0cd400640 1 -- 172.21.15.87:0/1286135572 shutdown_connections 2024-05-27T06:27:35.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.656+0000 7fb0cd400640 1 -- 172.21.15.87:0/1286135572 wait complete. 2024-05-27T06:27:35.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.656+0000 7fb0cd400640 1 Processor -- start 2024-05-27T06:27:35.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.656+0000 7fb0cd400640 1 -- start start 2024-05-27T06:27:35.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.660+0000 7fb0cd400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0c80b43b0 0x7fb0c8157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:35.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.660+0000 7fb0cd400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0c80b47c0 0x7fb0c80cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:35.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.660+0000 7fb0cd400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0c80ce100 0x7fb0c80ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:35.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.660+0000 7fb0cd400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c816c760 con 0x7fb0c80b47c0 2024-05-27T06:27:35.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.660+0000 7fb0cd400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c816c5e0 con 0x7fb0c80ce100 2024-05-27T06:27:35.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.660+0000 7fb0cd400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb0c816c8e0 con 0x7fb0c80b43b0 2024-05-27T06:27:35.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.660+0000 7fb0bde00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0c80b47c0 0x7fb0c80cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:35.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.660+0000 7fb0bde00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0c80b47c0 0x7fb0c80cc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60738/0 (socket says 172.21.15.87:60738) 2024-05-27T06:27:35.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.660+0000 7fb0bde00640 1 -- 172.21.15.87:0/3771717262 learned_addr learned my addr 172.21.15.87:0/3771717262 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:35.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.660+0000 7fb0c7200640 1 --2- 172.21.15.87:0/3771717262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0c80ce100 0x7fb0c80ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:35.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.660+0000 7fb0c6800640 1 --2- 172.21.15.87:0/3771717262 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0c80b43b0 0x7fb0c8157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:35.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.660+0000 7fb0bde00640 1 -- 172.21.15.87:0/3771717262 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0c80b43b0 msgr2=0x7fb0c8157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:35.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.660+0000 7fb0bde00640 1 --2- 172.21.15.87:0/3771717262 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0c80b43b0 0x7fb0c8157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:35.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.660+0000 7fb0bde00640 1 -- 172.21.15.87:0/3771717262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0c80ce100 msgr2=0x7fb0c80ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:35.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.660+0000 7fb0bde00640 1 --2- 172.21.15.87:0/3771717262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0c80ce100 0x7fb0c80ccef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:35.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.660+0000 7fb0bde00640 1 -- 172.21.15.87:0/3771717262 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c8167e30 con 0x7fb0c80b47c0 2024-05-27T06:27:35.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.660+0000 7fb0c6800640 1 --2- 172.21.15.87:0/3771717262 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0c80b43b0 0x7fb0c8157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:27:35.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.660+0000 7fb0bde00640 1 --2- 172.21.15.87:0/3771717262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0c80b47c0 0x7fb0c80cc9b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb0b000b3c0 tx=0x7fb0b000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:35.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.660+0000 7fb0bf400640 1 -- 172.21.15.87:0/3771717262 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0005d40 con 0x7fb0c80b47c0 2024-05-27T06:27:35.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.660+0000 7fb0bf400640 1 -- 172.21.15.87:0/3771717262 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b0016070 con 0x7fb0c80b47c0 2024-05-27T06:27:35.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.660+0000 7fb0cd400640 1 -- 172.21.15.87:0/3771717262 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0c8159ef0 con 0x7fb0c80b47c0 2024-05-27T06:27:35.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.660+0000 7fb0bf400640 1 -- 172.21.15.87:0/3771717262 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0006250 con 0x7fb0c80b47c0 2024-05-27T06:27:35.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.660+0000 7fb0cd400640 1 -- 172.21.15.87:0/3771717262 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0c815a4b0 con 0x7fb0c80b47c0 2024-05-27T06:27:35.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.660+0000 7fb0cd400640 1 -- 172.21.15.87:0/3771717262 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0c806aa30 con 0x7fb0c80b47c0 2024-05-27T06:27:35.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.664+0000 7fb0bf400640 1 -- 172.21.15.87:0/3771717262 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb0b00063f0 con 0x7fb0c80b47c0 2024-05-27T06:27:35.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.664+0000 7fb0bf400640 1 --2- 172.21.15.87:0/3771717262 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb0a406f430 0x7fb0a4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:35.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.664+0000 7fb0bf400640 1 -- 172.21.15.87:0/3771717262 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fb0b008e890 con 0x7fb0c80b47c0 2024-05-27T06:27:35.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.664+0000 7fb0c6800640 1 --2- 172.21.15.87:0/3771717262 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb0a406f430 0x7fb0a4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:35.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.664+0000 7fb0c6800640 1 --2- 172.21.15.87:0/3771717262 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb0a406f430 0x7fb0a4071940 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80ad000 tx=0x7fb0b80a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:35.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.668+0000 7fb0bf400640 1 -- 172.21.15.87:0/3771717262 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb0b005ba30 con 0x7fb0c80b47c0 2024-05-27T06:27:35.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:35.828+0000 7fb0cd400640 1 -- 172.21.15.87:0/3771717262 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb0c80d1870 con 0x7fb0c80b47c0 2024-05-27T06:27:36.256 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T06:27:36.260 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T06:27:36.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.548+0000 7fb0bf400640 1 -- 172.21.15.87:0/3771717262 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7fb0b005b330 con 0x7fb0c80b47c0 2024-05-27T06:27:36.549 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_metadata' created 2024-05-27T06:27:36.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.552+0000 7fb0cd400640 1 -- 172.21.15.87:0/3771717262 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb0a406f430 msgr2=0x7fb0a4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:36.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.552+0000 7fb0cd400640 1 --2- 172.21.15.87:0/3771717262 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb0a406f430 0x7fb0a4071940 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80ad000 tx=0x7fb0b80a6000 comp rx=0 tx=0).stop 2024-05-27T06:27:36.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.552+0000 7fb0cd400640 1 -- 172.21.15.87:0/3771717262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0c80b47c0 msgr2=0x7fb0c80cc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:36.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.552+0000 7fb0cd400640 1 --2- 172.21.15.87:0/3771717262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0c80b47c0 0x7fb0c80cc9b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb0b000b3c0 tx=0x7fb0b000b880 comp rx=0 tx=0).stop 2024-05-27T06:27:36.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.552+0000 7fb0cd400640 1 -- 172.21.15.87:0/3771717262 shutdown_connections 2024-05-27T06:27:36.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.552+0000 7fb0cd400640 1 --2- 172.21.15.87:0/3771717262 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb0a406f430 0x7fb0a4071940 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:36.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.552+0000 7fb0cd400640 1 --2- 172.21.15.87:0/3771717262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0c80ce100 0x7fb0c80ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:36.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.552+0000 7fb0cd400640 1 --2- 172.21.15.87:0/3771717262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0c80b47c0 0x7fb0c80cc9b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:36.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.552+0000 7fb0cd400640 1 --2- 172.21.15.87:0/3771717262 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0c80b43b0 0x7fb0c8157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:36.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.552+0000 7fb0cd400640 1 -- 172.21.15.87:0/3771717262 >> 172.21.15.87:0/3771717262 conn(0x7fb0c80d3580 msgr2=0x7fb0c8168330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:36.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.552+0000 7fb0cd400640 1 -- 172.21.15.87:0/3771717262 shutdown_connections 2024-05-27T06:27:36.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.552+0000 7fb0cd400640 1 -- 172.21.15.87:0/3771717262 wait complete. 2024-05-27T06:27:36.581 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-05-27T06:27:36.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.736+0000 7fe720200640 1 Processor -- start 2024-05-27T06:27:36.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.736+0000 7fe720200640 1 -- start start 2024-05-27T06:27:36.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.740+0000 7fe720200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe7181610c0 0x7fe7180d02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:36.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.740+0000 7fe720200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7180d1130 con 0x7fe7180d0810 2024-05-27T06:27:36.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.740+0000 7fe720200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7180d0e50 con 0x7fe7180d1e10 2024-05-27T06:27:36.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.740+0000 7fe720200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fe7180d0c20 con 0x7fe7181610c0 2024-05-27T06:27:36.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.740+0000 7fe71d800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe7181610c0 0x7fe7180d02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:36.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.740+0000 7fe71ce00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe7180d0810 0x7fe7180d1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57766/0 (socket says 172.21.15.87:57766) 2024-05-27T06:27:36.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.740+0000 7fe71ce00640 1 -- 172.21.15.87:0/905251220 learned_addr learned my addr 172.21.15.87:0/905251220 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:27:36.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.740+0000 7fe71d800640 1 -- 172.21.15.87:0/905251220 >> v1:172.21.15.149:6789/0 conn(0x7fe7180d1e10 legacy=0x7fe71806eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:36.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.740+0000 7fe71d800640 1 -- 172.21.15.87:0/905251220 >> v1:172.21.15.87:6789/0 conn(0x7fe7180d0810 legacy=0x7fe7180d1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:36.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.740+0000 7fe71d800640 1 -- 172.21.15.87:0/905251220 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe718161a00 con 0x7fe7181610c0 2024-05-27T06:27:36.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.740+0000 7fe717e00640 1 -- 172.21.15.87:0/905251220 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 585561291 0 0) 0x7fe7180d1130 con 0x7fe7180d0810 2024-05-27T06:27:36.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.744+0000 7fe71d800640 1 --2- 172.21.15.87:0/905251220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7181610c0 0x7fe7180d02d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe70c0097c0 tx=0x7fe70c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce0cb2620f02e60 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:36.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.744+0000 7fe717e00640 1 -- 172.21.15.87:0/905251220 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c0aa600 con 0x7fe7181610c0 2024-05-27T06:27:36.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.744+0000 7fe717e00640 1 -- 172.21.15.87:0/905251220 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe70c0af070 con 0x7fe7181610c0 2024-05-27T06:27:36.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.744+0000 7fe717e00640 1 -- 172.21.15.87:0/905251220 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c0aa9c0 con 0x7fe7181610c0 2024-05-27T06:27:36.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.744+0000 7fe720200640 1 -- 172.21.15.87:0/905251220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7181610c0 msgr2=0x7fe7180d02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:36.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.744+0000 7fe720200640 1 --2- 172.21.15.87:0/905251220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7181610c0 0x7fe7180d02d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe70c0097c0 tx=0x7fe70c01c4a0 comp rx=0 tx=0).stop 2024-05-27T06:27:36.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.744+0000 7fe720200640 1 -- 172.21.15.87:0/905251220 shutdown_connections 2024-05-27T06:27:36.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.744+0000 7fe720200640 1 --2- 172.21.15.87:0/905251220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7181610c0 0x7fe7180d02d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:36.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.744+0000 7fe720200640 1 -- 172.21.15.87:0/905251220 >> 172.21.15.87:0/905251220 conn(0x7fe7180b46b0 msgr2=0x7fe7180b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:36.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.744+0000 7fe720200640 1 -- 172.21.15.87:0/905251220 shutdown_connections 2024-05-27T06:27:36.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.744+0000 7fe720200640 1 -- 172.21.15.87:0/905251220 wait complete. 2024-05-27T06:27:36.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.744+0000 7fe720200640 1 Processor -- start 2024-05-27T06:27:36.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.744+0000 7fe720200640 1 -- start start 2024-05-27T06:27:36.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.748+0000 7fe720200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7180d0810 0x7fe7180b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:36.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.748+0000 7fe720200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7181610c0 0x7fe71809c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:36.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.748+0000 7fe720200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7181fa520 0x7fe71809c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:36.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.748+0000 7fe720200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe718161650 con 0x7fe7181610c0 2024-05-27T06:27:36.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.748+0000 7fe720200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe7181614d0 con 0x7fe7181fa520 2024-05-27T06:27:36.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.748+0000 7fe720200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe71816bc80 con 0x7fe7180d0810 2024-05-27T06:27:36.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.748+0000 7fe71ce00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7181610c0 0x7fe71809c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:36.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.748+0000 7fe71ce00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7181610c0 0x7fe71809c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60756/0 (socket says 172.21.15.87:60756) 2024-05-27T06:27:36.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.748+0000 7fe71ce00640 1 -- 172.21.15.87:0/2527743732 learned_addr learned my addr 172.21.15.87:0/2527743732 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:36.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.748+0000 7fe71d800640 1 --2- 172.21.15.87:0/2527743732 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7180d0810 0x7fe7180b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:36.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.748+0000 7fe71e200640 1 --2- 172.21.15.87:0/2527743732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7181fa520 0x7fe71809c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:36.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.748+0000 7fe71ce00640 1 -- 172.21.15.87:0/2527743732 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7180d0810 msgr2=0x7fe7180b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:36.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.748+0000 7fe71ce00640 1 --2- 172.21.15.87:0/2527743732 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7180d0810 0x7fe7180b33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:36.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.748+0000 7fe71ce00640 1 -- 172.21.15.87:0/2527743732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7181fa520 msgr2=0x7fe71809c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:36.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.748+0000 7fe71ce00640 1 --2- 172.21.15.87:0/2527743732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7181fa520 0x7fe71809c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:36.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.748+0000 7fe71ce00640 1 -- 172.21.15.87:0/2527743732 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe71809ccc0 con 0x7fe7181610c0 2024-05-27T06:27:36.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.748+0000 7fe71ce00640 1 --2- 172.21.15.87:0/2527743732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7181610c0 0x7fe71809c240 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe70400c460 tx=0x7fe70400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:36.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.748+0000 7fe715600640 1 -- 172.21.15.87:0/2527743732 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7040074e0 con 0x7fe7181610c0 2024-05-27T06:27:36.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.748+0000 7fe715600640 1 -- 172.21.15.87:0/2527743732 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7040047f0 con 0x7fe7181610c0 2024-05-27T06:27:36.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.748+0000 7fe715600640 1 -- 172.21.15.87:0/2527743732 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe704004be0 con 0x7fe7181610c0 2024-05-27T06:27:36.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.748+0000 7fe720200640 1 -- 172.21.15.87:0/2527743732 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe71809b480 con 0x7fe7181610c0 2024-05-27T06:27:36.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.748+0000 7fe720200640 1 -- 172.21.15.87:0/2527743732 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe71809ba40 con 0x7fe7181610c0 2024-05-27T06:27:36.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.748+0000 7fe720200640 1 -- 172.21.15.87:0/2527743732 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7180b3ac0 con 0x7fe7181610c0 2024-05-27T06:27:36.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.752+0000 7fe715600640 1 -- 172.21.15.87:0/2527743732 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe704011070 con 0x7fe7181610c0 2024-05-27T06:27:36.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.752+0000 7fe715600640 1 --2- 172.21.15.87:0/2527743732 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe6f806f430 0x7fe6f8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:36.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.752+0000 7fe715600640 1 -- 172.21.15.87:0/2527743732 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7fe70408f220 con 0x7fe7181610c0 2024-05-27T06:27:36.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.752+0000 7fe71d800640 1 --2- 172.21.15.87:0/2527743732 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe6f806f430 0x7fe6f8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:36.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.752+0000 7fe71d800640 1 --2- 172.21.15.87:0/2527743732 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe6f806f430 0x7fe6f8071940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe70c0ae000 tx=0x7fe70c004740 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:36.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.756+0000 7fe715600640 1 -- 172.21.15.87:0/2527743732 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe70405bc80 con 0x7fe7181610c0 2024-05-27T06:27:36.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:36.916+0000 7fe720200640 1 -- 172.21.15.87:0/2527743732 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fe718069060 con 0x7fe7181610c0 2024-05-27T06:27:37.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.556+0000 7fe715600640 1 -- 172.21.15.87:0/2527743732 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7fe70405ff80 con 0x7fe7181610c0 2024-05-27T06:27:37.556 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_data' created 2024-05-27T06:27:37.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.560+0000 7fe720200640 1 -- 172.21.15.87:0/2527743732 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe6f806f430 msgr2=0x7fe6f8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:37.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.560+0000 7fe720200640 1 --2- 172.21.15.87:0/2527743732 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe6f806f430 0x7fe6f8071940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe70c0ae000 tx=0x7fe70c004740 comp rx=0 tx=0).stop 2024-05-27T06:27:37.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.560+0000 7fe720200640 1 -- 172.21.15.87:0/2527743732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7181610c0 msgr2=0x7fe71809c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:37.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.560+0000 7fe720200640 1 --2- 172.21.15.87:0/2527743732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7181610c0 0x7fe71809c240 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe70400c460 tx=0x7fe70400c920 comp rx=0 tx=0).stop 2024-05-27T06:27:37.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.560+0000 7fe720200640 1 -- 172.21.15.87:0/2527743732 shutdown_connections 2024-05-27T06:27:37.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.560+0000 7fe720200640 1 --2- 172.21.15.87:0/2527743732 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe6f806f430 0x7fe6f8071940 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:37.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.560+0000 7fe720200640 1 --2- 172.21.15.87:0/2527743732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7181fa520 0x7fe71809c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:37.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.560+0000 7fe720200640 1 --2- 172.21.15.87:0/2527743732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7181610c0 0x7fe71809c240 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:37.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.560+0000 7fe720200640 1 --2- 172.21.15.87:0/2527743732 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7180d0810 0x7fe7180b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:37.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.560+0000 7fe720200640 1 -- 172.21.15.87:0/2527743732 >> 172.21.15.87:0/2527743732 conn(0x7fe7180b46b0 msgr2=0x7fe7180ae5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:37.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.560+0000 7fe720200640 1 -- 172.21.15.87:0/2527743732 shutdown_connections 2024-05-27T06:27:37.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.560+0000 7fe720200640 1 -- 172.21.15.87:0/2527743732 wait complete. 2024-05-27T06:27:37.600 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-27T06:27:37.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.752+0000 7fcdc3c00640 1 Processor -- start 2024-05-27T06:27:37.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.752+0000 7fcdc3c00640 1 -- start start 2024-05-27T06:27:37.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.752+0000 7fcdc3c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcdbc157310 0x7fcdbc15dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:37.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.752+0000 7fcdc3c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcdbc06c940 0x7fcdbc06cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:37.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.752+0000 7fcdc3c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdbc15e110 con 0x7fcdbc0d1700 2024-05-27T06:27:37.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.752+0000 7fcdc3c00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fcdbc0d0140 con 0x7fcdbc06c940 2024-05-27T06:27:37.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.752+0000 7fcdc3c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fcdbc0cf530 con 0x7fcdbc157310 2024-05-27T06:27:37.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.752+0000 7fcdc1c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcdbc06c940 0x7fcdbc06cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:37.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.752+0000 7fcdc1c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcdbc06c940 0x7fcdbc06cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60766/0 (socket says 172.21.15.87:60766) 2024-05-27T06:27:37.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.752+0000 7fcdc1c00640 1 -- 172.21.15.87:0/1661389198 learned_addr learned my addr 172.21.15.87:0/1661389198 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:37.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.752+0000 7fcdc1200640 1 --2- 172.21.15.87:0/1661389198 >> v2:172.21.15.149:3300/0 conn(0x7fcdbc157310 0x7fcdbc15dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:37.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.752+0000 7fcdc1c00640 1 -- 172.21.15.87:0/1661389198 >> v2:172.21.15.149:3300/0 conn(0x7fcdbc157310 msgr2=0x7fcdbc15dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:37.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.752+0000 7fcdc1c00640 1 --2- 172.21.15.87:0/1661389198 >> v2:172.21.15.149:3300/0 conn(0x7fcdbc157310 0x7fcdbc15dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:37.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.752+0000 7fcdc1c00640 1 -- 172.21.15.87:0/1661389198 >> v1:172.21.15.149:6789/0 conn(0x7fcdbc0d1700 legacy=0x7fcdbc0d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:37.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.752+0000 7fcdc1c00640 1 -- 172.21.15.87:0/1661389198 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdbc0cf810 con 0x7fcdbc06c940 2024-05-27T06:27:37.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.756+0000 7fcdc1c00640 1 --2- 172.21.15.87:0/1661389198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdbc06c940 0x7fcdbc06cd50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4009e50 tx=0x7fcdb401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8505b16bdd719f90 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:37.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.756+0000 7fcdbb400640 1 -- 172.21.15.87:0/1661389198 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb40a5710 con 0x7fcdbc06c940 2024-05-27T06:27:37.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.756+0000 7fcdbb400640 1 -- 172.21.15.87:0/1661389198 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdb40a58b0 con 0x7fcdbc06c940 2024-05-27T06:27:37.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.756+0000 7fcdbb400640 1 -- 172.21.15.87:0/1661389198 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb40a5c80 con 0x7fcdbc06c940 2024-05-27T06:27:37.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.756+0000 7fcdc3c00640 1 -- 172.21.15.87:0/1661389198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdbc06c940 msgr2=0x7fcdbc06cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:37.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.756+0000 7fcdc3c00640 1 --2- 172.21.15.87:0/1661389198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdbc06c940 0x7fcdbc06cd50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4009e50 tx=0x7fcdb401c960 comp rx=0 tx=0).stop 2024-05-27T06:27:37.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.756+0000 7fcdc3c00640 1 -- 172.21.15.87:0/1661389198 shutdown_connections 2024-05-27T06:27:37.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.756+0000 7fcdc3c00640 1 --2- 172.21.15.87:0/1661389198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdbc06c940 0x7fcdbc06cd50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:37.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.756+0000 7fcdc3c00640 1 --2- 172.21.15.87:0/1661389198 >> v2:172.21.15.149:3300/0 conn(0x7fcdbc157310 0x7fcdbc15dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:37.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.756+0000 7fcdc3c00640 1 -- 172.21.15.87:0/1661389198 >> 172.21.15.87:0/1661389198 conn(0x7fcdbc0b46b0 msgr2=0x7fcdbc0b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:37.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.756+0000 7fcdc3c00640 1 -- 172.21.15.87:0/1661389198 shutdown_connections 2024-05-27T06:27:37.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.756+0000 7fcdc3c00640 1 -- 172.21.15.87:0/1661389198 wait complete. 2024-05-27T06:27:37.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.760+0000 7fcdc3c00640 1 Processor -- start 2024-05-27T06:27:37.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.760+0000 7fcdc3c00640 1 -- start start 2024-05-27T06:27:37.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.760+0000 7fcdc3c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcdbc06c940 0x7fcdbc153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:37.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.760+0000 7fcdc3c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdbc0d1700 0x7fcdbc153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:37.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.760+0000 7fcdc3c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdbc157310 0x7fcdbc1500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:37.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.760+0000 7fcdc3c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc070640 con 0x7fcdbc0d1700 2024-05-27T06:27:37.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.760+0000 7fcdc3c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc06d6a0 con 0x7fcdbc157310 2024-05-27T06:27:37.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.760+0000 7fcdc3c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcdbc0707c0 con 0x7fcdbc06c940 2024-05-27T06:27:37.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.760+0000 7fcdbbe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdbc0d1700 0x7fcdbc153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:37.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.760+0000 7fcdbbe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdbc0d1700 0x7fcdbc153190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60780/0 (socket says 172.21.15.87:60780) 2024-05-27T06:27:37.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.760+0000 7fcdbbe00640 1 -- 172.21.15.87:0/3058961194 learned_addr learned my addr 172.21.15.87:0/3058961194 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:37.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.760+0000 7fcdc1200640 1 --2- 172.21.15.87:0/3058961194 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcdbc06c940 0x7fcdbc153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:37.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.760+0000 7fcdc1c00640 1 --2- 172.21.15.87:0/3058961194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdbc157310 0x7fcdbc1500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:37.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.760+0000 7fcdbbe00640 1 -- 172.21.15.87:0/3058961194 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcdbc06c940 msgr2=0x7fcdbc153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:37.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.760+0000 7fcdbbe00640 1 --2- 172.21.15.87:0/3058961194 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcdbc06c940 0x7fcdbc153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:37.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.760+0000 7fcdbbe00640 1 -- 172.21.15.87:0/3058961194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdbc157310 msgr2=0x7fcdbc1500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:37.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.760+0000 7fcdbbe00640 1 --2- 172.21.15.87:0/3058961194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdbc157310 0x7fcdbc1500d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:37.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.760+0000 7fcdbbe00640 1 -- 172.21.15.87:0/3058961194 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdbc154540 con 0x7fcdbc0d1700 2024-05-27T06:27:37.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.760+0000 7fcdbbe00640 1 --2- 172.21.15.87:0/3058961194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdbc0d1700 0x7fcdbc153190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcda800c3c0 tx=0x7fcda800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:37.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.764+0000 7fcdb8c00640 1 -- 172.21.15.87:0/3058961194 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda8017070 con 0x7fcdbc0d1700 2024-05-27T06:27:37.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.764+0000 7fcdb8c00640 1 -- 172.21.15.87:0/3058961194 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcda80052d0 con 0x7fcdbc0d1700 2024-05-27T06:27:37.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.764+0000 7fcdb8c00640 1 -- 172.21.15.87:0/3058961194 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda8003800 con 0x7fcdbc0d1700 2024-05-27T06:27:37.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.764+0000 7fcdc3c00640 1 -- 172.21.15.87:0/3058961194 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdbc1523d0 con 0x7fcdbc0d1700 2024-05-27T06:27:37.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.764+0000 7fcdc3c00640 1 -- 172.21.15.87:0/3058961194 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdbc152990 con 0x7fcdbc0d1700 2024-05-27T06:27:37.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.764+0000 7fcdc3c00640 1 -- 172.21.15.87:0/3058961194 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdbc06aa30 con 0x7fcdbc0d1700 2024-05-27T06:27:37.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.764+0000 7fcdb8c00640 1 -- 172.21.15.87:0/3058961194 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fcda801a070 con 0x7fcdbc0d1700 2024-05-27T06:27:37.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.764+0000 7fcdb8c00640 1 --2- 172.21.15.87:0/3058961194 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fcd9c06f430 0x7fcd9c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:37.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.764+0000 7fcdb8c00640 1 -- 172.21.15.87:0/3058961194 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fcda808e8d0 con 0x7fcdbc0d1700 2024-05-27T06:27:37.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.764+0000 7fcdc1200640 1 --2- 172.21.15.87:0/3058961194 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fcd9c06f430 0x7fcd9c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:37.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.768+0000 7fcdc1200640 1 --2- 172.21.15.87:0/3058961194 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fcd9c06f430 0x7fcd9c071940 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc0d2290 tx=0x7fcdb0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:37.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.768+0000 7fcdb8c00640 1 -- 172.21.15.87:0/3058961194 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fcdbc15e110 con 0x7fcdbc0d1700 2024-05-27T06:27:37.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:37.960+0000 7fcdc3c00640 1 -- 172.21.15.87:0/3058961194 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fcdbc0b3cc0 con 0x7fcdbc0d1700 2024-05-27T06:27:38.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.560+0000 7fcdb8c00640 1 -- 172.21.15.87:0/3058961194 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fcda8005480 con 0x7fcdbc0d1700 2024-05-27T06:27:38.560 INFO:teuthology.orchestra.run.smithi087.stderr:new fs with metadata pool 2 and data pool 3 2024-05-27T06:27:38.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.564+0000 7fcdc3c00640 1 -- 172.21.15.87:0/3058961194 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fcd9c06f430 msgr2=0x7fcd9c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:38.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.564+0000 7fcdc3c00640 1 --2- 172.21.15.87:0/3058961194 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fcd9c06f430 0x7fcd9c071940 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc0d2290 tx=0x7fcdb0008040 comp rx=0 tx=0).stop 2024-05-27T06:27:38.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.564+0000 7fcdc3c00640 1 -- 172.21.15.87:0/3058961194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdbc0d1700 msgr2=0x7fcdbc153190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:38.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.564+0000 7fcdc3c00640 1 --2- 172.21.15.87:0/3058961194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdbc0d1700 0x7fcdbc153190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcda800c3c0 tx=0x7fcda800c880 comp rx=0 tx=0).stop 2024-05-27T06:27:38.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.564+0000 7fcdc3c00640 1 -- 172.21.15.87:0/3058961194 shutdown_connections 2024-05-27T06:27:38.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.564+0000 7fcdc3c00640 1 --2- 172.21.15.87:0/3058961194 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fcd9c06f430 0x7fcd9c071940 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc0d2290 tx=0x7fcdb0008040 comp rx=0 tx=0).stop 2024-05-27T06:27:38.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.564+0000 7fcdc3c00640 1 --2- 172.21.15.87:0/3058961194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdbc157310 0x7fcdbc1500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:38.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.564+0000 7fcdc3c00640 1 --2- 172.21.15.87:0/3058961194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdbc0d1700 0x7fcdbc153190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:38.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.564+0000 7fcdc3c00640 1 --2- 172.21.15.87:0/3058961194 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcdbc06c940 0x7fcdbc153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:38.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.564+0000 7fcdc3c00640 1 -- 172.21.15.87:0/3058961194 >> 172.21.15.87:0/3058961194 conn(0x7fcdbc0b46b0 msgr2=0x7fcdbc151540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:38.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.568+0000 7fcdc3c00640 1 -- 172.21.15.87:0/3058961194 shutdown_connections 2024-05-27T06:27:38.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.568+0000 7fcdc3c00640 1 -- 172.21.15.87:0/3058961194 wait complete. 2024-05-27T06:27:38.616 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-05-27T06:27:38.616 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-05-27T06:27:38.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.767+0000 7f7c3e400640 1 Processor -- start 2024-05-27T06:27:38.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.767+0000 7f7c3e400640 1 -- start start 2024-05-27T06:27:38.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.771+0000 7f7c3e400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7c380cfa50 0x7f7c380d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:38.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.771+0000 7f7c3e400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7c380d2090 0x7f7c380b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:38.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.771+0000 7f7c3e400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c380d1410 con 0x7f7c380cf640 2024-05-27T06:27:38.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.771+0000 7f7c3e400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f7c380ce370 con 0x7f7c380cfa50 2024-05-27T06:27:38.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.771+0000 7f7c3e400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f7c380cf1b0 con 0x7f7c380d2090 2024-05-27T06:27:38.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.771+0000 7f7c2ea00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7c380cfa50 0x7f7c380d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:38.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.771+0000 7f7c2ea00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7c380cfa50 0x7f7c380d1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60796/0 (socket says 172.21.15.87:60796) 2024-05-27T06:27:38.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.771+0000 7f7c2ea00640 1 -- 172.21.15.87:0/162537853 learned_addr learned my addr 172.21.15.87:0/162537853 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:38.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.771+0000 7f7c37e00640 1 --2- 172.21.15.87:0/162537853 >> v2:172.21.15.149:3300/0 conn(0x7f7c380d2090 0x7f7c380b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:38.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.771+0000 7f7c2ea00640 1 -- 172.21.15.87:0/162537853 >> v2:172.21.15.149:3300/0 conn(0x7f7c380d2090 msgr2=0x7f7c380b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:38.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.771+0000 7f7c2ea00640 1 --2- 172.21.15.87:0/162537853 >> v2:172.21.15.149:3300/0 conn(0x7f7c380d2090 0x7f7c380b2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:38.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.771+0000 7f7c2ea00640 1 -- 172.21.15.87:0/162537853 >> v1:172.21.15.149:6789/0 conn(0x7f7c380cf640 legacy=0x7f7c3806efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:38.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.771+0000 7f7c36a00640 1 -- 172.21.15.87:0/162537853 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3088829872 0 0) 0x7f7c380d1410 con 0x7f7c380cf640 2024-05-27T06:27:38.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.771+0000 7f7c2ea00640 1 -- 172.21.15.87:0/162537853 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c380d24a0 con 0x7f7c380cfa50 2024-05-27T06:27:38.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.775+0000 7f7c2ea00640 1 --2- 172.21.15.87:0/162537853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c380cfa50 0x7f7c380d1b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7c380cf330 tx=0x7f7c2001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d0ab07e1d698893 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:38.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.775+0000 7f7c36a00640 1 -- 172.21.15.87:0/162537853 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c200ab5f0 con 0x7f7c380cfa50 2024-05-27T06:27:38.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.775+0000 7f7c36a00640 1 -- 172.21.15.87:0/162537853 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c200b0070 con 0x7f7c380cfa50 2024-05-27T06:27:38.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.775+0000 7f7c36a00640 1 -- 172.21.15.87:0/162537853 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c200ab9b0 con 0x7f7c380cfa50 2024-05-27T06:27:38.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.775+0000 7f7c3e400640 1 -- 172.21.15.87:0/162537853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c380cfa50 msgr2=0x7f7c380d1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:38.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.775+0000 7f7c3e400640 1 --2- 172.21.15.87:0/162537853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c380cfa50 0x7f7c380d1b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7c380cf330 tx=0x7f7c2001c500 comp rx=0 tx=0).stop 2024-05-27T06:27:38.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.775+0000 7f7c3e400640 1 -- 172.21.15.87:0/162537853 shutdown_connections 2024-05-27T06:27:38.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.775+0000 7f7c3e400640 1 --2- 172.21.15.87:0/162537853 >> v2:172.21.15.149:3300/0 conn(0x7f7c380d2090 0x7f7c380b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:38.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.775+0000 7f7c3e400640 1 --2- 172.21.15.87:0/162537853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c380cfa50 0x7f7c380d1b50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:38.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.775+0000 7f7c3e400640 1 -- 172.21.15.87:0/162537853 >> 172.21.15.87:0/162537853 conn(0x7f7c380d3580 msgr2=0x7f7c380d3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:38.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.775+0000 7f7c3e400640 1 -- 172.21.15.87:0/162537853 shutdown_connections 2024-05-27T06:27:38.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.775+0000 7f7c3e400640 1 -- 172.21.15.87:0/162537853 wait complete. 2024-05-27T06:27:38.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.779+0000 7f7c3e400640 1 Processor -- start 2024-05-27T06:27:38.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.779+0000 7f7c3e400640 1 -- start start 2024-05-27T06:27:38.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.779+0000 7f7c3e400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c380cf640 0x7f7c380cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:38.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.779+0000 7f7c3e400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c380cfa50 0x7f7c3815f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:38.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.779+0000 7f7c3e400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c380d2090 0x7f7c381617f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:38.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.779+0000 7f7c3e400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7c380b3880 con 0x7f7c380cf640 2024-05-27T06:27:38.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.779+0000 7f7c3e400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7c380cee40 con 0x7f7c380cfa50 2024-05-27T06:27:38.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.779+0000 7f7c3e400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7c3806f6d0 con 0x7f7c380d2090 2024-05-27T06:27:38.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.779+0000 7f7c37400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c380cf640 0x7f7c380cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:38.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.779+0000 7f7c37400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c380cf640 0x7f7c380cd0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60802/0 (socket says 172.21.15.87:60802) 2024-05-27T06:27:38.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.779+0000 7f7c37400640 1 -- 172.21.15.87:0/2735342930 learned_addr learned my addr 172.21.15.87:0/2735342930 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:38.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.779+0000 7f7c2ea00640 1 --2- 172.21.15.87:0/2735342930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c380cfa50 0x7f7c3815f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:38.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.779+0000 7f7c37e00640 1 --2- 172.21.15.87:0/2735342930 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c380d2090 0x7f7c381617f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:38.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.779+0000 7f7c37400640 1 -- 172.21.15.87:0/2735342930 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c380d2090 msgr2=0x7f7c381617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:38.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.779+0000 7f7c37400640 1 --2- 172.21.15.87:0/2735342930 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c380d2090 0x7f7c381617f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:38.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.779+0000 7f7c37400640 1 -- 172.21.15.87:0/2735342930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c380cfa50 msgr2=0x7f7c3815f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:38.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.779+0000 7f7c37400640 1 --2- 172.21.15.87:0/2735342930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c380cfa50 0x7f7c3815f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:38.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.779+0000 7f7c37400640 1 -- 172.21.15.87:0/2735342930 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c380aeaf0 con 0x7f7c380cf640 2024-05-27T06:27:38.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.779+0000 7f7c37e00640 1 --2- 172.21.15.87:0/2735342930 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c380d2090 0x7f7c381617f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:27:38.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.779+0000 7f7c37400640 1 --2- 172.21.15.87:0/2735342930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c380cf640 0x7f7c380cd0b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7c2800c780 tx=0x7f7c2800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:38.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.779+0000 7f7c2fe00640 1 -- 172.21.15.87:0/2735342930 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c28017070 con 0x7f7c380cf640 2024-05-27T06:27:38.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.779+0000 7f7c2fe00640 1 -- 172.21.15.87:0/2735342930 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c28003db0 con 0x7f7c380cf640 2024-05-27T06:27:38.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.779+0000 7f7c3e400640 1 -- 172.21.15.87:0/2735342930 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c380aedd0 con 0x7f7c380cf640 2024-05-27T06:27:38.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.779+0000 7f7c2fe00640 1 -- 172.21.15.87:0/2735342930 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c28005270 con 0x7f7c380cf640 2024-05-27T06:27:38.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.779+0000 7f7c3e400640 1 -- 172.21.15.87:0/2735342930 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c380af390 con 0x7f7c380cf640 2024-05-27T06:27:38.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.783+0000 7f7c3e400640 1 -- 172.21.15.87:0/2735342930 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c3806aa30 con 0x7f7c380cf640 2024-05-27T06:27:38.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.783+0000 7f7c2fe00640 1 -- 172.21.15.87:0/2735342930 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7c2801a070 con 0x7f7c380cf640 2024-05-27T06:27:38.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.783+0000 7f7c2fe00640 1 --2- 172.21.15.87:0/2735342930 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7c1406f400 0x7f7c14071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:38.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.783+0000 7f7c2fe00640 1 -- 172.21.15.87:0/2735342930 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f7c2808e860 con 0x7f7c380cf640 2024-05-27T06:27:38.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.783+0000 7f7c2ea00640 1 --2- 172.21.15.87:0/2735342930 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7c1406f400 0x7f7c14071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:38.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.783+0000 7f7c2ea00640 1 --2- 172.21.15.87:0/2735342930 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7c1406f400 0x7f7c14071910 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7c200af000 tx=0x7f7c200a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:38.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.787+0000 7f7c2fe00640 1 -- 172.21.15.87:0/2735342930 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7c2805b0f0 con 0x7f7c380cf640 2024-05-27T06:27:38.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:38.955+0000 7f7c3e400640 1 -- 172.21.15.87:0/2735342930 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f7c38164930 con 0x7f7c380cf640 2024-05-27T06:27:39.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.563+0000 7f7c2fe00640 1 -- 172.21.15.87:0/2735342930 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7f7c2805f3f0 con 0x7f7c380cf640 2024-05-27T06:27:39.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.563+0000 7f7c3e400640 1 -- 172.21.15.87:0/2735342930 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7c1406f400 msgr2=0x7f7c14071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:39.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.563+0000 7f7c3e400640 1 --2- 172.21.15.87:0/2735342930 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7c1406f400 0x7f7c14071910 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7c200af000 tx=0x7f7c200a7000 comp rx=0 tx=0).stop 2024-05-27T06:27:39.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.563+0000 7f7c3e400640 1 -- 172.21.15.87:0/2735342930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c380cf640 msgr2=0x7f7c380cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:39.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.563+0000 7f7c3e400640 1 --2- 172.21.15.87:0/2735342930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c380cf640 0x7f7c380cd0b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7c2800c780 tx=0x7f7c2800cc40 comp rx=0 tx=0).stop 2024-05-27T06:27:39.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.567+0000 7f7c3e400640 1 -- 172.21.15.87:0/2735342930 shutdown_connections 2024-05-27T06:27:39.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.567+0000 7f7c3e400640 1 --2- 172.21.15.87:0/2735342930 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7c1406f400 0x7f7c14071910 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:39.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.567+0000 7f7c3e400640 1 --2- 172.21.15.87:0/2735342930 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c380d2090 0x7f7c381617f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:39.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.567+0000 7f7c3e400640 1 --2- 172.21.15.87:0/2735342930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c380cfa50 0x7f7c3815f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:39.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.567+0000 7f7c3e400640 1 --2- 172.21.15.87:0/2735342930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c380cf640 0x7f7c380cd0b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:39.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.567+0000 7f7c3e400640 1 -- 172.21.15.87:0/2735342930 >> 172.21.15.87:0/2735342930 conn(0x7f7c380d3580 msgr2=0x7f7c380d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:39.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.567+0000 7f7c3e400640 1 -- 172.21.15.87:0/2735342930 shutdown_connections 2024-05-27T06:27:39.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.567+0000 7f7c3e400640 1 -- 172.21.15.87:0/2735342930 wait complete. 2024-05-27T06:27:39.587 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-05-27T06:27:39.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.743+0000 7fee47e00640 1 Processor -- start 2024-05-27T06:27:39.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.743+0000 7fee47e00640 1 -- start start 2024-05-27T06:27:39.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.747+0000 7fee47e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee4015edc0 0x7fee400704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:39.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.747+0000 7fee47e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fee400d16b0 0x7fee400d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:39.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.747+0000 7fee47e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee400d2000 con 0x7fee400700a0 2024-05-27T06:27:39.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.747+0000 7fee47e00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fee4006ea30 con 0x7fee400d16b0 2024-05-27T06:27:39.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.747+0000 7fee47e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fee4006ed10 con 0x7fee4015edc0 2024-05-27T06:27:39.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.747+0000 7fee45e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fee400d16b0 0x7fee400d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:39.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.747+0000 7fee45e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fee400d16b0 0x7fee400d1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60816/0 (socket says 172.21.15.87:60816) 2024-05-27T06:27:39.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.747+0000 7fee45e00640 1 -- 172.21.15.87:0/3073396077 learned_addr learned my addr 172.21.15.87:0/3073396077 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:39.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.747+0000 7fee44a00640 1 --2- 172.21.15.87:0/3073396077 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee4015edc0 0x7fee400704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:39.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.747+0000 7fee45e00640 1 -- 172.21.15.87:0/3073396077 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee4015edc0 msgr2=0x7fee400704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:39.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.747+0000 7fee45e00640 1 --2- 172.21.15.87:0/3073396077 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee4015edc0 0x7fee400704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:39.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.747+0000 7fee45e00640 1 -- 172.21.15.87:0/3073396077 >> v1:172.21.15.149:6789/0 conn(0x7fee400700a0 legacy=0x7fee4015e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:39.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.747+0000 7fee45e00640 1 -- 172.21.15.87:0/3073396077 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee4006eff0 con 0x7fee400d16b0 2024-05-27T06:27:39.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.751+0000 7fee45e00640 1 --2- 172.21.15.87:0/3073396077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee400d16b0 0x7fee400d1ac0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fee38009e50 tx=0x7fee3801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95875f087ec536e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:39.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.751+0000 7fee3fe00640 1 -- 172.21.15.87:0/3073396077 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee380a57f0 con 0x7fee400d16b0 2024-05-27T06:27:39.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.751+0000 7fee3fe00640 1 -- 172.21.15.87:0/3073396077 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee380a5990 con 0x7fee400d16b0 2024-05-27T06:27:39.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.751+0000 7fee3fe00640 1 -- 172.21.15.87:0/3073396077 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee380a5d60 con 0x7fee400d16b0 2024-05-27T06:27:39.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.751+0000 7fee47e00640 1 -- 172.21.15.87:0/3073396077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee400d16b0 msgr2=0x7fee400d1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:39.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.751+0000 7fee47e00640 1 --2- 172.21.15.87:0/3073396077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee400d16b0 0x7fee400d1ac0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fee38009e50 tx=0x7fee3801ca30 comp rx=0 tx=0).stop 2024-05-27T06:27:39.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.751+0000 7fee47e00640 1 -- 172.21.15.87:0/3073396077 shutdown_connections 2024-05-27T06:27:39.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.751+0000 7fee47e00640 1 --2- 172.21.15.87:0/3073396077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee400d16b0 0x7fee400d1ac0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:39.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.751+0000 7fee47e00640 1 --2- 172.21.15.87:0/3073396077 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee4015edc0 0x7fee400704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:39.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.751+0000 7fee47e00640 1 -- 172.21.15.87:0/3073396077 >> 172.21.15.87:0/3073396077 conn(0x7fee400b4640 msgr2=0x7fee400b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:39.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.751+0000 7fee47e00640 1 -- 172.21.15.87:0/3073396077 shutdown_connections 2024-05-27T06:27:39.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.751+0000 7fee47e00640 1 -- 172.21.15.87:0/3073396077 wait complete. 2024-05-27T06:27:39.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.751+0000 7fee47e00640 1 Processor -- start 2024-05-27T06:27:39.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.751+0000 7fee47e00640 1 -- start start 2024-05-27T06:27:39.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.755+0000 7fee47e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee400700a0 0x7fee40099e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:39.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.755+0000 7fee47e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee400d16b0 0x7fee40161090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:39.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.755+0000 7fee47e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee40068c00 0x7fee401615d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:39.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.755+0000 7fee47e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fee401583f0 con 0x7fee400700a0 2024-05-27T06:27:39.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.755+0000 7fee47e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fee40158270 con 0x7fee400d16b0 2024-05-27T06:27:39.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.755+0000 7fee47e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fee400ccbb0 con 0x7fee40068c00 2024-05-27T06:27:39.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.755+0000 7fee45400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee400700a0 0x7fee40099e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:39.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.755+0000 7fee45400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee400700a0 0x7fee40099e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60820/0 (socket says 172.21.15.87:60820) 2024-05-27T06:27:39.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.755+0000 7fee45400640 1 -- 172.21.15.87:0/3185417269 learned_addr learned my addr 172.21.15.87:0/3185417269 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:39.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.755+0000 7fee45e00640 1 --2- 172.21.15.87:0/3185417269 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee40068c00 0x7fee401615d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:39.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.755+0000 7fee44a00640 1 --2- 172.21.15.87:0/3185417269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee400d16b0 0x7fee40161090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:39.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.755+0000 7fee45400640 1 -- 172.21.15.87:0/3185417269 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee40068c00 msgr2=0x7fee401615d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:39.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.755+0000 7fee45400640 1 --2- 172.21.15.87:0/3185417269 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee40068c00 0x7fee401615d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:39.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.755+0000 7fee45400640 1 -- 172.21.15.87:0/3185417269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee400d16b0 msgr2=0x7fee40161090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:39.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.755+0000 7fee45400640 1 --2- 172.21.15.87:0/3185417269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee400d16b0 0x7fee40161090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:39.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.755+0000 7fee45400640 1 -- 172.21.15.87:0/3185417269 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee400c32c0 con 0x7fee400700a0 2024-05-27T06:27:39.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.755+0000 7fee44a00640 1 --2- 172.21.15.87:0/3185417269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee400d16b0 0x7fee40161090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:27:39.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.755+0000 7fee45400640 1 --2- 172.21.15.87:0/3185417269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee400700a0 0x7fee40099e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fee3400c390 tx=0x7fee3400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:39.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.755+0000 7fee3d600640 1 -- 172.21.15.87:0/3185417269 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee34017070 con 0x7fee400700a0 2024-05-27T06:27:39.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.755+0000 7fee3d600640 1 -- 172.21.15.87:0/3185417269 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee340052d0 con 0x7fee400700a0 2024-05-27T06:27:39.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.755+0000 7fee47e00640 1 -- 172.21.15.87:0/3185417269 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee400c4360 con 0x7fee400700a0 2024-05-27T06:27:39.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.755+0000 7fee3d600640 1 -- 172.21.15.87:0/3185417269 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee34003800 con 0x7fee400700a0 2024-05-27T06:27:39.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.755+0000 7fee47e00640 1 -- 172.21.15.87:0/3185417269 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee400c3880 con 0x7fee400700a0 2024-05-27T06:27:39.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.755+0000 7fee47e00640 1 -- 172.21.15.87:0/3185417269 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee4006aa30 con 0x7fee400700a0 2024-05-27T06:27:39.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.759+0000 7fee3d600640 1 -- 172.21.15.87:0/3185417269 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fee3401a070 con 0x7fee400700a0 2024-05-27T06:27:39.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.759+0000 7fee3d600640 1 --2- 172.21.15.87:0/3185417269 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fee2006f400 0x7fee20071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:39.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.759+0000 7fee3d600640 1 -- 172.21.15.87:0/3185417269 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7fee3408e6d0 con 0x7fee400700a0 2024-05-27T06:27:39.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.759+0000 7fee44a00640 1 --2- 172.21.15.87:0/3185417269 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fee2006f400 0x7fee20071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:39.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.759+0000 7fee44a00640 1 --2- 172.21.15.87:0/3185417269 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fee2006f400 0x7fee20071910 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fee400cd6c0 tx=0x7fee2c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:39.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.763+0000 7fee3d600640 1 -- 172.21.15.87:0/3185417269 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fee34005480 con 0x7fee400700a0 2024-05-27T06:27:39.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:39.923+0000 7fee47e00640 1 -- 172.21.15.87:0/3185417269 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fee4006d150 con 0x7fee400700a0 2024-05-27T06:27:41.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.623+0000 7fee3d600640 1 -- 172.21.15.87:0/3185417269 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7fee3405ada0 con 0x7fee400700a0 2024-05-27T06:27:41.623 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_data_ec' created 2024-05-27T06:27:41.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.627+0000 7fee47e00640 1 -- 172.21.15.87:0/3185417269 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fee2006f400 msgr2=0x7fee20071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:41.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.627+0000 7fee47e00640 1 --2- 172.21.15.87:0/3185417269 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fee2006f400 0x7fee20071910 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fee400cd6c0 tx=0x7fee2c008040 comp rx=0 tx=0).stop 2024-05-27T06:27:41.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.627+0000 7fee47e00640 1 -- 172.21.15.87:0/3185417269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee400700a0 msgr2=0x7fee40099e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:41.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.627+0000 7fee47e00640 1 --2- 172.21.15.87:0/3185417269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee400700a0 0x7fee40099e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fee3400c390 tx=0x7fee3400c850 comp rx=0 tx=0).stop 2024-05-27T06:27:41.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.627+0000 7fee47e00640 1 -- 172.21.15.87:0/3185417269 shutdown_connections 2024-05-27T06:27:41.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.627+0000 7fee47e00640 1 --2- 172.21.15.87:0/3185417269 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fee2006f400 0x7fee20071910 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:41.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.627+0000 7fee47e00640 1 --2- 172.21.15.87:0/3185417269 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fee40068c00 0x7fee401615d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:41.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.627+0000 7fee47e00640 1 --2- 172.21.15.87:0/3185417269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee400d16b0 0x7fee40161090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:41.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.627+0000 7fee47e00640 1 --2- 172.21.15.87:0/3185417269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee400700a0 0x7fee40099e10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:41.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.627+0000 7fee47e00640 1 -- 172.21.15.87:0/3185417269 >> 172.21.15.87:0/3185417269 conn(0x7fee400b4640 msgr2=0x7fee400cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:41.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.627+0000 7fee47e00640 1 -- 172.21.15.87:0/3185417269 shutdown_connections 2024-05-27T06:27:41.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.627+0000 7fee47e00640 1 -- 172.21.15.87:0/3185417269 wait complete. 2024-05-27T06:27:41.658 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-05-27T06:27:41.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.811+0000 7f996ee00640 1 Processor -- start 2024-05-27T06:27:41.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.811+0000 7f996ee00640 1 -- start start 2024-05-27T06:27:41.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.811+0000 7f996ee00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9968157310 0x7f996815dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:41.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.811+0000 7f996ee00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f996806c940 0x7f996806cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:41.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.811+0000 7f996ee00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f996815e110 con 0x7f99680d1700 2024-05-27T06:27:41.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.811+0000 7f996ee00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f99680d0140 con 0x7f996806c940 2024-05-27T06:27:41.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.811+0000 7f996ee00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f99680cf530 con 0x7f9968157310 2024-05-27T06:27:41.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.815+0000 7f996ce00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f996806c940 0x7f996806cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:41.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.815+0000 7f996ce00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f996806c940 0x7f996806cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60836/0 (socket says 172.21.15.87:60836) 2024-05-27T06:27:41.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.815+0000 7f996ce00640 1 -- 172.21.15.87:0/3117929095 learned_addr learned my addr 172.21.15.87:0/3117929095 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:41.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.815+0000 7f9967e00640 1 --2- 172.21.15.87:0/3117929095 >> v2:172.21.15.149:3300/0 conn(0x7f9968157310 0x7f996815dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:41.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.815+0000 7f996ce00640 1 -- 172.21.15.87:0/3117929095 >> v2:172.21.15.149:3300/0 conn(0x7f9968157310 msgr2=0x7f996815dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:41.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.815+0000 7f996ce00640 1 --2- 172.21.15.87:0/3117929095 >> v2:172.21.15.149:3300/0 conn(0x7f9968157310 0x7f996815dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:41.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.815+0000 7f996ce00640 1 -- 172.21.15.87:0/3117929095 >> v1:172.21.15.149:6789/0 conn(0x7f99680d1700 legacy=0x7f99680d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:41.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.815+0000 7f996ce00640 1 -- 172.21.15.87:0/3117929095 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99680cf810 con 0x7f996806c940 2024-05-27T06:27:41.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.815+0000 7f996ce00640 1 --2- 172.21.15.87:0/3117929095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f996806c940 0x7f996806cd50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9960009e50 tx=0x7f996001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9eaee84f60fdb2 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:41.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.815+0000 7f9966a00640 1 -- 172.21.15.87:0/3117929095 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99600a5710 con 0x7f996806c940 2024-05-27T06:27:41.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.815+0000 7f9966a00640 1 -- 172.21.15.87:0/3117929095 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99600a58b0 con 0x7f996806c940 2024-05-27T06:27:41.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.815+0000 7f9966a00640 1 -- 172.21.15.87:0/3117929095 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99600a5c80 con 0x7f996806c940 2024-05-27T06:27:41.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.819+0000 7f996ee00640 1 -- 172.21.15.87:0/3117929095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f996806c940 msgr2=0x7f996806cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:41.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.819+0000 7f996ee00640 1 --2- 172.21.15.87:0/3117929095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f996806c940 0x7f996806cd50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9960009e50 tx=0x7f996001c960 comp rx=0 tx=0).stop 2024-05-27T06:27:41.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.819+0000 7f996ee00640 1 -- 172.21.15.87:0/3117929095 shutdown_connections 2024-05-27T06:27:41.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.819+0000 7f996ee00640 1 --2- 172.21.15.87:0/3117929095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f996806c940 0x7f996806cd50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:41.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.819+0000 7f996ee00640 1 --2- 172.21.15.87:0/3117929095 >> v2:172.21.15.149:3300/0 conn(0x7f9968157310 0x7f996815dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:41.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.819+0000 7f996ee00640 1 -- 172.21.15.87:0/3117929095 >> 172.21.15.87:0/3117929095 conn(0x7f99680b46b0 msgr2=0x7f99680b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:41.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.819+0000 7f996ee00640 1 -- 172.21.15.87:0/3117929095 shutdown_connections 2024-05-27T06:27:41.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.819+0000 7f996ee00640 1 -- 172.21.15.87:0/3117929095 wait complete. 2024-05-27T06:27:41.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.819+0000 7f996ee00640 1 Processor -- start 2024-05-27T06:27:41.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.819+0000 7f996ee00640 1 -- start start 2024-05-27T06:27:41.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.823+0000 7f996ee00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f996806c940 0x7f9968150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:41.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.823+0000 7f996ee00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99680d1700 0x7f996815ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:41.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.823+0000 7f996ee00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9968157310 0x7f99680af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:41.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.823+0000 7f996ee00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9968070640 con 0x7f9968157310 2024-05-27T06:27:41.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.823+0000 7f996ee00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f996806d6a0 con 0x7f996806c940 2024-05-27T06:27:41.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.823+0000 7f996ee00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f99680707c0 con 0x7f99680d1700 2024-05-27T06:27:41.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.823+0000 7f996ce00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9968157310 0x7f99680af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:41.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.823+0000 7f996ce00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9968157310 0x7f99680af310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60840/0 (socket says 172.21.15.87:60840) 2024-05-27T06:27:41.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.823+0000 7f996ce00640 1 -- 172.21.15.87:0/2452270426 learned_addr learned my addr 172.21.15.87:0/2452270426 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:41.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.823+0000 7f9967e00640 1 --2- 172.21.15.87:0/2452270426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f996806c940 0x7f9968150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:41.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.823+0000 7f9967400640 1 --2- 172.21.15.87:0/2452270426 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99680d1700 0x7f996815ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:41.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.823+0000 7f996ce00640 1 -- 172.21.15.87:0/2452270426 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99680d1700 msgr2=0x7f996815ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:41.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.823+0000 7f996ce00640 1 --2- 172.21.15.87:0/2452270426 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99680d1700 0x7f996815ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:41.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.823+0000 7f996ce00640 1 -- 172.21.15.87:0/2452270426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f996806c940 msgr2=0x7f9968150450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:41.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.823+0000 7f996ce00640 1 --2- 172.21.15.87:0/2452270426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f996806c940 0x7f9968150450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:41.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.823+0000 7f996ce00640 1 -- 172.21.15.87:0/2452270426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9968150d90 con 0x7f9968157310 2024-05-27T06:27:41.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.823+0000 7f9967e00640 1 --2- 172.21.15.87:0/2452270426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f996806c940 0x7f9968150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:27:41.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.823+0000 7f996ce00640 1 --2- 172.21.15.87:0/2452270426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9968157310 0x7f99680af310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f99600af040 tx=0x7f9960019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:41.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.823+0000 7f995fe00640 1 -- 172.21.15.87:0/2452270426 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99600bc020 con 0x7f9968157310 2024-05-27T06:27:41.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.823+0000 7f995fe00640 1 -- 172.21.15.87:0/2452270426 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99600b8670 con 0x7f9968157310 2024-05-27T06:27:41.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.823+0000 7f995fe00640 1 -- 172.21.15.87:0/2452270426 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9960009510 con 0x7f9968157310 2024-05-27T06:27:41.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.823+0000 7f996ee00640 1 -- 172.21.15.87:0/2452270426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9968151070 con 0x7f9968157310 2024-05-27T06:27:41.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.823+0000 7f996ee00640 1 -- 172.21.15.87:0/2452270426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9968151630 con 0x7f9968157310 2024-05-27T06:27:41.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.823+0000 7f996ee00640 1 -- 172.21.15.87:0/2452270426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f996806aa30 con 0x7f9968157310 2024-05-27T06:27:41.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.827+0000 7f995fe00640 1 -- 172.21.15.87:0/2452270426 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f99600bf020 con 0x7f9968157310 2024-05-27T06:27:41.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.827+0000 7f995fe00640 1 --2- 172.21.15.87:0/2452270426 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f994806f400 0x7f9948071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:41.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.827+0000 7f995fe00640 1 -- 172.21.15.87:0/2452270426 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f996012a460 con 0x7f9968157310 2024-05-27T06:27:41.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.827+0000 7f9967e00640 1 --2- 172.21.15.87:0/2452270426 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f994806f400 0x7f9948071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:41.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.827+0000 7f9967e00640 1 --2- 172.21.15.87:0/2452270426 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f994806f400 0x7f9948071910 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f99680d2290 tx=0x7f9958008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:41.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.831+0000 7f995fe00640 1 -- 172.21.15.87:0/2452270426 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f99600c6030 con 0x7f9968157310 2024-05-27T06:27:41.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:41.991+0000 7f996ee00640 1 -- 172.21.15.87:0/2452270426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f9968161250 con 0x7f9968157310 2024-05-27T06:27:42.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.627+0000 7f995fe00640 1 -- 172.21.15.87:0/2452270426 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f99600165e0 con 0x7f9968157310 2024-05-27T06:27:42.629 INFO:teuthology.orchestra.run.smithi087.stderr:set pool 4 allow_ec_overwrites to true 2024-05-27T06:27:42.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.635+0000 7f996ee00640 1 -- 172.21.15.87:0/2452270426 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f994806f400 msgr2=0x7f9948071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:42.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.635+0000 7f996ee00640 1 --2- 172.21.15.87:0/2452270426 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f994806f400 0x7f9948071910 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f99680d2290 tx=0x7f9958008040 comp rx=0 tx=0).stop 2024-05-27T06:27:42.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.635+0000 7f996ee00640 1 -- 172.21.15.87:0/2452270426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9968157310 msgr2=0x7f99680af310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:42.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.635+0000 7f996ee00640 1 --2- 172.21.15.87:0/2452270426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9968157310 0x7f99680af310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f99600af040 tx=0x7f9960019700 comp rx=0 tx=0).stop 2024-05-27T06:27:42.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.635+0000 7f996ee00640 1 -- 172.21.15.87:0/2452270426 shutdown_connections 2024-05-27T06:27:42.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.635+0000 7f996ee00640 1 --2- 172.21.15.87:0/2452270426 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f994806f400 0x7f9948071910 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:42.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.635+0000 7f996ee00640 1 --2- 172.21.15.87:0/2452270426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9968157310 0x7f99680af310 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:42.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.635+0000 7f996ee00640 1 --2- 172.21.15.87:0/2452270426 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99680d1700 0x7f996815ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:42.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.635+0000 7f996ee00640 1 --2- 172.21.15.87:0/2452270426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f996806c940 0x7f9968150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:42.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.635+0000 7f996ee00640 1 -- 172.21.15.87:0/2452270426 >> 172.21.15.87:0/2452270426 conn(0x7f99680b46b0 msgr2=0x7f99681524a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:42.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.635+0000 7f996ee00640 1 -- 172.21.15.87:0/2452270426 shutdown_connections 2024-05-27T06:27:42.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.635+0000 7f996ee00640 1 -- 172.21.15.87:0/2452270426 wait complete. 2024-05-27T06:27:42.678 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-05-27T06:27:42.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.831+0000 7f5905a00640 1 Processor -- start 2024-05-27T06:27:42.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.831+0000 7f5905a00640 1 -- start start 2024-05-27T06:27:42.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.835+0000 7f5905a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f59000c9b50 0x7f590016ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:42.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.835+0000 7f5905a00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59000d2530 con 0x7f590015a420 2024-05-27T06:27:42.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.835+0000 7f5905a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59000d2810 con 0x7f590006e3f0 2024-05-27T06:27:42.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.835+0000 7f5905a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f59000d2af0 con 0x7f59000c9b50 2024-05-27T06:27:42.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.835+0000 7f58fea00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f590015a420 0x7f59000d1ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57774/0 (socket says 172.21.15.87:57774) 2024-05-27T06:27:42.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.835+0000 7f58fea00640 1 -- 172.21.15.87:0/1107737461 learned_addr learned my addr 172.21.15.87:0/1107737461 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:27:42.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.835+0000 7f58ff400640 1 --2- 172.21.15.87:0/1107737461 >> v2:172.21.15.149:3300/0 conn(0x7f59000c9b50 0x7f590016ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:42.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.835+0000 7f58fe000640 1 -- 172.21.15.87:0/1107737461 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 91989429 0 0) 0x7f59000d2530 con 0x7f590015a420 2024-05-27T06:27:42.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.835+0000 7f58fe000640 1 -- 172.21.15.87:0/1107737461 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58e4003530 con 0x7f590015a420 2024-05-27T06:27:42.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.835+0000 7f58ff400640 1 -- 172.21.15.87:0/1107737461 >> v1:172.21.15.149:6789/0 conn(0x7f590006e3f0 legacy=0x7f590006e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:42.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.835+0000 7f58ff400640 1 -- 172.21.15.87:0/1107737461 >> v1:172.21.15.87:6789/0 conn(0x7f590015a420 legacy=0x7f59000d1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:42.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.835+0000 7f58ff400640 1 -- 172.21.15.87:0/1107737461 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59000d2dd0 con 0x7f59000c9b50 2024-05-27T06:27:42.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.839+0000 7f58ff400640 1 --2- 172.21.15.87:0/1107737461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59000c9b50 0x7f590016ac40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f58f8009d90 tx=0x7f58f801c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2234e0787226f112 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:42.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.839+0000 7f58fe000640 1 -- 172.21.15.87:0/1107737461 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f80b2070 con 0x7f59000c9b50 2024-05-27T06:27:42.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.839+0000 7f58fe000640 1 -- 172.21.15.87:0/1107737461 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f80a5820 con 0x7f59000c9b50 2024-05-27T06:27:42.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.839+0000 7f58fe000640 1 -- 172.21.15.87:0/1107737461 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f80a5bf0 con 0x7f59000c9b50 2024-05-27T06:27:42.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.839+0000 7f5905a00640 1 -- 172.21.15.87:0/1107737461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59000c9b50 msgr2=0x7f590016ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:42.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.839+0000 7f5905a00640 1 --2- 172.21.15.87:0/1107737461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59000c9b50 0x7f590016ac40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f58f8009d90 tx=0x7f58f801c850 comp rx=0 tx=0).stop 2024-05-27T06:27:42.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.839+0000 7f5905a00640 1 -- 172.21.15.87:0/1107737461 shutdown_connections 2024-05-27T06:27:42.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.839+0000 7f5905a00640 1 --2- 172.21.15.87:0/1107737461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59000c9b50 0x7f590016ac40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:42.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.839+0000 7f5905a00640 1 -- 172.21.15.87:0/1107737461 >> 172.21.15.87:0/1107737461 conn(0x7f59000cffd0 msgr2=0x7f59000d03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:42.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.839+0000 7f5905a00640 1 -- 172.21.15.87:0/1107737461 shutdown_connections 2024-05-27T06:27:42.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.839+0000 7f5905a00640 1 -- 172.21.15.87:0/1107737461 wait complete. 2024-05-27T06:27:42.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.839+0000 7f5905a00640 1 Processor -- start 2024-05-27T06:27:42.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.843+0000 7f5905a00640 1 -- start start 2024-05-27T06:27:42.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.843+0000 7f5905a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f590006e3f0 0x7f590014bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:42.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.843+0000 7f5905a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59000c9b50 0x7f590014e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:42.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.843+0000 7f5905a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f590015a420 0x7f590014ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:42.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.843+0000 7f5905a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f590016dd30 con 0x7f59000c9b50 2024-05-27T06:27:42.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.843+0000 7f5905a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f590016dbb0 con 0x7f590015a420 2024-05-27T06:27:42.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.843+0000 7f5905a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f590016deb0 con 0x7f590006e3f0 2024-05-27T06:27:42.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.843+0000 7f58f6000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59000c9b50 0x7f590014e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:42.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.843+0000 7f58f6000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59000c9b50 0x7f590014e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60842/0 (socket says 172.21.15.87:60842) 2024-05-27T06:27:42.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.843+0000 7f58f6000640 1 -- 172.21.15.87:0/1272987766 learned_addr learned my addr 172.21.15.87:0/1272987766 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.843+0000 7f58ff400640 1 --2- 172.21.15.87:0/1272987766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f590015a420 0x7f590014ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.843+0000 7f58fea00640 1 --2- 172.21.15.87:0/1272987766 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f590006e3f0 0x7f590014bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.843+0000 7f58f6000640 1 -- 172.21.15.87:0/1272987766 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f590006e3f0 msgr2=0x7f590014bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.843+0000 7f58f6000640 1 --2- 172.21.15.87:0/1272987766 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f590006e3f0 0x7f590014bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.843+0000 7f58f6000640 1 -- 172.21.15.87:0/1272987766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f590015a420 msgr2=0x7f590014ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.843+0000 7f58f6000640 1 --2- 172.21.15.87:0/1272987766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f590015a420 0x7f590014ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.843+0000 7f58f6000640 1 -- 172.21.15.87:0/1272987766 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5900158d60 con 0x7f59000c9b50 2024-05-27T06:27:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.843+0000 7f58f6000640 1 --2- 172.21.15.87:0/1272987766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59000c9b50 0x7f590014e850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f58e800c430 tx=0x7f58e800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.843+0000 7f58f7400640 1 -- 172.21.15.87:0/1272987766 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e8017070 con 0x7f59000c9b50 2024-05-27T06:27:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.843+0000 7f58f7400640 1 -- 172.21.15.87:0/1272987766 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e80052d0 con 0x7f59000c9b50 2024-05-27T06:27:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.843+0000 7f58f7400640 1 -- 172.21.15.87:0/1272987766 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e80054c0 con 0x7f59000c9b50 2024-05-27T06:27:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.843+0000 7f5905a00640 1 -- 172.21.15.87:0/1272987766 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59000b6c30 con 0x7f59000c9b50 2024-05-27T06:27:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.843+0000 7f5905a00640 1 -- 172.21.15.87:0/1272987766 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59000b71f0 con 0x7f59000c9b50 2024-05-27T06:27:42.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.843+0000 7f5905a00640 1 -- 172.21.15.87:0/1272987766 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59000b69a0 con 0x7f59000c9b50 2024-05-27T06:27:42.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.847+0000 7f58f7400640 1 -- 172.21.15.87:0/1272987766 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f58e801a070 con 0x7f59000c9b50 2024-05-27T06:27:42.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.847+0000 7f58f7400640 1 --2- 172.21.15.87:0/1272987766 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f58dc06f430 0x7f58dc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:42.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.847+0000 7f58f7400640 1 -- 172.21.15.87:0/1272987766 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f58e808e8b0 con 0x7f59000c9b50 2024-05-27T06:27:42.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.847+0000 7f58fea00640 1 --2- 172.21.15.87:0/1272987766 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f58dc06f430 0x7f58dc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:42.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.847+0000 7f58fea00640 1 --2- 172.21.15.87:0/1272987766 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f58dc06f430 0x7f58dc071940 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f58f0005890 tx=0x7f58f0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:42.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:42.851+0000 7f58f7400640 1 -- 172.21.15.87:0/1272987766 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f58e805ae20 con 0x7f59000c9b50 2024-05-27T06:27:43.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.043+0000 7f5905a00640 1 -- 172.21.15.87:0/1272987766 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f590006aa30 con 0x7f59000c9b50 2024-05-27T06:27:43.540 INFO:tasks.ceph.mds.c.smithi087.stderr:2024-05-27T06:27:43.543+0000 7f55db400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-27T06:27:43.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.631+0000 7f58f7400640 1 -- 172.21.15.87:0/1272987766 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7f58e805f120 con 0x7f59000c9b50 2024-05-27T06:27:43.631 INFO:teuthology.orchestra.run.smithi087.stderr:added data pool 4 to fsmap 2024-05-27T06:27:43.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.635+0000 7f5905a00640 1 -- 172.21.15.87:0/1272987766 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f58dc06f430 msgr2=0x7f58dc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:43.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.635+0000 7f5905a00640 1 --2- 172.21.15.87:0/1272987766 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f58dc06f430 0x7f58dc071940 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f58f0005890 tx=0x7f58f0009040 comp rx=0 tx=0).stop 2024-05-27T06:27:43.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.635+0000 7f5905a00640 1 -- 172.21.15.87:0/1272987766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59000c9b50 msgr2=0x7f590014e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:43.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.635+0000 7f5905a00640 1 --2- 172.21.15.87:0/1272987766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59000c9b50 0x7f590014e850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f58e800c430 tx=0x7f58e800c8f0 comp rx=0 tx=0).stop 2024-05-27T06:27:43.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.635+0000 7f5905a00640 1 -- 172.21.15.87:0/1272987766 shutdown_connections 2024-05-27T06:27:43.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.635+0000 7f5905a00640 1 --2- 172.21.15.87:0/1272987766 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f58dc06f430 0x7f58dc071940 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:43.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.635+0000 7f5905a00640 1 --2- 172.21.15.87:0/1272987766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f590015a420 0x7f590014ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:43.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.635+0000 7f5905a00640 1 --2- 172.21.15.87:0/1272987766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59000c9b50 0x7f590014e850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:43.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.635+0000 7f5905a00640 1 --2- 172.21.15.87:0/1272987766 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f590006e3f0 0x7f590014bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:43.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.635+0000 7f5905a00640 1 -- 172.21.15.87:0/1272987766 >> 172.21.15.87:0/1272987766 conn(0x7f59000cffd0 msgr2=0x7f5900151990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:43.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.635+0000 7f5905a00640 1 -- 172.21.15.87:0/1272987766 shutdown_connections 2024-05-27T06:27:43.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.635+0000 7f5905a00640 1 -- 172.21.15.87:0/1272987766 wait complete. 2024-05-27T06:27:43.657 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T06:27:43.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.807+0000 7ff088800640 1 Processor -- start 2024-05-27T06:27:43.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.807+0000 7ff088800640 1 -- start start 2024-05-27T06:27:43.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.807+0000 7ff088800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff080168f90 0x7ff08016b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:43.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.807+0000 7ff088800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0800ce7a0 con 0x7ff0801605d0 2024-05-27T06:27:43.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.807+0000 7ff088800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0800cea80 con 0x7ff08006e8b0 2024-05-27T06:27:43.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.807+0000 7ff088800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7ff0800ced60 con 0x7ff080168f90 2024-05-27T06:27:43.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.807+0000 7ff085e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff0801605d0 0x7ff0801609e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57786/0 (socket says 172.21.15.87:57786) 2024-05-27T06:27:43.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.807+0000 7ff085e00640 1 -- 172.21.15.87:0/2282251372 learned_addr learned my addr 172.21.15.87:0/2282251372 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:27:43.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.807+0000 7ff086800640 1 --2- 172.21.15.87:0/2282251372 >> v2:172.21.15.149:3300/0 conn(0x7ff080168f90 0x7ff08016b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:43.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.807+0000 7ff084a00640 1 -- 172.21.15.87:0/2282251372 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1057762552 0 0) 0x7ff0800ce7a0 con 0x7ff0801605d0 2024-05-27T06:27:43.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.807+0000 7ff084a00640 1 -- 172.21.15.87:0/2282251372 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff068003530 con 0x7ff0801605d0 2024-05-27T06:27:43.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.807+0000 7ff084a00640 1 -- 172.21.15.87:0/2282251372 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1749916030 0 0) 0x7ff068003530 con 0x7ff0801605d0 2024-05-27T06:27:43.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.807+0000 7ff084a00640 1 -- 172.21.15.87:0/2282251372 >> v2:172.21.15.149:3300/0 conn(0x7ff080168f90 msgr2=0x7ff08016b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:43.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.807+0000 7ff084a00640 1 --2- 172.21.15.87:0/2282251372 >> v2:172.21.15.149:3300/0 conn(0x7ff080168f90 0x7ff08016b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:43.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.807+0000 7ff084a00640 1 -- 172.21.15.87:0/2282251372 >> v1:172.21.15.149:6789/0 conn(0x7ff08006e8b0 legacy=0x7ff08006ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:43.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.807+0000 7ff084a00640 1 -- 172.21.15.87:0/2282251372 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0800cf040 con 0x7ff0801605d0 2024-05-27T06:27:43.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.807+0000 7ff084a00640 1 -- 172.21.15.87:0/2282251372 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7ff074001700 con 0x7ff0801605d0 2024-05-27T06:27:43.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.807+0000 7ff084a00640 1 -- 172.21.15.87:0/2282251372 >> v1:172.21.15.87:6789/0 conn(0x7ff0801605d0 legacy=0x7ff0801609e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:43.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.807+0000 7ff084a00640 1 --2- 172.21.15.87:0/2282251372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff068003ad0 0x7ff068003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:43.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.807+0000 7ff084a00640 1 --2- 172.21.15.87:0/2282251372 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff068004810 0x7ff068004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:43.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.807+0000 7ff084a00640 1 --2- 172.21.15.87:0/2282251372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff068005360 0x7ff06800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:43.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.807+0000 7ff084a00640 1 -- 172.21.15.87:0/2282251372 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff0800ced60 con 0x7ff068003ad0 2024-05-27T06:27:43.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.807+0000 7ff084a00640 1 -- 172.21.15.87:0/2282251372 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff06800c260 con 0x7ff068005360 2024-05-27T06:27:43.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.807+0000 7ff084a00640 1 -- 172.21.15.87:0/2282251372 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff06800c460 con 0x7ff068004810 2024-05-27T06:27:43.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.811+0000 7ff085e00640 1 --2- 172.21.15.87:0/2282251372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff068003ad0 0x7ff068003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:43.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.811+0000 7ff086800640 1 --2- 172.21.15.87:0/2282251372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff068005360 0x7ff06800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:43.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.811+0000 7ff085400640 1 --2- 172.21.15.87:0/2282251372 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff068004810 0x7ff068004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:43.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.811+0000 7ff085e00640 1 -- 172.21.15.87:0/2282251372 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff068004810 msgr2=0x7ff068004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:43.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.811+0000 7ff085e00640 1 --2- 172.21.15.87:0/2282251372 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff068004810 0x7ff068004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:43.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.811+0000 7ff085e00640 1 -- 172.21.15.87:0/2282251372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff068005360 msgr2=0x7ff06800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:43.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.811+0000 7ff085e00640 1 --2- 172.21.15.87:0/2282251372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff068005360 0x7ff06800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:43.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.811+0000 7ff085e00640 1 -- 172.21.15.87:0/2282251372 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff068003530 con 0x7ff068003ad0 2024-05-27T06:27:43.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.811+0000 7ff086800640 1 --2- 172.21.15.87:0/2282251372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff068005360 0x7ff06800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:27:43.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.811+0000 7ff086800640 1 -- 172.21.15.87:0/2282251372 reap_dead start 2024-05-27T06:27:43.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.811+0000 7ff085e00640 1 --2- 172.21.15.87:0/2282251372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff068003ad0 0x7ff068003f40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff07400c210 tx=0x7ff07401cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7db8aec5dc74b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:43.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.811+0000 7ff084a00640 1 -- 172.21.15.87:0/2282251372 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff074007d70 con 0x7ff068003ad0 2024-05-27T06:27:43.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.811+0000 7ff084a00640 1 -- 172.21.15.87:0/2282251372 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0740a9020 con 0x7ff068003ad0 2024-05-27T06:27:43.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.811+0000 7ff084a00640 1 -- 172.21.15.87:0/2282251372 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff074005b00 con 0x7ff068003ad0 2024-05-27T06:27:43.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.815+0000 7ff088800640 1 -- 172.21.15.87:0/2282251372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff068003ad0 msgr2=0x7ff068003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:43.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.815+0000 7ff088800640 1 --2- 172.21.15.87:0/2282251372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff068003ad0 0x7ff068003f40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff07400c210 tx=0x7ff07401cba0 comp rx=0 tx=0).stop 2024-05-27T06:27:43.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.815+0000 7ff088800640 1 -- 172.21.15.87:0/2282251372 shutdown_connections 2024-05-27T06:27:43.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.815+0000 7ff088800640 1 --2- 172.21.15.87:0/2282251372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff068003ad0 0x7ff068003f40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:43.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.815+0000 7ff088800640 1 -- 172.21.15.87:0/2282251372 >> 172.21.15.87:0/2282251372 conn(0x7ff0800d3590 msgr2=0x7ff0800d39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:43.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.815+0000 7ff088800640 1 -- 172.21.15.87:0/2282251372 shutdown_connections 2024-05-27T06:27:43.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.815+0000 7ff088800640 1 -- 172.21.15.87:0/2282251372 wait complete. 2024-05-27T06:27:43.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.815+0000 7ff088800640 1 Processor -- start 2024-05-27T06:27:43.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.815+0000 7ff088800640 1 -- start start 2024-05-27T06:27:43.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.819+0000 7ff088800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff068003ad0 0x7ff0800b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:43.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.819+0000 7ff088800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff080151270 0x7ff08014df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:43.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.819+0000 7ff088800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0801fd840 0x7ff0801fdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:43.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.819+0000 7ff088800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff080163fa0 con 0x7ff068003ad0 2024-05-27T06:27:43.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.819+0000 7ff088800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff080163e20 con 0x7ff0801fd840 2024-05-27T06:27:43.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.819+0000 7ff088800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff080164120 con 0x7ff080151270 2024-05-27T06:27:43.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.819+0000 7ff085e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff068003ad0 0x7ff0800b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:43.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.819+0000 7ff085e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff068003ad0 0x7ff0800b21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60874/0 (socket says 172.21.15.87:60874) 2024-05-27T06:27:43.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.819+0000 7ff085e00640 1 -- 172.21.15.87:0/1533439503 learned_addr learned my addr 172.21.15.87:0/1533439503 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:43.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.819+0000 7ff085400640 1 --2- 172.21.15.87:0/1533439503 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff080151270 0x7ff08014df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:43.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.819+0000 7ff086800640 1 --2- 172.21.15.87:0/1533439503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0801fd840 0x7ff0801fdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:43.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.819+0000 7ff085e00640 1 -- 172.21.15.87:0/1533439503 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff080151270 msgr2=0x7ff08014df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:43.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.819+0000 7ff085e00640 1 --2- 172.21.15.87:0/1533439503 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff080151270 0x7ff08014df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:43.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.819+0000 7ff085e00640 1 -- 172.21.15.87:0/1533439503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0801fd840 msgr2=0x7ff0801fdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:43.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.819+0000 7ff085e00640 1 --2- 172.21.15.87:0/1533439503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0801fd840 0x7ff0801fdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:43.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.819+0000 7ff085e00640 1 -- 172.21.15.87:0/1533439503 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0801fe190 con 0x7ff068003ad0 2024-05-27T06:27:43.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.819+0000 7ff085e00640 1 --2- 172.21.15.87:0/1533439503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff068003ad0 0x7ff0800b21c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff07401c660 tx=0x7ff068005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:43.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.819+0000 7ff07a000640 1 -- 172.21.15.87:0/1533439503 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff074007d70 con 0x7ff068003ad0 2024-05-27T06:27:43.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.819+0000 7ff07a000640 1 -- 172.21.15.87:0/1533439503 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0740016e0 con 0x7ff068003ad0 2024-05-27T06:27:43.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.819+0000 7ff07a000640 1 -- 172.21.15.87:0/1533439503 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff074001cb0 con 0x7ff068003ad0 2024-05-27T06:27:43.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.819+0000 7ff088800640 1 -- 172.21.15.87:0/1533439503 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0800af870 con 0x7ff068003ad0 2024-05-27T06:27:43.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.819+0000 7ff088800640 1 -- 172.21.15.87:0/1533439503 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0800b7670 con 0x7ff068003ad0 2024-05-27T06:27:43.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.819+0000 7ff088800640 1 -- 172.21.15.87:0/1533439503 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff08006aa30 con 0x7ff068003ad0 2024-05-27T06:27:43.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.819+0000 7ff07a000640 1 -- 172.21.15.87:0/1533439503 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff0740bd060 con 0x7ff068003ad0 2024-05-27T06:27:43.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.823+0000 7ff07a000640 1 --2- 172.21.15.87:0/1533439503 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff06406f400 0x7ff064071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:43.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.823+0000 7ff07a000640 1 -- 172.21.15.87:0/1533439503 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff074128520 con 0x7ff068003ad0 2024-05-27T06:27:43.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.823+0000 7ff085400640 1 --2- 172.21.15.87:0/1533439503 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff06406f400 0x7ff064071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:43.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.823+0000 7ff085400640 1 --2- 172.21.15.87:0/1533439503 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff06406f400 0x7ff064071910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff070000c10 tx=0x7ff070009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:43.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:43.827+0000 7ff07a000640 1 -- 172.21.15.87:0/1533439503 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff0801fe190 con 0x7ff068003ad0 2024-05-27T06:27:44.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.015+0000 7ff088800640 1 -- 172.21.15.87:0/1533439503 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0800cfdf0 con 0x7ff068003ad0 2024-05-27T06:27:44.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.015+0000 7ff07a000640 1 -- 172.21.15.87:0/1533439503 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5177 (secure 0 0 0) 0x7ff080161000 con 0x7ff068003ad0 2024-05-27T06:27:44.015 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:27:44.015 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1075024068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1075024068},{"type":"v1","addr":"172.21.15.87:6835","nonce":1075024068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/437385084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":437385084},{"type":"v1","addr":"172.21.15.149:6833","nonce":437385084}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/852280291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":852280291},{"type":"v1","addr":"172.21.15.149:6835","nonce":852280291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T06:27:37.964959+0000","modified":"2024-05-27T06:27:43.049055+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/1799934036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1799934036},{"type":"v1","addr":"172.21.15.87:6837","nonce":1799934036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-27T06:27:44.015 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 7 2024-05-27T06:27:44.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.015+0000 7ff088800640 1 -- 172.21.15.87:0/1533439503 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff06406f400 msgr2=0x7ff064071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:44.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.015+0000 7ff088800640 1 --2- 172.21.15.87:0/1533439503 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff06406f400 0x7ff064071910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff070000c10 tx=0x7ff070009040 comp rx=0 tx=0).stop 2024-05-27T06:27:44.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.015+0000 7ff088800640 1 -- 172.21.15.87:0/1533439503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff068003ad0 msgr2=0x7ff0800b21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:44.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.015+0000 7ff088800640 1 --2- 172.21.15.87:0/1533439503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff068003ad0 0x7ff0800b21c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff07401c660 tx=0x7ff068005840 comp rx=0 tx=0).stop 2024-05-27T06:27:44.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.015+0000 7ff088800640 1 -- 172.21.15.87:0/1533439503 shutdown_connections 2024-05-27T06:27:44.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.015+0000 7ff088800640 1 --2- 172.21.15.87:0/1533439503 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff06406f400 0x7ff064071910 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.015+0000 7ff088800640 1 --2- 172.21.15.87:0/1533439503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0801fd840 0x7ff0801fdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.015+0000 7ff088800640 1 --2- 172.21.15.87:0/1533439503 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff080151270 0x7ff08014df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.015+0000 7ff088800640 1 --2- 172.21.15.87:0/1533439503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff068003ad0 0x7ff0800b21c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.015+0000 7ff088800640 1 -- 172.21.15.87:0/1533439503 >> 172.21.15.87:0/1533439503 conn(0x7ff0800d3590 msgr2=0x7ff08015fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:44.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.015+0000 7ff088800640 1 -- 172.21.15.87:0/1533439503 shutdown_connections 2024-05-27T06:27:44.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.015+0000 7ff088800640 1 -- 172.21.15.87:0/1533439503 wait complete. 2024-05-27T06:27:44.036 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T06:27:44.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.183+0000 7f9059000640 1 Processor -- start 2024-05-27T06:27:44.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.183+0000 7f9059000640 1 -- start start 2024-05-27T06:27:44.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.183+0000 7f9059000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f90540cea40 0x7f9054158360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:44.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.183+0000 7f9059000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90540b2fb0 0x7f90540b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:44.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.183+0000 7f9059000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90540b2cd0 con 0x7f90540d2010 2024-05-27T06:27:44.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.183+0000 7f9059000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f90540ce5b0 con 0x7f90540cea40 2024-05-27T06:27:44.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.183+0000 7f9059000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f90540cdc80 con 0x7f90540b2fb0 2024-05-27T06:27:44.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.183+0000 7f9052800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90540b2fb0 0x7f90540b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:44.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.183+0000 7f9051e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f90540cea40 0x7f9054158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:44.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.183+0000 7f9052800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90540b2fb0 0x7f90540b33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.87:41850/0 (socket says 172.21.15.87:41850) 2024-05-27T06:27:44.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.183+0000 7f9052800640 1 -- 172.21.15.87:0/487887000 learned_addr learned my addr 172.21.15.87:0/487887000 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:44.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.187+0000 7f9052800640 1 -- 172.21.15.87:0/487887000 >> v2:172.21.15.149:3300/0 conn(0x7f90540cea40 msgr2=0x7f9054158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:44.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.187+0000 7f9052800640 1 --2- 172.21.15.87:0/487887000 >> v2:172.21.15.149:3300/0 conn(0x7f90540cea40 0x7f9054158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.187+0000 7f9052800640 1 -- 172.21.15.87:0/487887000 >> v1:172.21.15.149:6789/0 conn(0x7f90540d2010 legacy=0x7f90540d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:44.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.187+0000 7f9052800640 1 -- 172.21.15.87:0/487887000 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90540cdf60 con 0x7f90540b2fb0 2024-05-27T06:27:44.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.187+0000 7f9052800640 1 --2- 172.21.15.87:0/487887000 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90540b2fb0 0x7f90540b33c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f904c009870 tx=0x7f904c01c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5082f8414ae6a09e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:44.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.187+0000 7f9051400640 1 -- 172.21.15.87:0/487887000 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c0a95f0 con 0x7f90540b2fb0 2024-05-27T06:27:44.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.187+0000 7f9051400640 1 -- 172.21.15.87:0/487887000 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f904c0a9790 con 0x7f90540b2fb0 2024-05-27T06:27:44.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.187+0000 7f9051400640 1 -- 172.21.15.87:0/487887000 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c0a9b60 con 0x7f90540b2fb0 2024-05-27T06:27:44.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.191+0000 7f9059000640 1 -- 172.21.15.87:0/487887000 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90540b2fb0 msgr2=0x7f90540b33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:44.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.191+0000 7f9059000640 1 --2- 172.21.15.87:0/487887000 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90540b2fb0 0x7f90540b33c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f904c009870 tx=0x7f904c01c530 comp rx=0 tx=0).stop 2024-05-27T06:27:44.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.191+0000 7f9059000640 1 -- 172.21.15.87:0/487887000 shutdown_connections 2024-05-27T06:27:44.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.191+0000 7f9059000640 1 --2- 172.21.15.87:0/487887000 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90540b2fb0 0x7f90540b33c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.191+0000 7f9059000640 1 --2- 172.21.15.87:0/487887000 >> v2:172.21.15.149:3300/0 conn(0x7f90540cea40 0x7f9054158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.191+0000 7f9059000640 1 -- 172.21.15.87:0/487887000 >> 172.21.15.87:0/487887000 conn(0x7f90540d3590 msgr2=0x7f90540d39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:44.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.191+0000 7f9059000640 1 -- 172.21.15.87:0/487887000 shutdown_connections 2024-05-27T06:27:44.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.191+0000 7f9059000640 1 -- 172.21.15.87:0/487887000 wait complete. 2024-05-27T06:27:44.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.191+0000 7f9059000640 1 Processor -- start 2024-05-27T06:27:44.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.191+0000 7f9059000640 1 -- start start 2024-05-27T06:27:44.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.191+0000 7f9059000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90540b2fb0 0x7f905414bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:44.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.195+0000 7f9059000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90540cea40 0x7f905415f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:44.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.195+0000 7f9059000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90540d2010 0x7f905415fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:44.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.195+0000 7f9059000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f90540d2ee0 con 0x7f90540b2fb0 2024-05-27T06:27:44.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.195+0000 7f9059000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f90540d2d60 con 0x7f90540d2010 2024-05-27T06:27:44.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.195+0000 7f9059000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f90540cee50 con 0x7f90540cea40 2024-05-27T06:27:44.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.195+0000 7f9051e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90540b2fb0 0x7f905414bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:44.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.195+0000 7f9051e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90540b2fb0 0x7f905414bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60884/0 (socket says 172.21.15.87:60884) 2024-05-27T06:27:44.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.195+0000 7f9051e00640 1 -- 172.21.15.87:0/2687132691 learned_addr learned my addr 172.21.15.87:0/2687132691 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:44.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.195+0000 7f9052800640 1 --2- 172.21.15.87:0/2687132691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90540d2010 0x7f905415fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:44.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.195+0000 7f9049400640 1 --2- 172.21.15.87:0/2687132691 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90540cea40 0x7f905415f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:44.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.195+0000 7f9051e00640 1 -- 172.21.15.87:0/2687132691 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90540cea40 msgr2=0x7f905415f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:44.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.195+0000 7f9051e00640 1 --2- 172.21.15.87:0/2687132691 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90540cea40 0x7f905415f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.195+0000 7f9051e00640 1 -- 172.21.15.87:0/2687132691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90540d2010 msgr2=0x7f905415fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:44.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.195+0000 7f9051e00640 1 --2- 172.21.15.87:0/2687132691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90540d2010 0x7f905415fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.195+0000 7f9051e00640 1 -- 172.21.15.87:0/2687132691 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9054156740 con 0x7f90540b2fb0 2024-05-27T06:27:44.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.195+0000 7f9052800640 1 --2- 172.21.15.87:0/2687132691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90540d2010 0x7f905415fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:27:44.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.195+0000 7f9049400640 1 --2- 172.21.15.87:0/2687132691 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90540cea40 0x7f905415f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:27:44.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.195+0000 7f9051e00640 1 --2- 172.21.15.87:0/2687132691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90540b2fb0 0x7f905414bc30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9044009cd0 tx=0x7f904400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:44.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.195+0000 7f904aa00640 1 -- 172.21.15.87:0/2687132691 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9044018020 con 0x7f90540b2fb0 2024-05-27T06:27:44.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.195+0000 7f904aa00640 1 -- 172.21.15.87:0/2687132691 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9044014480 con 0x7f90540b2fb0 2024-05-27T06:27:44.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.195+0000 7f9059000640 1 -- 172.21.15.87:0/2687132691 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9054156a20 con 0x7f90540b2fb0 2024-05-27T06:27:44.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.195+0000 7f904aa00640 1 -- 172.21.15.87:0/2687132691 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9044014850 con 0x7f90540b2fb0 2024-05-27T06:27:44.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.195+0000 7f9059000640 1 -- 172.21.15.87:0/2687132691 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9054158f90 con 0x7f90540b2fb0 2024-05-27T06:27:44.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.195+0000 7f9059000640 1 -- 172.21.15.87:0/2687132691 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90541591f0 con 0x7f90540b2fb0 2024-05-27T06:27:44.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.195+0000 7f904aa00640 1 -- 172.21.15.87:0/2687132691 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f904401b020 con 0x7f90540b2fb0 2024-05-27T06:27:44.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.199+0000 7f904aa00640 1 --2- 172.21.15.87:0/2687132691 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f903006f430 0x7f9030071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:44.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.199+0000 7f904aa00640 1 -- 172.21.15.87:0/2687132691 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f90440904a0 con 0x7f90540b2fb0 2024-05-27T06:27:44.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.199+0000 7f9049400640 1 --2- 172.21.15.87:0/2687132691 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f903006f430 0x7f9030071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:44.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.199+0000 7f9049400640 1 --2- 172.21.15.87:0/2687132691 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f903006f430 0x7f9030071940 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f90541fd7a0 tx=0x7f903c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:44.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.203+0000 7f904aa00640 1 -- 172.21.15.87:0/2687132691 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f9044022020 con 0x7f90540b2fb0 2024-05-27T06:27:44.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.359+0000 7f9059000640 1 -- 172.21.15.87:0/2687132691 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f905406aa30 con 0x7f90540b2fb0 2024-05-27T06:27:44.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.359+0000 7f904aa00640 1 -- 172.21.15.87:0/2687132691 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7f9044010040 con 0x7f90540b2fb0 2024-05-27T06:27:44.360 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:27:44.361 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:27:43.048854+0000","last_up_change":"2024-05-27T06:27:25.988592+0000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T06:27:26.590191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T06:27:35.840893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T06:27:36.929608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-27T06:27:40.638358+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6801","nonce":3674824716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6803","nonce":3674824716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6807","nonce":3674824716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6805","nonce":3674824716}]},"public_addr":"172.21.15.87:6801/3674824716","cluster_addr":"172.21.15.87:6803/3674824716","heartbeat_back_addr":"172.21.15.87:6807/3674824716","heartbeat_front_addr":"172.21.15.87:6805/3674824716","state":["exists","up"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6809","nonce":2443981288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6811","nonce":2443981288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6815","nonce":2443981288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6813","nonce":2443981288}]},"public_addr":"172.21.15.87:6809/2443981288","cluster_addr":"172.21.15.87:6811/2443981288","heartbeat_back_addr":"172.21.15.87:6815/2443981288","heartbeat_front_addr":"172.21.15.87:6813/2443981288","state":["exists","up"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6819","nonce":1441249238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6823","nonce":1441249238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6831","nonce":1441249238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6825","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6827","nonce":1441249238}]},"public_addr":"172.21.15.87:6819/1441249238","cluster_addr":"172.21.15.87:6823/1441249238","heartbeat_back_addr":"172.21.15.87:6831/1441249238","heartbeat_front_addr":"172.21.15.87:6827/1441249238","state":["exists","up"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6818","nonce":1173805234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6822","nonce":1173805234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6829","nonce":1173805234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6826","nonce":1173805234}]},"public_addr":"172.21.15.87:6818/1173805234","cluster_addr":"172.21.15.87:6822/1173805234","heartbeat_back_addr":"172.21.15.87:6829/1173805234","heartbeat_front_addr":"172.21.15.87:6826/1173805234","state":["exists","up"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6819","nonce":1551871079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6823","nonce":1551871079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6831","nonce":1551871079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6827","nonce":1551871079}]},"public_addr":"172.21.15.149:6819/1551871079","cluster_addr":"172.21.15.149:6823/1551871079","heartbeat_back_addr":"172.21.15.149:6831/1551871079","heartbeat_front_addr":"172.21.15.149:6827/1551871079","state":["exists","up"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6818","nonce":582864816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6822","nonce":582864816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6830","nonce":582864816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6826","nonce":582864816}]},"public_addr":"172.21.15.149:6818/582864816","cluster_addr":"172.21.15.149:6822/582864816","heartbeat_back_addr":"172.21.15.149:6830/582864816","heartbeat_front_addr":"172.21.15.149:6826/582864816","state":["exists","up"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6801","nonce":531351314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6803","nonce":531351314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6807","nonce":531351314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6805","nonce":531351314}]},"public_addr":"172.21.15.149:6801/531351314","cluster_addr":"172.21.15.149:6803/531351314","heartbeat_back_addr":"172.21.15.149:6807/531351314","heartbeat_front_addr":"172.21.15.149:6805/531351314","state":["exists","up"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6809","nonce":1171039913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6811","nonce":1171039913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6815","nonce":1171039913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6813","nonce":1171039913}]},"public_addr":"172.21.15.149:6809/1171039913","cluster_addr":"172.21.15.149:6811/1171039913","heartbeat_back_addr":"172.21.15.149:6815/1171039913","heartbeat_front_addr":"172.21.15.149:6813/1171039913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.589776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.819787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.767566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.683842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.038885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.120319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.687007+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.812832+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:27:44.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.363+0000 7f9059000640 1 -- 172.21.15.87:0/2687132691 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f903006f430 msgr2=0x7f9030071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:44.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.363+0000 7f9059000640 1 --2- 172.21.15.87:0/2687132691 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f903006f430 0x7f9030071940 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f90541fd7a0 tx=0x7f903c009040 comp rx=0 tx=0).stop 2024-05-27T06:27:44.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.363+0000 7f9059000640 1 -- 172.21.15.87:0/2687132691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90540b2fb0 msgr2=0x7f905414bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:44.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.363+0000 7f9059000640 1 --2- 172.21.15.87:0/2687132691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90540b2fb0 0x7f905414bc30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9044009cd0 tx=0x7f904400c490 comp rx=0 tx=0).stop 2024-05-27T06:27:44.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.363+0000 7f9059000640 1 -- 172.21.15.87:0/2687132691 shutdown_connections 2024-05-27T06:27:44.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.363+0000 7f9059000640 1 --2- 172.21.15.87:0/2687132691 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f903006f430 0x7f9030071940 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.363+0000 7f9059000640 1 --2- 172.21.15.87:0/2687132691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90540d2010 0x7f905415fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.363+0000 7f9059000640 1 --2- 172.21.15.87:0/2687132691 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90540cea40 0x7f905415f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.363+0000 7f9059000640 1 --2- 172.21.15.87:0/2687132691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90540b2fb0 0x7f905414bc30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.363+0000 7f9059000640 1 -- 172.21.15.87:0/2687132691 >> 172.21.15.87:0/2687132691 conn(0x7f90540d3590 msgr2=0x7f90540b6be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:44.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.363+0000 7f9059000640 1 -- 172.21.15.87:0/2687132691 shutdown_connections 2024-05-27T06:27:44.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.363+0000 7f9059000640 1 -- 172.21.15.87:0/2687132691 wait complete. 2024-05-27T06:27:44.382 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T06:27:44.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.527+0000 7f2d38e00640 1 Processor -- start 2024-05-27T06:27:44.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.527+0000 7f2d38e00640 1 -- start start 2024-05-27T06:27:44.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.531+0000 7f2d38e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d340cbf90 0x7f2d3406cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:44.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.531+0000 7f2d38e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2d3415d6f0 0x7f2d340d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:44.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.531+0000 7f2d38e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d3415dbb0 con 0x7f2d3406d500 2024-05-27T06:27:44.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.531+0000 7f2d38e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f2d3406d910 con 0x7f2d3415d6f0 2024-05-27T06:27:44.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.531+0000 7f2d38e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2d3415de90 con 0x7f2d340cbf90 2024-05-27T06:27:44.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.531+0000 7f2d32800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2d3415d6f0 0x7f2d340d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:44.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.531+0000 7f2d31e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d340cbf90 0x7f2d3406cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:44.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.531+0000 7f2d31e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d340cbf90 0x7f2d3406cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.87:41870/0 (socket says 172.21.15.87:41870) 2024-05-27T06:27:44.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.531+0000 7f2d31e00640 1 -- 172.21.15.87:0/3955879186 learned_addr learned my addr 172.21.15.87:0/3955879186 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:44.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.531+0000 7f2d32800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2d3415d6f0 0x7f2d340d1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:56578/0 (socket says 172.21.15.87:56578) 2024-05-27T06:27:44.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.531+0000 7f2d29400640 1 --1- 172.21.15.87:0/3955879186 >> v1:172.21.15.149:6789/0 conn(0x7f2d3406d500 0x7f2d3415cfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.87:44532/0 (socket says 172.21.15.87:44532) 2024-05-27T06:27:44.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.531+0000 7f2d31e00640 1 -- 172.21.15.87:0/3955879186 >> v2:172.21.15.149:3300/0 conn(0x7f2d3415d6f0 msgr2=0x7f2d340d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:44.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.531+0000 7f2d31e00640 1 --2- 172.21.15.87:0/3955879186 >> v2:172.21.15.149:3300/0 conn(0x7f2d3415d6f0 0x7f2d340d1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.531+0000 7f2d31e00640 1 -- 172.21.15.87:0/3955879186 >> v1:172.21.15.149:6789/0 conn(0x7f2d3406d500 legacy=0x7f2d3415cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:44.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.531+0000 7f2d31e00640 1 -- 172.21.15.87:0/3955879186 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d3406c7c0 con 0x7f2d340cbf90 2024-05-27T06:27:44.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.535+0000 7f2d31e00640 1 --2- 172.21.15.87:0/3955879186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d340cbf90 0x7f2d3406cfc0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2d24009870 tx=0x7f2d2401ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=164576e5fbec68fb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:44.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.535+0000 7f2d31400640 1 -- 172.21.15.87:0/3955879186 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d240b5070 con 0x7f2d340cbf90 2024-05-27T06:27:44.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.535+0000 7f2d31400640 1 -- 172.21.15.87:0/3955879186 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d240a8a70 con 0x7f2d340cbf90 2024-05-27T06:27:44.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.535+0000 7f2d31400640 1 -- 172.21.15.87:0/3955879186 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d240a8e40 con 0x7f2d340cbf90 2024-05-27T06:27:44.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.535+0000 7f2d38e00640 1 -- 172.21.15.87:0/3955879186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d340cbf90 msgr2=0x7f2d3406cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:44.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.535+0000 7f2d38e00640 1 --2- 172.21.15.87:0/3955879186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d340cbf90 0x7f2d3406cfc0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2d24009870 tx=0x7f2d2401ed70 comp rx=0 tx=0).stop 2024-05-27T06:27:44.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.535+0000 7f2d38e00640 1 -- 172.21.15.87:0/3955879186 shutdown_connections 2024-05-27T06:27:44.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.535+0000 7f2d38e00640 1 --2- 172.21.15.87:0/3955879186 >> v2:172.21.15.149:3300/0 conn(0x7f2d3415d6f0 0x7f2d340d1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.535+0000 7f2d38e00640 1 --2- 172.21.15.87:0/3955879186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d340cbf90 0x7f2d3406cfc0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.535+0000 7f2d38e00640 1 -- 172.21.15.87:0/3955879186 >> 172.21.15.87:0/3955879186 conn(0x7f2d340b46b0 msgr2=0x7f2d340b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:44.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.535+0000 7f2d38e00640 1 -- 172.21.15.87:0/3955879186 shutdown_connections 2024-05-27T06:27:44.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.535+0000 7f2d38e00640 1 -- 172.21.15.87:0/3955879186 wait complete. 2024-05-27T06:27:44.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.539+0000 7f2d38e00640 1 Processor -- start 2024-05-27T06:27:44.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.539+0000 7f2d38e00640 1 -- start start 2024-05-27T06:27:44.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.539+0000 7f2d38e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d3406d500 0x7f2d341e7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:44.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.539+0000 7f2d38e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d340cbf90 0x7f2d341e7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:44.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.539+0000 7f2d38e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d34156eb0 0x7f2d341f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:44.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.539+0000 7f2d38e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2d340cc3a0 con 0x7f2d340cbf90 2024-05-27T06:27:44.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.539+0000 7f2d38e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3415e170 con 0x7f2d34156eb0 2024-05-27T06:27:44.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.539+0000 7f2d38e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2d3406ec50 con 0x7f2d3406d500 2024-05-27T06:27:44.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.539+0000 7f2d29400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d340cbf90 0x7f2d341e7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:44.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.539+0000 7f2d29400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d340cbf90 0x7f2d341e7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60896/0 (socket says 172.21.15.87:60896) 2024-05-27T06:27:44.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.539+0000 7f2d29400640 1 -- 172.21.15.87:0/2857123440 learned_addr learned my addr 172.21.15.87:0/2857123440 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:44.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.539+0000 7f2d32800640 1 --2- 172.21.15.87:0/2857123440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d34156eb0 0x7f2d341f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:44.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.539+0000 7f2d31e00640 1 --2- 172.21.15.87:0/2857123440 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d3406d500 0x7f2d341e7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:44.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.539+0000 7f2d29400640 1 -- 172.21.15.87:0/2857123440 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d3406d500 msgr2=0x7f2d341e7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:44.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.539+0000 7f2d29400640 1 --2- 172.21.15.87:0/2857123440 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d3406d500 0x7f2d341e7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.539+0000 7f2d29400640 1 -- 172.21.15.87:0/2857123440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d34156eb0 msgr2=0x7f2d341f5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:44.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.539+0000 7f2d29400640 1 --2- 172.21.15.87:0/2857123440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d34156eb0 0x7f2d341f5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.539+0000 7f2d29400640 1 -- 172.21.15.87:0/2857123440 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d341f6e20 con 0x7f2d340cbf90 2024-05-27T06:27:44.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.539+0000 7f2d29400640 1 --2- 172.21.15.87:0/2857123440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d340cbf90 0x7f2d341e7b70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2d34074f70 tx=0x7f2d1c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:44.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.539+0000 7f2d2aa00640 1 -- 172.21.15.87:0/2857123440 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0074e0 con 0x7f2d340cbf90 2024-05-27T06:27:44.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.539+0000 7f2d2aa00640 1 -- 172.21.15.87:0/2857123440 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d1c007680 con 0x7f2d340cbf90 2024-05-27T06:27:44.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.539+0000 7f2d2aa00640 1 -- 172.21.15.87:0/2857123440 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c004a10 con 0x7f2d340cbf90 2024-05-27T06:27:44.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.539+0000 7f2d38e00640 1 -- 172.21.15.87:0/2857123440 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d341f7100 con 0x7f2d340cbf90 2024-05-27T06:27:44.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.539+0000 7f2d38e00640 1 -- 172.21.15.87:0/2857123440 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d34158bc0 con 0x7f2d340cbf90 2024-05-27T06:27:44.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.539+0000 7f2d38e00640 1 -- 172.21.15.87:0/2857123440 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d3406aa30 con 0x7f2d340cbf90 2024-05-27T06:27:44.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.543+0000 7f2d2aa00640 1 -- 172.21.15.87:0/2857123440 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2d1c01a020 con 0x7f2d340cbf90 2024-05-27T06:27:44.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.543+0000 7f2d2aa00640 1 --2- 172.21.15.87:0/2857123440 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2d1006f400 0x7f2d10071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:44.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.543+0000 7f2d2aa00640 1 -- 172.21.15.87:0/2857123440 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2d1c08eb60 con 0x7f2d340cbf90 2024-05-27T06:27:44.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.543+0000 7f2d31e00640 1 --2- 172.21.15.87:0/2857123440 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2d1006f400 0x7f2d10071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:44.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.543+0000 7f2d31e00640 1 --2- 172.21.15.87:0/2857123440 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2d1006f400 0x7f2d10071910 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2d240b2000 tx=0x7f2d24008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:44.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.547+0000 7f2d2aa00640 1 -- 172.21.15.87:0/2857123440 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f2d1c05b0b0 con 0x7f2d340cbf90 2024-05-27T06:27:44.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.711+0000 7f2d38e00640 1 -- 172.21.15.87:0/2857123440 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2d341f6b40 con 0x7f2d340cbf90 2024-05-27T06:27:44.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.711+0000 7f2d2aa00640 1 -- 172.21.15.87:0/2857123440 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7f2d1c05f3b0 con 0x7f2d340cbf90 2024-05-27T06:27:44.711 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:27:44.711 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:27:43.048854+0000","last_up_change":"2024-05-27T06:27:25.988592+0000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T06:27:26.590191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T06:27:35.840893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T06:27:36.929608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-27T06:27:40.638358+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6801","nonce":3674824716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6803","nonce":3674824716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6807","nonce":3674824716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6805","nonce":3674824716}]},"public_addr":"172.21.15.87:6801/3674824716","cluster_addr":"172.21.15.87:6803/3674824716","heartbeat_back_addr":"172.21.15.87:6807/3674824716","heartbeat_front_addr":"172.21.15.87:6805/3674824716","state":["exists","up"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6809","nonce":2443981288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6811","nonce":2443981288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6815","nonce":2443981288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6813","nonce":2443981288}]},"public_addr":"172.21.15.87:6809/2443981288","cluster_addr":"172.21.15.87:6811/2443981288","heartbeat_back_addr":"172.21.15.87:6815/2443981288","heartbeat_front_addr":"172.21.15.87:6813/2443981288","state":["exists","up"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6819","nonce":1441249238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6823","nonce":1441249238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6831","nonce":1441249238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6825","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6827","nonce":1441249238}]},"public_addr":"172.21.15.87:6819/1441249238","cluster_addr":"172.21.15.87:6823/1441249238","heartbeat_back_addr":"172.21.15.87:6831/1441249238","heartbeat_front_addr":"172.21.15.87:6827/1441249238","state":["exists","up"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6818","nonce":1173805234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6822","nonce":1173805234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6829","nonce":1173805234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6826","nonce":1173805234}]},"public_addr":"172.21.15.87:6818/1173805234","cluster_addr":"172.21.15.87:6822/1173805234","heartbeat_back_addr":"172.21.15.87:6829/1173805234","heartbeat_front_addr":"172.21.15.87:6826/1173805234","state":["exists","up"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6819","nonce":1551871079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6823","nonce":1551871079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6831","nonce":1551871079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6827","nonce":1551871079}]},"public_addr":"172.21.15.149:6819/1551871079","cluster_addr":"172.21.15.149:6823/1551871079","heartbeat_back_addr":"172.21.15.149:6831/1551871079","heartbeat_front_addr":"172.21.15.149:6827/1551871079","state":["exists","up"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6818","nonce":582864816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6822","nonce":582864816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6830","nonce":582864816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6826","nonce":582864816}]},"public_addr":"172.21.15.149:6818/582864816","cluster_addr":"172.21.15.149:6822/582864816","heartbeat_back_addr":"172.21.15.149:6830/582864816","heartbeat_front_addr":"172.21.15.149:6826/582864816","state":["exists","up"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6801","nonce":531351314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6803","nonce":531351314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6807","nonce":531351314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6805","nonce":531351314}]},"public_addr":"172.21.15.149:6801/531351314","cluster_addr":"172.21.15.149:6803/531351314","heartbeat_back_addr":"172.21.15.149:6807/531351314","heartbeat_front_addr":"172.21.15.149:6805/531351314","state":["exists","up"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6809","nonce":1171039913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6811","nonce":1171039913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6815","nonce":1171039913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6813","nonce":1171039913}]},"public_addr":"172.21.15.149:6809/1171039913","cluster_addr":"172.21.15.149:6811/1171039913","heartbeat_back_addr":"172.21.15.149:6815/1171039913","heartbeat_front_addr":"172.21.15.149:6813/1171039913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.589776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.819787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.767566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.683842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.038885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.120319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.687007+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.812832+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:27:44.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.715+0000 7f2d38e00640 1 -- 172.21.15.87:0/2857123440 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2d1006f400 msgr2=0x7f2d10071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:44.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.715+0000 7f2d38e00640 1 --2- 172.21.15.87:0/2857123440 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2d1006f400 0x7f2d10071910 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2d240b2000 tx=0x7f2d24008040 comp rx=0 tx=0).stop 2024-05-27T06:27:44.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.715+0000 7f2d38e00640 1 -- 172.21.15.87:0/2857123440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d340cbf90 msgr2=0x7f2d341e7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:44.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.715+0000 7f2d38e00640 1 --2- 172.21.15.87:0/2857123440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d340cbf90 0x7f2d341e7b70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2d34074f70 tx=0x7f2d1c001e80 comp rx=0 tx=0).stop 2024-05-27T06:27:44.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.715+0000 7f2d38e00640 1 -- 172.21.15.87:0/2857123440 shutdown_connections 2024-05-27T06:27:44.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.715+0000 7f2d38e00640 1 --2- 172.21.15.87:0/2857123440 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2d1006f400 0x7f2d10071910 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.715+0000 7f2d38e00640 1 --2- 172.21.15.87:0/2857123440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d34156eb0 0x7f2d341f5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.715+0000 7f2d38e00640 1 --2- 172.21.15.87:0/2857123440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d340cbf90 0x7f2d341e7b70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.715+0000 7f2d38e00640 1 --2- 172.21.15.87:0/2857123440 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d3406d500 0x7f2d341e7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.715+0000 7f2d38e00640 1 -- 172.21.15.87:0/2857123440 >> 172.21.15.87:0/2857123440 conn(0x7f2d340b46b0 msgr2=0x7f2d340cc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:44.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.715+0000 7f2d38e00640 1 -- 172.21.15.87:0/2857123440 shutdown_connections 2024-05-27T06:27:44.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.715+0000 7f2d38e00640 1 -- 172.21.15.87:0/2857123440 wait complete. 2024-05-27T06:27:44.750 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T06:27:44.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.895+0000 7f9fbda00640 1 Processor -- start 2024-05-27T06:27:44.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.895+0000 7f9fbda00640 1 -- start start 2024-05-27T06:27:44.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.899+0000 7f9fbda00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9fb815fe80 0x7f9fb8072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:44.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.899+0000 7f9fbda00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9fb80d1e50 0x7f9fb806f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:44.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.899+0000 7f9fbda00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fb806ec40 con 0x7f9fb806d0b0 2024-05-27T06:27:44.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.899+0000 7f9fbda00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f9fb8070960 con 0x7f9fb815fe80 2024-05-27T06:27:44.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.899+0000 7f9fbda00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f9fb806d4c0 con 0x7f9fb80d1e50 2024-05-27T06:27:44.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.899+0000 7f9fb6a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9fb815fe80 0x7f9fb8072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:44.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.899+0000 7f9fb6a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9fb815fe80 0x7f9fb8072aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59722/0 (socket says 172.21.15.87:59722) 2024-05-27T06:27:44.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.899+0000 7f9fb6a00640 1 -- 172.21.15.87:0/3927145217 learned_addr learned my addr 172.21.15.87:0/3927145217 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:44.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.899+0000 7f9fae000640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f9fb806d0b0 0x7f9fb80d1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45404/0 (socket says 172.21.15.87:45404) 2024-05-27T06:27:44.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.899+0000 7f9fb7400640 1 --2- 172.21.15.87:0/3927145217 >> v2:172.21.15.149:3300/0 conn(0x7f9fb80d1e50 0x7f9fb806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:44.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.899+0000 7f9fb6a00640 1 -- 172.21.15.87:0/3927145217 >> v2:172.21.15.149:3300/0 conn(0x7f9fb80d1e50 msgr2=0x7f9fb806f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:44.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.899+0000 7f9fb6a00640 1 --2- 172.21.15.87:0/3927145217 >> v2:172.21.15.149:3300/0 conn(0x7f9fb80d1e50 0x7f9fb806f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.899+0000 7f9fb6a00640 1 -- 172.21.15.87:0/3927145217 >> v1:172.21.15.87:6789/0 conn(0x7f9fb806d0b0 legacy=0x7f9fb80d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:44.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.899+0000 7f9fb6a00640 1 -- 172.21.15.87:0/3927145217 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb80703a0 con 0x7f9fb815fe80 2024-05-27T06:27:44.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.899+0000 7f9fb6000640 1 -- 172.21.15.87:0/3927145217 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3172212082 0 0) 0x7f9fb806ec40 con 0x7f9fb806d0b0 2024-05-27T06:27:44.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.903+0000 7f9fb6a00640 1 --2- 172.21.15.87:0/3927145217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fb815fe80 0x7f9fb8072aa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8074c40 tx=0x7f9fa801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f2973b2f839454 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:44.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.903+0000 7f9fb6000640 1 -- 172.21.15.87:0/3927145217 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa80a5630 con 0x7f9fb815fe80 2024-05-27T06:27:44.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.903+0000 7f9fb6000640 1 -- 172.21.15.87:0/3927145217 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa80a57d0 con 0x7f9fb815fe80 2024-05-27T06:27:44.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.903+0000 7f9fb6000640 1 -- 172.21.15.87:0/3927145217 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa80a5ba0 con 0x7f9fb815fe80 2024-05-27T06:27:44.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.903+0000 7f9fbda00640 1 -- 172.21.15.87:0/3927145217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fb815fe80 msgr2=0x7f9fb8072aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:44.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.903+0000 7f9fbda00640 1 --2- 172.21.15.87:0/3927145217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fb815fe80 0x7f9fb8072aa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8074c40 tx=0x7f9fa801c9f0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.903+0000 7f9fbda00640 1 -- 172.21.15.87:0/3927145217 shutdown_connections 2024-05-27T06:27:44.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.903+0000 7f9fbda00640 1 --2- 172.21.15.87:0/3927145217 >> v2:172.21.15.149:3300/0 conn(0x7f9fb80d1e50 0x7f9fb806f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.903+0000 7f9fbda00640 1 --2- 172.21.15.87:0/3927145217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fb815fe80 0x7f9fb8072aa0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.903+0000 7f9fbda00640 1 -- 172.21.15.87:0/3927145217 >> 172.21.15.87:0/3927145217 conn(0x7f9fb80b46b0 msgr2=0x7f9fb80b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:44.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.903+0000 7f9fbda00640 1 -- 172.21.15.87:0/3927145217 shutdown_connections 2024-05-27T06:27:44.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.903+0000 7f9fbda00640 1 -- 172.21.15.87:0/3927145217 wait complete. 2024-05-27T06:27:44.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.907+0000 7f9fbda00640 1 Processor -- start 2024-05-27T06:27:44.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.907+0000 7f9fbda00640 1 -- start start 2024-05-27T06:27:44.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.907+0000 7f9fbda00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fb806d0b0 0x7f9fb809eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:44.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.907+0000 7f9fbda00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fb815fe80 0x7f9fb815b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:44.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.907+0000 7f9fbda00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fb80ae950 0x7f9fb80aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:44.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.907+0000 7f9fbda00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb816ccd0 con 0x7f9fb806d0b0 2024-05-27T06:27:44.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.907+0000 7f9fbda00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb816cb50 con 0x7f9fb815fe80 2024-05-27T06:27:44.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.907+0000 7f9fbda00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9fb816ce50 con 0x7f9fb80ae950 2024-05-27T06:27:44.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.907+0000 7f9fb6a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fb806d0b0 0x7f9fb809eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:44.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.907+0000 7f9fb6a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fb806d0b0 0x7f9fb809eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59732/0 (socket says 172.21.15.87:59732) 2024-05-27T06:27:44.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.907+0000 7f9fb6a00640 1 -- 172.21.15.87:0/4242455723 learned_addr learned my addr 172.21.15.87:0/4242455723 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:44.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.907+0000 7f9fae000640 1 --2- 172.21.15.87:0/4242455723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fb815fe80 0x7f9fb815b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:44.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.907+0000 7f9fb6a00640 1 -- 172.21.15.87:0/4242455723 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fb80ae950 msgr2=0x7f9fb80aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:44.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.907+0000 7f9fb7400640 1 --2- 172.21.15.87:0/4242455723 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fb80ae950 0x7f9fb80aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:44.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.907+0000 7f9fb6a00640 1 --2- 172.21.15.87:0/4242455723 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fb80ae950 0x7f9fb80aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.907+0000 7f9fb6a00640 1 -- 172.21.15.87:0/4242455723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fb815fe80 msgr2=0x7f9fb815b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:44.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.907+0000 7f9fb6a00640 1 --2- 172.21.15.87:0/4242455723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fb815fe80 0x7f9fb815b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:44.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.907+0000 7f9fb6a00640 1 -- 172.21.15.87:0/4242455723 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb80af2a0 con 0x7f9fb806d0b0 2024-05-27T06:27:44.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.907+0000 7f9fb7400640 1 --2- 172.21.15.87:0/4242455723 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fb80ae950 0x7f9fb80aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:27:44.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.907+0000 7f9fae000640 1 --2- 172.21.15.87:0/4242455723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fb815fe80 0x7f9fb815b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:27:44.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.907+0000 7f9fb6a00640 1 --2- 172.21.15.87:0/4242455723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fb806d0b0 0x7f9fb809eed0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9fa80af040 tx=0x7f9fa8019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:44.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.907+0000 7f9faf400640 1 -- 172.21.15.87:0/4242455723 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa80b8670 con 0x7f9fb806d0b0 2024-05-27T06:27:44.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.907+0000 7f9faf400640 1 -- 172.21.15.87:0/4242455723 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa80be070 con 0x7f9fb806d0b0 2024-05-27T06:27:44.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.907+0000 7f9fbda00640 1 -- 172.21.15.87:0/4242455723 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fb81630a0 con 0x7f9fb806d0b0 2024-05-27T06:27:44.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.907+0000 7f9faf400640 1 -- 172.21.15.87:0/4242455723 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa80b8a70 con 0x7f9fb806d0b0 2024-05-27T06:27:44.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.907+0000 7f9fbda00640 1 -- 172.21.15.87:0/4242455723 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fb80cbee0 con 0x7f9fb806d0b0 2024-05-27T06:27:44.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.911+0000 7f9fbda00640 1 -- 172.21.15.87:0/4242455723 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fb806aa30 con 0x7f9fb806d0b0 2024-05-27T06:27:44.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.911+0000 7f9faf400640 1 -- 172.21.15.87:0/4242455723 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9fa80b8c10 con 0x7f9fb806d0b0 2024-05-27T06:27:44.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.911+0000 7f9faf400640 1 --2- 172.21.15.87:0/4242455723 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9f9406f400 0x7f9f94071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:44.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.911+0000 7f9faf400640 1 -- 172.21.15.87:0/4242455723 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9fa812a690 con 0x7f9fb806d0b0 2024-05-27T06:27:44.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.911+0000 7f9fae000640 1 --2- 172.21.15.87:0/4242455723 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9f9406f400 0x7f9f94071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:44.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.911+0000 7f9fae000640 1 --2- 172.21.15.87:0/4242455723 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9f9406f400 0x7f9f94071910 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9fb815fad0 tx=0x7f9fa0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:44.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:44.915+0000 7f9faf400640 1 -- 172.21.15.87:0/4242455723 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f9fb80af2a0 con 0x7f9fb806d0b0 2024-05-27T06:27:45.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.107+0000 7f9fbda00640 1 -- 172.21.15.87:0/4242455723 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9fb806f1c0 con 0x7f9fb806d0b0 2024-05-27T06:27:45.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.107+0000 7f9faf400640 1 -- 172.21.15.87:0/4242455723 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5177 (secure 0 0 0) 0x7f9fa80165e0 con 0x7f9fb806d0b0 2024-05-27T06:27:45.109 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:27:45.109 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1075024068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1075024068},{"type":"v1","addr":"172.21.15.87:6835","nonce":1075024068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/437385084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":437385084},{"type":"v1","addr":"172.21.15.149:6833","nonce":437385084}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/852280291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":852280291},{"type":"v1","addr":"172.21.15.149:6835","nonce":852280291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T06:27:37.964959+0000","modified":"2024-05-27T06:27:43.049055+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/1799934036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1799934036},{"type":"v1","addr":"172.21.15.87:6837","nonce":1799934036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-27T06:27:45.109 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 7 2024-05-27T06:27:45.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.111+0000 7f9fbda00640 1 -- 172.21.15.87:0/4242455723 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9f9406f400 msgr2=0x7f9f94071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:45.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.111+0000 7f9fbda00640 1 --2- 172.21.15.87:0/4242455723 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9f9406f400 0x7f9f94071910 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9fb815fad0 tx=0x7f9fa0009040 comp rx=0 tx=0).stop 2024-05-27T06:27:45.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.111+0000 7f9fbda00640 1 -- 172.21.15.87:0/4242455723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fb806d0b0 msgr2=0x7f9fb809eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:45.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.111+0000 7f9fbda00640 1 --2- 172.21.15.87:0/4242455723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fb806d0b0 0x7f9fb809eed0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9fa80af040 tx=0x7f9fa8019790 comp rx=0 tx=0).stop 2024-05-27T06:27:45.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.111+0000 7f9fbda00640 1 -- 172.21.15.87:0/4242455723 shutdown_connections 2024-05-27T06:27:45.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.111+0000 7f9fbda00640 1 --2- 172.21.15.87:0/4242455723 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9f9406f400 0x7f9f94071910 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:45.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.111+0000 7f9fbda00640 1 --2- 172.21.15.87:0/4242455723 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fb80ae950 0x7f9fb80aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:45.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.111+0000 7f9fbda00640 1 --2- 172.21.15.87:0/4242455723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fb815fe80 0x7f9fb815b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:45.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.111+0000 7f9fbda00640 1 --2- 172.21.15.87:0/4242455723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fb806d0b0 0x7f9fb809eed0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:45.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.111+0000 7f9fbda00640 1 -- 172.21.15.87:0/4242455723 >> 172.21.15.87:0/4242455723 conn(0x7f9fb80b46b0 msgr2=0x7f9fb80b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:45.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.111+0000 7f9fbda00640 1 -- 172.21.15.87:0/4242455723 shutdown_connections 2024-05-27T06:27:45.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.111+0000 7f9fbda00640 1 -- 172.21.15.87:0/4242455723 wait complete. 2024-05-27T06:27:45.131 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T06:27:45.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.275+0000 7f5ca4000640 1 Processor -- start 2024-05-27T06:27:45.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.279+0000 7f5ca4000640 1 -- start start 2024-05-27T06:27:45.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.279+0000 7f5ca4000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c9c072aa0 0x7f5c9c06d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:45.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.279+0000 7f5ca4000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5c9c072eb0 0x7f5c9c0d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:45.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.279+0000 7f5ca4000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c9c0cd120 con 0x7f5c9c06dd60 2024-05-27T06:27:45.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.279+0000 7f5ca4000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f5c9c0cdd30 con 0x7f5c9c072eb0 2024-05-27T06:27:45.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.279+0000 7f5ca4000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5c9c0cd400 con 0x7f5c9c072aa0 2024-05-27T06:27:45.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.279+0000 7f5ca0c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5c9c072eb0 0x7f5c9c0d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:45.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.279+0000 7f5ca0c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5c9c072eb0 0x7f5c9c0d1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59740/0 (socket says 172.21.15.87:59740) 2024-05-27T06:27:45.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.279+0000 7f5ca0c00640 1 -- 172.21.15.87:0/3517656395 learned_addr learned my addr 172.21.15.87:0/3517656395 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:45.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.279+0000 7f5ca1600640 1 --2- 172.21.15.87:0/3517656395 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c9c072aa0 0x7f5c9c06d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:45.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.279+0000 7f5ca0c00640 1 -- 172.21.15.87:0/3517656395 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c9c072aa0 msgr2=0x7f5c9c06d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:45.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.279+0000 7f5ca0c00640 1 --2- 172.21.15.87:0/3517656395 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c9c072aa0 0x7f5c9c06d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:45.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.279+0000 7f5ca0c00640 1 -- 172.21.15.87:0/3517656395 >> v1:172.21.15.149:6789/0 conn(0x7f5c9c06dd60 legacy=0x7f5c9c0ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:45.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.279+0000 7f5ca0c00640 1 -- 172.21.15.87:0/3517656395 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c9c0cd6e0 con 0x7f5c9c072eb0 2024-05-27T06:27:45.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.283+0000 7f5ca0c00640 1 --2- 172.21.15.87:0/3517656395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c9c072eb0 0x7f5c9c0d1740 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5c88009870 tx=0x7f5c8801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455583ebcd3af24a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:45.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.283+0000 7f5c9be00640 1 -- 172.21.15.87:0/3517656395 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c880a9610 con 0x7f5c9c072eb0 2024-05-27T06:27:45.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.283+0000 7f5c9be00640 1 -- 172.21.15.87:0/3517656395 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c880a97b0 con 0x7f5c9c072eb0 2024-05-27T06:27:45.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.283+0000 7f5c9be00640 1 -- 172.21.15.87:0/3517656395 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c880a9b80 con 0x7f5c9c072eb0 2024-05-27T06:27:45.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.283+0000 7f5ca4000640 1 -- 172.21.15.87:0/3517656395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c9c072eb0 msgr2=0x7f5c9c0d1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:45.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.283+0000 7f5ca4000640 1 --2- 172.21.15.87:0/3517656395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c9c072eb0 0x7f5c9c0d1740 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5c88009870 tx=0x7f5c8801c530 comp rx=0 tx=0).stop 2024-05-27T06:27:45.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.283+0000 7f5ca4000640 1 -- 172.21.15.87:0/3517656395 shutdown_connections 2024-05-27T06:27:45.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.283+0000 7f5ca4000640 1 --2- 172.21.15.87:0/3517656395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c9c072eb0 0x7f5c9c0d1740 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:45.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.283+0000 7f5ca4000640 1 --2- 172.21.15.87:0/3517656395 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c9c072aa0 0x7f5c9c06d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:45.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.283+0000 7f5ca4000640 1 -- 172.21.15.87:0/3517656395 >> 172.21.15.87:0/3517656395 conn(0x7f5c9c0b46b0 msgr2=0x7f5c9c0b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:45.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.283+0000 7f5ca4000640 1 -- 172.21.15.87:0/3517656395 shutdown_connections 2024-05-27T06:27:45.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.283+0000 7f5ca4000640 1 -- 172.21.15.87:0/3517656395 wait complete. 2024-05-27T06:27:45.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.287+0000 7f5ca4000640 1 Processor -- start 2024-05-27T06:27:45.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.287+0000 7f5ca4000640 1 -- start start 2024-05-27T06:27:45.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.287+0000 7f5ca4000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c9c06dd60 0x7f5c9c159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:45.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.287+0000 7f5ca4000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c9c072aa0 0x7f5c9c15cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:45.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.287+0000 7f5ca4000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c9c072eb0 0x7f5c9c166c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:45.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.287+0000 7f5ca4000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5c9c16b230 con 0x7f5c9c072eb0 2024-05-27T06:27:45.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.287+0000 7f5ca4000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5c9c16b0b0 con 0x7f5c9c06dd60 2024-05-27T06:27:45.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.287+0000 7f5ca4000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5c9c16b3b0 con 0x7f5c9c072aa0 2024-05-27T06:27:45.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.287+0000 7f5ca2000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c9c072eb0 0x7f5c9c166c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:45.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.287+0000 7f5ca2000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c9c072eb0 0x7f5c9c166c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59756/0 (socket says 172.21.15.87:59756) 2024-05-27T06:27:45.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.287+0000 7f5ca2000640 1 -- 172.21.15.87:0/2489665520 learned_addr learned my addr 172.21.15.87:0/2489665520 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:45.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.287+0000 7f5ca1600640 1 --2- 172.21.15.87:0/2489665520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c9c06dd60 0x7f5c9c159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:45.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.287+0000 7f5ca0c00640 1 --2- 172.21.15.87:0/2489665520 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c9c072aa0 0x7f5c9c15cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:45.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.287+0000 7f5ca2000640 1 -- 172.21.15.87:0/2489665520 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c9c072aa0 msgr2=0x7f5c9c15cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:45.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.287+0000 7f5ca2000640 1 --2- 172.21.15.87:0/2489665520 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c9c072aa0 0x7f5c9c15cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:45.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.287+0000 7f5ca2000640 1 -- 172.21.15.87:0/2489665520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c9c06dd60 msgr2=0x7f5c9c159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:45.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.287+0000 7f5ca2000640 1 --2- 172.21.15.87:0/2489665520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c9c06dd60 0x7f5c9c159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:45.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.287+0000 7f5ca2000640 1 -- 172.21.15.87:0/2489665520 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c9c1f9cb0 con 0x7f5c9c072eb0 2024-05-27T06:27:45.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.287+0000 7f5ca2000640 1 --2- 172.21.15.87:0/2489665520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c9c072eb0 0x7f5c9c166c40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5c9400c740 tx=0x7f5c9400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:45.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.287+0000 7f5c99600640 1 -- 172.21.15.87:0/2489665520 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c94003b80 con 0x7f5c9c072eb0 2024-05-27T06:27:45.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.287+0000 7f5c99600640 1 -- 172.21.15.87:0/2489665520 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c9400ce50 con 0x7f5c9c072eb0 2024-05-27T06:27:45.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.287+0000 7f5ca4000640 1 -- 172.21.15.87:0/2489665520 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c9c1f9f90 con 0x7f5c9c072eb0 2024-05-27T06:27:45.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.287+0000 7f5c99600640 1 -- 172.21.15.87:0/2489665520 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9400a850 con 0x7f5c9c072eb0 2024-05-27T06:27:45.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.287+0000 7f5ca4000640 1 -- 172.21.15.87:0/2489665520 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c9c1fa550 con 0x7f5c9c072eb0 2024-05-27T06:27:45.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.291+0000 7f5ca4000640 1 -- 172.21.15.87:0/2489665520 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c9c06aa30 con 0x7f5c9c072eb0 2024-05-27T06:27:45.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.291+0000 7f5c99600640 1 -- 172.21.15.87:0/2489665520 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5c9400a9f0 con 0x7f5c9c072eb0 2024-05-27T06:27:45.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.291+0000 7f5c99600640 1 --2- 172.21.15.87:0/2489665520 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5c7c06f400 0x7f5c7c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:45.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.291+0000 7f5c99600640 1 -- 172.21.15.87:0/2489665520 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5c9408f360 con 0x7f5c9c072eb0 2024-05-27T06:27:45.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.291+0000 7f5ca1600640 1 --2- 172.21.15.87:0/2489665520 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5c7c06f400 0x7f5c7c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:45.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.291+0000 7f5ca1600640 1 --2- 172.21.15.87:0/2489665520 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5c7c06f400 0x7f5c7c071910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009ac0 tx=0x7f5c90009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:45.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.295+0000 7f5c99600640 1 -- 172.21.15.87:0/2489665520 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f5c9405b8c0 con 0x7f5c9c072eb0 2024-05-27T06:27:45.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.455+0000 7f5ca4000640 1 -- 172.21.15.87:0/2489665520 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5c9c168310 con 0x7f5c9c072eb0 2024-05-27T06:27:45.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.455+0000 7f5c99600640 1 -- 172.21.15.87:0/2489665520 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7f5c9405fbc0 con 0x7f5c9c072eb0 2024-05-27T06:27:45.456 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:27:45.456 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:27:43.048854+0000","last_up_change":"2024-05-27T06:27:25.988592+0000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T06:27:26.590191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T06:27:35.840893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T06:27:36.929608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-27T06:27:40.638358+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6801","nonce":3674824716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6803","nonce":3674824716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6807","nonce":3674824716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6805","nonce":3674824716}]},"public_addr":"172.21.15.87:6801/3674824716","cluster_addr":"172.21.15.87:6803/3674824716","heartbeat_back_addr":"172.21.15.87:6807/3674824716","heartbeat_front_addr":"172.21.15.87:6805/3674824716","state":["exists","up"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6809","nonce":2443981288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6811","nonce":2443981288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6815","nonce":2443981288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6813","nonce":2443981288}]},"public_addr":"172.21.15.87:6809/2443981288","cluster_addr":"172.21.15.87:6811/2443981288","heartbeat_back_addr":"172.21.15.87:6815/2443981288","heartbeat_front_addr":"172.21.15.87:6813/2443981288","state":["exists","up"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6819","nonce":1441249238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6823","nonce":1441249238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6831","nonce":1441249238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6825","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6827","nonce":1441249238}]},"public_addr":"172.21.15.87:6819/1441249238","cluster_addr":"172.21.15.87:6823/1441249238","heartbeat_back_addr":"172.21.15.87:6831/1441249238","heartbeat_front_addr":"172.21.15.87:6827/1441249238","state":["exists","up"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6818","nonce":1173805234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6822","nonce":1173805234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6829","nonce":1173805234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6826","nonce":1173805234}]},"public_addr":"172.21.15.87:6818/1173805234","cluster_addr":"172.21.15.87:6822/1173805234","heartbeat_back_addr":"172.21.15.87:6829/1173805234","heartbeat_front_addr":"172.21.15.87:6826/1173805234","state":["exists","up"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6819","nonce":1551871079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6823","nonce":1551871079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6831","nonce":1551871079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6827","nonce":1551871079}]},"public_addr":"172.21.15.149:6819/1551871079","cluster_addr":"172.21.15.149:6823/1551871079","heartbeat_back_addr":"172.21.15.149:6831/1551871079","heartbeat_front_addr":"172.21.15.149:6827/1551871079","state":["exists","up"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6818","nonce":582864816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6822","nonce":582864816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6830","nonce":582864816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6826","nonce":582864816}]},"public_addr":"172.21.15.149:6818/582864816","cluster_addr":"172.21.15.149:6822/582864816","heartbeat_back_addr":"172.21.15.149:6830/582864816","heartbeat_front_addr":"172.21.15.149:6826/582864816","state":["exists","up"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6801","nonce":531351314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6803","nonce":531351314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6807","nonce":531351314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6805","nonce":531351314}]},"public_addr":"172.21.15.149:6801/531351314","cluster_addr":"172.21.15.149:6803/531351314","heartbeat_back_addr":"172.21.15.149:6807/531351314","heartbeat_front_addr":"172.21.15.149:6805/531351314","state":["exists","up"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6809","nonce":1171039913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6811","nonce":1171039913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6815","nonce":1171039913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6813","nonce":1171039913}]},"public_addr":"172.21.15.149:6809/1171039913","cluster_addr":"172.21.15.149:6811/1171039913","heartbeat_back_addr":"172.21.15.149:6815/1171039913","heartbeat_front_addr":"172.21.15.149:6813/1171039913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.589776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.819787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.767566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.683842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.038885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.120319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.687007+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.812832+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:27:45.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.459+0000 7f5ca4000640 1 -- 172.21.15.87:0/2489665520 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5c7c06f400 msgr2=0x7f5c7c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:45.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.459+0000 7f5ca4000640 1 --2- 172.21.15.87:0/2489665520 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5c7c06f400 0x7f5c7c071910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009ac0 tx=0x7f5c90009190 comp rx=0 tx=0).stop 2024-05-27T06:27:45.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.459+0000 7f5ca4000640 1 -- 172.21.15.87:0/2489665520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c9c072eb0 msgr2=0x7f5c9c166c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:45.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.459+0000 7f5ca4000640 1 --2- 172.21.15.87:0/2489665520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c9c072eb0 0x7f5c9c166c40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5c9400c740 tx=0x7f5c9400cc00 comp rx=0 tx=0).stop 2024-05-27T06:27:45.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.459+0000 7f5ca4000640 1 -- 172.21.15.87:0/2489665520 shutdown_connections 2024-05-27T06:27:45.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.459+0000 7f5ca4000640 1 --2- 172.21.15.87:0/2489665520 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5c7c06f400 0x7f5c7c071910 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:45.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.459+0000 7f5ca4000640 1 --2- 172.21.15.87:0/2489665520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c9c072eb0 0x7f5c9c166c40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:45.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.459+0000 7f5ca4000640 1 --2- 172.21.15.87:0/2489665520 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c9c072aa0 0x7f5c9c15cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:45.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.459+0000 7f5ca4000640 1 --2- 172.21.15.87:0/2489665520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c9c06dd60 0x7f5c9c159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:45.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.459+0000 7f5ca4000640 1 -- 172.21.15.87:0/2489665520 >> 172.21.15.87:0/2489665520 conn(0x7f5c9c0b46b0 msgr2=0x7f5c9c0ae400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:45.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.459+0000 7f5ca4000640 1 -- 172.21.15.87:0/2489665520 shutdown_connections 2024-05-27T06:27:45.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:45.459+0000 7f5ca4000640 1 -- 172.21.15.87:0/2489665520 wait complete. 2024-05-27T06:27:45.880 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-27T06:27:37.964959+0000', 'modified': '2024-05-27T06:27:43.049055+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.87:6837/1799934036', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6836', 'nonce': 1799934036}, {'type': 'v1', 'addr': '172.21.15.87:6837', 'nonce': 1799934036}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4290, 'qdb_cluster': [4290]} 2024-05-27T06:27:45.880 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-27T06:27:45.880 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-27T06:27:46.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.027+0000 7f14df600640 1 Processor -- start 2024-05-27T06:27:46.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.027+0000 7f14df600640 1 -- start start 2024-05-27T06:27:46.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.031+0000 7f14df600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14d80aec30 0x7f14d80702b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:46.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.031+0000 7f14df600640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14d806fe20 con 0x7f14d806c720 2024-05-27T06:27:46.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.031+0000 7f14df600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14d80b0ba0 con 0x7f14d806efc0 2024-05-27T06:27:46.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.031+0000 7f14df600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f14d815ef50 con 0x7f14d80aec30 2024-05-27T06:27:46.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.031+0000 7f14dd600640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f14d806c720 0x7f14d806cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45410/0 (socket says 172.21.15.87:45410) 2024-05-27T06:27:46.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.031+0000 7f14dd600640 1 -- 172.21.15.87:0/30153204 learned_addr learned my addr 172.21.15.87:0/30153204 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:27:46.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.031+0000 7f14dcc00640 1 --2- 172.21.15.87:0/30153204 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14d80aec30 0x7f14d80702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:46.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.031+0000 7f14d7e00640 1 -- 172.21.15.87:0/30153204 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 786862659 0 0) 0x7f14d806fe20 con 0x7f14d806c720 2024-05-27T06:27:46.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.031+0000 7f14d7e00640 1 -- 172.21.15.87:0/30153204 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14bc003530 con 0x7f14d806c720 2024-05-27T06:27:46.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.031+0000 7f14d7e00640 1 -- 172.21.15.87:0/30153204 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3023969296 0 0) 0x7f14d80b0ba0 con 0x7f14d806efc0 2024-05-27T06:27:46.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.031+0000 7f14d7e00640 1 -- 172.21.15.87:0/30153204 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14d806fe20 con 0x7f14d806efc0 2024-05-27T06:27:46.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.031+0000 7f14d7e00640 1 -- 172.21.15.87:0/30153204 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4256240751 0 0) 0x7f14bc003530 con 0x7f14d806c720 2024-05-27T06:27:46.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.031+0000 7f14dcc00640 1 -- 172.21.15.87:0/30153204 >> v1:172.21.15.149:6789/0 conn(0x7f14d806efc0 legacy=0x7f14d806f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:46.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.031+0000 7f14dcc00640 1 -- 172.21.15.87:0/30153204 >> v1:172.21.15.87:6789/0 conn(0x7f14d806c720 legacy=0x7f14d806cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:46.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.031+0000 7f14dcc00640 1 -- 172.21.15.87:0/30153204 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14d80b08c0 con 0x7f14d80aec30 2024-05-27T06:27:46.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.035+0000 7f14dcc00640 1 --2- 172.21.15.87:0/30153204 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14d80aec30 0x7f14d80702b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f14c80097f0 tx=0x7f14c801c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10441ad88d6cde6b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:46.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.035+0000 7f14d7e00640 1 -- 172.21.15.87:0/30153204 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c80b0070 con 0x7f14d80aec30 2024-05-27T06:27:46.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.035+0000 7f14d7e00640 1 -- 172.21.15.87:0/30153204 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14c80ab400 con 0x7f14d80aec30 2024-05-27T06:27:46.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.035+0000 7f14d7e00640 1 -- 172.21.15.87:0/30153204 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d0001a80 con 0x7f14d80aec30 2024-05-27T06:27:46.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.035+0000 7f14df600640 1 -- 172.21.15.87:0/30153204 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14d80aec30 msgr2=0x7f14d80702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:46.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.035+0000 7f14df600640 1 --2- 172.21.15.87:0/30153204 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14d80aec30 0x7f14d80702b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f14c80097f0 tx=0x7f14c801c2e0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.035+0000 7f14df600640 1 -- 172.21.15.87:0/30153204 shutdown_connections 2024-05-27T06:27:46.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.035+0000 7f14df600640 1 --2- 172.21.15.87:0/30153204 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14d80aec30 0x7f14d80702b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.035+0000 7f14df600640 1 -- 172.21.15.87:0/30153204 >> 172.21.15.87:0/30153204 conn(0x7f14d80b2fb0 msgr2=0x7f14d80b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:46.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.035+0000 7f14df600640 1 -- 172.21.15.87:0/30153204 shutdown_connections 2024-05-27T06:27:46.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.035+0000 7f14df600640 1 -- 172.21.15.87:0/30153204 wait complete. 2024-05-27T06:27:46.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.035+0000 7f14df600640 1 Processor -- start 2024-05-27T06:27:46.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.035+0000 7f14df600640 1 -- start start 2024-05-27T06:27:46.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.039+0000 7f14df600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14d806c720 0x7f14d814f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:46.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.039+0000 7f14df600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14d806efc0 0x7f14d8151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:46.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.039+0000 7f14df600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14d80aec30 0x7f14d8151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:46.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.039+0000 7f14df600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f14d806e0c0 con 0x7f14d80aec30 2024-05-27T06:27:46.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.039+0000 7f14df600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f14d806df40 con 0x7f14d806efc0 2024-05-27T06:27:46.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.039+0000 7f14df600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f14d80707f0 con 0x7f14d806c720 2024-05-27T06:27:46.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.039+0000 7f14dd600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14d80aec30 0x7f14d8151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:46.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.039+0000 7f14dd600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14d80aec30 0x7f14d8151ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59766/0 (socket says 172.21.15.87:59766) 2024-05-27T06:27:46.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.039+0000 7f14dd600640 1 -- 172.21.15.87:0/3582061233 learned_addr learned my addr 172.21.15.87:0/3582061233 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:46.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.039+0000 7f14dcc00640 1 --2- 172.21.15.87:0/3582061233 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14d806c720 0x7f14d814f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:46.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.039+0000 7f14cfe00640 1 --2- 172.21.15.87:0/3582061233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14d806efc0 0x7f14d8151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:46.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.039+0000 7f14dd600640 1 -- 172.21.15.87:0/3582061233 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14d806c720 msgr2=0x7f14d814f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:46.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.039+0000 7f14dd600640 1 --2- 172.21.15.87:0/3582061233 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14d806c720 0x7f14d814f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.039+0000 7f14dd600640 1 -- 172.21.15.87:0/3582061233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14d806efc0 msgr2=0x7f14d8151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:46.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.039+0000 7f14dd600640 1 --2- 172.21.15.87:0/3582061233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14d806efc0 0x7f14d8151590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.039+0000 7f14dd600640 1 -- 172.21.15.87:0/3582061233 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14d815d110 con 0x7f14d80aec30 2024-05-27T06:27:46.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.039+0000 7f14cfe00640 1 --2- 172.21.15.87:0/3582061233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14d806efc0 0x7f14d8151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:27:46.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.039+0000 7f14dd600640 1 --2- 172.21.15.87:0/3582061233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14d80aec30 0x7f14d8151ad0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f14d0002240 tx=0x7f14d000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:46.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.039+0000 7f14d5600640 1 -- 172.21.15.87:0/3582061233 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d0017070 con 0x7f14d80aec30 2024-05-27T06:27:46.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.039+0000 7f14d5600640 1 -- 172.21.15.87:0/3582061233 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d000ad40 con 0x7f14d80aec30 2024-05-27T06:27:46.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.039+0000 7f14d5600640 1 -- 172.21.15.87:0/3582061233 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d0012600 con 0x7f14d80aec30 2024-05-27T06:27:46.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.039+0000 7f14df600640 1 -- 172.21.15.87:0/3582061233 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14d806d9c0 con 0x7f14d80aec30 2024-05-27T06:27:46.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.039+0000 7f14df600640 1 -- 172.21.15.87:0/3582061233 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14d8152180 con 0x7f14d80aec30 2024-05-27T06:27:46.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.043+0000 7f14d5600640 1 -- 172.21.15.87:0/3582061233 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f14d001a070 con 0x7f14d80aec30 2024-05-27T06:27:46.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.043+0000 7f14d5600640 1 --2- 172.21.15.87:0/3582061233 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f14b406f430 0x7f14b4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:46.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.043+0000 7f14d5600640 1 -- 172.21.15.87:0/3582061233 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f14d008f360 con 0x7f14d80aec30 2024-05-27T06:27:46.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.043+0000 7f14e6d39000 1 Processor -- start 2024-05-27T06:27:46.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.043+0000 7f14dcc00640 1 --2- 172.21.15.87:0/3582061233 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f14b406f430 0x7f14b4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:46.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.043+0000 7f14e6d39000 1 -- start start 2024-05-27T06:27:46.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.043+0000 7f14dcc00640 1 --2- 172.21.15.87:0/3582061233 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f14b406f430 0x7f14b4071940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f14c80ad000 tx=0x7f14c80a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:46.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14e6d39000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eaa0ad21f0 0x55eaa0c1bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:46.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14e6d39000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55eaa0acaf90 0x55eaa0c1c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:46.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14e6d39000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0ab4a60 0x55eaa0c1c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:46.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14e6d39000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55eaa0a2e6f0 con 0x55eaa0ab4a60 2024-05-27T06:27:46.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14e6d39000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55eaa0a1e290 con 0x55eaa0ad21f0 2024-05-27T06:27:46.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14e6d39000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55eaa0a222d0 con 0x55eaa0acaf90 2024-05-27T06:27:46.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14dd600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0ab4a60 0x55eaa0c1c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:46.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14dd600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0ab4a60 0x55eaa0c1c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59776/0 (socket says 172.21.15.87:59776) 2024-05-27T06:27:46.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14dd600640 1 -- 172.21.15.87:0/3014006900 learned_addr learned my addr 172.21.15.87:0/3014006900 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:46.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14cfe00640 1 --2- 172.21.15.87:0/3014006900 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55eaa0acaf90 0x55eaa0c1c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:46.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14dcc00640 1 --2- 172.21.15.87:0/3014006900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eaa0ad21f0 0x55eaa0c1bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:46.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14dd600640 1 -- 172.21.15.87:0/3014006900 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55eaa0acaf90 msgr2=0x55eaa0c1c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:46.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14dd600640 1 --2- 172.21.15.87:0/3014006900 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55eaa0acaf90 0x55eaa0c1c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14dd600640 1 -- 172.21.15.87:0/3014006900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eaa0ad21f0 msgr2=0x55eaa0c1bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:46.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14dd600640 1 --2- 172.21.15.87:0/3014006900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eaa0ad21f0 0x55eaa0c1bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14dd600640 1 -- 172.21.15.87:0/3014006900 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eaa09fcc10 con 0x55eaa0ab4a60 2024-05-27T06:27:46.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14dd600640 1 --2- 172.21.15.87:0/3014006900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0ab4a60 0x55eaa0c1c6e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f14d005b840 tx=0x7f14d005b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3d840b5a5b7203 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:46.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14cd200640 1 -- 172.21.15.87:0/3014006900 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d0062110 con 0x55eaa0ab4a60 2024-05-27T06:27:46.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14cd200640 1 -- 172.21.15.87:0/3014006900 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d00645d0 con 0x55eaa0ab4a60 2024-05-27T06:27:46.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14cd200640 1 -- 172.21.15.87:0/3014006900 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d0064340 con 0x55eaa0ab4a60 2024-05-27T06:27:46.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14e6d39000 1 -- 172.21.15.87:0/3014006900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0ab4a60 msgr2=0x55eaa0c1c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:46.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14e6d39000 1 --2- 172.21.15.87:0/3014006900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0ab4a60 0x55eaa0c1c6e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f14d005b840 tx=0x7f14d005b480 comp rx=0 tx=0).stop 2024-05-27T06:27:46.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14e6d39000 1 -- 172.21.15.87:0/3014006900 shutdown_connections 2024-05-27T06:27:46.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14e6d39000 1 --2- 172.21.15.87:0/3014006900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0ab4a60 0x55eaa0c1c6e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14e6d39000 1 --2- 172.21.15.87:0/3014006900 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55eaa0acaf90 0x55eaa0c1c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14e6d39000 1 --2- 172.21.15.87:0/3014006900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eaa0ad21f0 0x55eaa0c1bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14e6d39000 1 -- 172.21.15.87:0/3014006900 >> 172.21.15.87:0/3014006900 conn(0x55eaa0ad8db0 msgr2=0x55eaa0bfec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:46.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14e6d39000 1 -- 172.21.15.87:0/3014006900 shutdown_connections 2024-05-27T06:27:46.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14e6d39000 1 -- 172.21.15.87:0/3014006900 wait complete. 2024-05-27T06:27:46.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14e6d39000 1 -- start start 2024-05-27T06:27:46.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.047+0000 7f14e6d39000 1 Processor -- start 2024-05-27T06:27:46.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14e6d39000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eaa0ab4a60 0x55eaa0bda270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:46.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14e6d39000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0acaf90 0x55eaa0bdd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:46.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14e6d39000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55eaa0ad21f0 0x55eaa0bddb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:46.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14e6d39000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55eaa09b67d0 con 0x55eaa0acaf90 2024-05-27T06:27:46.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14e6d39000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55eaa0a26900 con 0x55eaa0ab4a60 2024-05-27T06:27:46.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14e6d39000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55eaa09cb1a0 con 0x55eaa0ad21f0 2024-05-27T06:27:46.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14e6d39000 10 client.0 _ll_register_callbacks cb 0x55eaa0bbd560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T06:27:46.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14cfe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0acaf90 0x55eaa0bdd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:46.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14cfe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0acaf90 0x55eaa0bdd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59788/0 (socket says 172.21.15.87:59788) 2024-05-27T06:27:46.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14cfe00640 1 -- 172.21.15.87:0/1123450113 learned_addr learned my addr 172.21.15.87:0/1123450113 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:46.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14dcc00640 1 --2- 172.21.15.87:0/1123450113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eaa0ab4a60 0x55eaa0bda270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:46.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14dd600640 1 --2- 172.21.15.87:0/1123450113 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55eaa0ad21f0 0x55eaa0bddb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:46.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14cfe00640 1 -- 172.21.15.87:0/1123450113 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55eaa0ad21f0 msgr2=0x55eaa0bddb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:46.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14cfe00640 1 --2- 172.21.15.87:0/1123450113 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55eaa0ad21f0 0x55eaa0bddb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14cfe00640 1 -- 172.21.15.87:0/1123450113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eaa0ab4a60 msgr2=0x55eaa0bda270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:46.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14cfe00640 1 --2- 172.21.15.87:0/1123450113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eaa0ab4a60 0x55eaa0bda270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14cfe00640 1 -- 172.21.15.87:0/1123450113 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eaa0a669d0 con 0x55eaa0acaf90 2024-05-27T06:27:46.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14dcc00640 1 --2- 172.21.15.87:0/1123450113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eaa0ab4a60 0x55eaa0bda270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:27:46.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14cfe00640 1 --2- 172.21.15.87:0/1123450113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0acaf90 0x55eaa0bdd640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f14c0001e50 tx=0x7f14c0001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ceb05f3c01ee48 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:46.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14c5600640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-27T06:27:46.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14c5600640 1 -- 172.21.15.87:0/1123450113 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c00050d0 con 0x55eaa0acaf90 2024-05-27T06:27:46.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14c5600640 1 -- 172.21.15.87:0/1123450113 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f14c0005270 con 0x55eaa0acaf90 2024-05-27T06:27:46.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14e6d39000 1 -- 172.21.15.87:0/1123450113 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14d00645d0 con 0x55eaa0acaf90 2024-05-27T06:27:46.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14c5600640 1 -- 172.21.15.87:0/1123450113 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f14c0020050 con 0x55eaa0acaf90 2024-05-27T06:27:46.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14e6d39000 10 client.4392 fetch_fsmap learned FSMap version 7 2024-05-27T06:27:46.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14e6d39000 1 -- 172.21.15.87:0/1123450113 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55eaa09f9530 con 0x55eaa0acaf90 2024-05-27T06:27:46.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14c5600640 1 -- 172.21.15.87:0/1123450113 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d00645d0 con 0x55eaa0acaf90 2024-05-27T06:27:46.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14c5600640 1 -- 172.21.15.87:0/1123450113 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7f14c0023020 con 0x55eaa0acaf90 2024-05-27T06:27:46.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14e6d39000 10 client.4392 fetch_fsmap finished waiting for FSMap version 7 2024-05-27T06:27:46.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14e6d39000 10 client.4392 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-27T06:27:46.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14e6d39000 20 client.4392 populate_metadata read hostname 'smithi087' 2024-05-27T06:27:46.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14e6d39000 1 --2- 172.21.15.87:0/1123450113 >> [v2:172.21.15.87:6836/1799934036,v1:172.21.15.87:6837/1799934036] conn(0x55eaa06c67d0 0x55eaa0c22b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:46.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14e6d39000 4 client.4392 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T06:27:46.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14e6d39000 1 -- 172.21.15.87:0/1123450113 --> [v2:172.21.15.87:6836/1799934036,v1:172.21.15.87:6837/1799934036] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eaa09b9be0 con 0x55eaa06c67d0 2024-05-27T06:27:46.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14dcc00640 1 --2- 172.21.15.87:0/1123450113 >> [v2:172.21.15.87:6836/1799934036,v1:172.21.15.87:6837/1799934036] conn(0x55eaa06c67d0 0x55eaa0c22b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:46.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14c5600640 10 client.4392 ms_handle_connect on v2:172.21.15.87:6836/1799934036 2024-05-27T06:27:46.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.051+0000 7f14dcc00640 1 --2- 172.21.15.87:0/1123450113 >> [v2:172.21.15.87:6836/1799934036,v1:172.21.15.87:6837/1799934036] conn(0x55eaa06c67d0 0x55eaa0c22b70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=292df967edeafd9a server_cookie=dbc6b46535c387c4 in_seq=0 out_seq=0 2024-05-27T06:27:46.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.055+0000 7f14c5600640 1 -- 172.21.15.87:0/1123450113 <== mds.0 v2:172.21.15.87:6836/1799934036 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55eaa09b9be0 con 0x55eaa06c67d0 2024-05-27T06:27:46.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.055+0000 7f14c5600640 10 client.4392 handle_command_reply: tid=0 2024-05-27T06:27:46.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.055+0000 7f14e6d39000 1 client.4392 shutdown 2024-05-27T06:27:46.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.055+0000 7f14e6d39000 1 -- 172.21.15.87:0/1123450113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0acaf90 msgr2=0x55eaa0bdd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:46.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.055+0000 7f14e6d39000 1 --2- 172.21.15.87:0/1123450113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0acaf90 0x55eaa0bdd640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f14c0001e50 tx=0x7f14c0001e80 comp rx=0 tx=0).stop 2024-05-27T06:27:46.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.055+0000 7f14e6d39000 1 -- 172.21.15.87:0/1123450113 shutdown_connections 2024-05-27T06:27:46.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.055+0000 7f14e6d39000 1 --2- 172.21.15.87:0/1123450113 >> [v2:172.21.15.87:6836/1799934036,v1:172.21.15.87:6837/1799934036] conn(0x55eaa06c67d0 0x55eaa0c22b70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.055+0000 7f14e6d39000 1 --2- 172.21.15.87:0/1123450113 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55eaa0ad21f0 0x55eaa0bddb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.055+0000 7f14e6d39000 1 --2- 172.21.15.87:0/1123450113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0acaf90 0x55eaa0bdd640 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.055+0000 7f14e6d39000 1 --2- 172.21.15.87:0/1123450113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eaa0ab4a60 0x55eaa0bda270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.055+0000 7f14c5600640 0 client.4392 ms_handle_reset on v2:172.21.15.87:6836/1799934036 2024-05-27T06:27:46.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.055+0000 7f14e6d39000 1 -- 172.21.15.87:0/1123450113 >> 172.21.15.87:0/1123450113 conn(0x55eaa0ad8db0 msgr2=0x55eaa0bd36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:46.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.055+0000 7f14e6d39000 1 -- 172.21.15.87:0/1123450113 shutdown_connections 2024-05-27T06:27:46.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.055+0000 7f14e6d39000 1 -- 172.21.15.87:0/1123450113 wait complete. 2024-05-27T06:27:46.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.055+0000 7f14e6d39000 20 client.4392 trim_cache size 0 max 16384 2024-05-27T06:27:46.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.071+0000 7f14e6d39000 1 Processor -- start 2024-05-27T06:27:46.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.071+0000 7f14e6d39000 1 -- start start 2024-05-27T06:27:46.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14e6d39000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0ab4a60 0x55eaa0c89ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:46.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14e6d39000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eaa0acaf90 0x55eaa0c8a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:46.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14e6d39000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55eaa0ad21f0 0x55eaa0c8a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:46.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14e6d39000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f14d8206480 con 0x55eaa0ab4a60 2024-05-27T06:27:46.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14e6d39000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f14d81577f0 con 0x55eaa0acaf90 2024-05-27T06:27:46.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14e6d39000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f14d8205f80 con 0x55eaa0ad21f0 2024-05-27T06:27:46.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14dcc00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0ab4a60 0x55eaa0c89ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:46.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14dcc00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0ab4a60 0x55eaa0c89ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59792/0 (socket says 172.21.15.87:59792) 2024-05-27T06:27:46.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14dcc00640 1 -- 172.21.15.87:0/197999812 learned_addr learned my addr 172.21.15.87:0/197999812 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:46.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14dcc00640 1 -- 172.21.15.87:0/197999812 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55eaa0ad21f0 msgr2=0x55eaa0c8a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:46.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14dcc00640 1 --2- 172.21.15.87:0/197999812 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55eaa0ad21f0 0x55eaa0c8a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14dcc00640 1 -- 172.21.15.87:0/197999812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eaa0acaf90 msgr2=0x55eaa0c8a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:46.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14dcc00640 1 --2- 172.21.15.87:0/197999812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eaa0acaf90 0x55eaa0c8a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14dcc00640 1 -- 172.21.15.87:0/197999812 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eaa09bf880 con 0x55eaa0ab4a60 2024-05-27T06:27:46.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14dcc00640 1 --2- 172.21.15.87:0/197999812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0ab4a60 0x55eaa0c89ea0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f14c8009160 tx=0x7f14c8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7643ba3457de723b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:46.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14c7e00640 1 -- 172.21.15.87:0/197999812 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c80b0040 con 0x55eaa0ab4a60 2024-05-27T06:27:46.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14c7e00640 1 -- 172.21.15.87:0/197999812 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14c80d0410 con 0x55eaa0ab4a60 2024-05-27T06:27:46.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14c7e00640 1 -- 172.21.15.87:0/197999812 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c80d07c0 con 0x55eaa0ab4a60 2024-05-27T06:27:46.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14e6d39000 1 -- 172.21.15.87:0/197999812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0ab4a60 msgr2=0x55eaa0c89ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:46.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14e6d39000 1 --2- 172.21.15.87:0/197999812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0ab4a60 0x55eaa0c89ea0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f14c8009160 tx=0x7f14c8004740 comp rx=0 tx=0).stop 2024-05-27T06:27:46.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14e6d39000 1 -- 172.21.15.87:0/197999812 shutdown_connections 2024-05-27T06:27:46.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14e6d39000 1 --2- 172.21.15.87:0/197999812 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55eaa0ad21f0 0x55eaa0c8a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14e6d39000 1 --2- 172.21.15.87:0/197999812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eaa0acaf90 0x55eaa0c8a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14e6d39000 1 --2- 172.21.15.87:0/197999812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0ab4a60 0x55eaa0c89ea0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14e6d39000 1 -- 172.21.15.87:0/197999812 >> 172.21.15.87:0/197999812 conn(0x55eaa0ad8db0 msgr2=0x55eaa0bfebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:46.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14e6d39000 1 -- 172.21.15.87:0/197999812 shutdown_connections 2024-05-27T06:27:46.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14e6d39000 1 -- 172.21.15.87:0/197999812 wait complete. 2024-05-27T06:27:46.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.075+0000 7f14e6d39000 1 -- start start 2024-05-27T06:27:46.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14e6d39000 1 Processor -- start 2024-05-27T06:27:46.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14e6d39000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eaa0ab4a60 0x55eaa0c8e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:46.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14e6d39000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55eaa0acaf90 0x55eaa0c8ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:46.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14e6d39000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0ad21f0 0x55eaa0c27670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:46.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14e6d39000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55eaa0aa2590 con 0x55eaa0ad21f0 2024-05-27T06:27:46.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14e6d39000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55eaa09e1650 con 0x55eaa0ab4a60 2024-05-27T06:27:46.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14e6d39000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55eaa0a2d4c0 con 0x55eaa0acaf90 2024-05-27T06:27:46.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14e6d39000 10 client.0 _ll_register_callbacks cb 0x7f14c0007d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T06:27:46.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14dd600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0ad21f0 0x55eaa0c27670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:46.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14dd600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0ad21f0 0x55eaa0c27670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59808/0 (socket says 172.21.15.87:59808) 2024-05-27T06:27:46.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14dd600640 1 -- 172.21.15.87:0/396775067 learned_addr learned my addr 172.21.15.87:0/396775067 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:46.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14dd600640 1 -- 172.21.15.87:0/396775067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55eaa0acaf90 msgr2=0x55eaa0c8ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:46.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14dd600640 1 --2- 172.21.15.87:0/396775067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55eaa0acaf90 0x55eaa0c8ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14dd600640 1 -- 172.21.15.87:0/396775067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eaa0ab4a60 msgr2=0x55eaa0c8e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:46.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14dcc00640 1 --2- 172.21.15.87:0/396775067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eaa0ab4a60 0x55eaa0c8e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:46.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14dd600640 1 --2- 172.21.15.87:0/396775067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eaa0ab4a60 0x55eaa0c8e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14dd600640 1 -- 172.21.15.87:0/396775067 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eaa09d5ea0 con 0x55eaa0ad21f0 2024-05-27T06:27:46.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14dcc00640 1 --2- 172.21.15.87:0/396775067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eaa0ab4a60 0x55eaa0c8e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:27:46.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14dd600640 1 --2- 172.21.15.87:0/396775067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0ad21f0 0x55eaa0c27670 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f14d005ba70 tx=0x7f14d008d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c23373887713487 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:46.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14c5600640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-27T06:27:46.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14c5600640 1 -- 172.21.15.87:0/396775067 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d0062110 con 0x55eaa0ad21f0 2024-05-27T06:27:46.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14c5600640 1 -- 172.21.15.87:0/396775067 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f14d0070dd0 con 0x55eaa0ad21f0 2024-05-27T06:27:46.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14e6d39000 1 -- 172.21.15.87:0/396775067 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14c80d0410 con 0x55eaa0ad21f0 2024-05-27T06:27:46.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14c5600640 1 -- 172.21.15.87:0/396775067 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f14d00645d0 con 0x55eaa0ad21f0 2024-05-27T06:27:46.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14e6d39000 10 client.4398 fetch_fsmap learned FSMap version 7 2024-05-27T06:27:46.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14e6d39000 1 -- 172.21.15.87:0/396775067 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55eaa0aa2a20 con 0x55eaa0ad21f0 2024-05-27T06:27:46.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14c5600640 1 -- 172.21.15.87:0/396775067 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14c80d0410 con 0x55eaa0ad21f0 2024-05-27T06:27:46.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14c5600640 1 -- 172.21.15.87:0/396775067 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7f14d0004b70 con 0x55eaa0ad21f0 2024-05-27T06:27:46.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14e6d39000 10 client.4398 fetch_fsmap finished waiting for FSMap version 7 2024-05-27T06:27:46.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14e6d39000 10 client.4398 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-27T06:27:46.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14e6d39000 20 client.4398 populate_metadata read hostname 'smithi087' 2024-05-27T06:27:46.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14e6d39000 1 --2- 172.21.15.87:0/396775067 >> [v2:172.21.15.87:6836/1799934036,v1:172.21.15.87:6837/1799934036] conn(0x55eaa06b4830 0x55eaa0c27fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:46.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14e6d39000 4 client.4398 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-27T06:27:46.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14e6d39000 1 -- 172.21.15.87:0/396775067 --> [v2:172.21.15.87:6836/1799934036,v1:172.21.15.87:6837/1799934036] -- command(tid 0: {"prefix": "status"}) -- 0x55eaa09bdde0 con 0x55eaa06b4830 2024-05-27T06:27:46.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14dcc00640 1 --2- 172.21.15.87:0/396775067 >> [v2:172.21.15.87:6836/1799934036,v1:172.21.15.87:6837/1799934036] conn(0x55eaa06b4830 0x55eaa0c27fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:46.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14c5600640 10 client.4398 ms_handle_connect on v2:172.21.15.87:6836/1799934036 2024-05-27T06:27:46.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.079+0000 7f14dcc00640 1 --2- 172.21.15.87:0/396775067 >> [v2:172.21.15.87:6836/1799934036,v1:172.21.15.87:6837/1799934036] conn(0x55eaa06b4830 0x55eaa0c27fa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57334ccdf522fd97 server_cookie=1ad862747cee705d in_seq=0 out_seq=0 2024-05-27T06:27:46.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.083+0000 7f14c5600640 1 -- 172.21.15.87:0/396775067 <== mds.0 v2:172.21.15.87:6836/1799934036 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55eaa09bdde0 con 0x55eaa06b4830 2024-05-27T06:27:46.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.083+0000 7f14c5600640 10 client.4398 handle_command_reply: tid=0 2024-05-27T06:27:46.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.083+0000 7f14e6d39000 1 client.4398 shutdown 2024-05-27T06:27:46.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.083+0000 7f14e6d39000 1 -- 172.21.15.87:0/396775067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0ad21f0 msgr2=0x55eaa0c27670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:46.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.083+0000 7f14e6d39000 1 --2- 172.21.15.87:0/396775067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0ad21f0 0x55eaa0c27670 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f14d005ba70 tx=0x7f14d008d380 comp rx=0 tx=0).stop 2024-05-27T06:27:46.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.083+0000 7f14e6d39000 1 -- 172.21.15.87:0/396775067 shutdown_connections 2024-05-27T06:27:46.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.083+0000 7f14e6d39000 1 --2- 172.21.15.87:0/396775067 >> [v2:172.21.15.87:6836/1799934036,v1:172.21.15.87:6837/1799934036] conn(0x55eaa06b4830 0x55eaa0c27fa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.083+0000 7f14e6d39000 1 --2- 172.21.15.87:0/396775067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55eaa0ad21f0 0x55eaa0c27670 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.083+0000 7f14e6d39000 1 --2- 172.21.15.87:0/396775067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55eaa0acaf90 0x55eaa0c8ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.083+0000 7f14e6d39000 1 --2- 172.21.15.87:0/396775067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55eaa0ab4a60 0x55eaa0c8e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.083+0000 7f14c5600640 0 client.4398 ms_handle_reset on v2:172.21.15.87:6836/1799934036 2024-05-27T06:27:46.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.083+0000 7f14e6d39000 1 -- 172.21.15.87:0/396775067 >> 172.21.15.87:0/396775067 conn(0x55eaa0ad8db0 msgr2=0x55eaa0bfebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:46.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.083+0000 7f14e6d39000 1 -- 172.21.15.87:0/396775067 shutdown_connections 2024-05-27T06:27:46.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.083+0000 7f14e6d39000 1 -- 172.21.15.87:0/396775067 wait complete. 2024-05-27T06:27:46.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.083+0000 7f14e6d39000 20 client.4398 trim_cache size 0 max 16384 2024-05-27T06:27:46.086 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-27T06:27:46.086 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_fsid": "0412686d-4f35-45cc-b082-ef9741c1aff5", 2024-05-27T06:27:46.086 INFO:teuthology.orchestra.run.smithi087.stdout: "whoami": 0, 2024-05-27T06:27:46.086 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 4290, 2024-05-27T06:27:46.086 INFO:teuthology.orchestra.run.smithi087.stdout: "want_state": "up:active", 2024-05-27T06:27:46.086 INFO:teuthology.orchestra.run.smithi087.stdout: "state": "up:active", 2024-05-27T06:27:46.086 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs", 2024-05-27T06:27:46.087 INFO:teuthology.orchestra.run.smithi087.stdout: "rank_uptime": 7.5210523519999999, 2024-05-27T06:27:46.087 INFO:teuthology.orchestra.run.smithi087.stdout: "mdsmap_epoch": 7, 2024-05-27T06:27:46.087 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch": 24, 2024-05-27T06:27:46.087 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch_barrier": 23, 2024-05-27T06:27:46.087 INFO:teuthology.orchestra.run.smithi087.stdout: "uptime": 13.507347318000001 2024-05-27T06:27:46.087 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-27T06:27:46.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.083+0000 7f14df600640 1 -- 172.21.15.87:0/3582061233 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f14b406f430 msgr2=0x7f14b4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:46.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.083+0000 7f14df600640 1 --2- 172.21.15.87:0/3582061233 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f14b406f430 0x7f14b4071940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f14c80ad000 tx=0x7f14c80a6000 comp rx=0 tx=0).stop 2024-05-27T06:27:46.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.083+0000 7f14df600640 1 -- 172.21.15.87:0/3582061233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14d80aec30 msgr2=0x7f14d8151ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:46.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.083+0000 7f14df600640 1 --2- 172.21.15.87:0/3582061233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14d80aec30 0x7f14d8151ad0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f14d0002240 tx=0x7f14d000a430 comp rx=0 tx=0).stop 2024-05-27T06:27:46.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.083+0000 7f14df600640 1 -- 172.21.15.87:0/3582061233 shutdown_connections 2024-05-27T06:27:46.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.083+0000 7f14df600640 1 --2- 172.21.15.87:0/3582061233 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f14b406f430 0x7f14b4071940 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.083+0000 7f14df600640 1 --2- 172.21.15.87:0/3582061233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14d80aec30 0x7f14d8151ad0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.083+0000 7f14df600640 1 --2- 172.21.15.87:0/3582061233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14d806efc0 0x7f14d8151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.083+0000 7f14df600640 1 --2- 172.21.15.87:0/3582061233 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14d806c720 0x7f14d814f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.083+0000 7f14df600640 1 -- 172.21.15.87:0/3582061233 >> 172.21.15.87:0/3582061233 conn(0x7f14d80b2fb0 msgr2=0x7f14d8150180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:46.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.083+0000 7f14df600640 1 -- 172.21.15.87:0/3582061233 shutdown_connections 2024-05-27T06:27:46.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.083+0000 7f14df600640 1 -- 172.21.15.87:0/3582061233 wait complete. 2024-05-27T06:27:46.102 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-27T06:27:46.102 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-27T06:27:46.102 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-27T06:27:46.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.247+0000 7ffbdd200640 1 Processor -- start 2024-05-27T06:27:46.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.247+0000 7ffbdd200640 1 -- start start 2024-05-27T06:27:46.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.251+0000 7ffbdd200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffbd806e320 0x7ffbd80b5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:46.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.251+0000 7ffbdd200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ffbd80b5c40 0x7ffbd80702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:46.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.251+0000 7ffbdd200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbd80af650 con 0x7ffbd806d430 2024-05-27T06:27:46.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.251+0000 7ffbdd200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7ffbd806fe30 con 0x7ffbd806e320 2024-05-27T06:27:46.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.251+0000 7ffbdd200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7ffbd80b6050 con 0x7ffbd80b5c40 2024-05-27T06:27:46.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.251+0000 7ffbcd400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffbd806e320 0x7ffbd80b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:46.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.251+0000 7ffbd5e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ffbd806d430 0x7ffbd80aef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45424/0 (socket says 172.21.15.87:45424) 2024-05-27T06:27:46.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.251+0000 7ffbd5e00640 1 -- 172.21.15.87:0/2937331756 learned_addr learned my addr 172.21.15.87:0/2937331756 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:27:46.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.251+0000 7ffbd6800640 1 --2- 172.21.15.87:0/2937331756 >> v2:172.21.15.149:3300/0 conn(0x7ffbd80b5c40 0x7ffbd80702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:46.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.251+0000 7ffbcd400640 1 -- 172.21.15.87:0/2937331756 >> v2:172.21.15.149:3300/0 conn(0x7ffbd80b5c40 msgr2=0x7ffbd80702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:46.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.251+0000 7ffbcd400640 1 --2- 172.21.15.87:0/2937331756 >> v2:172.21.15.149:3300/0 conn(0x7ffbd80b5c40 0x7ffbd80702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.251+0000 7ffbcd400640 1 -- 172.21.15.87:0/2937331756 >> v1:172.21.15.87:6789/0 conn(0x7ffbd806d430 legacy=0x7ffbd80aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:46.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.251+0000 7ffbd5400640 1 -- 172.21.15.87:0/2937331756 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3563211975 0 0) 0x7ffbc80014a0 con 0x7ffbd806d430 2024-05-27T06:27:46.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.251+0000 7ffbcd400640 1 -- 172.21.15.87:0/2937331756 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd806f240 con 0x7ffbd806e320 2024-05-27T06:27:46.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.255+0000 7ffbcd400640 1 --2- 172.21.15.87:0/2937331756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbd806e320 0x7ffbd80b5700 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8164930 tx=0x7ffbc001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22aa94edcf853c02 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:46.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.255+0000 7ffbd5400640 1 -- 172.21.15.87:0/2937331756 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc00ab660 con 0x7ffbd806e320 2024-05-27T06:27:46.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.255+0000 7ffbd5400640 1 -- 172.21.15.87:0/2937331756 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc00b0070 con 0x7ffbd806e320 2024-05-27T06:27:46.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.255+0000 7ffbd5400640 1 -- 172.21.15.87:0/2937331756 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc00aba20 con 0x7ffbd806e320 2024-05-27T06:27:46.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.255+0000 7ffbdd200640 1 -- 172.21.15.87:0/2937331756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbd806e320 msgr2=0x7ffbd80b5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:46.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.255+0000 7ffbdd200640 1 --2- 172.21.15.87:0/2937331756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbd806e320 0x7ffbd80b5700 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8164930 tx=0x7ffbc001c460 comp rx=0 tx=0).stop 2024-05-27T06:27:46.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.255+0000 7ffbdd200640 1 -- 172.21.15.87:0/2937331756 shutdown_connections 2024-05-27T06:27:46.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.255+0000 7ffbdd200640 1 --2- 172.21.15.87:0/2937331756 >> v2:172.21.15.149:3300/0 conn(0x7ffbd80b5c40 0x7ffbd80702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.255+0000 7ffbdd200640 1 --2- 172.21.15.87:0/2937331756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbd806e320 0x7ffbd80b5700 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.255+0000 7ffbdd200640 1 -- 172.21.15.87:0/2937331756 >> 172.21.15.87:0/2937331756 conn(0x7ffbd80d1e70 msgr2=0x7ffbd80d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:46.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.255+0000 7ffbdd200640 1 -- 172.21.15.87:0/2937331756 shutdown_connections 2024-05-27T06:27:46.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.255+0000 7ffbdd200640 1 -- 172.21.15.87:0/2937331756 wait complete. 2024-05-27T06:27:46.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.255+0000 7ffbdd200640 1 Processor -- start 2024-05-27T06:27:46.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.255+0000 7ffbdd200640 1 -- start start 2024-05-27T06:27:46.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.259+0000 7ffbdd200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbd806d430 0x7ffbd815e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:46.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.259+0000 7ffbdd200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffbd806e320 0x7ffbd81602c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:46.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.259+0000 7ffbdd200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbd80b5c40 0x7ffbd8160800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:46.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.259+0000 7ffbdd200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd806e730 con 0x7ffbd806d430 2024-05-27T06:27:46.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.259+0000 7ffbdd200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd806fac0 con 0x7ffbd80b5c40 2024-05-27T06:27:46.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.259+0000 7ffbdd200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ffbd816cc30 con 0x7ffbd806e320 2024-05-27T06:27:46.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.259+0000 7ffbd5e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbd806d430 0x7ffbd815e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:46.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.259+0000 7ffbd5e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbd806d430 0x7ffbd815e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59824/0 (socket says 172.21.15.87:59824) 2024-05-27T06:27:46.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.259+0000 7ffbd5e00640 1 -- 172.21.15.87:0/3905883757 learned_addr learned my addr 172.21.15.87:0/3905883757 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:46.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.259+0000 7ffbd6800640 1 --2- 172.21.15.87:0/3905883757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbd80b5c40 0x7ffbd8160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:46.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.259+0000 7ffbcd400640 1 --2- 172.21.15.87:0/3905883757 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffbd806e320 0x7ffbd81602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:46.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.259+0000 7ffbd5e00640 1 -- 172.21.15.87:0/3905883757 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffbd806e320 msgr2=0x7ffbd81602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:46.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.259+0000 7ffbd5e00640 1 --2- 172.21.15.87:0/3905883757 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffbd806e320 0x7ffbd81602c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.259+0000 7ffbd5e00640 1 -- 172.21.15.87:0/3905883757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbd80b5c40 msgr2=0x7ffbd8160800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:46.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.259+0000 7ffbd5e00640 1 --2- 172.21.15.87:0/3905883757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbd80b5c40 0x7ffbd8160800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.259+0000 7ffbd5e00640 1 -- 172.21.15.87:0/3905883757 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd80d10b0 con 0x7ffbd806d430 2024-05-27T06:27:46.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.259+0000 7ffbd6800640 1 --2- 172.21.15.87:0/3905883757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbd80b5c40 0x7ffbd8160800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:27:46.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.259+0000 7ffbcd400640 1 --2- 172.21.15.87:0/3905883757 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffbd806e320 0x7ffbd81602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:27:46.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.259+0000 7ffbd5e00640 1 --2- 172.21.15.87:0/3905883757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbd806d430 0x7ffbd815e630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800c770 tx=0x7ffbc800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:46.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.259+0000 7ffbcea00640 1 -- 172.21.15.87:0/3905883757 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8018070 con 0x7ffbd806d430 2024-05-27T06:27:46.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.259+0000 7ffbcea00640 1 -- 172.21.15.87:0/3905883757 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc800a640 con 0x7ffbd806d430 2024-05-27T06:27:46.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.259+0000 7ffbcea00640 1 -- 172.21.15.87:0/3905883757 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc800aa30 con 0x7ffbd806d430 2024-05-27T06:27:46.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.259+0000 7ffbdd200640 1 -- 172.21.15.87:0/3905883757 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbd80d1390 con 0x7ffbd806d430 2024-05-27T06:27:46.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.259+0000 7ffbdd200640 1 -- 172.21.15.87:0/3905883757 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbd814d5b0 con 0x7ffbd806d430 2024-05-27T06:27:46.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.259+0000 7ffbdd200640 1 -- 172.21.15.87:0/3905883757 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbd806aa30 con 0x7ffbd806d430 2024-05-27T06:27:46.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.263+0000 7ffbcea00640 1 -- 172.21.15.87:0/3905883757 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ffbc800abd0 con 0x7ffbd806d430 2024-05-27T06:27:46.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.263+0000 7ffbcea00640 1 --2- 172.21.15.87:0/3905883757 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ffbb406f400 0x7ffbb4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:46.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.263+0000 7ffbcea00640 1 -- 172.21.15.87:0/3905883757 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ffbc808ebf0 con 0x7ffbd806d430 2024-05-27T06:27:46.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.263+0000 7ffbcd400640 1 --2- 172.21.15.87:0/3905883757 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ffbb406f400 0x7ffbb4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:46.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.263+0000 7ffbcd400640 1 --2- 172.21.15.87:0/3905883757 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ffbb406f400 0x7ffbb4071910 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ffbc00af000 tx=0x7ffbc00a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:46.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.267+0000 7ffbcea00640 1 -- 172.21.15.87:0/3905883757 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ffbd80af650 con 0x7ffbd806d430 2024-05-27T06:27:46.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.455+0000 7ffbdd200640 1 -- 172.21.15.87:0/3905883757 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ffbd8163600 con 0x7ffbd806d430 2024-05-27T06:27:46.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.455+0000 7ffbcea00640 1 -- 172.21.15.87:0/3905883757 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7ffbc805b700 con 0x7ffbd806d430 2024-05-27T06:27:46.457 INFO:teuthology.orchestra.run.smithi087.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-27T06:27:46.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.459+0000 7ffbdd200640 1 -- 172.21.15.87:0/3905883757 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ffbb406f400 msgr2=0x7ffbb4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:46.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.459+0000 7ffbdd200640 1 --2- 172.21.15.87:0/3905883757 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ffbb406f400 0x7ffbb4071910 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ffbc00af000 tx=0x7ffbc00a7000 comp rx=0 tx=0).stop 2024-05-27T06:27:46.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.459+0000 7ffbdd200640 1 -- 172.21.15.87:0/3905883757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbd806d430 msgr2=0x7ffbd815e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:46.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.459+0000 7ffbdd200640 1 --2- 172.21.15.87:0/3905883757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbd806d430 0x7ffbd815e630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800c770 tx=0x7ffbc800cc30 comp rx=0 tx=0).stop 2024-05-27T06:27:46.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.459+0000 7ffbdd200640 1 -- 172.21.15.87:0/3905883757 shutdown_connections 2024-05-27T06:27:46.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.459+0000 7ffbdd200640 1 --2- 172.21.15.87:0/3905883757 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ffbb406f400 0x7ffbb4071910 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.459+0000 7ffbdd200640 1 --2- 172.21.15.87:0/3905883757 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbd80b5c40 0x7ffbd8160800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.459+0000 7ffbdd200640 1 --2- 172.21.15.87:0/3905883757 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffbd806e320 0x7ffbd81602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.459+0000 7ffbdd200640 1 --2- 172.21.15.87:0/3905883757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbd806d430 0x7ffbd815e630 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:46.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.459+0000 7ffbdd200640 1 -- 172.21.15.87:0/3905883757 >> 172.21.15.87:0/3905883757 conn(0x7ffbd80d1e70 msgr2=0x7ffbd80b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:46.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.459+0000 7ffbdd200640 1 -- 172.21.15.87:0/3905883757 shutdown_connections 2024-05-27T06:27:46.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46.459+0000 7ffbdd200640 1 -- 172.21.15.87:0/3905883757 wait complete. 2024-05-27T06:27:46.478 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-27T06:27:46.478 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-27T06:27:46.479 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-05-27T06:27:46.479 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-05-27T06:27:46.479 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-27T06:27:46.479 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-27T06:27:46.479 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-27T06:27:46.479 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-27T06:27:46.479 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-05-27T06:27:46.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:27:46.479 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-05-27T06:27:46.488 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T06:27:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T06:27:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T06:27:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:27:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-05-27T06:27:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:27:46.488 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:27:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-05-27T06:27:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-05-27T06:27:46.488 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:27:46.488 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-05-27T06:27:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-05-27T06:27:46.489 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:27:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:27:46.489 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-27T06:27:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:27:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-27T06:27:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42475sec preferred_lft 42475sec 2024-05-27T06:27:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-05-27T06:27:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:27:46.489 INFO:teuthology.orchestra.run.smithi087.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-27T06:27:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 02:42:75:41:48:14 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:27:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-27T06:27:46.489 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:27:46.491 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-27T06:27:46.491 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:27:46.491 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-27T06:27:46.491 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add name ceph-brx type bridge 2024-05-27T06:27:46.491 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr flush dev ceph-brx 2024-05-27T06:27:46.491 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set ceph-brx up 2024-05-27T06:27:46.491 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-27T06:27:46.491 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-27T06:27:46.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:27:46.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:27:46.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:27:46.654 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-27T06:27:46.719 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-05-27T06:27:46.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:27:46.721 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-05-27T06:27:46.794 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-05-27T06:27:46.794 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-27T06:27:46.794 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-27T06:27:46.794 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-27T06:27:46.794 INFO:teuthology.orchestra.run.smithi087.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-27T06:27:46.794 INFO:teuthology.orchestra.run.smithi087.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-27T06:27:46.794 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-27T06:27:46.794 INFO:teuthology.orchestra.run.smithi087.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:27:46.795 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:27:46.795 INFO:teuthology.orchestra.run.smithi087.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:27:46.795 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-27T06:27:46.795 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:27:46.795 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-27T06:27:46.795 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-27T06:27:46.795 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-27T06:27:46.795 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-27T06:27:46.796 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-27T06:27:46.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:27:46.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:27:46.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:27:46.930 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-05-27T06:27:46.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:27:46.940 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list-id 2024-05-27T06:27:46.994 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:27:46.994 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-27T06:27:46.994 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-27T06:27:46.994 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-05-27T06:27:46.994 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-27T06:27:47.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:27:47.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:27:47.119 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-05-27T06:27:47.119 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:27:47.119 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-27T06:27:47.119 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-05-27T06:27:47.119 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-27T06:27:47.119 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-05-27T06:27:47.119 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-05-27T06:27:47.119 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-05-27T06:27:47.119 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-27T06:27:47.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:27:47.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:27:47.353 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:27:47.353 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-27T06:27:47.353 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-05-27T06:27:47.353 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set dev brx.0 master ceph-brx 2024-05-27T06:27:47.353 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-27T06:27:47.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:27:47.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:27:47.437 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-05-27T06:27:47.437 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T06:27:47.437 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-05-27T06:27:47.446 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-05-27T06:27:47.446 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T06:27:47.446 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-05-27T06:27:47.500 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-05-27T06:27:47.564 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T06:27:47.614 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-05-27T06:27:47.614 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-05-27T06:27:47.614 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-05-27T06:27:47.614 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-05-27T06:27:47.614 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-05-27T06:27:47.614 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-05-27T06:27:47.614 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-05-27T06:27:47.614 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-05-27T06:27:47.615 INFO:teuthology.orchestra.run.smithi087.stdout:/run/lock 2024-05-27T06:27:47.615 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-05-27T06:27:47.615 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-05-27T06:27:47.615 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-05-27T06:27:47.615 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T06:27:47.615 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-05-27T06:27:47.615 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-05-27T06:27:47.615 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-05-27T06:27:47.615 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-05-27T06:27:47.615 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/fs/nfsd 2024-05-27T06:27:47.615 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-05-27T06:27:47.615 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-05-27T06:27:47.615 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysusers.service 2024-05-27T06:27:47.616 INFO:teuthology.orchestra.run.smithi087.stdout:/run/rpc_pipefs 2024-05-27T06:27:47.616 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-05-27T06:27:47.616 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-05-27T06:27:47.616 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2024-05-27T06:27:47.616 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2024-05-27T06:27:47.616 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2024-05-27T06:27:47.616 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2024-05-27T06:27:47.616 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-05-27T06:27:47.616 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-27T06:27:47.616 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-27T06:27:47.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:27:47.617 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-05-27T06:27:47.669 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-27T06:27:47.669 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-05-27T06:27:47.716 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-05-27T06:27:47.736 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T06:27:47.786 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-05-27T06:27:47.786 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-05-27T06:27:47.786 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-05-27T06:27:47.786 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-05-27T06:27:47.786 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-05-27T06:27:47.786 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-05-27T06:27:47.787 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-05-27T06:27:47.787 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-05-27T06:27:47.787 INFO:teuthology.orchestra.run.smithi087.stdout:/run/lock 2024-05-27T06:27:47.787 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-05-27T06:27:47.787 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-05-27T06:27:47.787 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-05-27T06:27:47.787 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T06:27:47.787 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-05-27T06:27:47.787 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-05-27T06:27:47.787 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-05-27T06:27:47.787 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-05-27T06:27:47.787 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/fs/nfsd 2024-05-27T06:27:47.787 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-05-27T06:27:47.787 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-05-27T06:27:47.787 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysusers.service 2024-05-27T06:27:47.788 INFO:teuthology.orchestra.run.smithi087.stdout:/run/rpc_pipefs 2024-05-27T06:27:47.788 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-05-27T06:27:47.788 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-05-27T06:27:47.788 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2024-05-27T06:27:47.788 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2024-05-27T06:27:47.788 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2024-05-27T06:27:47.788 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2024-05-27T06:27:47.788 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-05-27T06:27:47.788 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-27T06:27:47.788 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-27T06:27:47.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:27:47.789 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-05-27T06:27:47.823 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi087.stderr:2024-05-27T06:27:47.823+0000 7fc19ad2b580 -1 init, newargv = 0x564162c62ca0 newargc=15 2024-05-27T06:27:47.824 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi087.stderr:ceph-fuse[34131]: starting ceph client 2024-05-27T06:27:47.835 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi087.stderr:ceph-fuse[34131]: starting fuse 2024-05-27T06:27:48.933 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-05-27T06:27:48.957 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T06:27:49.015 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-05-27T06:27:49.015 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-05-27T06:27:49.016 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-05-27T06:27:49.016 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-05-27T06:27:49.016 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-05-27T06:27:49.016 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-05-27T06:27:49.016 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-05-27T06:27:49.016 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-05-27T06:27:49.016 INFO:teuthology.orchestra.run.smithi087.stdout:/run/lock 2024-05-27T06:27:49.016 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-05-27T06:27:49.016 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-05-27T06:27:49.016 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-05-27T06:27:49.016 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T06:27:49.016 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-05-27T06:27:49.016 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-05-27T06:27:49.016 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-05-27T06:27:49.017 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-05-27T06:27:49.017 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/fs/nfsd 2024-05-27T06:27:49.017 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-05-27T06:27:49.017 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-05-27T06:27:49.017 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysusers.service 2024-05-27T06:27:49.017 INFO:teuthology.orchestra.run.smithi087.stdout:/run/rpc_pipefs 2024-05-27T06:27:49.017 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-05-27T06:27:49.017 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-05-27T06:27:49.017 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2024-05-27T06:27:49.017 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2024-05-27T06:27:49.017 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2024-05-27T06:27:49.017 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2024-05-27T06:27:49.017 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-05-27T06:27:49.018 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-27T06:27:49.018 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-27T06:27:49.018 INFO:teuthology.orchestra.run.smithi087.stdout:/home/ubuntu/cephtest/mnt.admin 2024-05-27T06:27:49.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:27:49.019 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-05-27T06:27:49.070 INFO:teuthology.orchestra.run.smithi087.stdout:44 2024-05-27T06:27:49.070 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-05-27T06:27:49.070 DEBUG:teuthology.orchestra.run.smithi087:> sudo stdin-killer -- python3 -c ' 2024-05-27T06:27:49.070 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-05-27T06:27:49.070 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-05-27T06:27:49.070 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-05-27T06:27:49.070 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-05-27T06:27:49.071 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:27:49.071 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-05-27T06:27:49.071 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-05-27T06:27:49.071 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-05-27T06:27:49.071 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-05-27T06:27:49.071 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:27:49.071 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-05-27T06:27:49.071 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-05-27T06:27:49.071 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-05-27T06:27:49.071 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-05-27T06:27:49.071 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:27:49.071 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-05-27T06:27:49.071 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-27T06:27:49.071 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-27T06:27:49.072 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-27T06:27:49.072 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-05-27T06:27:49.072 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-05-27T06:27:49.072 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-05-27T06:27:49.072 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-27T06:27:49.072 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:27:49.072 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.admin")) 2024-05-27T06:27:49.072 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-05-27T06:27:49.202 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.admin.34131.asok 2024-05-27T06:27:49.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:27:49.214 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.34131.asok 2024-05-27T06:27:49.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:27:49.214 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.34131.asok status 2024-05-27T06:27:49.398 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-27T06:27:49.398 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-05-27T06:27:49.398 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "38f9d900c83c63799fbdbe61acc9a11b0d3554a6", 2024-05-27T06:27:49.398 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 19.0.0-3872-g38f9d900 (38f9d900c83c63799fbdbe61acc9a11b0d3554a6) squid (dev)", 2024-05-27T06:27:49.398 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "admin", 2024-05-27T06:27:49.398 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-05-27T06:27:49.398 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-05-27T06:27:49.399 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "34131", 2024-05-27T06:27:49.399 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-05-27T06:27:49.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:27:49.399 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-05-27T06:27:49.399 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-05-27T06:27:49.399 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 4413, 2024-05-27T06:27:49.399 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-05-27T06:27:49.399 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-05-27T06:27:49.399 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-05-27T06:27:49.399 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 4413 2024-05-27T06:27:49.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:27:49.399 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-05-27T06:27:49.399 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-05-27T06:27:49.400 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-05-27T06:27:49.400 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2947584093 2024-05-27T06:27:49.400 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:27:49.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:27:49.400 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-05-27T06:27:49.400 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-05-27T06:27:49.400 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-05-27T06:27:49.400 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2947584093 2024-05-27T06:27:49.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:27:49.400 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.4413 192.168.0.1:0/2947584093", 2024-05-27T06:27:49.400 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/2947584093", 2024-05-27T06:27:49.400 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-05-27T06:27:49.400 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 7, 2024-05-27T06:27:49.400 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 24, 2024-05-27T06:27:49.400 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-05-27T06:27:49.401 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-05-27T06:27:49.401 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-05-27T06:27:49.401 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-27T06:27:49.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:27:49.413 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-05-27T06:27:49.413 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-05-27T06:27:49.422 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-05-27T06:27:49.423 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-05-27T06:27:49.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:27:49.423 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-05-27T06:27:49.485 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-05-27T06:27:49.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-27T06:27:49.604 INFO:teuthology.orchestra.run.smithi087.stdout:# file: . 2024-05-27T06:27:49.604 INFO:teuthology.orchestra.run.smithi087.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-05-27T06:27:49.604 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:27:49.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:27:49.611 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:27:49.611 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:27:49.619 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T06:27:49.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.807+0000 7fab16600640 1 Processor -- start 2024-05-27T06:27:49.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.807+0000 7fab16600640 1 -- start start 2024-05-27T06:27:49.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.811+0000 7fab16600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fab100aec30 0x7fab100702b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:49.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.811+0000 7fab16600640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab1006fe20 con 0x7fab1006efc0 2024-05-27T06:27:49.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.811+0000 7fab16600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab100b0ba0 con 0x7fab1006c720 2024-05-27T06:27:49.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.811+0000 7fab16600640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fab1015ef50 con 0x7fab100aec30 2024-05-27T06:27:49.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.811+0000 7fab0f400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fab100aec30 0x7fab100702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:49.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.811+0000 7fab06a00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fab1006efc0 0x7fab1006f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45438/0 (socket says 172.21.15.87:45438) 2024-05-27T06:27:49.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.811+0000 7fab06a00640 1 -- 172.21.15.87:0/1518197759 learned_addr learned my addr 172.21.15.87:0/1518197759 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:27:49.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.811+0000 7fab0f400640 1 -- 172.21.15.87:0/1518197759 >> v1:172.21.15.149:6789/0 conn(0x7fab1006c720 legacy=0x7fab1006cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:49.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.811+0000 7fab0f400640 1 -- 172.21.15.87:0/1518197759 >> v1:172.21.15.87:6789/0 conn(0x7fab1006efc0 legacy=0x7fab1006f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:49.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.811+0000 7fab0f400640 1 -- 172.21.15.87:0/1518197759 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab100b08c0 con 0x7fab100aec30 2024-05-27T06:27:49.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.815+0000 7fab0f400640 1 --2- 172.21.15.87:0/1518197759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab100aec30 0x7fab100702b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fab000097c0 tx=0x7fab0001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3760ba5681825ad server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:49.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.815+0000 7fab0ea00640 1 -- 172.21.15.87:0/1518197759 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab000b0070 con 0x7fab100aec30 2024-05-27T06:27:49.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.815+0000 7fab0ea00640 1 -- 172.21.15.87:0/1518197759 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab000ab600 con 0x7fab100aec30 2024-05-27T06:27:49.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.815+0000 7fab0ea00640 1 -- 172.21.15.87:0/1518197759 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab000ab9d0 con 0x7fab100aec30 2024-05-27T06:27:49.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.815+0000 7fab16600640 1 -- 172.21.15.87:0/1518197759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab100aec30 msgr2=0x7fab100702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:49.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.815+0000 7fab16600640 1 --2- 172.21.15.87:0/1518197759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab100aec30 0x7fab100702b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fab000097c0 tx=0x7fab0001c380 comp rx=0 tx=0).stop 2024-05-27T06:27:49.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.815+0000 7fab16600640 1 -- 172.21.15.87:0/1518197759 shutdown_connections 2024-05-27T06:27:49.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.815+0000 7fab16600640 1 --2- 172.21.15.87:0/1518197759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab100aec30 0x7fab100702b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:49.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.815+0000 7fab16600640 1 -- 172.21.15.87:0/1518197759 >> 172.21.15.87:0/1518197759 conn(0x7fab100b2fb0 msgr2=0x7fab100b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:49.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.815+0000 7fab16600640 1 -- 172.21.15.87:0/1518197759 shutdown_connections 2024-05-27T06:27:49.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.815+0000 7fab16600640 1 -- 172.21.15.87:0/1518197759 wait complete. 2024-05-27T06:27:49.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.815+0000 7fab16600640 1 Processor -- start 2024-05-27T06:27:49.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.815+0000 7fab16600640 1 -- start start 2024-05-27T06:27:49.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.819+0000 7fab16600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab1006c720 0x7fab10150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:49.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.819+0000 7fab16600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab1006efc0 0x7fab1009a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:49.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.819+0000 7fab16600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab100aec30 0x7fab10072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:49.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.819+0000 7fab16600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fab1006e0c0 con 0x7fab100aec30 2024-05-27T06:27:49.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.819+0000 7fab16600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fab1006df40 con 0x7fab1006c720 2024-05-27T06:27:49.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.819+0000 7fab16600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fab100707f0 con 0x7fab1006efc0 2024-05-27T06:27:49.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.819+0000 7fab0fe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab100aec30 0x7fab10072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:49.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.819+0000 7fab0fe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab100aec30 0x7fab10072a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59840/0 (socket says 172.21.15.87:59840) 2024-05-27T06:27:49.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.819+0000 7fab0fe00640 1 -- 172.21.15.87:0/1193432151 learned_addr learned my addr 172.21.15.87:0/1193432151 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:49.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.819+0000 7fab06a00640 1 --2- 172.21.15.87:0/1193432151 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab1006efc0 0x7fab1009a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:49.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.819+0000 7fab0f400640 1 --2- 172.21.15.87:0/1193432151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab1006c720 0x7fab10150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:49.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.819+0000 7fab0fe00640 1 -- 172.21.15.87:0/1193432151 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab1006efc0 msgr2=0x7fab1009a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:49.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.819+0000 7fab0fe00640 1 --2- 172.21.15.87:0/1193432151 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab1006efc0 0x7fab1009a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:49.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.819+0000 7fab0fe00640 1 -- 172.21.15.87:0/1193432151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab1006c720 msgr2=0x7fab10150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:49.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.819+0000 7fab0fe00640 1 --2- 172.21.15.87:0/1193432151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab1006c720 0x7fab10150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:49.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.819+0000 7fab0fe00640 1 -- 172.21.15.87:0/1193432151 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab1014fd90 con 0x7fab100aec30 2024-05-27T06:27:49.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.819+0000 7fab0fe00640 1 --2- 172.21.15.87:0/1193432151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab100aec30 0x7fab10072a70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fab0800b970 tx=0x7fab0800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:49.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.819+0000 7fab07e00640 1 -- 172.21.15.87:0/1193432151 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab08019070 con 0x7fab100aec30 2024-05-27T06:27:49.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.819+0000 7fab07e00640 1 -- 172.21.15.87:0/1193432151 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab0800cb40 con 0x7fab100aec30 2024-05-27T06:27:49.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.819+0000 7fab16600640 1 -- 172.21.15.87:0/1193432151 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab10150070 con 0x7fab100aec30 2024-05-27T06:27:49.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.819+0000 7fab07e00640 1 -- 172.21.15.87:0/1193432151 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab08014440 con 0x7fab100aec30 2024-05-27T06:27:49.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.819+0000 7fab16600640 1 -- 172.21.15.87:0/1193432151 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab10150630 con 0x7fab100aec30 2024-05-27T06:27:49.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.819+0000 7fab16600640 1 -- 172.21.15.87:0/1193432151 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab1006aa30 con 0x7fab100aec30 2024-05-27T06:27:49.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.823+0000 7fab07e00640 1 -- 172.21.15.87:0/1193432151 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fab0801c070 con 0x7fab100aec30 2024-05-27T06:27:49.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.823+0000 7fab07e00640 1 --2- 172.21.15.87:0/1193432151 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7faaec06f430 0x7faaec071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:49.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.823+0000 7fab07e00640 1 -- 172.21.15.87:0/1193432151 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fab0808f250 con 0x7fab100aec30 2024-05-27T06:27:49.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.823+0000 7fab0f400640 1 --2- 172.21.15.87:0/1193432151 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7faaec06f430 0x7faaec071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:49.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.823+0000 7fab0f400640 1 --2- 172.21.15.87:0/1193432151 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7faaec06f430 0x7faaec071940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fab000ad000 tx=0x7fab000a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:49.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.827+0000 7fab07e00640 1 -- 172.21.15.87:0/1193432151 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fab0805bdf0 con 0x7fab100aec30 2024-05-27T06:27:49.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.995+0000 7fab16600640 1 -- 172.21.15.87:0/1193432151 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fab10149860 con 0x7fab100aec30 2024-05-27T06:27:49.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.995+0000 7fab07e00640 1 -- 172.21.15.87:0/1193432151 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fab0805b6f0 con 0x7fab100aec30 2024-05-27T06:27:49.995 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2024-05-27T06:27:49.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.995+0000 7fab16600640 1 -- 172.21.15.87:0/1193432151 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7faaec06f430 msgr2=0x7faaec071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:49.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.995+0000 7fab16600640 1 --2- 172.21.15.87:0/1193432151 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7faaec06f430 0x7faaec071940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fab000ad000 tx=0x7fab000a6000 comp rx=0 tx=0).stop 2024-05-27T06:27:49.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.995+0000 7fab16600640 1 -- 172.21.15.87:0/1193432151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab100aec30 msgr2=0x7fab10072a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:49.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.995+0000 7fab16600640 1 --2- 172.21.15.87:0/1193432151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab100aec30 0x7fab10072a70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fab0800b970 tx=0x7fab0800be30 comp rx=0 tx=0).stop 2024-05-27T06:27:49.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.995+0000 7fab16600640 1 -- 172.21.15.87:0/1193432151 shutdown_connections 2024-05-27T06:27:49.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.995+0000 7fab16600640 1 --2- 172.21.15.87:0/1193432151 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7faaec06f430 0x7faaec071940 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:49.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.995+0000 7fab16600640 1 --2- 172.21.15.87:0/1193432151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab100aec30 0x7fab10072a70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:49.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.995+0000 7fab16600640 1 --2- 172.21.15.87:0/1193432151 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab1006efc0 0x7fab1009a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:49.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.995+0000 7fab16600640 1 --2- 172.21.15.87:0/1193432151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab1006c720 0x7fab10150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:49.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.999+0000 7fab16600640 1 -- 172.21.15.87:0/1193432151 >> 172.21.15.87:0/1193432151 conn(0x7fab100b2fb0 msgr2=0x7fab1014ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:49.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.999+0000 7fab16600640 1 -- 172.21.15.87:0/1193432151 shutdown_connections 2024-05-27T06:27:49.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:49.999+0000 7fab16600640 1 -- 172.21.15.87:0/1193432151 wait complete. 2024-05-27T06:27:50.025 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:27:50.025 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:27:50.034 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T06:27:50.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.223+0000 7fdfa4c00640 1 Processor -- start 2024-05-27T06:27:50.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.223+0000 7fdfa4c00640 1 -- start start 2024-05-27T06:27:50.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.227+0000 7fdfa4c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdfa00d26a0 0x7fdfa015dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:50.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.227+0000 7fdfa4c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdfa00b9010 0x7fdfa00cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:50.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.227+0000 7fdfa4c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfa00ce6d0 con 0x7fdfa00ce2c0 2024-05-27T06:27:50.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.227+0000 7fdfa4c00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fdfa00b64e0 con 0x7fdfa00b9010 2024-05-27T06:27:50.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.227+0000 7fdfa4c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fdfa00b30d0 con 0x7fdfa00d26a0 2024-05-27T06:27:50.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.227+0000 7fdf97e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdfa00b9010 0x7fdfa00cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:50.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.227+0000 7fdf97e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdfa00b9010 0x7fdfa00cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59844/0 (socket says 172.21.15.87:59844) 2024-05-27T06:27:50.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.227+0000 7fdf97e00640 1 -- 172.21.15.87:0/254252894 learned_addr learned my addr 172.21.15.87:0/254252894 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:50.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.227+0000 7fdf9de00640 1 --2- 172.21.15.87:0/254252894 >> v2:172.21.15.149:3300/0 conn(0x7fdfa00d26a0 0x7fdfa015dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:50.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.227+0000 7fdf97e00640 1 -- 172.21.15.87:0/254252894 >> v2:172.21.15.149:3300/0 conn(0x7fdfa00d26a0 msgr2=0x7fdfa015dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:50.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.227+0000 7fdf97e00640 1 --2- 172.21.15.87:0/254252894 >> v2:172.21.15.149:3300/0 conn(0x7fdfa00d26a0 0x7fdfa015dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:50.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.227+0000 7fdf97e00640 1 -- 172.21.15.87:0/254252894 >> v1:172.21.15.149:6789/0 conn(0x7fdfa00ce2c0 legacy=0x7fdfa01617d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:50.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.227+0000 7fdf97e00640 1 -- 172.21.15.87:0/254252894 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa00b2da0 con 0x7fdfa00b9010 2024-05-27T06:27:50.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.227+0000 7fdf97e00640 1 --2- 172.21.15.87:0/254252894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdfa00b9010 0x7fdfa00cdd80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00743b0 tx=0x7fdf8801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862697c486d3c18 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:50.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.231+0000 7fdf9d400640 1 -- 172.21.15.87:0/254252894 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf880b5070 con 0x7fdfa00b9010 2024-05-27T06:27:50.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.231+0000 7fdf9d400640 1 -- 172.21.15.87:0/254252894 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf880a8a10 con 0x7fdfa00b9010 2024-05-27T06:27:50.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.231+0000 7fdf9d400640 1 -- 172.21.15.87:0/254252894 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf880a8de0 con 0x7fdfa00b9010 2024-05-27T06:27:50.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.231+0000 7fdfa4c00640 1 -- 172.21.15.87:0/254252894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdfa00b9010 msgr2=0x7fdfa00cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:50.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.231+0000 7fdfa4c00640 1 --2- 172.21.15.87:0/254252894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdfa00b9010 0x7fdfa00cdd80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00743b0 tx=0x7fdf8801ed10 comp rx=0 tx=0).stop 2024-05-27T06:27:50.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.231+0000 7fdfa4c00640 1 -- 172.21.15.87:0/254252894 shutdown_connections 2024-05-27T06:27:50.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.231+0000 7fdfa4c00640 1 --2- 172.21.15.87:0/254252894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdfa00b9010 0x7fdfa00cdd80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:50.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.231+0000 7fdfa4c00640 1 --2- 172.21.15.87:0/254252894 >> v2:172.21.15.149:3300/0 conn(0x7fdfa00d26a0 0x7fdfa015dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:50.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.231+0000 7fdfa4c00640 1 -- 172.21.15.87:0/254252894 >> 172.21.15.87:0/254252894 conn(0x7fdfa00cffa0 msgr2=0x7fdfa00d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:50.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.231+0000 7fdfa4c00640 1 -- 172.21.15.87:0/254252894 shutdown_connections 2024-05-27T06:27:50.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.231+0000 7fdfa4c00640 1 -- 172.21.15.87:0/254252894 wait complete. 2024-05-27T06:27:50.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.231+0000 7fdfa4c00640 1 Processor -- start 2024-05-27T06:27:50.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.231+0000 7fdfa4c00640 1 -- start start 2024-05-27T06:27:50.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.235+0000 7fdfa4c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfa00b9010 0x7fdfa00c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:50.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.235+0000 7fdfa4c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfa00ce2c0 0x7fdfa01511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:50.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.235+0000 7fdfa4c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdfa00d26a0 0x7fdfa0151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:50.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.235+0000 7fdfa4c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa00d31d0 con 0x7fdfa00d26a0 2024-05-27T06:27:50.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.235+0000 7fdfa4c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa00d2ef0 con 0x7fdfa00b9010 2024-05-27T06:27:50.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.235+0000 7fdfa4c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdfa00b4570 con 0x7fdfa00ce2c0 2024-05-27T06:27:50.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.235+0000 7fdf9e800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdfa00d26a0 0x7fdfa0151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:50.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.235+0000 7fdf9e800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdfa00d26a0 0x7fdfa0151710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59854/0 (socket says 172.21.15.87:59854) 2024-05-27T06:27:50.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.235+0000 7fdf9e800640 1 -- 172.21.15.87:0/716908230 learned_addr learned my addr 172.21.15.87:0/716908230 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:50.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.235+0000 7fdf97e00640 1 --2- 172.21.15.87:0/716908230 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfa00ce2c0 0x7fdfa01511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:50.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.235+0000 7fdf9de00640 1 --2- 172.21.15.87:0/716908230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfa00b9010 0x7fdfa00c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:50.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.235+0000 7fdf9e800640 1 -- 172.21.15.87:0/716908230 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfa00ce2c0 msgr2=0x7fdfa01511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:50.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.235+0000 7fdf9e800640 1 --2- 172.21.15.87:0/716908230 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfa00ce2c0 0x7fdfa01511d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:50.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.235+0000 7fdf9e800640 1 -- 172.21.15.87:0/716908230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfa00b9010 msgr2=0x7fdfa00c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:50.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.235+0000 7fdf9e800640 1 --2- 172.21.15.87:0/716908230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfa00b9010 0x7fdfa00c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:50.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.235+0000 7fdf9e800640 1 -- 172.21.15.87:0/716908230 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa0151c50 con 0x7fdfa00d26a0 2024-05-27T06:27:50.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.235+0000 7fdf9e800640 1 --2- 172.21.15.87:0/716908230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdfa00d26a0 0x7fdfa0151710 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdf9800c730 tx=0x7fdf9800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:50.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.235+0000 7fdf96000640 1 -- 172.21.15.87:0/716908230 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf98003b80 con 0x7fdfa00d26a0 2024-05-27T06:27:50.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.235+0000 7fdf96000640 1 -- 172.21.15.87:0/716908230 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf98003d20 con 0x7fdfa00d26a0 2024-05-27T06:27:50.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.235+0000 7fdf96000640 1 -- 172.21.15.87:0/716908230 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf9800aa70 con 0x7fdfa00d26a0 2024-05-27T06:27:50.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.235+0000 7fdfa4c00640 1 -- 172.21.15.87:0/716908230 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfa00c9b80 con 0x7fdfa00d26a0 2024-05-27T06:27:50.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.235+0000 7fdfa4c00640 1 -- 172.21.15.87:0/716908230 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfa01506f0 con 0x7fdfa00d26a0 2024-05-27T06:27:50.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.235+0000 7fdfa4c00640 1 -- 172.21.15.87:0/716908230 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfa00c98f0 con 0x7fdfa00d26a0 2024-05-27T06:27:50.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.239+0000 7fdf96000640 1 -- 172.21.15.87:0/716908230 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fdf9800ac10 con 0x7fdfa00d26a0 2024-05-27T06:27:50.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.239+0000 7fdf96000640 1 --2- 172.21.15.87:0/716908230 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fdf7c06f430 0x7fdf7c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:50.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.239+0000 7fdf96000640 1 -- 172.21.15.87:0/716908230 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdf9808fdf0 con 0x7fdfa00d26a0 2024-05-27T06:27:50.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.239+0000 7fdf9de00640 1 --2- 172.21.15.87:0/716908230 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fdf7c06f430 0x7fdf7c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:50.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.239+0000 7fdf9de00640 1 --2- 172.21.15.87:0/716908230 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fdf7c06f430 0x7fdf7c071940 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00b2960 tx=0x7fdf90006f90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:50.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.247+0000 7fdf96000640 1 -- 172.21.15.87:0/716908230 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fdfa00ce6d0 con 0x7fdfa00d26a0 2024-05-27T06:27:50.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.415+0000 7fdfa4c00640 1 -- 172.21.15.87:0/716908230 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdfa006aa30 con 0x7fdfa00d26a0 2024-05-27T06:27:50.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.415+0000 7fdf96000640 1 -- 172.21.15.87:0/716908230 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fdf9805c3c0 con 0x7fdfa00d26a0 2024-05-27T06:27:50.417 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2024-05-27T06:27:50.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.419+0000 7fdfa4c00640 1 -- 172.21.15.87:0/716908230 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fdf7c06f430 msgr2=0x7fdf7c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:50.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.419+0000 7fdfa4c00640 1 --2- 172.21.15.87:0/716908230 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fdf7c06f430 0x7fdf7c071940 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00b2960 tx=0x7fdf90006f90 comp rx=0 tx=0).stop 2024-05-27T06:27:50.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.419+0000 7fdfa4c00640 1 -- 172.21.15.87:0/716908230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdfa00d26a0 msgr2=0x7fdfa0151710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:50.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.419+0000 7fdfa4c00640 1 --2- 172.21.15.87:0/716908230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdfa00d26a0 0x7fdfa0151710 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdf9800c730 tx=0x7fdf9800cbf0 comp rx=0 tx=0).stop 2024-05-27T06:27:50.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.419+0000 7fdfa4c00640 1 -- 172.21.15.87:0/716908230 shutdown_connections 2024-05-27T06:27:50.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.419+0000 7fdfa4c00640 1 --2- 172.21.15.87:0/716908230 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fdf7c06f430 0x7fdf7c071940 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:50.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.419+0000 7fdfa4c00640 1 --2- 172.21.15.87:0/716908230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdfa00d26a0 0x7fdfa0151710 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:50.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.419+0000 7fdfa4c00640 1 --2- 172.21.15.87:0/716908230 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfa00ce2c0 0x7fdfa01511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:50.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.419+0000 7fdfa4c00640 1 --2- 172.21.15.87:0/716908230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfa00b9010 0x7fdfa00c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:50.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.419+0000 7fdfa4c00640 1 -- 172.21.15.87:0/716908230 >> 172.21.15.87:0/716908230 conn(0x7fdfa00cffa0 msgr2=0x7fdfa015e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:50.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.419+0000 7fdfa4c00640 1 -- 172.21.15.87:0/716908230 shutdown_connections 2024-05-27T06:27:50.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:50.419+0000 7fdfa4c00640 1 -- 172.21.15.87:0/716908230 wait complete. 2024-05-27T06:27:50.438 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-05-27T06:27:50.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:27:50.438 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-05-27T06:27:50.469 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi087.stderr:ceph-fuse[34131]: fuse finished with error 0 and tester_r 0 2024-05-27T06:27:50.472 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:27:56.573 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-05-27T06:27:56.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:27:56.573 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-05-27T06:27:56.592 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T06:27:56.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.791+0000 7f6a0aa00640 1 Processor -- start 2024-05-27T06:27:56.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.791+0000 7f6a0aa00640 1 -- start start 2024-05-27T06:27:56.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.795+0000 7f6a0aa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a04072aa0 0x7f6a0406d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:56.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.795+0000 7f6a0aa00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a040cd120 con 0x7f6a04072eb0 2024-05-27T06:27:56.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.795+0000 7f6a0aa00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a040cd400 con 0x7f6a040d1e50 2024-05-27T06:27:56.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.795+0000 7f6a0aa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6a040cdd30 con 0x7f6a04072aa0 2024-05-27T06:27:56.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.795+0000 7f69fb400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f6a04072eb0 0x7f6a040d1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:58684/0 (socket says 172.21.15.87:58684) 2024-05-27T06:27:56.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.795+0000 7f69fb400640 1 -- 172.21.15.87:0/1125131576 learned_addr learned my addr 172.21.15.87:0/1125131576 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:27:56.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.795+0000 7f6a03e00640 1 --2- 172.21.15.87:0/1125131576 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a04072aa0 0x7f6a0406d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:56.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.795+0000 7f6a03400640 1 -- 172.21.15.87:0/1125131576 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1687604433 0 0) 0x7f6a040cd120 con 0x7f6a04072eb0 2024-05-27T06:27:56.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.795+0000 7f6a03400640 1 -- 172.21.15.87:0/1125131576 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69e8003530 con 0x7f6a04072eb0 2024-05-27T06:27:56.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.795+0000 7f6a03400640 1 -- 172.21.15.87:0/1125131576 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3113565905 0 0) 0x7f6a040cd400 con 0x7f6a040d1e50 2024-05-27T06:27:56.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.795+0000 7f6a03400640 1 -- 172.21.15.87:0/1125131576 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a040cd120 con 0x7f6a040d1e50 2024-05-27T06:27:56.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.795+0000 7f6a03e00640 1 -- 172.21.15.87:0/1125131576 >> v1:172.21.15.149:6789/0 conn(0x7f6a040d1e50 legacy=0x7f6a040ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:56.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.795+0000 7f6a03e00640 1 -- 172.21.15.87:0/1125131576 >> v1:172.21.15.87:6789/0 conn(0x7f6a04072eb0 legacy=0x7f6a040d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:56.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.795+0000 7f6a03e00640 1 -- 172.21.15.87:0/1125131576 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a040cd6e0 con 0x7f6a04072aa0 2024-05-27T06:27:56.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.799+0000 7f6a03e00640 1 --2- 172.21.15.87:0/1125131576 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a04072aa0 0x7f6a0406d820 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0097f0 tx=0x7f69ec01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41e45b00e694d9d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:56.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.799+0000 7f6a03400640 1 -- 172.21.15.87:0/1125131576 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec0aa430 con 0x7f6a04072aa0 2024-05-27T06:27:56.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.799+0000 7f6a03400640 1 -- 172.21.15.87:0/1125131576 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69ec0af070 con 0x7f6a04072aa0 2024-05-27T06:27:56.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.799+0000 7f6a03400640 1 -- 172.21.15.87:0/1125131576 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec0aa7f0 con 0x7f6a04072aa0 2024-05-27T06:27:56.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.799+0000 7f6a0aa00640 1 -- 172.21.15.87:0/1125131576 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a04072aa0 msgr2=0x7f6a0406d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:56.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.799+0000 7f6a0aa00640 1 --2- 172.21.15.87:0/1125131576 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a04072aa0 0x7f6a0406d820 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0097f0 tx=0x7f69ec01c4b0 comp rx=0 tx=0).stop 2024-05-27T06:27:56.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.799+0000 7f6a0aa00640 1 -- 172.21.15.87:0/1125131576 shutdown_connections 2024-05-27T06:27:56.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.799+0000 7f6a0aa00640 1 --2- 172.21.15.87:0/1125131576 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a04072aa0 0x7f6a0406d820 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:56.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.799+0000 7f6a0aa00640 1 -- 172.21.15.87:0/1125131576 >> 172.21.15.87:0/1125131576 conn(0x7f6a040b46b0 msgr2=0x7f6a040b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:56.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.799+0000 7f6a0aa00640 1 -- 172.21.15.87:0/1125131576 shutdown_connections 2024-05-27T06:27:56.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.799+0000 7f6a0aa00640 1 -- 172.21.15.87:0/1125131576 wait complete. 2024-05-27T06:27:56.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.799+0000 7f6a0aa00640 1 Processor -- start 2024-05-27T06:27:56.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.799+0000 7f6a0aa00640 1 -- start start 2024-05-27T06:27:56.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.803+0000 7f6a0aa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a04072aa0 0x7f6a041592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:56.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.803+0000 7f6a0aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a04072eb0 0x7f6a0415c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:56.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.803+0000 7f6a0aa00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a040d1e50 0x7f6a0415cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:56.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.803+0000 7f6a0aa00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0416c450 con 0x7f6a040d1e50 2024-05-27T06:27:56.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.803+0000 7f6a0aa00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0416c2d0 con 0x7f6a04072eb0 2024-05-27T06:27:56.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.803+0000 7f6a0aa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6a0416c5d0 con 0x7f6a04072aa0 2024-05-27T06:27:56.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.803+0000 7f6a08a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a040d1e50 0x7f6a0415cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:56.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.803+0000 7f69fb400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a04072eb0 0x7f6a0415c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:56.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.803+0000 7f6a03e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a04072aa0 0x7f6a041592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:56.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.803+0000 7f6a08a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a040d1e50 0x7f6a0415cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37936/0 (socket says 172.21.15.87:37936) 2024-05-27T06:27:56.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.803+0000 7f6a08a00640 1 -- 172.21.15.87:0/1468077744 learned_addr learned my addr 172.21.15.87:0/1468077744 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:56.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.803+0000 7f6a08a00640 1 -- 172.21.15.87:0/1468077744 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a04072aa0 msgr2=0x7f6a041592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:56.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.803+0000 7f6a08a00640 1 --2- 172.21.15.87:0/1468077744 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a04072aa0 0x7f6a041592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:56.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.803+0000 7f6a08a00640 1 -- 172.21.15.87:0/1468077744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a04072eb0 msgr2=0x7f6a0415c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:56.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.803+0000 7f6a08a00640 1 --2- 172.21.15.87:0/1468077744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a04072eb0 0x7f6a0415c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:56.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.803+0000 7f6a08a00640 1 -- 172.21.15.87:0/1468077744 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a0415b830 con 0x7f6a040d1e50 2024-05-27T06:27:56.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.803+0000 7f6a08a00640 1 --2- 172.21.15.87:0/1468077744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a040d1e50 0x7f6a0415cb30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00c760 tx=0x7f69fc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:56.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.803+0000 7f6a00c00640 1 -- 172.21.15.87:0/1468077744 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc003b80 con 0x7f6a040d1e50 2024-05-27T06:27:56.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.803+0000 7f6a00c00640 1 -- 172.21.15.87:0/1468077744 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69fc003d40 con 0x7f6a040d1e50 2024-05-27T06:27:56.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.803+0000 7f6a0aa00640 1 -- 172.21.15.87:0/1468077744 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a0415bb10 con 0x7f6a040d1e50 2024-05-27T06:27:56.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.803+0000 7f6a00c00640 1 -- 172.21.15.87:0/1468077744 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc00aa90 con 0x7f6a040d1e50 2024-05-27T06:27:56.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.803+0000 7f6a0aa00640 1 -- 172.21.15.87:0/1468077744 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a040b4f10 con 0x7f6a040d1e50 2024-05-27T06:27:56.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.803+0000 7f6a0aa00640 1 -- 172.21.15.87:0/1468077744 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a0406aa30 con 0x7f6a040d1e50 2024-05-27T06:27:56.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.807+0000 7f6a00c00640 1 -- 172.21.15.87:0/1468077744 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f69fc00ac30 con 0x7f6a040d1e50 2024-05-27T06:27:56.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.807+0000 7f6a00c00640 1 --2- 172.21.15.87:0/1468077744 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f69e006f400 0x7f69e0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:56.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.807+0000 7f6a00c00640 1 -- 172.21.15.87:0/1468077744 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f69fc08f3c0 con 0x7f6a040d1e50 2024-05-27T06:27:56.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.807+0000 7f6a03e00640 1 --2- 172.21.15.87:0/1468077744 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f69e006f400 0x7f69e0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:56.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.807+0000 7f6a03e00640 1 --2- 172.21.15.87:0/1468077744 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f69e006f400 0x7f69e0071910 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0ae000 tx=0x7f69ec0a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:56.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.811+0000 7f6a00c00640 1 -- 172.21.15.87:0/1468077744 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f69fc05b9a0 con 0x7f6a040d1e50 2024-05-27T06:27:56.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.975+0000 7f6a0aa00640 1 -- 172.21.15.87:0/1468077744 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a04070830 con 0x7f6a040d1e50 2024-05-27T06:27:56.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.975+0000 7f6a00c00640 1 -- 172.21.15.87:0/1468077744 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7f69fc05fca0 con 0x7f6a040d1e50 2024-05-27T06:27:56.976 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:27:56.976 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:27:43.048854+0000","last_up_change":"2024-05-27T06:27:25.988592+0000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T06:27:26.590191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T06:27:35.840893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T06:27:36.929608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-27T06:27:40.638358+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6801","nonce":3674824716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6803","nonce":3674824716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6807","nonce":3674824716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6805","nonce":3674824716}]},"public_addr":"172.21.15.87:6801/3674824716","cluster_addr":"172.21.15.87:6803/3674824716","heartbeat_back_addr":"172.21.15.87:6807/3674824716","heartbeat_front_addr":"172.21.15.87:6805/3674824716","state":["exists","up"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6809","nonce":2443981288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6811","nonce":2443981288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6815","nonce":2443981288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6813","nonce":2443981288}]},"public_addr":"172.21.15.87:6809/2443981288","cluster_addr":"172.21.15.87:6811/2443981288","heartbeat_back_addr":"172.21.15.87:6815/2443981288","heartbeat_front_addr":"172.21.15.87:6813/2443981288","state":["exists","up"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6819","nonce":1441249238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6823","nonce":1441249238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6831","nonce":1441249238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6825","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6827","nonce":1441249238}]},"public_addr":"172.21.15.87:6819/1441249238","cluster_addr":"172.21.15.87:6823/1441249238","heartbeat_back_addr":"172.21.15.87:6831/1441249238","heartbeat_front_addr":"172.21.15.87:6827/1441249238","state":["exists","up"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6818","nonce":1173805234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6822","nonce":1173805234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6829","nonce":1173805234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6826","nonce":1173805234}]},"public_addr":"172.21.15.87:6818/1173805234","cluster_addr":"172.21.15.87:6822/1173805234","heartbeat_back_addr":"172.21.15.87:6829/1173805234","heartbeat_front_addr":"172.21.15.87:6826/1173805234","state":["exists","up"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6819","nonce":1551871079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6823","nonce":1551871079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6831","nonce":1551871079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6827","nonce":1551871079}]},"public_addr":"172.21.15.149:6819/1551871079","cluster_addr":"172.21.15.149:6823/1551871079","heartbeat_back_addr":"172.21.15.149:6831/1551871079","heartbeat_front_addr":"172.21.15.149:6827/1551871079","state":["exists","up"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6818","nonce":582864816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6822","nonce":582864816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6830","nonce":582864816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6826","nonce":582864816}]},"public_addr":"172.21.15.149:6818/582864816","cluster_addr":"172.21.15.149:6822/582864816","heartbeat_back_addr":"172.21.15.149:6830/582864816","heartbeat_front_addr":"172.21.15.149:6826/582864816","state":["exists","up"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6801","nonce":531351314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6803","nonce":531351314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6807","nonce":531351314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6805","nonce":531351314}]},"public_addr":"172.21.15.149:6801/531351314","cluster_addr":"172.21.15.149:6803/531351314","heartbeat_back_addr":"172.21.15.149:6807/531351314","heartbeat_front_addr":"172.21.15.149:6805/531351314","state":["exists","up"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6809","nonce":1171039913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6811","nonce":1171039913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6815","nonce":1171039913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6813","nonce":1171039913}]},"public_addr":"172.21.15.149:6809/1171039913","cluster_addr":"172.21.15.149:6811/1171039913","heartbeat_back_addr":"172.21.15.149:6815/1171039913","heartbeat_front_addr":"172.21.15.149:6813/1171039913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.589776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.819787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.767566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.683842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.038885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.120319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.687007+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.812832+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:27:56.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.975+0000 7f6a0aa00640 1 -- 172.21.15.87:0/1468077744 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f69e006f400 msgr2=0x7f69e0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:56.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.975+0000 7f6a0aa00640 1 --2- 172.21.15.87:0/1468077744 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f69e006f400 0x7f69e0071910 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0ae000 tx=0x7f69ec0a7000 comp rx=0 tx=0).stop 2024-05-27T06:27:56.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.975+0000 7f6a0aa00640 1 -- 172.21.15.87:0/1468077744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a040d1e50 msgr2=0x7f6a0415cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:56.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.975+0000 7f6a0aa00640 1 --2- 172.21.15.87:0/1468077744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a040d1e50 0x7f6a0415cb30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00c760 tx=0x7f69fc00cc20 comp rx=0 tx=0).stop 2024-05-27T06:27:56.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.979+0000 7f6a0aa00640 1 -- 172.21.15.87:0/1468077744 shutdown_connections 2024-05-27T06:27:56.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.979+0000 7f6a0aa00640 1 --2- 172.21.15.87:0/1468077744 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f69e006f400 0x7f69e0071910 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:56.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.979+0000 7f6a0aa00640 1 --2- 172.21.15.87:0/1468077744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a040d1e50 0x7f6a0415cb30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:56.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.979+0000 7f6a0aa00640 1 --2- 172.21.15.87:0/1468077744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a04072eb0 0x7f6a0415c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:56.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.979+0000 7f6a0aa00640 1 --2- 172.21.15.87:0/1468077744 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a04072aa0 0x7f6a041592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:56.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.979+0000 7f6a0aa00640 1 -- 172.21.15.87:0/1468077744 >> 172.21.15.87:0/1468077744 conn(0x7f6a040b46b0 msgr2=0x7f6a0406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:56.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.979+0000 7f6a0aa00640 1 -- 172.21.15.87:0/1468077744 shutdown_connections 2024-05-27T06:27:56.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:56.979+0000 7f6a0aa00640 1 -- 172.21.15.87:0/1468077744 wait complete. 2024-05-27T06:27:56.998 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T06:27:57.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.143+0000 7f76c2800640 1 Processor -- start 2024-05-27T06:27:57.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.143+0000 7f76c2800640 1 -- start start 2024-05-27T06:27:57.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.147+0000 7f76c2800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f76bc15cfe0 0x7f76bc15d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:57.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.147+0000 7f76c2800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f76bc0d1740 0x7f76bc0d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:57.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.147+0000 7f76c2800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76bc15d930 con 0x7f76bc0cbf90 2024-05-27T06:27:57.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.147+0000 7f76c2800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f76bc0d2090 con 0x7f76bc15cfe0 2024-05-27T06:27:57.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.147+0000 7f76c2800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f76bc15dbb0 con 0x7f76bc0d1740 2024-05-27T06:27:57.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.147+0000 7f76b2a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f76bc15cfe0 0x7f76bc15d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:57.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.147+0000 7f76b2a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f76bc15cfe0 0x7f76bc15d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37938/0 (socket says 172.21.15.87:37938) 2024-05-27T06:27:57.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.147+0000 7f76b2a00640 1 -- 172.21.15.87:0/1710136198 learned_addr learned my addr 172.21.15.87:0/1710136198 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:57.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.147+0000 7f76bbe00640 1 --2- 172.21.15.87:0/1710136198 >> v2:172.21.15.149:3300/0 conn(0x7f76bc0d1740 0x7f76bc0d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:57.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.147+0000 7f76b2a00640 1 -- 172.21.15.87:0/1710136198 >> v2:172.21.15.149:3300/0 conn(0x7f76bc0d1740 msgr2=0x7f76bc0d1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:57.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.147+0000 7f76b2a00640 1 --2- 172.21.15.87:0/1710136198 >> v2:172.21.15.149:3300/0 conn(0x7f76bc0d1740 0x7f76bc0d1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:57.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.147+0000 7f76b2a00640 1 -- 172.21.15.87:0/1710136198 >> v1:172.21.15.149:6789/0 conn(0x7f76bc0cbf90 legacy=0x7f76bc06cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:57.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.147+0000 7f76b2a00640 1 -- 172.21.15.87:0/1710136198 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76bc15de90 con 0x7f76bc15cfe0 2024-05-27T06:27:57.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.147+0000 7f76bbe00640 1 --2- 172.21.15.87:0/1710136198 >> v2:172.21.15.149:3300/0 conn(0x7f76bc0d1740 0x7f76bc0d1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:27:57.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.147+0000 7f76b2a00640 1 --2- 172.21.15.87:0/1710136198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76bc15cfe0 0x7f76bc15d3f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0cdc20 tx=0x7f76a401eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b701006469805375 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:57.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.151+0000 7f76baa00640 1 -- 172.21.15.87:0/1710136198 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a40b5070 con 0x7f76bc15cfe0 2024-05-27T06:27:57.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.151+0000 7f76baa00640 1 -- 172.21.15.87:0/1710136198 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76a40a87d0 con 0x7f76bc15cfe0 2024-05-27T06:27:57.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.151+0000 7f76baa00640 1 -- 172.21.15.87:0/1710136198 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a40a8ba0 con 0x7f76bc15cfe0 2024-05-27T06:27:57.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.151+0000 7f76c2800640 1 -- 172.21.15.87:0/1710136198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76bc15cfe0 msgr2=0x7f76bc15d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:57.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.151+0000 7f76c2800640 1 --2- 172.21.15.87:0/1710136198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76bc15cfe0 0x7f76bc15d3f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0cdc20 tx=0x7f76a401eb10 comp rx=0 tx=0).stop 2024-05-27T06:27:57.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.151+0000 7f76c2800640 1 -- 172.21.15.87:0/1710136198 shutdown_connections 2024-05-27T06:27:57.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.151+0000 7f76c2800640 1 --2- 172.21.15.87:0/1710136198 >> v2:172.21.15.149:3300/0 conn(0x7f76bc0d1740 0x7f76bc0d1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:57.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.151+0000 7f76c2800640 1 --2- 172.21.15.87:0/1710136198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76bc15cfe0 0x7f76bc15d3f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:57.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.151+0000 7f76c2800640 1 -- 172.21.15.87:0/1710136198 >> 172.21.15.87:0/1710136198 conn(0x7f76bc0b46b0 msgr2=0x7f76bc0b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:57.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.151+0000 7f76c2800640 1 -- 172.21.15.87:0/1710136198 shutdown_connections 2024-05-27T06:27:57.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.151+0000 7f76c2800640 1 -- 172.21.15.87:0/1710136198 wait complete. 2024-05-27T06:27:57.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.151+0000 7f76c2800640 1 Processor -- start 2024-05-27T06:27:57.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.151+0000 7f76c2800640 1 -- start start 2024-05-27T06:27:57.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.155+0000 7f76c2800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76bc0cbf90 0x7f76bc0ae190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:57.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.155+0000 7f76c2800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76bc0d1740 0x7f76bc1f6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:57.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.155+0000 7f76c2800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76bc15cfe0 0x7f76bc1f6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:57.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.155+0000 7f76c2800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f76bc15e170 con 0x7f76bc0d1740 2024-05-27T06:27:57.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.155+0000 7f76c2800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f76bc06caa0 con 0x7f76bc0cbf90 2024-05-27T06:27:57.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.155+0000 7f76c2800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f76bc0cc3a0 con 0x7f76bc15cfe0 2024-05-27T06:27:57.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.155+0000 7f76b2a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76bc0d1740 0x7f76bc1f6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:57.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.155+0000 7f76b2a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76bc0d1740 0x7f76bc1f6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37944/0 (socket says 172.21.15.87:37944) 2024-05-27T06:27:57.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.155+0000 7f76b2a00640 1 -- 172.21.15.87:0/186253917 learned_addr learned my addr 172.21.15.87:0/186253917 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:57.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.155+0000 7f76bbe00640 1 --2- 172.21.15.87:0/186253917 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76bc15cfe0 0x7f76bc1f6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:57.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.155+0000 7f76bb400640 1 --2- 172.21.15.87:0/186253917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76bc0cbf90 0x7f76bc0ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:57.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.155+0000 7f76b2a00640 1 -- 172.21.15.87:0/186253917 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76bc15cfe0 msgr2=0x7f76bc1f6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:57.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.155+0000 7f76b2a00640 1 --2- 172.21.15.87:0/186253917 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76bc15cfe0 0x7f76bc1f6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:57.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.155+0000 7f76b2a00640 1 -- 172.21.15.87:0/186253917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76bc0cbf90 msgr2=0x7f76bc0ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:57.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.155+0000 7f76b2a00640 1 --2- 172.21.15.87:0/186253917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76bc0cbf90 0x7f76bc0ae190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:57.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.155+0000 7f76b2a00640 1 -- 172.21.15.87:0/186253917 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76bc070390 con 0x7f76bc0d1740 2024-05-27T06:27:57.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.155+0000 7f76bb400640 1 --2- 172.21.15.87:0/186253917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76bc0cbf90 0x7f76bc0ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:27:57.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.155+0000 7f76b2a00640 1 --2- 172.21.15.87:0/186253917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76bc0d1740 0x7f76bc1f6150 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f76a401f3b0 tx=0x7f76a401b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:57.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.155+0000 7f76b3e00640 1 -- 172.21.15.87:0/186253917 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a40b5040 con 0x7f76bc0d1740 2024-05-27T06:27:57.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.155+0000 7f76b3e00640 1 -- 172.21.15.87:0/186253917 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76a40be070 con 0x7f76bc0d1740 2024-05-27T06:27:57.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.155+0000 7f76c2800640 1 -- 172.21.15.87:0/186253917 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76bc0caa90 con 0x7f76bc0d1740 2024-05-27T06:27:57.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.155+0000 7f76b3e00640 1 -- 172.21.15.87:0/186253917 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a40b0940 con 0x7f76bc0d1740 2024-05-27T06:27:57.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.155+0000 7f76c2800640 1 -- 172.21.15.87:0/186253917 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76bc0cafb0 con 0x7f76bc0d1740 2024-05-27T06:27:57.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.155+0000 7f76c2800640 1 -- 172.21.15.87:0/186253917 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76bc06aa30 con 0x7f76bc0d1740 2024-05-27T06:27:57.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.159+0000 7f76b3e00640 1 -- 172.21.15.87:0/186253917 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f76a40b0ae0 con 0x7f76bc0d1740 2024-05-27T06:27:57.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.159+0000 7f76b3e00640 1 --2- 172.21.15.87:0/186253917 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f769806f430 0x7f7698071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:57.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.159+0000 7f76b3e00640 1 -- 172.21.15.87:0/186253917 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f76a412ca10 con 0x7f76bc0d1740 2024-05-27T06:27:57.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.159+0000 7f76bb400640 1 --2- 172.21.15.87:0/186253917 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f769806f430 0x7f7698071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:57.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.159+0000 7f76bb400640 1 --2- 172.21.15.87:0/186253917 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f769806f430 0x7f7698071940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f76ac0098b0 tx=0x7f76ac008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:57.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.163+0000 7f76b3e00640 1 -- 172.21.15.87:0/186253917 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f76bc0caa90 con 0x7f76bc0d1740 2024-05-27T06:27:57.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.323+0000 7f76c2800640 1 -- 172.21.15.87:0/186253917 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76bc0cb1f0 con 0x7f76bc0d1740 2024-05-27T06:27:57.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.323+0000 7f76b3e00640 1 -- 172.21.15.87:0/186253917 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7f76bc15d930 con 0x7f76bc0d1740 2024-05-27T06:27:57.323 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:27:57.323 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:27:43.048854+0000","last_up_change":"2024-05-27T06:27:25.988592+0000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T06:27:26.590191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T06:27:35.840893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T06:27:36.929608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-27T06:27:40.638358+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6801","nonce":3674824716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6803","nonce":3674824716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6807","nonce":3674824716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6805","nonce":3674824716}]},"public_addr":"172.21.15.87:6801/3674824716","cluster_addr":"172.21.15.87:6803/3674824716","heartbeat_back_addr":"172.21.15.87:6807/3674824716","heartbeat_front_addr":"172.21.15.87:6805/3674824716","state":["exists","up"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6809","nonce":2443981288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6811","nonce":2443981288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6815","nonce":2443981288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6813","nonce":2443981288}]},"public_addr":"172.21.15.87:6809/2443981288","cluster_addr":"172.21.15.87:6811/2443981288","heartbeat_back_addr":"172.21.15.87:6815/2443981288","heartbeat_front_addr":"172.21.15.87:6813/2443981288","state":["exists","up"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6819","nonce":1441249238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6823","nonce":1441249238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6831","nonce":1441249238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6825","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6827","nonce":1441249238}]},"public_addr":"172.21.15.87:6819/1441249238","cluster_addr":"172.21.15.87:6823/1441249238","heartbeat_back_addr":"172.21.15.87:6831/1441249238","heartbeat_front_addr":"172.21.15.87:6827/1441249238","state":["exists","up"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6818","nonce":1173805234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6822","nonce":1173805234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6829","nonce":1173805234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6826","nonce":1173805234}]},"public_addr":"172.21.15.87:6818/1173805234","cluster_addr":"172.21.15.87:6822/1173805234","heartbeat_back_addr":"172.21.15.87:6829/1173805234","heartbeat_front_addr":"172.21.15.87:6826/1173805234","state":["exists","up"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6819","nonce":1551871079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6823","nonce":1551871079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6831","nonce":1551871079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6827","nonce":1551871079}]},"public_addr":"172.21.15.149:6819/1551871079","cluster_addr":"172.21.15.149:6823/1551871079","heartbeat_back_addr":"172.21.15.149:6831/1551871079","heartbeat_front_addr":"172.21.15.149:6827/1551871079","state":["exists","up"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6818","nonce":582864816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6822","nonce":582864816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6830","nonce":582864816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6826","nonce":582864816}]},"public_addr":"172.21.15.149:6818/582864816","cluster_addr":"172.21.15.149:6822/582864816","heartbeat_back_addr":"172.21.15.149:6830/582864816","heartbeat_front_addr":"172.21.15.149:6826/582864816","state":["exists","up"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6801","nonce":531351314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6803","nonce":531351314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6807","nonce":531351314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6805","nonce":531351314}]},"public_addr":"172.21.15.149:6801/531351314","cluster_addr":"172.21.15.149:6803/531351314","heartbeat_back_addr":"172.21.15.149:6807/531351314","heartbeat_front_addr":"172.21.15.149:6805/531351314","state":["exists","up"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6809","nonce":1171039913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6811","nonce":1171039913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6815","nonce":1171039913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6813","nonce":1171039913}]},"public_addr":"172.21.15.149:6809/1171039913","cluster_addr":"172.21.15.149:6811/1171039913","heartbeat_back_addr":"172.21.15.149:6815/1171039913","heartbeat_front_addr":"172.21.15.149:6813/1171039913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.589776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.819787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.767566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.683842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.038885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.120319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.687007+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.812832+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:27:57.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.323+0000 7f76c2800640 1 -- 172.21.15.87:0/186253917 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f769806f430 msgr2=0x7f7698071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:57.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.323+0000 7f76c2800640 1 --2- 172.21.15.87:0/186253917 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f769806f430 0x7f7698071940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f76ac0098b0 tx=0x7f76ac008040 comp rx=0 tx=0).stop 2024-05-27T06:27:57.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.323+0000 7f76c2800640 1 -- 172.21.15.87:0/186253917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76bc0d1740 msgr2=0x7f76bc1f6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:57.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.323+0000 7f76c2800640 1 --2- 172.21.15.87:0/186253917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76bc0d1740 0x7f76bc1f6150 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f76a401f3b0 tx=0x7f76a401b8b0 comp rx=0 tx=0).stop 2024-05-27T06:27:57.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.323+0000 7f76c2800640 1 -- 172.21.15.87:0/186253917 shutdown_connections 2024-05-27T06:27:57.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.323+0000 7f76c2800640 1 --2- 172.21.15.87:0/186253917 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f769806f430 0x7f7698071940 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:57.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.323+0000 7f76c2800640 1 --2- 172.21.15.87:0/186253917 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76bc15cfe0 0x7f76bc1f6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:57.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.323+0000 7f76c2800640 1 --2- 172.21.15.87:0/186253917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76bc0d1740 0x7f76bc1f6150 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:57.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.323+0000 7f76c2800640 1 --2- 172.21.15.87:0/186253917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76bc0cbf90 0x7f76bc0ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:57.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.323+0000 7f76c2800640 1 -- 172.21.15.87:0/186253917 >> 172.21.15.87:0/186253917 conn(0x7f76bc0b46b0 msgr2=0x7f76bc0b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:57.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.323+0000 7f76c2800640 1 -- 172.21.15.87:0/186253917 shutdown_connections 2024-05-27T06:27:57.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.327+0000 7f76c2800640 1 -- 172.21.15.87:0/186253917 wait complete. 2024-05-27T06:27:57.345 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-27T06:27:57.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.499+0000 7fda6e600640 1 Processor -- start 2024-05-27T06:27:57.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.499+0000 7fda6e600640 1 -- start start 2024-05-27T06:27:57.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.499+0000 7fda6e600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fda6815d350 0x7fda680cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:57.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.499+0000 7fda6e600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fda680ce220 0x7fda6806c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:57.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.499+0000 7fda6e600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda6806db10 con 0x7fda6815c3f0 2024-05-27T06:27:57.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.499+0000 7fda6e600640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fda680ce630 con 0x7fda6815d350 2024-05-27T06:27:57.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.499+0000 7fda6e600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fda6815d760 con 0x7fda680ce220 2024-05-27T06:27:57.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.499+0000 7fda5ea00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fda6815d350 0x7fda680cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:57.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.499+0000 7fda5ea00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fda6815d350 0x7fda680cdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37956/0 (socket says 172.21.15.87:37956) 2024-05-27T06:27:57.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.499+0000 7fda5ea00640 1 -- 172.21.15.87:0/263481736 learned_addr learned my addr 172.21.15.87:0/263481736 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:57.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.499+0000 7fda67e00640 1 --2- 172.21.15.87:0/263481736 >> v2:172.21.15.149:3300/0 conn(0x7fda680ce220 0x7fda6806c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:57.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.499+0000 7fda5ea00640 1 -- 172.21.15.87:0/263481736 >> v2:172.21.15.149:3300/0 conn(0x7fda680ce220 msgr2=0x7fda6806c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:57.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.499+0000 7fda5ea00640 1 --2- 172.21.15.87:0/263481736 >> v2:172.21.15.149:3300/0 conn(0x7fda680ce220 0x7fda6806c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:57.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.499+0000 7fda5ea00640 1 -- 172.21.15.87:0/263481736 >> v1:172.21.15.149:6789/0 conn(0x7fda6815c3f0 legacy=0x7fda68160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:57.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.499+0000 7fda5ea00640 1 -- 172.21.15.87:0/263481736 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda680cf2a0 con 0x7fda6815d350 2024-05-27T06:27:57.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.499+0000 7fda5ea00640 1 --2- 172.21.15.87:0/263481736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda6815d350 0x7fda680cdce0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fda68072a50 tx=0x7fda5001d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a2f694b7497c77d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:57.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.499+0000 7fda66a00640 1 -- 172.21.15.87:0/263481736 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda500b3070 con 0x7fda6815d350 2024-05-27T06:27:57.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.499+0000 7fda66a00640 1 -- 172.21.15.87:0/263481736 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda500a6810 con 0x7fda6815d350 2024-05-27T06:27:57.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.499+0000 7fda66a00640 1 -- 172.21.15.87:0/263481736 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5000b040 con 0x7fda6815d350 2024-05-27T06:27:57.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.499+0000 7fda6e600640 1 -- 172.21.15.87:0/263481736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda6815d350 msgr2=0x7fda680cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:57.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.499+0000 7fda6e600640 1 --2- 172.21.15.87:0/263481736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda6815d350 0x7fda680cdce0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fda68072a50 tx=0x7fda5001d8f0 comp rx=0 tx=0).stop 2024-05-27T06:27:57.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.499+0000 7fda6e600640 1 -- 172.21.15.87:0/263481736 shutdown_connections 2024-05-27T06:27:57.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.499+0000 7fda6e600640 1 --2- 172.21.15.87:0/263481736 >> v2:172.21.15.149:3300/0 conn(0x7fda680ce220 0x7fda6806c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:57.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.499+0000 7fda6e600640 1 --2- 172.21.15.87:0/263481736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda6815d350 0x7fda680cdce0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:57.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.499+0000 7fda6e600640 1 -- 172.21.15.87:0/263481736 >> 172.21.15.87:0/263481736 conn(0x7fda680b46b0 msgr2=0x7fda680b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:57.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.499+0000 7fda6e600640 1 -- 172.21.15.87:0/263481736 shutdown_connections 2024-05-27T06:27:57.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.499+0000 7fda6e600640 1 -- 172.21.15.87:0/263481736 wait complete. 2024-05-27T06:27:57.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.503+0000 7fda6e600640 1 Processor -- start 2024-05-27T06:27:57.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.503+0000 7fda6e600640 1 -- start start 2024-05-27T06:27:57.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.503+0000 7fda6e600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda680ce220 0x7fda6815b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:57.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.503+0000 7fda6e600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda6815c3f0 0x7fda681f9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:57.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.503+0000 7fda6e600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda6815d350 0x7fda680738c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:57.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.503+0000 7fda6e600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fda6806d070 con 0x7fda6815c3f0 2024-05-27T06:27:57.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.503+0000 7fda6e600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fda680cf860 con 0x7fda6815d350 2024-05-27T06:27:57.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.503+0000 7fda6e600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fda680b2f00 con 0x7fda680ce220 2024-05-27T06:27:57.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.503+0000 7fda5ea00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda6815c3f0 0x7fda681f9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:57.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.503+0000 7fda5ea00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda6815c3f0 0x7fda681f9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37972/0 (socket says 172.21.15.87:37972) 2024-05-27T06:27:57.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.503+0000 7fda5ea00640 1 -- 172.21.15.87:0/477468908 learned_addr learned my addr 172.21.15.87:0/477468908 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:57.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.503+0000 7fda67400640 1 --2- 172.21.15.87:0/477468908 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda680ce220 0x7fda6815b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:57.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.503+0000 7fda67e00640 1 --2- 172.21.15.87:0/477468908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda6815d350 0x7fda680738c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:57.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.503+0000 7fda5ea00640 1 -- 172.21.15.87:0/477468908 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda680ce220 msgr2=0x7fda6815b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:57.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.503+0000 7fda5ea00640 1 --2- 172.21.15.87:0/477468908 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda680ce220 0x7fda6815b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:57.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.503+0000 7fda5ea00640 1 -- 172.21.15.87:0/477468908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda6815d350 msgr2=0x7fda680738c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:57.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.503+0000 7fda5ea00640 1 --2- 172.21.15.87:0/477468908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda6815d350 0x7fda680738c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:57.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.507+0000 7fda5ea00640 1 -- 172.21.15.87:0/477468908 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda680b0990 con 0x7fda6815c3f0 2024-05-27T06:27:57.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.507+0000 7fda5ea00640 1 --2- 172.21.15.87:0/477468908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda6815c3f0 0x7fda681f9280 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fda5000a1c0 tx=0x7fda5001c130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:57.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.507+0000 7fda5fe00640 1 -- 172.21.15.87:0/477468908 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda500b3070 con 0x7fda6815c3f0 2024-05-27T06:27:57.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.507+0000 7fda5fe00640 1 -- 172.21.15.87:0/477468908 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda500b5070 con 0x7fda6815c3f0 2024-05-27T06:27:57.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.507+0000 7fda6e600640 1 -- 172.21.15.87:0/477468908 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda681662b0 con 0x7fda6815c3f0 2024-05-27T06:27:57.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.507+0000 7fda5fe00640 1 -- 172.21.15.87:0/477468908 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda500aea90 con 0x7fda6815c3f0 2024-05-27T06:27:57.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.507+0000 7fda6e600640 1 -- 172.21.15.87:0/477468908 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda68166870 con 0x7fda6815c3f0 2024-05-27T06:27:57.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.507+0000 7fda6e600640 1 -- 172.21.15.87:0/477468908 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda6806aa30 con 0x7fda6815c3f0 2024-05-27T06:27:57.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.507+0000 7fda5fe00640 1 -- 172.21.15.87:0/477468908 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fda500aec30 con 0x7fda6815c3f0 2024-05-27T06:27:57.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.511+0000 7fda5fe00640 1 --2- 172.21.15.87:0/477468908 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fda4406f400 0x7fda44071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:57.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.511+0000 7fda5fe00640 1 -- 172.21.15.87:0/477468908 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fda50129670 con 0x7fda6815c3f0 2024-05-27T06:27:57.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.511+0000 7fda67400640 1 --2- 172.21.15.87:0/477468908 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fda4406f400 0x7fda44071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:57.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.511+0000 7fda67400640 1 --2- 172.21.15.87:0/477468908 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fda4406f400 0x7fda44071910 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fda58007fd0 tx=0x7fda58009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:57.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.511+0000 7fda5fe00640 1 -- 172.21.15.87:0/477468908 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fda500174e0 con 0x7fda6815c3f0 2024-05-27T06:27:57.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:57.711+0000 7fda6e600640 1 -- 172.21.15.87:0/477468908 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fda68160b50 con 0x7fda6815c3f0 2024-05-27T06:27:58.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.691+0000 7fda5fe00640 1 -- 172.21.15.87:0/477468908 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7fda500f5dd0 con 0x7fda6815c3f0 2024-05-27T06:27:58.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.691+0000 7fda6e600640 1 -- 172.21.15.87:0/477468908 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fda4406f400 msgr2=0x7fda44071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:58.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.691+0000 7fda6e600640 1 --2- 172.21.15.87:0/477468908 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fda4406f400 0x7fda44071910 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fda58007fd0 tx=0x7fda58009040 comp rx=0 tx=0).stop 2024-05-27T06:27:58.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.691+0000 7fda6e600640 1 -- 172.21.15.87:0/477468908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda6815c3f0 msgr2=0x7fda681f9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:58.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.691+0000 7fda6e600640 1 --2- 172.21.15.87:0/477468908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda6815c3f0 0x7fda681f9280 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fda5000a1c0 tx=0x7fda5001c130 comp rx=0 tx=0).stop 2024-05-27T06:27:58.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.691+0000 7fda6e600640 1 -- 172.21.15.87:0/477468908 shutdown_connections 2024-05-27T06:27:58.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.691+0000 7fda6e600640 1 --2- 172.21.15.87:0/477468908 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fda4406f400 0x7fda44071910 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:58.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.691+0000 7fda6e600640 1 --2- 172.21.15.87:0/477468908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda6815d350 0x7fda680738c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:58.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.691+0000 7fda6e600640 1 --2- 172.21.15.87:0/477468908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda6815c3f0 0x7fda681f9280 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:58.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.691+0000 7fda6e600640 1 --2- 172.21.15.87:0/477468908 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda680ce220 0x7fda6815b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:58.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.691+0000 7fda6e600640 1 -- 172.21.15.87:0/477468908 >> 172.21.15.87:0/477468908 conn(0x7fda680b46b0 msgr2=0x7fda680b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:58.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.691+0000 7fda6e600640 1 -- 172.21.15.87:0/477468908 shutdown_connections 2024-05-27T06:27:58.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.691+0000 7fda6e600640 1 -- 172.21.15.87:0/477468908 wait complete. 2024-05-27T06:27:58.711 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-05-27T06:27:58.712 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-27T06:27:58.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.867+0000 7f3fbfa00640 1 Processor -- start 2024-05-27T06:27:58.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.867+0000 7f3fbfa00640 1 -- start start 2024-05-27T06:27:58.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fbfa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fb80d0c20 0x7f3fb80d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:58.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fbfa00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fb80b65e0 con 0x7f3fb81644e0 2024-05-27T06:27:58.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fbfa00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fb80b6300 con 0x7f3fb80742e0 2024-05-27T06:27:58.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fbfa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3fb81606f0 con 0x7f3fb80d0c20 2024-05-27T06:27:58.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fbd000640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f3fb81644e0 0x7f3fb8073bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:58690/0 (socket says 172.21.15.87:58690) 2024-05-27T06:27:58.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fbd000640 1 -- 172.21.15.87:0/1289912521 learned_addr learned my addr 172.21.15.87:0/1289912521 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:27:58.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fbda00640 1 --2- 172.21.15.87:0/1289912521 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fb80d0c20 0x7f3fb80d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:58.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fb7e00640 1 -- 172.21.15.87:0/1289912521 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 610359624 0 0) 0x7f3fa8001120 con 0x7f3fb81644e0 2024-05-27T06:27:58.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fb7e00640 1 -- 172.21.15.87:0/1289912521 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f9c003530 con 0x7f3fb81644e0 2024-05-27T06:27:58.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fb7e00640 1 -- 172.21.15.87:0/1289912521 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2484878932 0 0) 0x7f3f9c003530 con 0x7f3fb81644e0 2024-05-27T06:27:58.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fb7e00640 1 -- 172.21.15.87:0/1289912521 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fb80d0c20 msgr2=0x7f3fb80d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:58.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fb7e00640 1 --2- 172.21.15.87:0/1289912521 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fb80d0c20 0x7f3fb80d1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:58.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fb7e00640 1 -- 172.21.15.87:0/1289912521 >> v1:172.21.15.149:6789/0 conn(0x7f3fb80742e0 legacy=0x7f3fb80d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:58.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fb7e00640 1 -- 172.21.15.87:0/1289912521 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb81609d0 con 0x7f3fb81644e0 2024-05-27T06:27:58.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fb7e00640 1 -- 172.21.15.87:0/1289912521 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7f3fa80018d0 con 0x7f3fb81644e0 2024-05-27T06:27:58.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fb7e00640 1 -- 172.21.15.87:0/1289912521 >> v1:172.21.15.87:6789/0 conn(0x7f3fb81644e0 legacy=0x7f3fb8073bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:58.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fb7e00640 1 --2- 172.21.15.87:0/1289912521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f9c0039f0 0x7f3f9c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:58.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fb7e00640 1 --2- 172.21.15.87:0/1289912521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f9c004810 0x7f3f9c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:58.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fb7e00640 1 --2- 172.21.15.87:0/1289912521 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fb80d0c20 0x7f3f9c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:58.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fb7e00640 1 -- 172.21.15.87:0/1289912521 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb81606f0 con 0x7f3f9c004810 2024-05-27T06:27:58.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fb7e00640 1 -- 172.21.15.87:0/1289912521 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3f9c00bb00 con 0x7f3f9c0039f0 2024-05-27T06:27:58.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fb7e00640 1 -- 172.21.15.87:0/1289912521 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3f9c00bd00 con 0x7f3fb80d0c20 2024-05-27T06:27:58.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fafe00640 1 --2- 172.21.15.87:0/1289912521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f9c004810 0x7f3f9c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:58.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fbd000640 1 --2- 172.21.15.87:0/1289912521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f9c0039f0 0x7f3f9c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:58.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fbda00640 1 --2- 172.21.15.87:0/1289912521 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fb80d0c20 0x7f3f9c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:58.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fafe00640 1 -- 172.21.15.87:0/1289912521 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fb80d0c20 msgr2=0x7f3f9c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:58.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fafe00640 1 --2- 172.21.15.87:0/1289912521 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fb80d0c20 0x7f3f9c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:58.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fafe00640 1 -- 172.21.15.87:0/1289912521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f9c0039f0 msgr2=0x7f3f9c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:58.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fafe00640 1 --2- 172.21.15.87:0/1289912521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f9c0039f0 0x7f3f9c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:58.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fafe00640 1 -- 172.21.15.87:0/1289912521 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f9c003530 con 0x7f3f9c004810 2024-05-27T06:27:58.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.871+0000 7f3fbda00640 1 --2- 172.21.15.87:0/1289912521 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fb80d0c20 0x7f3f9c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:27:58.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.875+0000 7f3fafe00640 1 --2- 172.21.15.87:0/1289912521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f9c004810 0x7f3f9c004c20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0001840 tx=0x7f3fa001ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e70877ae22e0f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:58.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.875+0000 7f3fb7e00640 1 -- 172.21.15.87:0/1289912521 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa00b5070 con 0x7f3f9c004810 2024-05-27T06:27:58.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.875+0000 7f3fb7e00640 1 -- 172.21.15.87:0/1289912521 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fa00a8930 con 0x7f3f9c004810 2024-05-27T06:27:58.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.875+0000 7f3fb7e00640 1 -- 172.21.15.87:0/1289912521 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0001460 con 0x7f3f9c004810 2024-05-27T06:27:58.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.875+0000 7f3fbfa00640 1 -- 172.21.15.87:0/1289912521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f9c004810 msgr2=0x7f3f9c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:58.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.875+0000 7f3fbfa00640 1 --2- 172.21.15.87:0/1289912521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f9c004810 0x7f3f9c004c20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0001840 tx=0x7f3fa001ec50 comp rx=0 tx=0).stop 2024-05-27T06:27:58.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.875+0000 7f3fbda00640 1 -- 172.21.15.87:0/1289912521 reap_dead start 2024-05-27T06:27:58.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.875+0000 7f3fbfa00640 1 -- 172.21.15.87:0/1289912521 shutdown_connections 2024-05-27T06:27:58.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.875+0000 7f3fbfa00640 1 -- 172.21.15.87:0/1289912521 >> 172.21.15.87:0/1289912521 conn(0x7f3fb806fe10 msgr2=0x7f3fb8070220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:58.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.875+0000 7f3fbfa00640 1 -- 172.21.15.87:0/1289912521 shutdown_connections 2024-05-27T06:27:58.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.875+0000 7f3fbfa00640 1 -- 172.21.15.87:0/1289912521 wait complete. 2024-05-27T06:27:58.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.879+0000 7f3fbfa00640 1 Processor -- start 2024-05-27T06:27:58.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.879+0000 7f3fbfa00640 1 -- start start 2024-05-27T06:27:58.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.879+0000 7f3fbfa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f9c004810 0x7f3fb80cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:58.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.879+0000 7f3fbfa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fb81f9f20 0x7f3fb80713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:58.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.879+0000 7f3fbfa00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fb8071900 0x7f3fb8144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:58.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.879+0000 7f3fbfa00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb80b1bd0 con 0x7f3fb8071900 2024-05-27T06:27:58.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.879+0000 7f3fbfa00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb81648f0 con 0x7f3f9c004810 2024-05-27T06:27:58.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.879+0000 7f3fbfa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3fb80b1d50 con 0x7f3fb81f9f20 2024-05-27T06:27:58.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.879+0000 7f3fafe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fb81f9f20 0x7f3fb80713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:58.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.879+0000 7f3fbd000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f9c004810 0x7f3fb80cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:58.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.879+0000 7f3fbd000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f9c004810 0x7f3fb80cdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:39482/0 (socket says 172.21.15.87:39482) 2024-05-27T06:27:58.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.879+0000 7f3fafe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fb81f9f20 0x7f3fb80713c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.87:44788/0 (socket says 172.21.15.87:44788) 2024-05-27T06:27:58.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.879+0000 7f3fbd000640 1 -- 172.21.15.87:0/1598533813 learned_addr learned my addr 172.21.15.87:0/1598533813 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:58.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.879+0000 7f3fbda00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fb8071900 0x7f3fb8144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:58.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.879+0000 7f3fbda00640 1 -- 172.21.15.87:0/1598533813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fb81f9f20 msgr2=0x7f3fb80713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:58.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.879+0000 7f3fbda00640 1 --2- 172.21.15.87:0/1598533813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fb81f9f20 0x7f3fb80713c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:58.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.879+0000 7f3fbda00640 1 -- 172.21.15.87:0/1598533813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f9c004810 msgr2=0x7f3fb80cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:58.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.879+0000 7f3fbda00640 1 --2- 172.21.15.87:0/1598533813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f9c004810 0x7f3fb80cdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:58.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.879+0000 7f3fbda00640 1 -- 172.21.15.87:0/1598533813 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb815e110 con 0x7f3fb8071900 2024-05-27T06:27:58.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.879+0000 7f3fafe00640 1 --2- 172.21.15.87:0/1598533813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fb81f9f20 0x7f3fb80713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:27:58.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.879+0000 7f3fbda00640 1 --2- 172.21.15.87:0/1598533813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fb8071900 0x7f3fb8144770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3fb80d00c0 tx=0x7f3fb0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:58.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.879+0000 7f3fb5600640 1 -- 172.21.15.87:0/1598533813 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0010e50 con 0x7f3fb8071900 2024-05-27T06:27:58.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.879+0000 7f3fb5600640 1 -- 172.21.15.87:0/1598533813 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fb00039a0 con 0x7f3fb8071900 2024-05-27T06:27:58.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.879+0000 7f3fbfa00640 1 -- 172.21.15.87:0/1598533813 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fb8071d10 con 0x7f3fb8071900 2024-05-27T06:27:58.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.879+0000 7f3fb5600640 1 -- 172.21.15.87:0/1598533813 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0003d90 con 0x7f3fb8071900 2024-05-27T06:27:58.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.879+0000 7f3fbfa00640 1 -- 172.21.15.87:0/1598533813 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fb815e380 con 0x7f3fb8071900 2024-05-27T06:27:58.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.883+0000 7f3fbfa00640 1 -- 172.21.15.87:0/1598533813 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fb81e9940 con 0x7f3fb8071900 2024-05-27T06:27:58.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.883+0000 7f3fb5600640 1 -- 172.21.15.87:0/1598533813 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3fb001e020 con 0x7f3fb8071900 2024-05-27T06:27:58.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.883+0000 7f3fb5600640 1 --2- 172.21.15.87:0/1598533813 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3f9406f400 0x7f3f94071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:58.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.883+0000 7f3fb5600640 1 -- 172.21.15.87:0/1598533813 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3fb008fbc0 con 0x7f3fb8071900 2024-05-27T06:27:58.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.883+0000 7f3fbd000640 1 --2- 172.21.15.87:0/1598533813 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3f9406f400 0x7f3f94071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:58.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.883+0000 7f3fbd000640 1 --2- 172.21.15.87:0/1598533813 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3f9406f400 0x7f3f94071910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8001020 tx=0x7f3fa8007b30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:58.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:58.887+0000 7f3fb5600640 1 -- 172.21.15.87:0/1598533813 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f3fb8071d10 con 0x7f3fb8071900 2024-05-27T06:27:59.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.079+0000 7f3fbfa00640 1 -- 172.21.15.87:0/1598533813 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f3fb81598d0 con 0x7f3fb8071900 2024-05-27T06:27:59.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.691+0000 7f3fb5600640 1 -- 172.21.15.87:0/1598533813 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7f3fb008f020 con 0x7f3fb8071900 2024-05-27T06:27:59.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.695+0000 7f3fbfa00640 1 -- 172.21.15.87:0/1598533813 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3f9406f400 msgr2=0x7f3f94071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:59.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.695+0000 7f3fbfa00640 1 --2- 172.21.15.87:0/1598533813 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3f9406f400 0x7f3f94071910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8001020 tx=0x7f3fa8007b30 comp rx=0 tx=0).stop 2024-05-27T06:27:59.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.695+0000 7f3fbfa00640 1 -- 172.21.15.87:0/1598533813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fb8071900 msgr2=0x7f3fb8144770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:59.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.695+0000 7f3fbfa00640 1 --2- 172.21.15.87:0/1598533813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fb8071900 0x7f3fb8144770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3fb80d00c0 tx=0x7f3fb0009f90 comp rx=0 tx=0).stop 2024-05-27T06:27:59.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.695+0000 7f3fbfa00640 1 -- 172.21.15.87:0/1598533813 shutdown_connections 2024-05-27T06:27:59.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.695+0000 7f3fbfa00640 1 --2- 172.21.15.87:0/1598533813 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3f9406f400 0x7f3f94071910 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:59.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.695+0000 7f3fbfa00640 1 --2- 172.21.15.87:0/1598533813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fb8071900 0x7f3fb8144770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:59.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.695+0000 7f3fbfa00640 1 --2- 172.21.15.87:0/1598533813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fb81f9f20 0x7f3fb80713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:59.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.695+0000 7f3fbfa00640 1 --2- 172.21.15.87:0/1598533813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f9c004810 0x7f3fb80cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:59.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.695+0000 7f3fbfa00640 1 -- 172.21.15.87:0/1598533813 >> 172.21.15.87:0/1598533813 conn(0x7f3fb806fe10 msgr2=0x7f3fb8070220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:59.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.695+0000 7f3fbfa00640 1 -- 172.21.15.87:0/1598533813 shutdown_connections 2024-05-27T06:27:59.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.695+0000 7f3fbfa00640 1 -- 172.21.15.87:0/1598533813 wait complete. 2024-05-27T06:27:59.713 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-27T06:27:59.713 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T06:27:59.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.863+0000 7f7b47400640 1 Processor -- start 2024-05-27T06:27:59.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.863+0000 7f7b47400640 1 -- start start 2024-05-27T06:27:59.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b47400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7b400d1e50 0x7f7b400ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:59.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b47400640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b400cd120 con 0x7f7b40072eb0 2024-05-27T06:27:59.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b47400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b400cd400 con 0x7f7b40072aa0 2024-05-27T06:27:59.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b47400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f7b400cdd30 con 0x7f7b400d1e50 2024-05-27T06:27:59.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b37e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f7b40072eb0 0x7f7b400d1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:58704/0 (socket says 172.21.15.87:58704) 2024-05-27T06:27:59.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b37e00640 1 -- 172.21.15.87:0/1801564114 learned_addr learned my addr 172.21.15.87:0/1801564114 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:27:59.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b45400640 1 --2- 172.21.15.87:0/1801564114 >> v2:172.21.15.149:3300/0 conn(0x7f7b400d1e50 0x7f7b400ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:59.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b3fe00640 1 -- 172.21.15.87:0/1801564114 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 627837384 0 0) 0x7f7b400cd120 con 0x7f7b40072eb0 2024-05-27T06:27:59.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b3fe00640 1 -- 172.21.15.87:0/1801564114 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b24003530 con 0x7f7b40072eb0 2024-05-27T06:27:59.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b3fe00640 1 -- 172.21.15.87:0/1801564114 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3827277460 0 0) 0x7f7b400cd400 con 0x7f7b40072aa0 2024-05-27T06:27:59.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b3fe00640 1 -- 172.21.15.87:0/1801564114 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b400cd120 con 0x7f7b40072aa0 2024-05-27T06:27:59.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b3fe00640 1 -- 172.21.15.87:0/1801564114 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 37169093 0 0) 0x7f7b24003530 con 0x7f7b40072eb0 2024-05-27T06:27:59.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b3fe00640 1 -- 172.21.15.87:0/1801564114 >> v2:172.21.15.149:3300/0 conn(0x7f7b400d1e50 msgr2=0x7f7b400ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:59.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b3fe00640 1 --2- 172.21.15.87:0/1801564114 >> v2:172.21.15.149:3300/0 conn(0x7f7b400d1e50 0x7f7b400ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:59.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b3fe00640 1 -- 172.21.15.87:0/1801564114 >> v1:172.21.15.149:6789/0 conn(0x7f7b40072aa0 legacy=0x7f7b4006d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:59.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b3fe00640 1 -- 172.21.15.87:0/1801564114 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b400cd6e0 con 0x7f7b40072eb0 2024-05-27T06:27:59.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b3fe00640 1 -- 172.21.15.87:0/1801564114 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7f7b28001700 con 0x7f7b40072eb0 2024-05-27T06:27:59.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b3fe00640 1 -- 172.21.15.87:0/1801564114 >> v1:172.21.15.87:6789/0 conn(0x7f7b40072eb0 legacy=0x7f7b400d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:59.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b3fe00640 1 --2- 172.21.15.87:0/1801564114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b24003cb0 0x7f7b24004100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:59.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b3fe00640 1 --2- 172.21.15.87:0/1801564114 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b24004810 0x7f7b24004ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:59.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b3fe00640 1 --2- 172.21.15.87:0/1801564114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b24005310 0x7f7b2400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:59.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b3fe00640 1 -- 172.21.15.87:0/1801564114 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7b400cdd30 con 0x7f7b24005310 2024-05-27T06:27:59.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b3fe00640 1 -- 172.21.15.87:0/1801564114 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2400c2b0 con 0x7f7b24003cb0 2024-05-27T06:27:59.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b3fe00640 1 -- 172.21.15.87:0/1801564114 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7b2400c4b0 con 0x7f7b24004810 2024-05-27T06:27:59.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b45400640 1 --2- 172.21.15.87:0/1801564114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b24005310 0x7f7b2400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:59.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b37e00640 1 --2- 172.21.15.87:0/1801564114 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b24004810 0x7f7b24004ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:59.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b45400640 1 -- 172.21.15.87:0/1801564114 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b24004810 msgr2=0x7f7b24004ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:59.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b45400640 1 --2- 172.21.15.87:0/1801564114 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b24004810 0x7f7b24004ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:59.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b45400640 1 -- 172.21.15.87:0/1801564114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b24003cb0 msgr2=0x7f7b24004100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:27:59.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b45400640 1 --2- 172.21.15.87:0/1801564114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b24003cb0 0x7f7b24004100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:59.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b45400640 1 -- 172.21.15.87:0/1801564114 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b24003530 con 0x7f7b24005310 2024-05-27T06:27:59.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.867+0000 7f7b37e00640 1 --2- 172.21.15.87:0/1801564114 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b24004810 0x7f7b24004ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:27:59.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.871+0000 7f7b45400640 1 -- 172.21.15.87:0/1801564114 reap_dead start 2024-05-27T06:27:59.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.871+0000 7f7b45400640 1 --2- 172.21.15.87:0/1801564114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b24005310 0x7f7b2400b9d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7b38009f90 tx=0x7f7b3801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617f128735381c46 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:59.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.871+0000 7f7b3fe00640 1 -- 172.21.15.87:0/1801564114 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b380b2070 con 0x7f7b24005310 2024-05-27T06:27:59.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.871+0000 7f7b3fe00640 1 -- 172.21.15.87:0/1801564114 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b380a5b80 con 0x7f7b24005310 2024-05-27T06:27:59.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.871+0000 7f7b3fe00640 1 -- 172.21.15.87:0/1801564114 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b38009c10 con 0x7f7b24005310 2024-05-27T06:27:59.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.871+0000 7f7b47400640 1 -- 172.21.15.87:0/1801564114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b24005310 msgr2=0x7f7b2400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:59.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.871+0000 7f7b47400640 1 --2- 172.21.15.87:0/1801564114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b24005310 0x7f7b2400b9d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7b38009f90 tx=0x7f7b3801cc80 comp rx=0 tx=0).stop 2024-05-27T06:27:59.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.871+0000 7f7b47400640 1 -- 172.21.15.87:0/1801564114 shutdown_connections 2024-05-27T06:27:59.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.871+0000 7f7b47400640 1 --2- 172.21.15.87:0/1801564114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b24005310 0x7f7b2400b9d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:59.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.871+0000 7f7b47400640 1 -- 172.21.15.87:0/1801564114 >> 172.21.15.87:0/1801564114 conn(0x7f7b400b46b0 msgr2=0x7f7b400b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:27:59.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.871+0000 7f7b47400640 1 -- 172.21.15.87:0/1801564114 shutdown_connections 2024-05-27T06:27:59.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.871+0000 7f7b47400640 1 -- 172.21.15.87:0/1801564114 wait complete. 2024-05-27T06:27:59.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.875+0000 7f7b47400640 1 Processor -- start 2024-05-27T06:27:59.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.875+0000 7f7b47400640 1 -- start start 2024-05-27T06:27:59.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.875+0000 7f7b47400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b24005310 0x7f7b4015e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:59.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.875+0000 7f7b47400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b400caeb0 0x7f7b400b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:59.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.875+0000 7f7b47400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b400b2010 0x7f7b401f4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:59.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.875+0000 7f7b47400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7b400cce30 con 0x7f7b24005310 2024-05-27T06:27:59.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.875+0000 7f7b47400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7b400cccb0 con 0x7f7b400caeb0 2024-05-27T06:27:59.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.875+0000 7f7b47400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7b400d1740 con 0x7f7b400b2010 2024-05-27T06:27:59.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.875+0000 7f7b44a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b24005310 0x7f7b4015e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:59.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.875+0000 7f7b44a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b24005310 0x7f7b4015e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38012/0 (socket says 172.21.15.87:38012) 2024-05-27T06:27:59.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.875+0000 7f7b44a00640 1 -- 172.21.15.87:0/1175024907 learned_addr learned my addr 172.21.15.87:0/1175024907 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:27:59.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.875+0000 7f7b37e00640 1 --2- 172.21.15.87:0/1175024907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b400caeb0 0x7f7b400b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:59.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.875+0000 7f7b45400640 1 --2- 172.21.15.87:0/1175024907 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b400b2010 0x7f7b401f4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:59.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.875+0000 7f7b44a00640 1 -- 172.21.15.87:0/1175024907 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b400b2010 msgr2=0x7f7b401f4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:59.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.875+0000 7f7b44a00640 1 --2- 172.21.15.87:0/1175024907 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b400b2010 0x7f7b401f4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:59.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.875+0000 7f7b44a00640 1 -- 172.21.15.87:0/1175024907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b400caeb0 msgr2=0x7f7b400b1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:27:59.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.875+0000 7f7b44a00640 1 --2- 172.21.15.87:0/1175024907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b400caeb0 0x7f7b400b1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:27:59.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.875+0000 7f7b44a00640 1 -- 172.21.15.87:0/1175024907 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b400c9910 con 0x7f7b24005310 2024-05-27T06:27:59.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.879+0000 7f7b37e00640 1 --2- 172.21.15.87:0/1175024907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b400caeb0 0x7f7b400b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:27:59.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.879+0000 7f7b45400640 1 --2- 172.21.15.87:0/1175024907 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b400b2010 0x7f7b401f4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:27:59.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.879+0000 7f7b44a00640 1 --2- 172.21.15.87:0/1175024907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b24005310 0x7f7b4015e310 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7b3000c500 tx=0x7f7b3000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:59.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.879+0000 7f7b3d600640 1 -- 172.21.15.87:0/1175024907 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b300052d0 con 0x7f7b24005310 2024-05-27T06:27:59.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.879+0000 7f7b3d600640 1 -- 172.21.15.87:0/1175024907 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b30005490 con 0x7f7b24005310 2024-05-27T06:27:59.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.879+0000 7f7b3d600640 1 -- 172.21.15.87:0/1175024907 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b30012850 con 0x7f7b24005310 2024-05-27T06:27:59.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.879+0000 7f7b47400640 1 -- 172.21.15.87:0/1175024907 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b400c9e10 con 0x7f7b24005310 2024-05-27T06:27:59.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.879+0000 7f7b47400640 1 -- 172.21.15.87:0/1175024907 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b400ca3d0 con 0x7f7b24005310 2024-05-27T06:27:59.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.879+0000 7f7b47400640 1 -- 172.21.15.87:0/1175024907 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b400caaf0 con 0x7f7b24005310 2024-05-27T06:27:59.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.879+0000 7f7b3d600640 1 -- 172.21.15.87:0/1175024907 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7b300129f0 con 0x7f7b24005310 2024-05-27T06:27:59.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.879+0000 7f7b3d600640 1 --2- 172.21.15.87:0/1175024907 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7b1c06f400 0x7f7b1c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:27:59.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.879+0000 7f7b3d600640 1 -- 172.21.15.87:0/1175024907 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7b3008f250 con 0x7f7b24005310 2024-05-27T06:27:59.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.879+0000 7f7b37e00640 1 --2- 172.21.15.87:0/1175024907 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7b1c06f400 0x7f7b1c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:27:59.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.883+0000 7f7b37e00640 1 --2- 172.21.15.87:0/1175024907 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7b1c06f400 0x7f7b1c071910 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7b40159240 tx=0x7f7b28009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:27:59.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:27:59.883+0000 7f7b3d600640 1 -- 172.21.15.87:0/1175024907 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7b3005bf60 con 0x7f7b24005310 2024-05-27T06:28:00.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.075+0000 7f7b47400640 1 -- 172.21.15.87:0/1175024907 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b4006aa30 con 0x7f7b24005310 2024-05-27T06:28:00.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.075+0000 7f7b3d600640 1 -- 172.21.15.87:0/1175024907 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7f7b3005b860 con 0x7f7b24005310 2024-05-27T06:28:00.073 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:00.073 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1075024068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1075024068},{"type":"v1","addr":"172.21.15.87:6835","nonce":1075024068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/437385084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":437385084},{"type":"v1","addr":"172.21.15.149:6833","nonce":437385084}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/852280291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":852280291},{"type":"v1","addr":"172.21.15.149:6835","nonce":852280291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T06:27:37.964959+0000","modified":"2024-05-27T06:27:59.081534+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/1799934036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1799934036},{"type":"v1","addr":"172.21.15.87:6837","nonce":1799934036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-27T06:28:00.073 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 9 2024-05-27T06:28:00.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.079+0000 7f7b47400640 1 -- 172.21.15.87:0/1175024907 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7b1c06f400 msgr2=0x7f7b1c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:00.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.079+0000 7f7b47400640 1 --2- 172.21.15.87:0/1175024907 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7b1c06f400 0x7f7b1c071910 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7b40159240 tx=0x7f7b28009040 comp rx=0 tx=0).stop 2024-05-27T06:28:00.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.079+0000 7f7b47400640 1 -- 172.21.15.87:0/1175024907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b24005310 msgr2=0x7f7b4015e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:00.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.079+0000 7f7b47400640 1 --2- 172.21.15.87:0/1175024907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b24005310 0x7f7b4015e310 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7b3000c500 tx=0x7f7b3000c9c0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.079+0000 7f7b47400640 1 -- 172.21.15.87:0/1175024907 shutdown_connections 2024-05-27T06:28:00.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.079+0000 7f7b47400640 1 --2- 172.21.15.87:0/1175024907 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7b1c06f400 0x7f7b1c071910 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.079+0000 7f7b47400640 1 --2- 172.21.15.87:0/1175024907 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b400b2010 0x7f7b401f4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.079+0000 7f7b47400640 1 --2- 172.21.15.87:0/1175024907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b400caeb0 0x7f7b400b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.079+0000 7f7b47400640 1 --2- 172.21.15.87:0/1175024907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b24005310 0x7f7b4015e310 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.079+0000 7f7b47400640 1 -- 172.21.15.87:0/1175024907 >> 172.21.15.87:0/1175024907 conn(0x7f7b400b46b0 msgr2=0x7f7b400735d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:00.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.079+0000 7f7b47400640 1 -- 172.21.15.87:0/1175024907 shutdown_connections 2024-05-27T06:28:00.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.079+0000 7f7b47400640 1 -- 172.21.15.87:0/1175024907 wait complete. 2024-05-27T06:28:00.095 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T06:28:00.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.243+0000 7efd61200640 1 Processor -- start 2024-05-27T06:28:00.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.243+0000 7efd61200640 1 -- start start 2024-05-27T06:28:00.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.247+0000 7efd61200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efd5c15cfe0 0x7efd5c15d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:00.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.247+0000 7efd61200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efd5c0d1740 0x7efd5c0d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:00.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.247+0000 7efd61200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd5c15d930 con 0x7efd5c0cbf90 2024-05-27T06:28:00.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.247+0000 7efd61200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7efd5c0d2090 con 0x7efd5c15cfe0 2024-05-27T06:28:00.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.247+0000 7efd61200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7efd5c15dbb0 con 0x7efd5c0d1740 2024-05-27T06:28:00.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.247+0000 7efd59e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7efd5c0cbf90 0x7efd5c06cfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:58710/0 (socket says 172.21.15.87:58710) 2024-05-27T06:28:00.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.247+0000 7efd59e00640 1 -- 172.21.15.87:0/1923572475 learned_addr learned my addr 172.21.15.87:0/1923572475 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:00.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.247+0000 7efd51400640 1 --2- 172.21.15.87:0/1923572475 >> v2:172.21.15.87:3300/0 conn(0x7efd5c15cfe0 0x7efd5c15d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:00.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.247+0000 7efd5a800640 1 --2- 172.21.15.87:0/1923572475 >> v2:172.21.15.149:3300/0 conn(0x7efd5c0d1740 0x7efd5c0d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:00.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.247+0000 7efd59400640 1 -- 172.21.15.87:0/1923572475 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3625503506 0 0) 0x7efd4c0014a0 con 0x7efd5c0cbf90 2024-05-27T06:28:00.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.247+0000 7efd59400640 1 -- 172.21.15.87:0/1923572475 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd40003530 con 0x7efd5c0cbf90 2024-05-27T06:28:00.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.247+0000 7efd51400640 1 -- 172.21.15.87:0/1923572475 >> v2:172.21.15.149:3300/0 conn(0x7efd5c0d1740 msgr2=0x7efd5c0d1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:00.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.247+0000 7efd51400640 1 --2- 172.21.15.87:0/1923572475 >> v2:172.21.15.149:3300/0 conn(0x7efd5c0d1740 0x7efd5c0d1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.247+0000 7efd51400640 1 -- 172.21.15.87:0/1923572475 >> v1:172.21.15.87:6789/0 conn(0x7efd5c0cbf90 legacy=0x7efd5c06cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:00.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.247+0000 7efd51400640 1 -- 172.21.15.87:0/1923572475 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5c15de90 con 0x7efd5c15cfe0 2024-05-27T06:28:00.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.251+0000 7efd51400640 1 --2- 172.21.15.87:0/1923572475 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd5c15cfe0 0x7efd5c15d3f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efd5c071c90 tx=0x7efd4401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e8a453f757c990 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:00.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.251+0000 7efd59400640 1 -- 172.21.15.87:0/1923572475 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd440b5070 con 0x7efd5c15cfe0 2024-05-27T06:28:00.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.251+0000 7efd59400640 1 -- 172.21.15.87:0/1923572475 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd440a8970 con 0x7efd5c15cfe0 2024-05-27T06:28:00.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.251+0000 7efd59400640 1 -- 172.21.15.87:0/1923572475 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd440a8d40 con 0x7efd5c15cfe0 2024-05-27T06:28:00.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.251+0000 7efd61200640 1 -- 172.21.15.87:0/1923572475 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd5c15cfe0 msgr2=0x7efd5c15d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:00.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.251+0000 7efd61200640 1 --2- 172.21.15.87:0/1923572475 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd5c15cfe0 0x7efd5c15d3f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efd5c071c90 tx=0x7efd4401ec70 comp rx=0 tx=0).stop 2024-05-27T06:28:00.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.251+0000 7efd61200640 1 -- 172.21.15.87:0/1923572475 shutdown_connections 2024-05-27T06:28:00.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.251+0000 7efd61200640 1 --2- 172.21.15.87:0/1923572475 >> v2:172.21.15.149:3300/0 conn(0x7efd5c0d1740 0x7efd5c0d1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.251+0000 7efd61200640 1 --2- 172.21.15.87:0/1923572475 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd5c15cfe0 0x7efd5c15d3f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.251+0000 7efd61200640 1 -- 172.21.15.87:0/1923572475 >> 172.21.15.87:0/1923572475 conn(0x7efd5c0b46b0 msgr2=0x7efd5c0b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:00.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.251+0000 7efd61200640 1 -- 172.21.15.87:0/1923572475 shutdown_connections 2024-05-27T06:28:00.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.251+0000 7efd61200640 1 -- 172.21.15.87:0/1923572475 wait complete. 2024-05-27T06:28:00.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.255+0000 7efd61200640 1 Processor -- start 2024-05-27T06:28:00.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.255+0000 7efd61200640 1 -- start start 2024-05-27T06:28:00.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.255+0000 7efd61200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd5c0cbf90 0x7efd5c0b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:00.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.255+0000 7efd61200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd5c0d1740 0x7efd5c1f65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:00.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.255+0000 7efd61200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd5c15cfe0 0x7efd5c073b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:00.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.255+0000 7efd61200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c15e170 con 0x7efd5c15cfe0 2024-05-27T06:28:00.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.255+0000 7efd61200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c06caa0 con 0x7efd5c0d1740 2024-05-27T06:28:00.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.255+0000 7efd61200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efd5c0cc3a0 con 0x7efd5c0cbf90 2024-05-27T06:28:00.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.255+0000 7efd5a800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd5c15cfe0 0x7efd5c073b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:00.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.255+0000 7efd5a800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd5c15cfe0 0x7efd5c073b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38032/0 (socket says 172.21.15.87:38032) 2024-05-27T06:28:00.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.255+0000 7efd5a800640 1 -- 172.21.15.87:0/1886911617 learned_addr learned my addr 172.21.15.87:0/1886911617 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:00.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.255+0000 7efd59e00640 1 --2- 172.21.15.87:0/1886911617 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd5c0cbf90 0x7efd5c0b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:00.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.255+0000 7efd5a800640 1 -- 172.21.15.87:0/1886911617 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd5c0cbf90 msgr2=0x7efd5c0b3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:00.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.255+0000 7efd5a800640 1 --2- 172.21.15.87:0/1886911617 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd5c0cbf90 0x7efd5c0b3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.255+0000 7efd5a800640 1 -- 172.21.15.87:0/1886911617 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd5c0d1740 msgr2=0x7efd5c1f65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:00.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.255+0000 7efd5a800640 1 --2- 172.21.15.87:0/1886911617 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd5c0d1740 0x7efd5c1f65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.255+0000 7efd5a800640 1 -- 172.21.15.87:0/1886911617 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5c0c5350 con 0x7efd5c15cfe0 2024-05-27T06:28:00.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.255+0000 7efd59e00640 1 --2- 172.21.15.87:0/1886911617 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd5c0cbf90 0x7efd5c0b3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:00.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.255+0000 7efd5a800640 1 --2- 172.21.15.87:0/1886911617 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd5c15cfe0 0x7efd5c073b90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efd5400e7c0 tx=0x7efd5400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:00.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.255+0000 7efd52a00640 1 -- 172.21.15.87:0/1886911617 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd54017070 con 0x7efd5c15cfe0 2024-05-27T06:28:00.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.255+0000 7efd52a00640 1 -- 172.21.15.87:0/1886911617 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd5400ee70 con 0x7efd5c15cfe0 2024-05-27T06:28:00.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.255+0000 7efd52a00640 1 -- 172.21.15.87:0/1886911617 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5400cb40 con 0x7efd5c15cfe0 2024-05-27T06:28:00.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.255+0000 7efd61200640 1 -- 172.21.15.87:0/1886911617 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd5c157e50 con 0x7efd5c15cfe0 2024-05-27T06:28:00.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.255+0000 7efd61200640 1 -- 172.21.15.87:0/1886911617 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd5c15b970 con 0x7efd5c15cfe0 2024-05-27T06:28:00.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.259+0000 7efd61200640 1 -- 172.21.15.87:0/1886911617 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd5c06aa30 con 0x7efd5c15cfe0 2024-05-27T06:28:00.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.259+0000 7efd52a00640 1 -- 172.21.15.87:0/1886911617 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7efd5401a070 con 0x7efd5c15cfe0 2024-05-27T06:28:00.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.259+0000 7efd52a00640 1 --2- 172.21.15.87:0/1886911617 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efd3806f400 0x7efd38071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:00.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.259+0000 7efd52a00640 1 -- 172.21.15.87:0/1886911617 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7efd5408f7e0 con 0x7efd5c15cfe0 2024-05-27T06:28:00.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.259+0000 7efd59e00640 1 --2- 172.21.15.87:0/1886911617 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efd3806f400 0x7efd38071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:00.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.259+0000 7efd59e00640 1 --2- 172.21.15.87:0/1886911617 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efd3806f400 0x7efd38071910 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efd4c0017a0 tx=0x7efd4c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:00.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.263+0000 7efd52a00640 1 -- 172.21.15.87:0/1886911617 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7efd5405c420 con 0x7efd5c15cfe0 2024-05-27T06:28:00.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.419+0000 7efd61200640 1 -- 172.21.15.87:0/1886911617 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd5c0cd930 con 0x7efd5c15cfe0 2024-05-27T06:28:00.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.423+0000 7efd52a00640 1 -- 172.21.15.87:0/1886911617 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7efd5405bd20 con 0x7efd5c15cfe0 2024-05-27T06:28:00.418 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:00.418 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:27:43.048854+0000","last_up_change":"2024-05-27T06:27:25.988592+0000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T06:27:26.590191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T06:27:35.840893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T06:27:36.929608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-27T06:27:40.638358+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6801","nonce":3674824716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6803","nonce":3674824716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6807","nonce":3674824716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6805","nonce":3674824716}]},"public_addr":"172.21.15.87:6801/3674824716","cluster_addr":"172.21.15.87:6803/3674824716","heartbeat_back_addr":"172.21.15.87:6807/3674824716","heartbeat_front_addr":"172.21.15.87:6805/3674824716","state":["exists","up"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6809","nonce":2443981288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6811","nonce":2443981288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6815","nonce":2443981288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6813","nonce":2443981288}]},"public_addr":"172.21.15.87:6809/2443981288","cluster_addr":"172.21.15.87:6811/2443981288","heartbeat_back_addr":"172.21.15.87:6815/2443981288","heartbeat_front_addr":"172.21.15.87:6813/2443981288","state":["exists","up"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6819","nonce":1441249238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6823","nonce":1441249238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6831","nonce":1441249238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6825","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6827","nonce":1441249238}]},"public_addr":"172.21.15.87:6819/1441249238","cluster_addr":"172.21.15.87:6823/1441249238","heartbeat_back_addr":"172.21.15.87:6831/1441249238","heartbeat_front_addr":"172.21.15.87:6827/1441249238","state":["exists","up"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6818","nonce":1173805234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6822","nonce":1173805234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6829","nonce":1173805234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6826","nonce":1173805234}]},"public_addr":"172.21.15.87:6818/1173805234","cluster_addr":"172.21.15.87:6822/1173805234","heartbeat_back_addr":"172.21.15.87:6829/1173805234","heartbeat_front_addr":"172.21.15.87:6826/1173805234","state":["exists","up"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6819","nonce":1551871079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6823","nonce":1551871079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6831","nonce":1551871079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6827","nonce":1551871079}]},"public_addr":"172.21.15.149:6819/1551871079","cluster_addr":"172.21.15.149:6823/1551871079","heartbeat_back_addr":"172.21.15.149:6831/1551871079","heartbeat_front_addr":"172.21.15.149:6827/1551871079","state":["exists","up"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6818","nonce":582864816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6822","nonce":582864816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6830","nonce":582864816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6826","nonce":582864816}]},"public_addr":"172.21.15.149:6818/582864816","cluster_addr":"172.21.15.149:6822/582864816","heartbeat_back_addr":"172.21.15.149:6830/582864816","heartbeat_front_addr":"172.21.15.149:6826/582864816","state":["exists","up"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6801","nonce":531351314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6803","nonce":531351314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6807","nonce":531351314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6805","nonce":531351314}]},"public_addr":"172.21.15.149:6801/531351314","cluster_addr":"172.21.15.149:6803/531351314","heartbeat_back_addr":"172.21.15.149:6807/531351314","heartbeat_front_addr":"172.21.15.149:6805/531351314","state":["exists","up"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6809","nonce":1171039913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6811","nonce":1171039913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6815","nonce":1171039913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6813","nonce":1171039913}]},"public_addr":"172.21.15.149:6809/1171039913","cluster_addr":"172.21.15.149:6811/1171039913","heartbeat_back_addr":"172.21.15.149:6815/1171039913","heartbeat_front_addr":"172.21.15.149:6813/1171039913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.589776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.819787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.767566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.683842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.038885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.120319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.687007+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.812832+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:28:00.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.423+0000 7efd61200640 1 -- 172.21.15.87:0/1886911617 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efd3806f400 msgr2=0x7efd38071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:00.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.423+0000 7efd61200640 1 --2- 172.21.15.87:0/1886911617 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efd3806f400 0x7efd38071910 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efd4c0017a0 tx=0x7efd4c009040 comp rx=0 tx=0).stop 2024-05-27T06:28:00.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.423+0000 7efd61200640 1 -- 172.21.15.87:0/1886911617 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd5c15cfe0 msgr2=0x7efd5c073b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:00.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.423+0000 7efd61200640 1 --2- 172.21.15.87:0/1886911617 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd5c15cfe0 0x7efd5c073b90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efd5400e7c0 tx=0x7efd5400ec80 comp rx=0 tx=0).stop 2024-05-27T06:28:00.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.423+0000 7efd61200640 1 -- 172.21.15.87:0/1886911617 shutdown_connections 2024-05-27T06:28:00.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.423+0000 7efd61200640 1 --2- 172.21.15.87:0/1886911617 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efd3806f400 0x7efd38071910 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.423+0000 7efd61200640 1 --2- 172.21.15.87:0/1886911617 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd5c15cfe0 0x7efd5c073b90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.423+0000 7efd61200640 1 --2- 172.21.15.87:0/1886911617 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd5c0d1740 0x7efd5c1f65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.423+0000 7efd61200640 1 --2- 172.21.15.87:0/1886911617 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd5c0cbf90 0x7efd5c0b3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.423+0000 7efd61200640 1 -- 172.21.15.87:0/1886911617 >> 172.21.15.87:0/1886911617 conn(0x7efd5c0b46b0 msgr2=0x7efd5c0b1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:00.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.423+0000 7efd61200640 1 -- 172.21.15.87:0/1886911617 shutdown_connections 2024-05-27T06:28:00.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.423+0000 7efd61200640 1 -- 172.21.15.87:0/1886911617 wait complete. 2024-05-27T06:28:00.440 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-27T06:28:00.441 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T06:28:00.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.591+0000 7f89ab200640 1 Processor -- start 2024-05-27T06:28:00.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.591+0000 7f89ab200640 1 -- start start 2024-05-27T06:28:00.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89ab200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f89a40d1740 0x7f89a40d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:00.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89ab200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a40d2090 con 0x7f89a40cbf90 2024-05-27T06:28:00.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89ab200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a415dbb0 con 0x7f89a415cfe0 2024-05-27T06:28:00.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89ab200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f89a415de90 con 0x7f89a40d1740 2024-05-27T06:28:00.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89a3e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f89a40cbf90 0x7f89a406cfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:58714/0 (socket says 172.21.15.87:58714) 2024-05-27T06:28:00.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89a3e00640 1 -- 172.21.15.87:0/711506454 learned_addr learned my addr 172.21.15.87:0/711506454 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:00.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89a2a00640 1 -- 172.21.15.87:0/711506454 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2706598927 0 0) 0x7f8994001120 con 0x7f89a40cbf90 2024-05-27T06:28:00.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89a9200640 1 --2- 172.21.15.87:0/711506454 >> v2:172.21.15.149:3300/0 conn(0x7f89a40d1740 0x7f89a40d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:00.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89a2a00640 1 -- 172.21.15.87:0/711506454 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8988005740 con 0x7f89a40cbf90 2024-05-27T06:28:00.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89a2a00640 1 -- 172.21.15.87:0/711506454 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 271111406 0 0) 0x7f8988005740 con 0x7f89a40cbf90 2024-05-27T06:28:00.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89a2a00640 1 -- 172.21.15.87:0/711506454 >> v2:172.21.15.149:3300/0 conn(0x7f89a40d1740 msgr2=0x7f89a40d1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:00.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89a2a00640 1 --2- 172.21.15.87:0/711506454 >> v2:172.21.15.149:3300/0 conn(0x7f89a40d1740 0x7f89a40d1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89a2a00640 1 -- 172.21.15.87:0/711506454 >> v1:172.21.15.149:6789/0 conn(0x7f89a415cfe0 legacy=0x7f89a415d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:00.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89a2a00640 1 -- 172.21.15.87:0/711506454 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a406c7c0 con 0x7f89a40cbf90 2024-05-27T06:28:00.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89a2a00640 1 -- 172.21.15.87:0/711506454 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7f89940018f0 con 0x7f89a40cbf90 2024-05-27T06:28:00.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89a2a00640 1 -- 172.21.15.87:0/711506454 >> v1:172.21.15.87:6789/0 conn(0x7f89a40cbf90 legacy=0x7f89a406cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:00.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89a2a00640 1 --2- 172.21.15.87:0/711506454 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8988005ce0 0x7f8988006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:00.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89a2a00640 1 --2- 172.21.15.87:0/711506454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8988006a20 0x7f8988006e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:00.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89a2a00640 1 --2- 172.21.15.87:0/711506454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8988007570 0x7f898800dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:00.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89a2a00640 1 -- 172.21.15.87:0/711506454 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f89a415de90 con 0x7f8988007570 2024-05-27T06:28:00.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89a2a00640 1 -- 172.21.15.87:0/711506454 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f898800e460 con 0x7f8988006a20 2024-05-27T06:28:00.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89a2a00640 1 -- 172.21.15.87:0/711506454 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f898800e660 con 0x7f8988005ce0 2024-05-27T06:28:00.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89a9200640 1 --2- 172.21.15.87:0/711506454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8988007570 0x7f898800dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:00.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89a3e00640 1 --2- 172.21.15.87:0/711506454 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8988005ce0 0x7f8988006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:00.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89a3400640 1 --2- 172.21.15.87:0/711506454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8988006a20 0x7f8988006e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:00.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89a9200640 1 -- 172.21.15.87:0/711506454 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8988005ce0 msgr2=0x7f8988006150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:00.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89a9200640 1 --2- 172.21.15.87:0/711506454 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8988005ce0 0x7f8988006150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89a9200640 1 -- 172.21.15.87:0/711506454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8988006a20 msgr2=0x7f8988006e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:00.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89a9200640 1 --2- 172.21.15.87:0/711506454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8988006a20 0x7f8988006e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.595+0000 7f89a9200640 1 -- 172.21.15.87:0/711506454 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8988005740 con 0x7f8988007570 2024-05-27T06:28:00.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.599+0000 7f89a9200640 1 -- 172.21.15.87:0/711506454 reap_dead start 2024-05-27T06:28:00.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.599+0000 7f89a9200640 1 --2- 172.21.15.87:0/711506454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8988007570 0x7f898800dbe0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f89a40c83c0 tx=0x7f899c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=128840291437db83 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:00.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.599+0000 7f89a2a00640 1 -- 172.21.15.87:0/711506454 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c0b2070 con 0x7f8988007570 2024-05-27T06:28:00.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.599+0000 7f89a2a00640 1 -- 172.21.15.87:0/711506454 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f899c0a5c70 con 0x7f8988007570 2024-05-27T06:28:00.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.599+0000 7f89a2a00640 1 -- 172.21.15.87:0/711506454 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c009c10 con 0x7f8988007570 2024-05-27T06:28:00.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.599+0000 7f89ab200640 1 -- 172.21.15.87:0/711506454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8988007570 msgr2=0x7f898800dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:00.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.599+0000 7f89ab200640 1 --2- 172.21.15.87:0/711506454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8988007570 0x7f898800dbe0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f89a40c83c0 tx=0x7f899c01cc60 comp rx=0 tx=0).stop 2024-05-27T06:28:00.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.599+0000 7f89ab200640 1 -- 172.21.15.87:0/711506454 shutdown_connections 2024-05-27T06:28:00.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.599+0000 7f89ab200640 1 --2- 172.21.15.87:0/711506454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8988007570 0x7f898800dbe0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.599+0000 7f89ab200640 1 -- 172.21.15.87:0/711506454 >> 172.21.15.87:0/711506454 conn(0x7f89a40b46b0 msgr2=0x7f89a40b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:00.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.599+0000 7f89ab200640 1 -- 172.21.15.87:0/711506454 shutdown_connections 2024-05-27T06:28:00.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.599+0000 7f89ab200640 1 -- 172.21.15.87:0/711506454 wait complete. 2024-05-27T06:28:00.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.603+0000 7f89ab200640 1 Processor -- start 2024-05-27T06:28:00.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.603+0000 7f89ab200640 1 -- start start 2024-05-27T06:28:00.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.603+0000 7f89ab200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8988007570 0x7f89a41f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:00.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.603+0000 7f89ab200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89a41598e0 0x7f89a40c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:00.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.603+0000 7f89ab200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f89a40c8a90 0x7f89a40ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:00.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.603+0000 7f89ab200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f89a40cc3a0 con 0x7f89a41598e0 2024-05-27T06:28:00.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.603+0000 7f89ab200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f89a415e170 con 0x7f8988007570 2024-05-27T06:28:00.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.603+0000 7f89ab200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f89a406ec50 con 0x7f89a40c8a90 2024-05-27T06:28:00.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.603+0000 7f89a3400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89a41598e0 0x7f89a40c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:00.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.603+0000 7f89a3400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89a41598e0 0x7f89a40c9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38048/0 (socket says 172.21.15.87:38048) 2024-05-27T06:28:00.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.603+0000 7f89a3400640 1 -- 172.21.15.87:0/3571072610 learned_addr learned my addr 172.21.15.87:0/3571072610 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:00.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.603+0000 7f89a3e00640 1 --2- 172.21.15.87:0/3571072610 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8988007570 0x7f89a41f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:00.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.603+0000 7f89a9200640 1 --2- 172.21.15.87:0/3571072610 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f89a40c8a90 0x7f89a40ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:00.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.603+0000 7f89a3400640 1 -- 172.21.15.87:0/3571072610 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f89a40c8a90 msgr2=0x7f89a40ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:00.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.603+0000 7f89a3400640 1 --2- 172.21.15.87:0/3571072610 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f89a40c8a90 0x7f89a40ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.603+0000 7f89a3400640 1 -- 172.21.15.87:0/3571072610 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8988007570 msgr2=0x7f89a41f1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:00.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.603+0000 7f89a3400640 1 --2- 172.21.15.87:0/3571072610 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8988007570 0x7f89a41f1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.603+0000 7f89a3400640 1 -- 172.21.15.87:0/3571072610 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a41f2290 con 0x7f89a41598e0 2024-05-27T06:28:00.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.603+0000 7f89a3400640 1 --2- 172.21.15.87:0/3571072610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89a41598e0 0x7f89a40c9b00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f899000f7f0 tx=0x7f899000fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:00.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.603+0000 7f899be00640 1 -- 172.21.15.87:0/3571072610 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899001a070 con 0x7f89a41598e0 2024-05-27T06:28:00.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.603+0000 7f899be00640 1 -- 172.21.15.87:0/3571072610 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8990005110 con 0x7f89a41598e0 2024-05-27T06:28:00.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.603+0000 7f899be00640 1 -- 172.21.15.87:0/3571072610 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89900067e0 con 0x7f89a41598e0 2024-05-27T06:28:00.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.603+0000 7f89ab200640 1 -- 172.21.15.87:0/3571072610 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a40c6060 con 0x7f89a41598e0 2024-05-27T06:28:00.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.607+0000 7f89ab200640 1 -- 172.21.15.87:0/3571072610 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a40c6620 con 0x7f89a41598e0 2024-05-27T06:28:00.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.607+0000 7f89ab200640 1 -- 172.21.15.87:0/3571072610 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89a40c8f30 con 0x7f89a41598e0 2024-05-27T06:28:00.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.607+0000 7f899be00640 1 -- 172.21.15.87:0/3571072610 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f899001d070 con 0x7f89a41598e0 2024-05-27T06:28:00.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.611+0000 7f899be00640 1 --2- 172.21.15.87:0/3571072610 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f898406f430 0x7f8984071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:00.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.611+0000 7f899be00640 1 -- 172.21.15.87:0/3571072610 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f899008ecd0 con 0x7f89a41598e0 2024-05-27T06:28:00.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.611+0000 7f89a3e00640 1 --2- 172.21.15.87:0/3571072610 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f898406f430 0x7f8984071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:00.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.611+0000 7f89a3e00640 1 --2- 172.21.15.87:0/3571072610 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f898406f430 0x7f8984071940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8994007fd0 tx=0x7f8994007b30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:00.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.615+0000 7f899be00640 1 -- 172.21.15.87:0/3571072610 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f89a41f2290 con 0x7f89a41598e0 2024-05-27T06:28:00.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.767+0000 7f89ab200640 1 -- 172.21.15.87:0/3571072610 --> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f89a406aa30 con 0x7f898406f430 2024-05-27T06:28:00.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.779+0000 7f899be00640 1 -- 172.21.15.87:0/3571072610 <== mgr.4111 v2:172.21.15.87:6832/2724754260 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f89a406aa30 con 0x7f898406f430 2024-05-27T06:28:00.780 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:00.781 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-27T06:28:00.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.783+0000 7f89ab200640 1 -- 172.21.15.87:0/3571072610 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f898406f430 msgr2=0x7f8984071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:00.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.783+0000 7f89ab200640 1 --2- 172.21.15.87:0/3571072610 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f898406f430 0x7f8984071940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8994007fd0 tx=0x7f8994007b30 comp rx=0 tx=0).stop 2024-05-27T06:28:00.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.783+0000 7f89ab200640 1 -- 172.21.15.87:0/3571072610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89a41598e0 msgr2=0x7f89a40c9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:00.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.783+0000 7f89ab200640 1 --2- 172.21.15.87:0/3571072610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89a41598e0 0x7f89a40c9b00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f899000f7f0 tx=0x7f899000fcb0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.783+0000 7f89ab200640 1 -- 172.21.15.87:0/3571072610 shutdown_connections 2024-05-27T06:28:00.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.783+0000 7f89ab200640 1 --2- 172.21.15.87:0/3571072610 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f898406f430 0x7f8984071940 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.783+0000 7f89ab200640 1 --2- 172.21.15.87:0/3571072610 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f89a40c8a90 0x7f89a40ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.783+0000 7f89ab200640 1 --2- 172.21.15.87:0/3571072610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89a41598e0 0x7f89a40c9b00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.783+0000 7f89ab200640 1 --2- 172.21.15.87:0/3571072610 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8988007570 0x7f89a41f1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.783+0000 7f89ab200640 1 -- 172.21.15.87:0/3571072610 >> 172.21.15.87:0/3571072610 conn(0x7f89a40b46b0 msgr2=0x7f89a4072a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:00.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.783+0000 7f89ab200640 1 -- 172.21.15.87:0/3571072610 shutdown_connections 2024-05-27T06:28:00.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.783+0000 7f89ab200640 1 -- 172.21.15.87:0/3571072610 wait complete. 2024-05-27T06:28:00.800 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-05-27T06:28:00.568285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219372,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755348,"statfs":{"total":773094113280,"available":772869476352,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003847"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.699021+0000","last_change":"2024-05-27T06:27:37.599201+0000","last_active":"2024-05-27T06:27:44.699021+0000","last_peered":"2024-05-27T06:27:44.699021+0000","last_clean":"2024-05-27T06:27:44.699021+0000","last_became_active":"2024-05-27T06:27:37.598882+0000","last_became_peered":"2024-05-27T06:27:37.598882+0000","last_unstale":"2024-05-27T06:27:44.699021+0000","last_undegraded":"2024-05-27T06:27:44.699021+0000","last_fullsized":"2024-05-27T06:27:44.699021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:13:32.135455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.137061+0000","last_change":"2024-05-27T06:27:38.587525+0000","last_active":"2024-05-27T06:27:45.137061+0000","last_peered":"2024-05-27T06:27:45.137061+0000","last_clean":"2024-05-27T06:27:45.137061+0000","last_became_active":"2024-05-27T06:27:38.586949+0000","last_became_peered":"2024-05-27T06:27:38.586949+0000","last_unstale":"2024-05-27T06:27:45.137061+0000","last_undegraded":"2024-05-27T06:27:45.137061+0000","last_fullsized":"2024-05-27T06:27:45.137061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:24:46.797590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136334+0000","last_change":"2024-05-27T06:27:42.674258+0000","last_active":"2024-05-27T06:27:45.136334+0000","last_peered":"2024-05-27T06:27:45.136334+0000","last_clean":"2024-05-27T06:27:45.136334+0000","last_became_active":"2024-05-27T06:27:42.673626+0000","last_became_peered":"2024-05-27T06:27:42.673626+0000","last_unstale":"2024-05-27T06:27:45.136334+0000","last_undegraded":"2024-05-27T06:27:45.136334+0000","last_fullsized":"2024-05-27T06:27:45.136334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:29:26.664564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.137215+0000","last_change":"2024-05-27T06:27:37.598836+0000","last_active":"2024-05-27T06:27:45.137215+0000","last_peered":"2024-05-27T06:27:45.137215+0000","last_clean":"2024-05-27T06:27:45.137215+0000","last_became_active":"2024-05-27T06:27:37.598483+0000","last_became_peered":"2024-05-27T06:27:37.598483+0000","last_unstale":"2024-05-27T06:27:45.137215+0000","last_undegraded":"2024-05-27T06:27:45.137215+0000","last_fullsized":"2024-05-27T06:27:45.137215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:06:32.803214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698842+0000","last_change":"2024-05-27T06:27:38.590652+0000","last_active":"2024-05-27T06:27:44.698842+0000","last_peered":"2024-05-27T06:27:44.698842+0000","last_clean":"2024-05-27T06:27:44.698842+0000","last_became_active":"2024-05-27T06:27:38.590399+0000","last_became_peered":"2024-05-27T06:27:38.590399+0000","last_unstale":"2024-05-27T06:27:44.698842+0000","last_undegraded":"2024-05-27T06:27:44.698842+0000","last_fullsized":"2024-05-27T06:27:44.698842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:11:57.311912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641217+0000","last_change":"2024-05-27T06:27:42.678002+0000","last_active":"2024-05-27T06:27:43.641217+0000","last_peered":"2024-05-27T06:27:43.641217+0000","last_clean":"2024-05-27T06:27:43.641217+0000","last_became_active":"2024-05-27T06:27:42.672687+0000","last_became_peered":"2024-05-27T06:27:42.672687+0000","last_unstale":"2024-05-27T06:27:43.641217+0000","last_undegraded":"2024-05-27T06:27:43.641217+0000","last_fullsized":"2024-05-27T06:27:43.641217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:24:50.868712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560389+0000","last_change":"2024-05-27T06:27:37.593814+0000","last_active":"2024-05-27T06:27:45.560389+0000","last_peered":"2024-05-27T06:27:45.560389+0000","last_clean":"2024-05-27T06:27:45.560389+0000","last_became_active":"2024-05-27T06:27:37.593466+0000","last_became_peered":"2024-05-27T06:27:37.593466+0000","last_unstale":"2024-05-27T06:27:45.560389+0000","last_undegraded":"2024-05-27T06:27:45.560389+0000","last_fullsized":"2024-05-27T06:27:45.560389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:26:32.568342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562028+0000","last_change":"2024-05-27T06:27:38.601653+0000","last_active":"2024-05-27T06:27:45.562028+0000","last_peered":"2024-05-27T06:27:45.562028+0000","last_clean":"2024-05-27T06:27:45.562028+0000","last_became_active":"2024-05-27T06:27:38.601248+0000","last_became_peered":"2024-05-27T06:27:38.601248+0000","last_unstale":"2024-05-27T06:27:45.562028+0000","last_undegraded":"2024-05-27T06:27:45.562028+0000","last_fullsized":"2024-05-27T06:27:45.562028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:53.536742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641377+0000","last_change":"2024-05-27T06:27:42.676302+0000","last_active":"2024-05-27T06:27:43.641377+0000","last_peered":"2024-05-27T06:27:43.641377+0000","last_clean":"2024-05-27T06:27:43.641377+0000","last_became_active":"2024-05-27T06:27:42.673036+0000","last_became_peered":"2024-05-27T06:27:42.673036+0000","last_unstale":"2024-05-27T06:27:43.641377+0000","last_undegraded":"2024-05-27T06:27:43.641377+0000","last_fullsized":"2024-05-27T06:27:43.641377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:25:34.504656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560872+0000","last_change":"2024-05-27T06:27:37.599394+0000","last_active":"2024-05-27T06:27:45.560872+0000","last_peered":"2024-05-27T06:27:45.560872+0000","last_clean":"2024-05-27T06:27:45.560872+0000","last_became_active":"2024-05-27T06:27:37.598995+0000","last_became_peered":"2024-05-27T06:27:37.598995+0000","last_unstale":"2024-05-27T06:27:45.560872+0000","last_undegraded":"2024-05-27T06:27:45.560872+0000","last_fullsized":"2024-05-27T06:27:45.560872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:05:47.256329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562108+0000","last_change":"2024-05-27T06:27:38.595082+0000","last_active":"2024-05-27T06:27:45.562108+0000","last_peered":"2024-05-27T06:27:45.562108+0000","last_clean":"2024-05-27T06:27:45.562108+0000","last_became_active":"2024-05-27T06:27:38.594761+0000","last_became_peered":"2024-05-27T06:27:38.594761+0000","last_unstale":"2024-05-27T06:27:45.562108+0000","last_undegraded":"2024-05-27T06:27:45.562108+0000","last_fullsized":"2024-05-27T06:27:45.562108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:35.349266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641123+0000","last_change":"2024-05-27T06:27:42.657602+0000","last_active":"2024-05-27T06:27:43.641123+0000","last_peered":"2024-05-27T06:27:43.641123+0000","last_clean":"2024-05-27T06:27:43.641123+0000","last_became_active":"2024-05-27T06:27:42.657080+0000","last_became_peered":"2024-05-27T06:27:42.657080+0000","last_unstale":"2024-05-27T06:27:43.641123+0000","last_undegraded":"2024-05-27T06:27:43.641123+0000","last_fullsized":"2024-05-27T06:27:43.641123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:25:32.361553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561325+0000","last_change":"2024-05-27T06:27:38.588664+0000","last_active":"2024-05-27T06:27:45.561325+0000","last_peered":"2024-05-27T06:27:45.561325+0000","last_clean":"2024-05-27T06:27:45.561325+0000","last_became_active":"2024-05-27T06:27:38.588190+0000","last_became_peered":"2024-05-27T06:27:38.588190+0000","last_unstale":"2024-05-27T06:27:45.561325+0000","last_undegraded":"2024-05-27T06:27:45.561325+0000","last_fullsized":"2024-05-27T06:27:45.561325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:36:07.073192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561221+0000","last_change":"2024-05-27T06:27:37.593763+0000","last_active":"2024-05-27T06:27:45.561221+0000","last_peered":"2024-05-27T06:27:45.561221+0000","last_clean":"2024-05-27T06:27:45.561221+0000","last_became_active":"2024-05-27T06:27:37.593401+0000","last_became_peered":"2024-05-27T06:27:37.593401+0000","last_unstale":"2024-05-27T06:27:45.561221+0000","last_undegraded":"2024-05-27T06:27:45.561221+0000","last_fullsized":"2024-05-27T06:27:45.561221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:10.389223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.642016+0000","last_change":"2024-05-27T06:27:42.673785+0000","last_active":"2024-05-27T06:27:43.642016+0000","last_peered":"2024-05-27T06:27:43.642016+0000","last_clean":"2024-05-27T06:27:43.642016+0000","last_became_active":"2024-05-27T06:27:42.673292+0000","last_became_peered":"2024-05-27T06:27:42.673292+0000","last_unstale":"2024-05-27T06:27:43.642016+0000","last_undegraded":"2024-05-27T06:27:43.642016+0000","last_fullsized":"2024-05-27T06:27:43.642016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:30.051452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136563+0000","last_change":"2024-05-27T06:27:38.618042+0000","last_active":"2024-05-27T06:27:45.136563+0000","last_peered":"2024-05-27T06:27:45.136563+0000","last_clean":"2024-05-27T06:27:45.136563+0000","last_became_active":"2024-05-27T06:27:38.617706+0000","last_became_peered":"2024-05-27T06:27:38.617706+0000","last_unstale":"2024-05-27T06:27:45.136563+0000","last_undegraded":"2024-05-27T06:27:45.136563+0000","last_fullsized":"2024-05-27T06:27:45.136563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:25:28.290431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995400+0000","last_change":"2024-05-27T06:27:37.597113+0000","last_active":"2024-05-27T06:27:44.995400+0000","last_peered":"2024-05-27T06:27:44.995400+0000","last_clean":"2024-05-27T06:27:44.995400+0000","last_became_active":"2024-05-27T06:27:37.596735+0000","last_became_peered":"2024-05-27T06:27:37.596735+0000","last_unstale":"2024-05-27T06:27:44.995400+0000","last_undegraded":"2024-05-27T06:27:44.995400+0000","last_fullsized":"2024-05-27T06:27:44.995400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:39:09.133451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641559+0000","last_change":"2024-05-27T06:27:42.685192+0000","last_active":"2024-05-27T06:27:43.641559+0000","last_peered":"2024-05-27T06:27:43.641559+0000","last_clean":"2024-05-27T06:27:43.641559+0000","last_became_active":"2024-05-27T06:27:42.684722+0000","last_became_peered":"2024-05-27T06:27:42.684722+0000","last_unstale":"2024-05-27T06:27:43.641559+0000","last_undegraded":"2024-05-27T06:27:43.641559+0000","last_fullsized":"2024-05-27T06:27:43.641559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:29:09.440505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136801+0000","last_change":"2024-05-27T06:27:38.617808+0000","last_active":"2024-05-27T06:27:45.136801+0000","last_peered":"2024-05-27T06:27:45.136801+0000","last_clean":"2024-05-27T06:27:45.136801+0000","last_became_active":"2024-05-27T06:27:38.617484+0000","last_became_peered":"2024-05-27T06:27:38.617484+0000","last_unstale":"2024-05-27T06:27:45.136801+0000","last_undegraded":"2024-05-27T06:27:45.136801+0000","last_fullsized":"2024-05-27T06:27:45.136801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:43:18.651541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.994806+0000","last_change":"2024-05-27T06:27:37.600205+0000","last_active":"2024-05-27T06:27:44.994806+0000","last_peered":"2024-05-27T06:27:44.994806+0000","last_clean":"2024-05-27T06:27:44.994806+0000","last_became_active":"2024-05-27T06:27:37.599877+0000","last_became_peered":"2024-05-27T06:27:37.599877+0000","last_unstale":"2024-05-27T06:27:44.994806+0000","last_undegraded":"2024-05-27T06:27:44.994806+0000","last_fullsized":"2024-05-27T06:27:44.994806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:49:54.332511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995252+0000","last_change":"2024-05-27T06:27:42.673409+0000","last_active":"2024-05-27T06:27:44.995252+0000","last_peered":"2024-05-27T06:27:44.995252+0000","last_clean":"2024-05-27T06:27:44.995252+0000","last_became_active":"2024-05-27T06:27:42.672637+0000","last_became_peered":"2024-05-27T06:27:42.672637+0000","last_unstale":"2024-05-27T06:27:44.995252+0000","last_undegraded":"2024-05-27T06:27:44.995252+0000","last_fullsized":"2024-05-27T06:27:44.995252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:25.641088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641351+0000","last_change":"2024-05-27T06:27:38.587029+0000","last_active":"2024-05-27T06:27:43.641351+0000","last_peered":"2024-05-27T06:27:43.641351+0000","last_clean":"2024-05-27T06:27:43.641351+0000","last_became_active":"2024-05-27T06:27:38.586798+0000","last_became_peered":"2024-05-27T06:27:38.586798+0000","last_unstale":"2024-05-27T06:27:43.641351+0000","last_undegraded":"2024-05-27T06:27:43.641351+0000","last_fullsized":"2024-05-27T06:27:43.641351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:28.542049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561027+0000","last_change":"2024-05-27T06:27:37.585479+0000","last_active":"2024-05-27T06:27:45.561027+0000","last_peered":"2024-05-27T06:27:45.561027+0000","last_clean":"2024-05-27T06:27:45.561027+0000","last_became_active":"2024-05-27T06:27:37.585196+0000","last_became_peered":"2024-05-27T06:27:37.585196+0000","last_unstale":"2024-05-27T06:27:45.561027+0000","last_undegraded":"2024-05-27T06:27:45.561027+0000","last_fullsized":"2024-05-27T06:27:45.561027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:39:09.133451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641758+0000","last_change":"2024-05-27T06:27:42.673356+0000","last_active":"2024-05-27T06:27:43.641758+0000","last_peered":"2024-05-27T06:27:43.641758+0000","last_clean":"2024-05-27T06:27:43.641758+0000","last_became_active":"2024-05-27T06:27:42.672313+0000","last_became_peered":"2024-05-27T06:27:42.672313+0000","last_unstale":"2024-05-27T06:27:43.641758+0000","last_undegraded":"2024-05-27T06:27:43.641758+0000","last_fullsized":"2024-05-27T06:27:43.641758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:13:33.049711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.699037+0000","last_change":"2024-05-27T06:27:38.594812+0000","last_active":"2024-05-27T06:27:44.699037+0000","last_peered":"2024-05-27T06:27:44.699037+0000","last_clean":"2024-05-27T06:27:44.699037+0000","last_became_active":"2024-05-27T06:27:38.594510+0000","last_became_peered":"2024-05-27T06:27:38.594510+0000","last_unstale":"2024-05-27T06:27:44.699037+0000","last_undegraded":"2024-05-27T06:27:44.699037+0000","last_fullsized":"2024-05-27T06:27:44.699037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:47.314366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560621+0000","last_change":"2024-05-27T06:27:37.593100+0000","last_active":"2024-05-27T06:27:45.560621+0000","last_peered":"2024-05-27T06:27:45.560621+0000","last_clean":"2024-05-27T06:27:45.560621+0000","last_became_active":"2024-05-27T06:27:37.592805+0000","last_became_peered":"2024-05-27T06:27:37.592805+0000","last_unstale":"2024-05-27T06:27:45.560621+0000","last_undegraded":"2024-05-27T06:27:45.560621+0000","last_fullsized":"2024-05-27T06:27:45.560621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:27.532558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641244+0000","last_change":"2024-05-27T06:27:42.674749+0000","last_active":"2024-05-27T06:27:43.641244+0000","last_peered":"2024-05-27T06:27:43.641244+0000","last_clean":"2024-05-27T06:27:43.641244+0000","last_became_active":"2024-05-27T06:27:42.674306+0000","last_became_peered":"2024-05-27T06:27:42.674306+0000","last_unstale":"2024-05-27T06:27:43.641244+0000","last_undegraded":"2024-05-27T06:27:43.641244+0000","last_fullsized":"2024-05-27T06:27:43.641244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:36:05.667548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.137291+0000","last_change":"2024-05-27T06:27:38.600218+0000","last_active":"2024-05-27T06:27:45.137291+0000","last_peered":"2024-05-27T06:27:45.137291+0000","last_clean":"2024-05-27T06:27:45.137291+0000","last_became_active":"2024-05-27T06:27:38.599796+0000","last_became_peered":"2024-05-27T06:27:38.599796+0000","last_unstale":"2024-05-27T06:27:45.137291+0000","last_undegraded":"2024-05-27T06:27:45.137291+0000","last_fullsized":"2024-05-27T06:27:45.137291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:25:30.433535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995470+0000","last_change":"2024-05-27T06:27:37.594420+0000","last_active":"2024-05-27T06:27:44.995470+0000","last_peered":"2024-05-27T06:27:44.995470+0000","last_clean":"2024-05-27T06:27:44.995470+0000","last_became_active":"2024-05-27T06:27:37.593946+0000","last_became_peered":"2024-05-27T06:27:37.593946+0000","last_unstale":"2024-05-27T06:27:44.995470+0000","last_undegraded":"2024-05-27T06:27:44.995470+0000","last_fullsized":"2024-05-27T06:27:44.995470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:26:32.568342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136310+0000","last_change":"2024-05-27T06:27:42.685574+0000","last_active":"2024-05-27T06:27:45.136310+0000","last_peered":"2024-05-27T06:27:45.136310+0000","last_clean":"2024-05-27T06:27:45.136310+0000","last_became_active":"2024-05-27T06:27:42.685158+0000","last_became_peered":"2024-05-27T06:27:42.685158+0000","last_unstale":"2024-05-27T06:27:45.136310+0000","last_undegraded":"2024-05-27T06:27:45.136310+0000","last_fullsized":"2024-05-27T06:27:45.136310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:21:58.228721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995447+0000","last_change":"2024-05-27T06:27:38.609767+0000","last_active":"2024-05-27T06:27:44.995447+0000","last_peered":"2024-05-27T06:27:44.995447+0000","last_clean":"2024-05-27T06:27:44.995447+0000","last_became_active":"2024-05-27T06:27:38.603315+0000","last_became_peered":"2024-05-27T06:27:38.603315+0000","last_unstale":"2024-05-27T06:27:44.995447+0000","last_undegraded":"2024-05-27T06:27:44.995447+0000","last_fullsized":"2024-05-27T06:27:44.995447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:47.314366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560615+0000","last_change":"2024-05-27T06:27:37.599180+0000","last_active":"2024-05-27T06:27:45.560615+0000","last_peered":"2024-05-27T06:27:45.560615+0000","last_clean":"2024-05-27T06:27:45.560615+0000","last_became_active":"2024-05-27T06:27:37.598944+0000","last_became_peered":"2024-05-27T06:27:37.598944+0000","last_unstale":"2024-05-27T06:27:45.560615+0000","last_undegraded":"2024-05-27T06:27:45.560615+0000","last_fullsized":"2024-05-27T06:27:45.560615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:49:54.332511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698527+0000","last_change":"2024-05-27T06:27:42.676516+0000","last_active":"2024-05-27T06:27:44.698527+0000","last_peered":"2024-05-27T06:27:44.698527+0000","last_clean":"2024-05-27T06:27:44.698527+0000","last_became_active":"2024-05-27T06:27:42.674971+0000","last_became_peered":"2024-05-27T06:27:42.674971+0000","last_unstale":"2024-05-27T06:27:44.698527+0000","last_undegraded":"2024-05-27T06:27:44.698527+0000","last_fullsized":"2024-05-27T06:27:44.698527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:31:27.862446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562261+0000","last_change":"2024-05-27T06:27:38.596128+0000","last_active":"2024-05-27T06:27:45.562261+0000","last_peered":"2024-05-27T06:27:45.562261+0000","last_clean":"2024-05-27T06:27:45.562261+0000","last_became_active":"2024-05-27T06:27:38.595919+0000","last_became_peered":"2024-05-27T06:27:38.595919+0000","last_unstale":"2024-05-27T06:27:45.562261+0000","last_undegraded":"2024-05-27T06:27:45.562261+0000","last_fullsized":"2024-05-27T06:27:45.562261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:31:23.791324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995552+0000","last_change":"2024-05-27T06:27:37.593456+0000","last_active":"2024-05-27T06:27:44.995552+0000","last_peered":"2024-05-27T06:27:44.995552+0000","last_clean":"2024-05-27T06:27:44.995552+0000","last_became_active":"2024-05-27T06:27:37.592873+0000","last_became_peered":"2024-05-27T06:27:37.592873+0000","last_unstale":"2024-05-27T06:27:44.995552+0000","last_undegraded":"2024-05-27T06:27:44.995552+0000","last_fullsized":"2024-05-27T06:27:44.995552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:05:47.256329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.994952+0000","last_change":"2024-05-27T06:27:42.678385+0000","last_active":"2024-05-27T06:27:44.994952+0000","last_peered":"2024-05-27T06:27:44.994952+0000","last_clean":"2024-05-27T06:27:44.994952+0000","last_became_active":"2024-05-27T06:27:42.677822+0000","last_became_peered":"2024-05-27T06:27:42.677822+0000","last_unstale":"2024-05-27T06:27:44.994952+0000","last_undegraded":"2024-05-27T06:27:44.994952+0000","last_fullsized":"2024-05-27T06:27:44.994952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:31:27.862446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641909+0000","last_change":"2024-05-27T06:27:38.579066+0000","last_active":"2024-05-27T06:27:43.641909+0000","last_peered":"2024-05-27T06:27:43.641909+0000","last_clean":"2024-05-27T06:27:43.641909+0000","last_became_active":"2024-05-27T06:27:38.577426+0000","last_became_peered":"2024-05-27T06:27:38.577426+0000","last_unstale":"2024-05-27T06:27:43.641909+0000","last_undegraded":"2024-05-27T06:27:43.641909+0000","last_fullsized":"2024-05-27T06:27:43.641909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:11.398713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561828+0000","last_change":"2024-05-27T06:27:37.601204+0000","last_active":"2024-05-27T06:27:45.561828+0000","last_peered":"2024-05-27T06:27:45.561828+0000","last_clean":"2024-05-27T06:27:45.561828+0000","last_became_active":"2024-05-27T06:27:37.599178+0000","last_became_peered":"2024-05-27T06:27:37.599178+0000","last_unstale":"2024-05-27T06:27:45.561828+0000","last_undegraded":"2024-05-27T06:27:45.561828+0000","last_fullsized":"2024-05-27T06:27:45.561828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:10.389223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995594+0000","last_change":"2024-05-27T06:27:42.672415+0000","last_active":"2024-05-27T06:27:44.995594+0000","last_peered":"2024-05-27T06:27:44.995594+0000","last_clean":"2024-05-27T06:27:44.995594+0000","last_became_active":"2024-05-27T06:27:42.671247+0000","last_became_peered":"2024-05-27T06:27:42.671247+0000","last_unstale":"2024-05-27T06:27:44.995594+0000","last_undegraded":"2024-05-27T06:27:44.995594+0000","last_fullsized":"2024-05-27T06:27:44.995594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:21:58.228721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.994829+0000","last_change":"2024-05-27T06:27:38.601418+0000","last_active":"2024-05-27T06:27:44.994829+0000","last_peered":"2024-05-27T06:27:44.994829+0000","last_clean":"2024-05-27T06:27:44.994829+0000","last_became_active":"2024-05-27T06:27:38.600709+0000","last_became_peered":"2024-05-27T06:27:38.600709+0000","last_unstale":"2024-05-27T06:27:44.994829+0000","last_undegraded":"2024-05-27T06:27:44.994829+0000","last_fullsized":"2024-05-27T06:27:44.994829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:10:49.565828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.640446+0000","last_change":"2024-05-27T06:27:37.597493+0000","last_active":"2024-05-27T06:27:43.640446+0000","last_peered":"2024-05-27T06:27:43.640446+0000","last_clean":"2024-05-27T06:27:43.640446+0000","last_became_active":"2024-05-27T06:27:37.597007+0000","last_became_peered":"2024-05-27T06:27:37.597007+0000","last_unstale":"2024-05-27T06:27:43.640446+0000","last_undegraded":"2024-05-27T06:27:43.640446+0000","last_fullsized":"2024-05-27T06:27:43.640446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:39:09.133451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995343+0000","last_change":"2024-05-27T06:27:42.672189+0000","last_active":"2024-05-27T06:27:44.995343+0000","last_peered":"2024-05-27T06:27:44.995343+0000","last_clean":"2024-05-27T06:27:44.995343+0000","last_became_active":"2024-05-27T06:27:42.671679+0000","last_became_peered":"2024-05-27T06:27:42.671679+0000","last_unstale":"2024-05-27T06:27:44.995343+0000","last_undegraded":"2024-05-27T06:27:44.995343+0000","last_fullsized":"2024-05-27T06:27:44.995343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:56:11.868706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698082+0000","last_change":"2024-05-27T06:27:38.579100+0000","last_active":"2024-05-27T06:27:44.698082+0000","last_peered":"2024-05-27T06:27:44.698082+0000","last_clean":"2024-05-27T06:27:44.698082+0000","last_became_active":"2024-05-27T06:27:38.578133+0000","last_became_peered":"2024-05-27T06:27:38.578133+0000","last_unstale":"2024-05-27T06:27:44.698082+0000","last_undegraded":"2024-05-27T06:27:44.698082+0000","last_fullsized":"2024-05-27T06:27:44.698082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:52:56.162405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561032+0000","last_change":"2024-05-27T06:27:37.589413+0000","last_active":"2024-05-27T06:27:45.561032+0000","last_peered":"2024-05-27T06:27:45.561032+0000","last_clean":"2024-05-27T06:27:45.561032+0000","last_became_active":"2024-05-27T06:27:37.589095+0000","last_became_peered":"2024-05-27T06:27:37.589095+0000","last_unstale":"2024-05-27T06:27:45.561032+0000","last_undegraded":"2024-05-27T06:27:45.561032+0000","last_fullsized":"2024-05-27T06:27:45.561032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:27.532558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698947+0000","last_change":"2024-05-27T06:27:42.672540+0000","last_active":"2024-05-27T06:27:44.698947+0000","last_peered":"2024-05-27T06:27:44.698947+0000","last_clean":"2024-05-27T06:27:44.698947+0000","last_became_active":"2024-05-27T06:27:42.672001+0000","last_became_peered":"2024-05-27T06:27:42.672001+0000","last_unstale":"2024-05-27T06:27:44.698947+0000","last_undegraded":"2024-05-27T06:27:44.698947+0000","last_fullsized":"2024-05-27T06:27:44.698947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:56:11.868706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136536+0000","last_change":"2024-05-27T06:27:38.592046+0000","last_active":"2024-05-27T06:27:45.136536+0000","last_peered":"2024-05-27T06:27:45.136536+0000","last_clean":"2024-05-27T06:27:45.136536+0000","last_became_active":"2024-05-27T06:27:38.591693+0000","last_became_peered":"2024-05-27T06:27:38.591693+0000","last_unstale":"2024-05-27T06:27:45.136536+0000","last_undegraded":"2024-05-27T06:27:45.136536+0000","last_fullsized":"2024-05-27T06:27:45.136536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:10:49.565828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561713+0000","last_change":"2024-05-27T06:27:37.588339+0000","last_active":"2024-05-27T06:27:45.561713+0000","last_peered":"2024-05-27T06:27:45.561713+0000","last_clean":"2024-05-27T06:27:45.561713+0000","last_became_active":"2024-05-27T06:27:37.587997+0000","last_became_peered":"2024-05-27T06:27:37.587997+0000","last_unstale":"2024-05-27T06:27:45.561713+0000","last_undegraded":"2024-05-27T06:27:45.561713+0000","last_fullsized":"2024-05-27T06:27:45.561713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:05:47.256329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561179+0000","last_change":"2024-05-27T06:27:28.692457+0000","last_active":"2024-05-27T06:27:45.561179+0000","last_peered":"2024-05-27T06:27:45.561179+0000","last_clean":"2024-05-27T06:27:45.561179+0000","last_became_active":"2024-05-27T06:27:28.691290+0000","last_became_peered":"2024-05-27T06:27:28.691290+0000","last_unstale":"2024-05-27T06:27:45.561179+0000","last_undegraded":"2024-05-27T06:27:45.561179+0000","last_fullsized":"2024-05-27T06:27:45.561179+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_clean_scrub_stamp":"2024-05-27T06:27:26.991915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:45.563728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559963+0000","last_change":"2024-05-27T06:27:42.675952+0000","last_active":"2024-05-27T06:27:45.559963+0000","last_peered":"2024-05-27T06:27:45.559963+0000","last_clean":"2024-05-27T06:27:45.559963+0000","last_became_active":"2024-05-27T06:27:42.675456+0000","last_became_peered":"2024-05-27T06:27:42.675456+0000","last_unstale":"2024-05-27T06:27:45.559963+0000","last_undegraded":"2024-05-27T06:27:45.559963+0000","last_fullsized":"2024-05-27T06:27:45.559963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:30.051452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560151+0000","last_change":"2024-05-27T06:27:38.594241+0000","last_active":"2024-05-27T06:27:45.560151+0000","last_peered":"2024-05-27T06:27:45.560151+0000","last_clean":"2024-05-27T06:27:45.560151+0000","last_became_active":"2024-05-27T06:27:38.593947+0000","last_became_peered":"2024-05-27T06:27:38.593947+0000","last_unstale":"2024-05-27T06:27:45.560151+0000","last_undegraded":"2024-05-27T06:27:45.560151+0000","last_fullsized":"2024-05-27T06:27:45.560151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:53.536742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641007+0000","last_change":"2024-05-27T06:27:37.591342+0000","last_active":"2024-05-27T06:27:43.641007+0000","last_peered":"2024-05-27T06:27:43.641007+0000","last_clean":"2024-05-27T06:27:43.641007+0000","last_became_active":"2024-05-27T06:27:37.591027+0000","last_became_peered":"2024-05-27T06:27:37.591027+0000","last_unstale":"2024-05-27T06:27:43.641007+0000","last_undegraded":"2024-05-27T06:27:43.641007+0000","last_fullsized":"2024-05-27T06:27:43.641007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:27.532558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559661+0000","last_change":"2024-05-27T06:27:42.681211+0000","last_active":"2024-05-27T06:27:45.559661+0000","last_peered":"2024-05-27T06:27:45.559661+0000","last_clean":"2024-05-27T06:27:45.559661+0000","last_became_active":"2024-05-27T06:27:42.680695+0000","last_became_peered":"2024-05-27T06:27:42.680695+0000","last_unstale":"2024-05-27T06:27:45.559661+0000","last_undegraded":"2024-05-27T06:27:45.559661+0000","last_fullsized":"2024-05-27T06:27:45.559661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:57.607864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562099+0000","last_change":"2024-05-27T06:27:38.596719+0000","last_active":"2024-05-27T06:27:45.562099+0000","last_peered":"2024-05-27T06:27:45.562099+0000","last_clean":"2024-05-27T06:27:45.562099+0000","last_became_active":"2024-05-27T06:27:38.596458+0000","last_became_peered":"2024-05-27T06:27:38.596458+0000","last_unstale":"2024-05-27T06:27:45.562099+0000","last_undegraded":"2024-05-27T06:27:45.562099+0000","last_fullsized":"2024-05-27T06:27:45.562099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:25.980330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995382+0000","last_change":"2024-05-27T06:27:37.587248+0000","last_active":"2024-05-27T06:27:44.995382+0000","last_peered":"2024-05-27T06:27:44.995382+0000","last_clean":"2024-05-27T06:27:44.995382+0000","last_became_active":"2024-05-27T06:27:37.586914+0000","last_became_peered":"2024-05-27T06:27:37.586914+0000","last_unstale":"2024-05-27T06:27:44.995382+0000","last_undegraded":"2024-05-27T06:27:44.995382+0000","last_fullsized":"2024-05-27T06:27:44.995382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:10.389223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698571+0000","last_change":"2024-05-27T06:27:42.674862+0000","last_active":"2024-05-27T06:27:44.698571+0000","last_peered":"2024-05-27T06:27:44.698571+0000","last_clean":"2024-05-27T06:27:44.698571+0000","last_became_active":"2024-05-27T06:27:42.674435+0000","last_became_peered":"2024-05-27T06:27:42.674435+0000","last_unstale":"2024-05-27T06:27:44.698571+0000","last_undegraded":"2024-05-27T06:27:44.698571+0000","last_fullsized":"2024-05-27T06:27:44.698571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:25.641088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561573+0000","last_change":"2024-05-27T06:27:38.593263+0000","last_active":"2024-05-27T06:27:45.561573+0000","last_peered":"2024-05-27T06:27:45.561573+0000","last_clean":"2024-05-27T06:27:45.561573+0000","last_became_active":"2024-05-27T06:27:38.592852+0000","last_became_peered":"2024-05-27T06:27:38.592852+0000","last_unstale":"2024-05-27T06:27:45.561573+0000","last_undegraded":"2024-05-27T06:27:45.561573+0000","last_fullsized":"2024-05-27T06:27:45.561573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:21.569967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641310+0000","last_change":"2024-05-27T06:27:37.599453+0000","last_active":"2024-05-27T06:27:43.641310+0000","last_peered":"2024-05-27T06:27:43.641310+0000","last_clean":"2024-05-27T06:27:43.641310+0000","last_became_active":"2024-05-27T06:27:37.599122+0000","last_became_peered":"2024-05-27T06:27:37.599122+0000","last_unstale":"2024-05-27T06:27:43.641310+0000","last_undegraded":"2024-05-27T06:27:43.641310+0000","last_fullsized":"2024-05-27T06:27:43.641310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:10.389223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559414+0000","last_change":"2024-05-27T06:27:42.667965+0000","last_active":"2024-05-27T06:27:45.559414+0000","last_peered":"2024-05-27T06:27:45.559414+0000","last_clean":"2024-05-27T06:27:45.559414+0000","last_became_active":"2024-05-27T06:27:42.667525+0000","last_became_peered":"2024-05-27T06:27:42.667525+0000","last_unstale":"2024-05-27T06:27:45.559414+0000","last_undegraded":"2024-05-27T06:27:45.559414+0000","last_fullsized":"2024-05-27T06:27:45.559414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:39:45.712130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561139+0000","last_change":"2024-05-27T06:27:38.593273+0000","last_active":"2024-05-27T06:27:45.561139+0000","last_peered":"2024-05-27T06:27:45.561139+0000","last_clean":"2024-05-27T06:27:45.561139+0000","last_became_active":"2024-05-27T06:27:38.592904+0000","last_became_peered":"2024-05-27T06:27:38.592904+0000","last_unstale":"2024-05-27T06:27:45.561139+0000","last_undegraded":"2024-05-27T06:27:45.561139+0000","last_fullsized":"2024-05-27T06:27:45.561139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:13:28.978589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.642001+0000","last_change":"2024-05-27T06:27:37.588652+0000","last_active":"2024-05-27T06:27:43.642001+0000","last_peered":"2024-05-27T06:27:43.642001+0000","last_clean":"2024-05-27T06:27:43.642001+0000","last_became_active":"2024-05-27T06:27:37.587893+0000","last_became_peered":"2024-05-27T06:27:37.587893+0000","last_unstale":"2024-05-27T06:27:43.642001+0000","last_undegraded":"2024-05-27T06:27:43.642001+0000","last_fullsized":"2024-05-27T06:27:43.642001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:29:42.916475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641001+0000","last_change":"2024-05-27T06:27:42.673669+0000","last_active":"2024-05-27T06:27:43.641001+0000","last_peered":"2024-05-27T06:27:43.641001+0000","last_clean":"2024-05-27T06:27:43.641001+0000","last_became_active":"2024-05-27T06:27:42.672239+0000","last_became_peered":"2024-05-27T06:27:42.672239+0000","last_unstale":"2024-05-27T06:27:43.641001+0000","last_undegraded":"2024-05-27T06:27:43.641001+0000","last_fullsized":"2024-05-27T06:27:43.641001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:12:01.383034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560187+0000","last_change":"2024-05-27T06:27:38.592051+0000","last_active":"2024-05-27T06:27:45.560187+0000","last_peered":"2024-05-27T06:27:45.560187+0000","last_clean":"2024-05-27T06:27:45.560187+0000","last_became_active":"2024-05-27T06:27:38.591691+0000","last_became_peered":"2024-05-27T06:27:38.591691+0000","last_unstale":"2024-05-27T06:27:45.560187+0000","last_undegraded":"2024-05-27T06:27:45.560187+0000","last_fullsized":"2024-05-27T06:27:45.560187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:24:46.797590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.640005+0000","last_change":"2024-05-27T06:27:37.581720+0000","last_active":"2024-05-27T06:27:43.640005+0000","last_peered":"2024-05-27T06:27:43.640005+0000","last_clean":"2024-05-27T06:27:43.640005+0000","last_became_active":"2024-05-27T06:27:37.581315+0000","last_became_peered":"2024-05-27T06:27:37.581315+0000","last_unstale":"2024-05-27T06:27:43.640005+0000","last_undegraded":"2024-05-27T06:27:43.640005+0000","last_fullsized":"2024-05-27T06:27:43.640005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:52:20.552058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698884+0000","last_change":"2024-05-27T06:27:42.663374+0000","last_active":"2024-05-27T06:27:44.698884+0000","last_peered":"2024-05-27T06:27:44.698884+0000","last_clean":"2024-05-27T06:27:44.698884+0000","last_became_active":"2024-05-27T06:27:42.662889+0000","last_became_peered":"2024-05-27T06:27:42.662889+0000","last_unstale":"2024-05-27T06:27:44.698884+0000","last_undegraded":"2024-05-27T06:27:44.698884+0000","last_fullsized":"2024-05-27T06:27:44.698884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:54:35.677824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559633+0000","last_change":"2024-05-27T06:27:38.583434+0000","last_active":"2024-05-27T06:27:45.559633+0000","last_peered":"2024-05-27T06:27:45.559633+0000","last_clean":"2024-05-27T06:27:45.559633+0000","last_became_active":"2024-05-27T06:27:38.582843+0000","last_became_peered":"2024-05-27T06:27:38.582843+0000","last_unstale":"2024-05-27T06:27:45.559633+0000","last_undegraded":"2024-05-27T06:27:45.559633+0000","last_fullsized":"2024-05-27T06:27:45.559633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:41:11.973047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559966+0000","last_change":"2024-05-27T06:27:37.589051+0000","last_active":"2024-05-27T06:27:45.559966+0000","last_peered":"2024-05-27T06:27:45.559966+0000","last_clean":"2024-05-27T06:27:45.559966+0000","last_became_active":"2024-05-27T06:27:37.588633+0000","last_became_peered":"2024-05-27T06:27:37.588633+0000","last_unstale":"2024-05-27T06:27:45.559966+0000","last_undegraded":"2024-05-27T06:27:45.559966+0000","last_fullsized":"2024-05-27T06:27:45.559966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:05:47.256329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.137194+0000","last_change":"2024-05-27T06:27:42.686386+0000","last_active":"2024-05-27T06:27:45.137194+0000","last_peered":"2024-05-27T06:27:45.137194+0000","last_clean":"2024-05-27T06:27:45.137194+0000","last_became_active":"2024-05-27T06:27:42.685755+0000","last_became_peered":"2024-05-27T06:27:42.685755+0000","last_unstale":"2024-05-27T06:27:45.137194+0000","last_undegraded":"2024-05-27T06:27:45.137194+0000","last_fullsized":"2024-05-27T06:27:45.137194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:37:17.435617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561197+0000","last_change":"2024-05-27T06:27:38.593634+0000","last_active":"2024-05-27T06:27:45.561197+0000","last_peered":"2024-05-27T06:27:45.561197+0000","last_clean":"2024-05-27T06:27:45.561197+0000","last_became_active":"2024-05-27T06:27:38.593201+0000","last_became_peered":"2024-05-27T06:27:38.593201+0000","last_unstale":"2024-05-27T06:27:45.561197+0000","last_undegraded":"2024-05-27T06:27:45.561197+0000","last_fullsized":"2024-05-27T06:27:45.561197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:25:30.433535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561742+0000","last_change":"2024-05-27T06:27:37.596337+0000","last_active":"2024-05-27T06:27:45.561742+0000","last_peered":"2024-05-27T06:27:45.561742+0000","last_clean":"2024-05-27T06:27:45.561742+0000","last_became_active":"2024-05-27T06:27:37.596071+0000","last_became_peered":"2024-05-27T06:27:37.596071+0000","last_unstale":"2024-05-27T06:27:45.561742+0000","last_undegraded":"2024-05-27T06:27:45.561742+0000","last_fullsized":"2024-05-27T06:27:45.561742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:27.532558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136738+0000","last_change":"2024-05-27T06:27:42.686370+0000","last_active":"2024-05-27T06:27:45.136738+0000","last_peered":"2024-05-27T06:27:45.136738+0000","last_clean":"2024-05-27T06:27:45.136738+0000","last_became_active":"2024-05-27T06:27:42.685792+0000","last_became_peered":"2024-05-27T06:27:42.685792+0000","last_unstale":"2024-05-27T06:27:45.136738+0000","last_undegraded":"2024-05-27T06:27:45.136738+0000","last_fullsized":"2024-05-27T06:27:45.136738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:28:22.687108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698347+0000","last_change":"2024-05-27T06:27:38.594222+0000","last_active":"2024-05-27T06:27:44.698347+0000","last_peered":"2024-05-27T06:27:44.698347+0000","last_clean":"2024-05-27T06:27:44.698347+0000","last_became_active":"2024-05-27T06:27:38.593632+0000","last_became_peered":"2024-05-27T06:27:38.593632+0000","last_unstale":"2024-05-27T06:27:44.698347+0000","last_undegraded":"2024-05-27T06:27:44.698347+0000","last_fullsized":"2024-05-27T06:27:44.698347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:00:49.009171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698666+0000","last_change":"2024-05-27T06:27:37.589344+0000","last_active":"2024-05-27T06:27:44.698666+0000","last_peered":"2024-05-27T06:27:44.698666+0000","last_clean":"2024-05-27T06:27:44.698666+0000","last_became_active":"2024-05-27T06:27:37.588387+0000","last_became_peered":"2024-05-27T06:27:37.588387+0000","last_unstale":"2024-05-27T06:27:44.698666+0000","last_undegraded":"2024-05-27T06:27:44.698666+0000","last_fullsized":"2024-05-27T06:27:44.698666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:32:06.800381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562338+0000","last_change":"2024-05-27T06:27:42.673810+0000","last_active":"2024-05-27T06:27:45.562338+0000","last_peered":"2024-05-27T06:27:45.562338+0000","last_clean":"2024-05-27T06:27:45.562338+0000","last_became_active":"2024-05-27T06:27:42.673431+0000","last_became_peered":"2024-05-27T06:27:42.673431+0000","last_unstale":"2024-05-27T06:27:45.562338+0000","last_undegraded":"2024-05-27T06:27:45.562338+0000","last_fullsized":"2024-05-27T06:27:45.562338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:00:08.939251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560009+0000","last_change":"2024-05-27T06:27:38.599269+0000","last_active":"2024-05-27T06:27:45.560009+0000","last_peered":"2024-05-27T06:27:45.560009+0000","last_clean":"2024-05-27T06:27:45.560009+0000","last_became_active":"2024-05-27T06:27:38.598937+0000","last_became_peered":"2024-05-27T06:27:38.598937+0000","last_unstale":"2024-05-27T06:27:45.560009+0000","last_undegraded":"2024-05-27T06:27:45.560009+0000","last_fullsized":"2024-05-27T06:27:45.560009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:29:05.369384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:49.604485+0000","last_change":"2024-05-27T06:27:37.601137+0000","last_active":"2024-05-27T06:27:49.604485+0000","last_peered":"2024-05-27T06:27:49.604485+0000","last_clean":"2024-05-27T06:27:49.604485+0000","last_became_active":"2024-05-27T06:27:37.597839+0000","last_became_peered":"2024-05-27T06:27:37.597839+0000","last_unstale":"2024-05-27T06:27:49.604485+0000","last_undegraded":"2024-05-27T06:27:49.604485+0000","last_fullsized":"2024-05-27T06:27:49.604485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:10.389223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995265+0000","last_change":"2024-05-27T06:27:42.677071+0000","last_active":"2024-05-27T06:27:44.995265+0000","last_peered":"2024-05-27T06:27:44.995265+0000","last_clean":"2024-05-27T06:27:44.995265+0000","last_became_active":"2024-05-27T06:27:42.676468+0000","last_became_peered":"2024-05-27T06:27:42.676468+0000","last_unstale":"2024-05-27T06:27:44.995265+0000","last_undegraded":"2024-05-27T06:27:44.995265+0000","last_fullsized":"2024-05-27T06:27:44.995265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:54:35.677824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641784+0000","last_change":"2024-05-27T06:27:38.595005+0000","last_active":"2024-05-27T06:27:43.641784+0000","last_peered":"2024-05-27T06:27:43.641784+0000","last_clean":"2024-05-27T06:27:43.641784+0000","last_became_active":"2024-05-27T06:27:38.594686+0000","last_became_peered":"2024-05-27T06:27:38.594686+0000","last_unstale":"2024-05-27T06:27:43.641784+0000","last_undegraded":"2024-05-27T06:27:43.641784+0000","last_fullsized":"2024-05-27T06:27:43.641784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:26:33.577833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995173+0000","last_change":"2024-05-27T06:27:37.602334+0000","last_active":"2024-05-27T06:27:44.995173+0000","last_peered":"2024-05-27T06:27:44.995173+0000","last_clean":"2024-05-27T06:27:44.995173+0000","last_became_active":"2024-05-27T06:27:37.601956+0000","last_became_peered":"2024-05-27T06:27:37.601956+0000","last_unstale":"2024-05-27T06:27:44.995173+0000","last_undegraded":"2024-05-27T06:27:44.995173+0000","last_fullsized":"2024-05-27T06:27:44.995173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:27.532558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641965+0000","last_change":"2024-05-27T06:27:42.675917+0000","last_active":"2024-05-27T06:27:43.641965+0000","last_peered":"2024-05-27T06:27:43.641965+0000","last_clean":"2024-05-27T06:27:43.641965+0000","last_became_active":"2024-05-27T06:27:42.672667+0000","last_became_peered":"2024-05-27T06:27:42.672667+0000","last_unstale":"2024-05-27T06:27:43.641965+0000","last_undegraded":"2024-05-27T06:27:43.641965+0000","last_fullsized":"2024-05-27T06:27:43.641965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:57.607864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698963+0000","last_change":"2024-05-27T06:27:38.593445+0000","last_active":"2024-05-27T06:27:44.698963+0000","last_peered":"2024-05-27T06:27:44.698963+0000","last_clean":"2024-05-27T06:27:44.698963+0000","last_became_active":"2024-05-27T06:27:38.593177+0000","last_became_peered":"2024-05-27T06:27:38.593177+0000","last_unstale":"2024-05-27T06:27:44.698963+0000","last_undegraded":"2024-05-27T06:27:44.698963+0000","last_fullsized":"2024-05-27T06:27:44.698963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:25:28.290431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562220+0000","last_change":"2024-05-27T06:27:37.591786+0000","last_active":"2024-05-27T06:27:45.562220+0000","last_peered":"2024-05-27T06:27:45.562220+0000","last_clean":"2024-05-27T06:27:45.562220+0000","last_became_active":"2024-05-27T06:27:37.591376+0000","last_became_peered":"2024-05-27T06:27:37.591376+0000","last_unstale":"2024-05-27T06:27:45.562220+0000","last_undegraded":"2024-05-27T06:27:45.562220+0000","last_fullsized":"2024-05-27T06:27:45.562220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:26:32.568342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136705+0000","last_change":"2024-05-27T06:27:42.685562+0000","last_active":"2024-05-27T06:27:45.136705+0000","last_peered":"2024-05-27T06:27:45.136705+0000","last_clean":"2024-05-27T06:27:45.136705+0000","last_became_active":"2024-05-27T06:27:42.685102+0000","last_became_peered":"2024-05-27T06:27:42.685102+0000","last_unstale":"2024-05-27T06:27:45.136705+0000","last_undegraded":"2024-05-27T06:27:45.136705+0000","last_fullsized":"2024-05-27T06:27:45.136705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:00:08.939251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562310+0000","last_change":"2024-05-27T06:27:38.595953+0000","last_active":"2024-05-27T06:27:45.562310+0000","last_peered":"2024-05-27T06:27:45.562310+0000","last_clean":"2024-05-27T06:27:45.562310+0000","last_became_active":"2024-05-27T06:27:38.595628+0000","last_became_peered":"2024-05-27T06:27:38.595628+0000","last_unstale":"2024-05-27T06:27:45.562310+0000","last_undegraded":"2024-05-27T06:27:45.562310+0000","last_fullsized":"2024-05-27T06:27:45.562310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:36:01.596426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560492+0000","last_change":"2024-05-27T06:27:37.600029+0000","last_active":"2024-05-27T06:27:45.560492+0000","last_peered":"2024-05-27T06:27:45.560492+0000","last_clean":"2024-05-27T06:27:45.560492+0000","last_became_active":"2024-05-27T06:27:37.599416+0000","last_became_peered":"2024-05-27T06:27:37.599416+0000","last_unstale":"2024-05-27T06:27:45.560492+0000","last_undegraded":"2024-05-27T06:27:45.560492+0000","last_fullsized":"2024-05-27T06:27:45.560492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:52:20.552058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136431+0000","last_change":"2024-05-27T06:27:42.668152+0000","last_active":"2024-05-27T06:27:45.136431+0000","last_peered":"2024-05-27T06:27:45.136431+0000","last_clean":"2024-05-27T06:27:45.136431+0000","last_became_active":"2024-05-27T06:27:42.667699+0000","last_became_peered":"2024-05-27T06:27:42.667699+0000","last_unstale":"2024-05-27T06:27:45.136431+0000","last_undegraded":"2024-05-27T06:27:45.136431+0000","last_fullsized":"2024-05-27T06:27:45.136431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:39:45.712130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698461+0000","last_change":"2024-05-27T06:27:42.674408+0000","last_active":"2024-05-27T06:27:44.698461+0000","last_peered":"2024-05-27T06:27:44.698461+0000","last_clean":"2024-05-27T06:27:44.698461+0000","last_became_active":"2024-05-27T06:27:42.673922+0000","last_became_peered":"2024-05-27T06:27:42.673922+0000","last_unstale":"2024-05-27T06:27:44.698461+0000","last_undegraded":"2024-05-27T06:27:44.698461+0000","last_fullsized":"2024-05-27T06:27:44.698461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:39.420388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.994666+0000","last_change":"2024-05-27T06:27:38.612241+0000","last_active":"2024-05-27T06:27:44.994666+0000","last_peered":"2024-05-27T06:27:44.994666+0000","last_clean":"2024-05-27T06:27:44.994666+0000","last_became_active":"2024-05-27T06:27:38.611812+0000","last_became_peered":"2024-05-27T06:27:38.611812+0000","last_unstale":"2024-05-27T06:27:44.994666+0000","last_undegraded":"2024-05-27T06:27:44.994666+0000","last_fullsized":"2024-05-27T06:27:44.994666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:43:18.651541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560424+0000","last_change":"2024-05-27T06:27:37.588619+0000","last_active":"2024-05-27T06:27:45.560424+0000","last_peered":"2024-05-27T06:27:45.560424+0000","last_clean":"2024-05-27T06:27:45.560424+0000","last_became_active":"2024-05-27T06:27:37.588234+0000","last_became_peered":"2024-05-27T06:27:37.588234+0000","last_unstale":"2024-05-27T06:27:45.560424+0000","last_undegraded":"2024-05-27T06:27:45.560424+0000","last_fullsized":"2024-05-27T06:27:45.560424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:39:09.133451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560396+0000","last_change":"2024-05-27T06:27:42.675463+0000","last_active":"2024-05-27T06:27:45.560396+0000","last_peered":"2024-05-27T06:27:45.560396+0000","last_clean":"2024-05-27T06:27:45.560396+0000","last_became_active":"2024-05-27T06:27:42.674944+0000","last_became_peered":"2024-05-27T06:27:42.674944+0000","last_unstale":"2024-05-27T06:27:45.560396+0000","last_undegraded":"2024-05-27T06:27:45.560396+0000","last_fullsized":"2024-05-27T06:27:45.560396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:39.420388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136773+0000","last_change":"2024-05-27T06:27:38.602470+0000","last_active":"2024-05-27T06:27:45.136773+0000","last_peered":"2024-05-27T06:27:45.136773+0000","last_clean":"2024-05-27T06:27:45.136773+0000","last_became_active":"2024-05-27T06:27:38.602168+0000","last_became_peered":"2024-05-27T06:27:38.602168+0000","last_unstale":"2024-05-27T06:27:45.136773+0000","last_undegraded":"2024-05-27T06:27:45.136773+0000","last_fullsized":"2024-05-27T06:27:45.136773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:41:11.973047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136564+0000","last_change":"2024-05-27T06:27:37.594520+0000","last_active":"2024-05-27T06:27:45.136564+0000","last_peered":"2024-05-27T06:27:45.136564+0000","last_clean":"2024-05-27T06:27:45.136564+0000","last_became_active":"2024-05-27T06:27:37.594241+0000","last_became_peered":"2024-05-27T06:27:37.594241+0000","last_unstale":"2024-05-27T06:27:45.136564+0000","last_undegraded":"2024-05-27T06:27:45.136564+0000","last_fullsized":"2024-05-27T06:27:45.136564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:32:06.800381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559944+0000","last_change":"2024-05-27T06:27:37.584323+0000","last_active":"2024-05-27T06:27:45.559944+0000","last_peered":"2024-05-27T06:27:45.559944+0000","last_clean":"2024-05-27T06:27:45.559944+0000","last_became_active":"2024-05-27T06:27:37.583455+0000","last_became_peered":"2024-05-27T06:27:37.583455+0000","last_unstale":"2024-05-27T06:27:45.559944+0000","last_undegraded":"2024-05-27T06:27:45.559944+0000","last_fullsized":"2024-05-27T06:27:45.559944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:39:09.133451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698607+0000","last_change":"2024-05-27T06:27:38.574453+0000","last_active":"2024-05-27T06:27:44.698607+0000","last_peered":"2024-05-27T06:27:44.698607+0000","last_clean":"2024-05-27T06:27:44.698607+0000","last_became_active":"2024-05-27T06:27:38.574187+0000","last_became_peered":"2024-05-27T06:27:38.574187+0000","last_unstale":"2024-05-27T06:27:44.698607+0000","last_undegraded":"2024-05-27T06:27:44.698607+0000","last_fullsized":"2024-05-27T06:27:44.698607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:10:49.565828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.640927+0000","last_change":"2024-05-27T06:27:42.685818+0000","last_active":"2024-05-27T06:27:43.640927+0000","last_peered":"2024-05-27T06:27:43.640927+0000","last_clean":"2024-05-27T06:27:43.640927+0000","last_became_active":"2024-05-27T06:27:42.685168+0000","last_became_peered":"2024-05-27T06:27:42.685168+0000","last_unstale":"2024-05-27T06:27:43.640927+0000","last_undegraded":"2024-05-27T06:27:43.640927+0000","last_fullsized":"2024-05-27T06:27:43.640927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:53:00.233527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136653+0000","last_change":"2024-05-27T06:27:37.593851+0000","last_active":"2024-05-27T06:27:45.136653+0000","last_peered":"2024-05-27T06:27:45.136653+0000","last_clean":"2024-05-27T06:27:45.136653+0000","last_became_active":"2024-05-27T06:27:37.593555+0000","last_became_peered":"2024-05-27T06:27:37.593555+0000","last_unstale":"2024-05-27T06:27:45.136653+0000","last_undegraded":"2024-05-27T06:27:45.136653+0000","last_fullsized":"2024-05-27T06:27:45.136653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:13:32.135455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641290+0000","last_change":"2024-05-27T06:27:38.581691+0000","last_active":"2024-05-27T06:27:43.641290+0000","last_peered":"2024-05-27T06:27:43.641290+0000","last_clean":"2024-05-27T06:27:43.641290+0000","last_became_active":"2024-05-27T06:27:38.581340+0000","last_became_peered":"2024-05-27T06:27:38.581340+0000","last_unstale":"2024-05-27T06:27:43.641290+0000","last_undegraded":"2024-05-27T06:27:43.641290+0000","last_fullsized":"2024-05-27T06:27:43.641290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:49:55.342001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.137183+0000","last_change":"2024-05-27T06:27:42.685248+0000","last_active":"2024-05-27T06:27:45.137183+0000","last_peered":"2024-05-27T06:27:45.137183+0000","last_clean":"2024-05-27T06:27:45.137183+0000","last_became_active":"2024-05-27T06:27:42.684742+0000","last_became_peered":"2024-05-27T06:27:42.684742+0000","last_unstale":"2024-05-27T06:27:45.137183+0000","last_undegraded":"2024-05-27T06:27:45.137183+0000","last_fullsized":"2024-05-27T06:27:45.137183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:02:03.498823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559395+0000","last_change":"2024-05-27T06:27:38.583155+0000","last_active":"2024-05-27T06:27:45.559395+0000","last_peered":"2024-05-27T06:27:45.559395+0000","last_clean":"2024-05-27T06:27:45.559395+0000","last_became_active":"2024-05-27T06:27:38.582419+0000","last_became_peered":"2024-05-27T06:27:38.582419+0000","last_unstale":"2024-05-27T06:27:45.559395+0000","last_undegraded":"2024-05-27T06:27:45.559395+0000","last_fullsized":"2024-05-27T06:27:45.559395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:11:57.311912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.640034+0000","last_change":"2024-05-27T06:27:38.590551+0000","last_active":"2024-05-27T06:27:43.640034+0000","last_peered":"2024-05-27T06:27:43.640034+0000","last_clean":"2024-05-27T06:27:43.640034+0000","last_became_active":"2024-05-27T06:27:38.590245+0000","last_became_peered":"2024-05-27T06:27:38.590245+0000","last_unstale":"2024-05-27T06:27:43.640034+0000","last_undegraded":"2024-05-27T06:27:43.640034+0000","last_fullsized":"2024-05-27T06:27:43.640034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:49:55.342001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561694+0000","last_change":"2024-05-27T06:27:38.597109+0000","last_active":"2024-05-27T06:27:45.561694+0000","last_peered":"2024-05-27T06:27:45.561694+0000","last_clean":"2024-05-27T06:27:45.561694+0000","last_became_active":"2024-05-27T06:27:38.596436+0000","last_became_peered":"2024-05-27T06:27:38.596436+0000","last_unstale":"2024-05-27T06:27:45.561694+0000","last_undegraded":"2024-05-27T06:27:45.561694+0000","last_fullsized":"2024-05-27T06:27:45.561694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:29:05.369384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698590+0000","last_change":"2024-05-27T06:27:38.592354+0000","last_active":"2024-05-27T06:27:44.698590+0000","last_peered":"2024-05-27T06:27:44.698590+0000","last_clean":"2024-05-27T06:27:44.698590+0000","last_became_active":"2024-05-27T06:27:38.591629+0000","last_became_peered":"2024-05-27T06:27:38.591629+0000","last_unstale":"2024-05-27T06:27:44.698590+0000","last_undegraded":"2024-05-27T06:27:44.698590+0000","last_fullsized":"2024-05-27T06:27:44.698590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:43:18.651541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136957+0000","last_change":"2024-05-27T06:27:38.600703+0000","last_active":"2024-05-27T06:27:45.136957+0000","last_peered":"2024-05-27T06:27:45.136957+0000","last_clean":"2024-05-27T06:27:45.136957+0000","last_became_active":"2024-05-27T06:27:38.598995+0000","last_became_peered":"2024-05-27T06:27:38.598995+0000","last_unstale":"2024-05-27T06:27:45.136957+0000","last_undegraded":"2024-05-27T06:27:45.136957+0000","last_fullsized":"2024-05-27T06:27:45.136957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:47.314366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.994968+0000","last_change":"2024-05-27T06:27:38.591611+0000","last_active":"2024-05-27T06:27:44.994968+0000","last_peered":"2024-05-27T06:27:44.994968+0000","last_clean":"2024-05-27T06:27:44.994968+0000","last_became_active":"2024-05-27T06:27:38.591257+0000","last_became_peered":"2024-05-27T06:27:38.591257+0000","last_unstale":"2024-05-27T06:27:44.994968+0000","last_undegraded":"2024-05-27T06:27:44.994968+0000","last_fullsized":"2024-05-27T06:27:44.994968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:11:57.311912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560497+0000","last_change":"2024-05-27T06:27:38.601653+0000","last_active":"2024-05-27T06:27:45.560497+0000","last_peered":"2024-05-27T06:27:45.560497+0000","last_clean":"2024-05-27T06:27:45.560497+0000","last_became_active":"2024-05-27T06:27:38.601350+0000","last_became_peered":"2024-05-27T06:27:38.601350+0000","last_unstale":"2024-05-27T06:27:45.560497+0000","last_undegraded":"2024-05-27T06:27:45.560497+0000","last_fullsized":"2024-05-27T06:27:45.560497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:47.314366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.137255+0000","last_change":"2024-05-27T06:27:38.595137+0000","last_active":"2024-05-27T06:27:45.137255+0000","last_peered":"2024-05-27T06:27:45.137255+0000","last_clean":"2024-05-27T06:27:45.137255+0000","last_became_active":"2024-05-27T06:27:38.594672+0000","last_became_peered":"2024-05-27T06:27:38.594672+0000","last_unstale":"2024-05-27T06:27:45.137255+0000","last_undegraded":"2024-05-27T06:27:45.137255+0000","last_fullsized":"2024-05-27T06:27:45.137255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:36:01.596426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560306+0000","last_change":"2024-05-27T06:27:38.604733+0000","last_active":"2024-05-27T06:27:45.560306+0000","last_peered":"2024-05-27T06:27:45.560306+0000","last_clean":"2024-05-27T06:27:45.560306+0000","last_became_active":"2024-05-27T06:27:38.604412+0000","last_became_peered":"2024-05-27T06:27:38.604412+0000","last_unstale":"2024-05-27T06:27:45.560306+0000","last_undegraded":"2024-05-27T06:27:45.560306+0000","last_fullsized":"2024-05-27T06:27:45.560306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:25:28.290431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136468+0000","last_change":"2024-05-27T06:27:38.594417+0000","last_active":"2024-05-27T06:27:45.136468+0000","last_peered":"2024-05-27T06:27:45.136468+0000","last_clean":"2024-05-27T06:27:45.136468+0000","last_became_active":"2024-05-27T06:27:38.594093+0000","last_became_peered":"2024-05-27T06:27:38.594093+0000","last_unstale":"2024-05-27T06:27:45.136468+0000","last_undegraded":"2024-05-27T06:27:45.136468+0000","last_fullsized":"2024-05-27T06:27:45.136468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:36:07.073192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561566+0000","last_change":"2024-05-27T06:27:38.595842+0000","last_active":"2024-05-27T06:27:45.561566+0000","last_peered":"2024-05-27T06:27:45.561566+0000","last_clean":"2024-05-27T06:27:45.561566+0000","last_became_active":"2024-05-27T06:27:38.595187+0000","last_became_peered":"2024-05-27T06:27:38.595187+0000","last_unstale":"2024-05-27T06:27:45.561566+0000","last_undegraded":"2024-05-27T06:27:45.561566+0000","last_fullsized":"2024-05-27T06:27:45.561566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:25:30.433535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698434+0000","last_change":"2024-05-27T06:27:38.596103+0000","last_active":"2024-05-27T06:27:44.698434+0000","last_peered":"2024-05-27T06:27:44.698434+0000","last_clean":"2024-05-27T06:27:44.698434+0000","last_became_active":"2024-05-27T06:27:38.595235+0000","last_became_peered":"2024-05-27T06:27:38.595235+0000","last_unstale":"2024-05-27T06:27:44.698434+0000","last_undegraded":"2024-05-27T06:27:44.698434+0000","last_fullsized":"2024-05-27T06:27:44.698434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:41:11.973047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561763+0000","last_change":"2024-05-27T06:27:38.589402+0000","last_active":"2024-05-27T06:27:45.561763+0000","last_peered":"2024-05-27T06:27:45.561763+0000","last_clean":"2024-05-27T06:27:45.561763+0000","last_became_active":"2024-05-27T06:27:38.588485+0000","last_became_peered":"2024-05-27T06:27:38.588485+0000","last_unstale":"2024-05-27T06:27:45.561763+0000","last_undegraded":"2024-05-27T06:27:45.561763+0000","last_fullsized":"2024-05-27T06:27:45.561763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:25:28.290431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560506+0000","last_change":"2024-05-27T06:27:38.604825+0000","last_active":"2024-05-27T06:27:45.560506+0000","last_peered":"2024-05-27T06:27:45.560506+0000","last_clean":"2024-05-27T06:27:45.560506+0000","last_became_active":"2024-05-27T06:27:38.604493+0000","last_became_peered":"2024-05-27T06:27:38.604493+0000","last_unstale":"2024-05-27T06:27:45.560506+0000","last_undegraded":"2024-05-27T06:27:45.560506+0000","last_fullsized":"2024-05-27T06:27:45.560506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:35.349266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641191+0000","last_change":"2024-05-27T06:27:38.589333+0000","last_active":"2024-05-27T06:27:43.641191+0000","last_peered":"2024-05-27T06:27:43.641191+0000","last_clean":"2024-05-27T06:27:43.641191+0000","last_became_active":"2024-05-27T06:27:38.588557+0000","last_became_peered":"2024-05-27T06:27:38.588557+0000","last_unstale":"2024-05-27T06:27:43.641191+0000","last_undegraded":"2024-05-27T06:27:43.641191+0000","last_fullsized":"2024-05-27T06:27:43.641191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:04:46.051655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562481+0000","last_change":"2024-05-27T06:27:38.595781+0000","last_active":"2024-05-27T06:27:45.562481+0000","last_peered":"2024-05-27T06:27:45.562481+0000","last_clean":"2024-05-27T06:27:45.562481+0000","last_became_active":"2024-05-27T06:27:38.595427+0000","last_became_peered":"2024-05-27T06:27:38.595427+0000","last_unstale":"2024-05-27T06:27:45.562481+0000","last_undegraded":"2024-05-27T06:27:45.562481+0000","last_fullsized":"2024-05-27T06:27:45.562481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:21.569967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560183+0000","last_change":"2024-05-27T06:27:38.603388+0000","last_active":"2024-05-27T06:27:45.560183+0000","last_peered":"2024-05-27T06:27:45.560183+0000","last_clean":"2024-05-27T06:27:45.560183+0000","last_became_active":"2024-05-27T06:27:38.602534+0000","last_became_peered":"2024-05-27T06:27:38.602534+0000","last_unstale":"2024-05-27T06:27:45.560183+0000","last_undegraded":"2024-05-27T06:27:45.560183+0000","last_fullsized":"2024-05-27T06:27:45.560183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:11:57.311912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.994752+0000","last_change":"2024-05-27T06:27:38.597804+0000","last_active":"2024-05-27T06:27:44.994752+0000","last_peered":"2024-05-27T06:27:44.994752+0000","last_clean":"2024-05-27T06:27:44.994752+0000","last_became_active":"2024-05-27T06:27:38.597501+0000","last_became_peered":"2024-05-27T06:27:38.597501+0000","last_unstale":"2024-05-27T06:27:44.994752+0000","last_undegraded":"2024-05-27T06:27:44.994752+0000","last_fullsized":"2024-05-27T06:27:44.994752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:36:07.073192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698683+0000","last_change":"2024-05-27T06:27:38.595971+0000","last_active":"2024-05-27T06:27:44.698683+0000","last_peered":"2024-05-27T06:27:44.698683+0000","last_clean":"2024-05-27T06:27:44.698683+0000","last_became_active":"2024-05-27T06:27:38.595550+0000","last_became_peered":"2024-05-27T06:27:38.595550+0000","last_unstale":"2024-05-27T06:27:44.698683+0000","last_undegraded":"2024-05-27T06:27:44.698683+0000","last_fullsized":"2024-05-27T06:27:44.698683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:44:31.285463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136539+0000","last_change":"2024-05-27T06:27:38.587249+0000","last_active":"2024-05-27T06:27:45.136539+0000","last_peered":"2024-05-27T06:27:45.136539+0000","last_clean":"2024-05-27T06:27:45.136539+0000","last_became_active":"2024-05-27T06:27:38.586880+0000","last_became_peered":"2024-05-27T06:27:38.586880+0000","last_unstale":"2024-05-27T06:27:45.136539+0000","last_undegraded":"2024-05-27T06:27:45.136539+0000","last_fullsized":"2024-05-27T06:27:45.136539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:11:57.311912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641615+0000","last_change":"2024-05-27T06:27:38.588337+0000","last_active":"2024-05-27T06:27:43.641615+0000","last_peered":"2024-05-27T06:27:43.641615+0000","last_clean":"2024-05-27T06:27:43.641615+0000","last_became_active":"2024-05-27T06:27:38.587989+0000","last_became_peered":"2024-05-27T06:27:38.587989+0000","last_unstale":"2024-05-27T06:27:43.641615+0000","last_undegraded":"2024-05-27T06:27:43.641615+0000","last_fullsized":"2024-05-27T06:27:43.641615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:05:48.265820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560707+0000","last_change":"2024-05-27T06:27:38.589920+0000","last_active":"2024-05-27T06:27:45.560707+0000","last_peered":"2024-05-27T06:27:45.560707+0000","last_clean":"2024-05-27T06:27:45.560707+0000","last_became_active":"2024-05-27T06:27:38.588894+0000","last_became_peered":"2024-05-27T06:27:38.588894+0000","last_unstale":"2024-05-27T06:27:45.560707+0000","last_undegraded":"2024-05-27T06:27:45.560707+0000","last_fullsized":"2024-05-27T06:27:45.560707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:43:18.651541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560366+0000","last_change":"2024-05-27T06:27:38.589163+0000","last_active":"2024-05-27T06:27:45.560366+0000","last_peered":"2024-05-27T06:27:45.560366+0000","last_clean":"2024-05-27T06:27:45.560366+0000","last_became_active":"2024-05-27T06:27:38.588860+0000","last_became_peered":"2024-05-27T06:27:38.588860+0000","last_unstale":"2024-05-27T06:27:45.560366+0000","last_undegraded":"2024-05-27T06:27:45.560366+0000","last_fullsized":"2024-05-27T06:27:45.560366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:10:49.565828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561563+0000","last_change":"2024-05-27T06:27:38.592099+0000","last_active":"2024-05-27T06:27:45.561563+0000","last_peered":"2024-05-27T06:27:45.561563+0000","last_clean":"2024-05-27T06:27:45.561563+0000","last_became_active":"2024-05-27T06:27:38.591794+0000","last_became_peered":"2024-05-27T06:27:38.591794+0000","last_unstale":"2024-05-27T06:27:45.561563+0000","last_undegraded":"2024-05-27T06:27:45.561563+0000","last_fullsized":"2024-05-27T06:27:45.561563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:31:23.791324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136320+0000","last_change":"2024-05-27T06:27:38.591399+0000","last_active":"2024-05-27T06:27:45.136320+0000","last_peered":"2024-05-27T06:27:45.136320+0000","last_clean":"2024-05-27T06:27:45.136320+0000","last_became_active":"2024-05-27T06:27:38.591132+0000","last_became_peered":"2024-05-27T06:27:38.591132+0000","last_unstale":"2024-05-27T06:27:45.136320+0000","last_undegraded":"2024-05-27T06:27:45.136320+0000","last_fullsized":"2024-05-27T06:27:45.136320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:00:49.009171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560131+0000","last_change":"2024-05-27T06:27:38.606361+0000","last_active":"2024-05-27T06:27:45.560131+0000","last_peered":"2024-05-27T06:27:45.560131+0000","last_clean":"2024-05-27T06:27:45.560131+0000","last_became_active":"2024-05-27T06:27:38.605036+0000","last_became_peered":"2024-05-27T06:27:38.605036+0000","last_unstale":"2024-05-27T06:27:45.560131+0000","last_undegraded":"2024-05-27T06:27:45.560131+0000","last_fullsized":"2024-05-27T06:27:45.560131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:54:31.606702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561440+0000","last_change":"2024-05-27T06:27:38.594793+0000","last_active":"2024-05-27T06:27:45.561440+0000","last_peered":"2024-05-27T06:27:45.561440+0000","last_clean":"2024-05-27T06:27:45.561440+0000","last_became_active":"2024-05-27T06:27:38.594350+0000","last_became_peered":"2024-05-27T06:27:38.594350+0000","last_unstale":"2024-05-27T06:27:45.561440+0000","last_undegraded":"2024-05-27T06:27:45.561440+0000","last_fullsized":"2024-05-27T06:27:45.561440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:24:46.797590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560917+0000","last_change":"2024-05-27T06:27:38.600252+0000","last_active":"2024-05-27T06:27:45.560917+0000","last_peered":"2024-05-27T06:27:45.560917+0000","last_clean":"2024-05-27T06:27:45.560917+0000","last_became_active":"2024-05-27T06:27:38.599892+0000","last_became_peered":"2024-05-27T06:27:38.599892+0000","last_unstale":"2024-05-27T06:27:45.560917+0000","last_undegraded":"2024-05-27T06:27:45.560917+0000","last_fullsized":"2024-05-27T06:27:45.560917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:36:01.596426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561945+0000","last_change":"2024-05-27T06:27:38.595466+0000","last_active":"2024-05-27T06:27:45.561945+0000","last_peered":"2024-05-27T06:27:45.561945+0000","last_clean":"2024-05-27T06:27:45.561945+0000","last_became_active":"2024-05-27T06:27:38.593979+0000","last_became_peered":"2024-05-27T06:27:38.593979+0000","last_unstale":"2024-05-27T06:27:45.561945+0000","last_undegraded":"2024-05-27T06:27:45.561945+0000","last_fullsized":"2024-05-27T06:27:45.561945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:13:28.978589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698434+0000","last_change":"2024-05-27T06:27:38.581825+0000","last_active":"2024-05-27T06:27:44.698434+0000","last_peered":"2024-05-27T06:27:44.698434+0000","last_clean":"2024-05-27T06:27:44.698434+0000","last_became_active":"2024-05-27T06:27:38.580897+0000","last_became_peered":"2024-05-27T06:27:38.580897+0000","last_unstale":"2024-05-27T06:27:44.698434+0000","last_undegraded":"2024-05-27T06:27:44.698434+0000","last_fullsized":"2024-05-27T06:27:44.698434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:36:07.073192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995182+0000","last_change":"2024-05-27T06:27:38.596385+0000","last_active":"2024-05-27T06:27:44.995182+0000","last_peered":"2024-05-27T06:27:44.995182+0000","last_clean":"2024-05-27T06:27:44.995182+0000","last_became_active":"2024-05-27T06:27:38.595730+0000","last_became_peered":"2024-05-27T06:27:38.595730+0000","last_unstale":"2024-05-27T06:27:44.995182+0000","last_undegraded":"2024-05-27T06:27:44.995182+0000","last_fullsized":"2024-05-27T06:27:44.995182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:25:28.290431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561441+0000","last_change":"2024-05-27T06:27:38.591344+0000","last_active":"2024-05-27T06:27:45.561441+0000","last_peered":"2024-05-27T06:27:45.561441+0000","last_clean":"2024-05-27T06:27:45.561441+0000","last_became_active":"2024-05-27T06:27:38.591001+0000","last_became_peered":"2024-05-27T06:27:38.591001+0000","last_unstale":"2024-05-27T06:27:45.561441+0000","last_undegraded":"2024-05-27T06:27:45.561441+0000","last_fullsized":"2024-05-27T06:27:45.561441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:25.980330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T06:28:00.806 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T06:28:00.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.991+0000 7f0dabe00640 1 Processor -- start 2024-05-27T06:28:00.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.991+0000 7f0dabe00640 1 -- start start 2024-05-27T06:28:00.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.991+0000 7f0dabe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0da40b5540 0x7f0da4163270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:00.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.991+0000 7f0dabe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0da4160d80 0x7f0da4073b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:00.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.991+0000 7f0dabe00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0da40740c0 0x7f0da406cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:00.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.991+0000 7f0dabe00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f0da40b6770 con 0x7f0da40740c0 2024-05-27T06:28:00.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.991+0000 7f0dabe00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f0da40744d0 con 0x7f0da4160d80 2024-05-27T06:28:00.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.991+0000 7f0dabe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0da40b5ac0 con 0x7f0da40b5540 2024-05-27T06:28:00.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.991+0000 7f0da9e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0da40740c0 0x7f0da406cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:00.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.991+0000 7f0da9e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0da40740c0 0x7f0da406cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38052/0 (socket says 172.21.15.87:38052) 2024-05-27T06:28:00.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.991+0000 7f0da9e00640 1 -- 172.21.15.87:0/1034711548 learned_addr learned my addr 172.21.15.87:0/1034711548 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:00.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.991+0000 7f0da9400640 1 --2- 172.21.15.87:0/1034711548 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0da40b5540 0x7f0da4163270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:00.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.991+0000 7f0da9e00640 1 -- 172.21.15.87:0/1034711548 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0da40b5540 msgr2=0x7f0da4163270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:00.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.991+0000 7f0da8a00640 1 --2- 172.21.15.87:0/1034711548 >> v2:172.21.15.149:3300/0 conn(0x7f0da4160d80 0x7f0da4073b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:00.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.991+0000 7f0da9e00640 1 --2- 172.21.15.87:0/1034711548 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0da40b5540 0x7f0da4163270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.991+0000 7f0da9e00640 1 -- 172.21.15.87:0/1034711548 >> v2:172.21.15.149:3300/0 conn(0x7f0da4160d80 msgr2=0x7f0da4073b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:00.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.991+0000 7f0da9e00640 1 --2- 172.21.15.87:0/1034711548 >> v2:172.21.15.149:3300/0 conn(0x7f0da4160d80 0x7f0da4073b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.991+0000 7f0da9e00640 1 -- 172.21.15.87:0/1034711548 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0da40b5da0 con 0x7f0da40740c0 2024-05-27T06:28:00.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.991+0000 7f0da9400640 1 --2- 172.21.15.87:0/1034711548 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0da40b5540 0x7f0da4163270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:00.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.991+0000 7f0da8a00640 1 --2- 172.21.15.87:0/1034711548 >> v2:172.21.15.149:3300/0 conn(0x7f0da4160d80 0x7f0da4073b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:00.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.995+0000 7f0da9e00640 1 --2- 172.21.15.87:0/1034711548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0da40740c0 0x7f0da406cfb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0da4070bf0 tx=0x7f0d9c01c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b2d104d4a64d3a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:00.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.995+0000 7f0da3e00640 1 -- 172.21.15.87:0/1034711548 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c0a5580 con 0x7f0da40740c0 2024-05-27T06:28:00.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.995+0000 7f0da3e00640 1 -- 172.21.15.87:0/1034711548 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d9c0a5720 con 0x7f0da40740c0 2024-05-27T06:28:00.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.995+0000 7f0da3e00640 1 -- 172.21.15.87:0/1034711548 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c0a5af0 con 0x7f0da40740c0 2024-05-27T06:28:00.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.995+0000 7f0dabe00640 1 -- 172.21.15.87:0/1034711548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0da40740c0 msgr2=0x7f0da406cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:00.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.995+0000 7f0dabe00640 1 --2- 172.21.15.87:0/1034711548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0da40740c0 0x7f0da406cfb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0da4070bf0 tx=0x7f0d9c01c700 comp rx=0 tx=0).stop 2024-05-27T06:28:00.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.995+0000 7f0dabe00640 1 -- 172.21.15.87:0/1034711548 shutdown_connections 2024-05-27T06:28:00.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.995+0000 7f0dabe00640 1 --2- 172.21.15.87:0/1034711548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0da40740c0 0x7f0da406cfb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.995+0000 7f0dabe00640 1 --2- 172.21.15.87:0/1034711548 >> v2:172.21.15.149:3300/0 conn(0x7f0da4160d80 0x7f0da4073b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.995+0000 7f0dabe00640 1 --2- 172.21.15.87:0/1034711548 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0da40b5540 0x7f0da4163270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.995+0000 7f0dabe00640 1 -- 172.21.15.87:0/1034711548 >> 172.21.15.87:0/1034711548 conn(0x7f0da40700d0 msgr2=0x7f0da40704e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:00.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.995+0000 7f0dabe00640 1 -- 172.21.15.87:0/1034711548 shutdown_connections 2024-05-27T06:28:00.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.995+0000 7f0dabe00640 1 -- 172.21.15.87:0/1034711548 wait complete. 2024-05-27T06:28:00.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.999+0000 7f0dabe00640 1 Processor -- start 2024-05-27T06:28:00.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.999+0000 7f0dabe00640 1 -- start start 2024-05-27T06:28:00.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.999+0000 7f0dabe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0da40740c0 0x7f0da415e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:00.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.999+0000 7f0dabe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0da40b5540 0x7f0da40cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:00.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.999+0000 7f0dabe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0da4160d80 0x7f0da40cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:00.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.999+0000 7f0dabe00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0da40b6d80 con 0x7f0da40b5540 2024-05-27T06:28:00.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.999+0000 7f0dabe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0da40b6c00 con 0x7f0da40740c0 2024-05-27T06:28:00.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.999+0000 7f0dabe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0da40b6f00 con 0x7f0da4160d80 2024-05-27T06:28:00.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.999+0000 7f0da8a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0da40b5540 0x7f0da40cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:00.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.999+0000 7f0da8a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0da40b5540 0x7f0da40cb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38066/0 (socket says 172.21.15.87:38066) 2024-05-27T06:28:00.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:00.999+0000 7f0da8a00640 1 -- 172.21.15.87:0/2874719592 learned_addr learned my addr 172.21.15.87:0/2874719592 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:00.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.003+0000 7f0da9400640 1 --2- 172.21.15.87:0/2874719592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0da40740c0 0x7f0da415e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:00.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.003+0000 7f0da9e00640 1 --2- 172.21.15.87:0/2874719592 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0da4160d80 0x7f0da40cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:00.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.003+0000 7f0da8a00640 1 -- 172.21.15.87:0/2874719592 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0da4160d80 msgr2=0x7f0da40cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:00.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.003+0000 7f0da8a00640 1 --2- 172.21.15.87:0/2874719592 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0da4160d80 0x7f0da40cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.003+0000 7f0da8a00640 1 -- 172.21.15.87:0/2874719592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0da40740c0 msgr2=0x7f0da415e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:00.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.003+0000 7f0da8a00640 1 --2- 172.21.15.87:0/2874719592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0da40740c0 0x7f0da415e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:00.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.003+0000 7f0da8a00640 1 -- 172.21.15.87:0/2874719592 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0da4148c40 con 0x7f0da40b5540 2024-05-27T06:28:00.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.003+0000 7f0da8a00640 1 --2- 172.21.15.87:0/2874719592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0da40b5540 0x7f0da40cb8c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000c7f0 tx=0x7f0d9000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:01.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.003+0000 7f0da1600640 1 -- 172.21.15.87:0/2874719592 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d90015070 con 0x7f0da40b5540 2024-05-27T06:28:01.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.003+0000 7f0da1600640 1 -- 172.21.15.87:0/2874719592 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d90004220 con 0x7f0da40b5540 2024-05-27T06:28:01.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.003+0000 7f0dabe00640 1 -- 172.21.15.87:0/2874719592 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0da415eef0 con 0x7f0da40b5540 2024-05-27T06:28:01.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.003+0000 7f0da1600640 1 -- 172.21.15.87:0/2874719592 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d90003620 con 0x7f0da40b5540 2024-05-27T06:28:01.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.003+0000 7f0dabe00640 1 -- 172.21.15.87:0/2874719592 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0da4149850 con 0x7f0da40b5540 2024-05-27T06:28:01.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.003+0000 7f0dabe00640 1 -- 172.21.15.87:0/2874719592 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0da406aa30 con 0x7f0da40b5540 2024-05-27T06:28:01.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.003+0000 7f0da1600640 1 -- 172.21.15.87:0/2874719592 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0d900039d0 con 0x7f0da40b5540 2024-05-27T06:28:01.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.007+0000 7f0da1600640 1 --2- 172.21.15.87:0/2874719592 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0d8406f400 0x7f0d84071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:01.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.007+0000 7f0da1600640 1 -- 172.21.15.87:0/2874719592 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0d9008f710 con 0x7f0da40b5540 2024-05-27T06:28:01.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.007+0000 7f0da9400640 1 --2- 172.21.15.87:0/2874719592 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0d8406f400 0x7f0d84071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:01.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.007+0000 7f0da9400640 1 --2- 172.21.15.87:0/2874719592 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0d8406f400 0x7f0d84071910 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0d98006fd0 tx=0x7f0d98008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:01.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.011+0000 7f0da1600640 1 -- 172.21.15.87:0/2874719592 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f0d9005c220 con 0x7f0da40b5540 2024-05-27T06:28:01.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.163+0000 7f0dabe00640 1 -- 172.21.15.87:0/2874719592 --> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0da40706f0 con 0x7f0d8406f400 2024-05-27T06:28:01.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.171+0000 7f0da1600640 1 -- 172.21.15.87:0/2874719592 <== mgr.4111 v2:172.21.15.87:6832/2724754260 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f0da40706f0 con 0x7f0d8406f400 2024-05-27T06:28:01.172 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:01.174 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-27T06:28:01.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.175+0000 7f0dabe00640 1 -- 172.21.15.87:0/2874719592 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0d8406f400 msgr2=0x7f0d84071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:01.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.175+0000 7f0dabe00640 1 --2- 172.21.15.87:0/2874719592 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0d8406f400 0x7f0d84071910 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0d98006fd0 tx=0x7f0d98008040 comp rx=0 tx=0).stop 2024-05-27T06:28:01.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.175+0000 7f0dabe00640 1 -- 172.21.15.87:0/2874719592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0da40b5540 msgr2=0x7f0da40cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:01.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.175+0000 7f0dabe00640 1 --2- 172.21.15.87:0/2874719592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0da40b5540 0x7f0da40cb8c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000c7f0 tx=0x7f0d9000ccb0 comp rx=0 tx=0).stop 2024-05-27T06:28:01.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.175+0000 7f0dabe00640 1 -- 172.21.15.87:0/2874719592 shutdown_connections 2024-05-27T06:28:01.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.175+0000 7f0dabe00640 1 --2- 172.21.15.87:0/2874719592 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0d8406f400 0x7f0d84071910 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:01.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.175+0000 7f0dabe00640 1 --2- 172.21.15.87:0/2874719592 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0da4160d80 0x7f0da40cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:01.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.175+0000 7f0dabe00640 1 --2- 172.21.15.87:0/2874719592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0da40b5540 0x7f0da40cb8c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:01.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.175+0000 7f0dabe00640 1 --2- 172.21.15.87:0/2874719592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0da40740c0 0x7f0da415e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:01.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.175+0000 7f0dabe00640 1 -- 172.21.15.87:0/2874719592 >> 172.21.15.87:0/2874719592 conn(0x7f0da40700d0 msgr2=0x7f0da4162340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:01.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.175+0000 7f0dabe00640 1 -- 172.21.15.87:0/2874719592 shutdown_connections 2024-05-27T06:28:01.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.175+0000 7f0dabe00640 1 -- 172.21.15.87:0/2874719592 wait complete. 2024-05-27T06:28:01.193 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-05-27T06:28:00.568285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219372,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755348,"statfs":{"total":773094113280,"available":772869476352,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003847"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.699021+0000","last_change":"2024-05-27T06:27:37.599201+0000","last_active":"2024-05-27T06:27:44.699021+0000","last_peered":"2024-05-27T06:27:44.699021+0000","last_clean":"2024-05-27T06:27:44.699021+0000","last_became_active":"2024-05-27T06:27:37.598882+0000","last_became_peered":"2024-05-27T06:27:37.598882+0000","last_unstale":"2024-05-27T06:27:44.699021+0000","last_undegraded":"2024-05-27T06:27:44.699021+0000","last_fullsized":"2024-05-27T06:27:44.699021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:13:32.135455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.137061+0000","last_change":"2024-05-27T06:27:38.587525+0000","last_active":"2024-05-27T06:27:45.137061+0000","last_peered":"2024-05-27T06:27:45.137061+0000","last_clean":"2024-05-27T06:27:45.137061+0000","last_became_active":"2024-05-27T06:27:38.586949+0000","last_became_peered":"2024-05-27T06:27:38.586949+0000","last_unstale":"2024-05-27T06:27:45.137061+0000","last_undegraded":"2024-05-27T06:27:45.137061+0000","last_fullsized":"2024-05-27T06:27:45.137061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:24:46.797590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136334+0000","last_change":"2024-05-27T06:27:42.674258+0000","last_active":"2024-05-27T06:27:45.136334+0000","last_peered":"2024-05-27T06:27:45.136334+0000","last_clean":"2024-05-27T06:27:45.136334+0000","last_became_active":"2024-05-27T06:27:42.673626+0000","last_became_peered":"2024-05-27T06:27:42.673626+0000","last_unstale":"2024-05-27T06:27:45.136334+0000","last_undegraded":"2024-05-27T06:27:45.136334+0000","last_fullsized":"2024-05-27T06:27:45.136334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:29:26.664564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.137215+0000","last_change":"2024-05-27T06:27:37.598836+0000","last_active":"2024-05-27T06:27:45.137215+0000","last_peered":"2024-05-27T06:27:45.137215+0000","last_clean":"2024-05-27T06:27:45.137215+0000","last_became_active":"2024-05-27T06:27:37.598483+0000","last_became_peered":"2024-05-27T06:27:37.598483+0000","last_unstale":"2024-05-27T06:27:45.137215+0000","last_undegraded":"2024-05-27T06:27:45.137215+0000","last_fullsized":"2024-05-27T06:27:45.137215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:06:32.803214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698842+0000","last_change":"2024-05-27T06:27:38.590652+0000","last_active":"2024-05-27T06:27:44.698842+0000","last_peered":"2024-05-27T06:27:44.698842+0000","last_clean":"2024-05-27T06:27:44.698842+0000","last_became_active":"2024-05-27T06:27:38.590399+0000","last_became_peered":"2024-05-27T06:27:38.590399+0000","last_unstale":"2024-05-27T06:27:44.698842+0000","last_undegraded":"2024-05-27T06:27:44.698842+0000","last_fullsized":"2024-05-27T06:27:44.698842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:11:57.311912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641217+0000","last_change":"2024-05-27T06:27:42.678002+0000","last_active":"2024-05-27T06:27:43.641217+0000","last_peered":"2024-05-27T06:27:43.641217+0000","last_clean":"2024-05-27T06:27:43.641217+0000","last_became_active":"2024-05-27T06:27:42.672687+0000","last_became_peered":"2024-05-27T06:27:42.672687+0000","last_unstale":"2024-05-27T06:27:43.641217+0000","last_undegraded":"2024-05-27T06:27:43.641217+0000","last_fullsized":"2024-05-27T06:27:43.641217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:24:50.868712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560389+0000","last_change":"2024-05-27T06:27:37.593814+0000","last_active":"2024-05-27T06:27:45.560389+0000","last_peered":"2024-05-27T06:27:45.560389+0000","last_clean":"2024-05-27T06:27:45.560389+0000","last_became_active":"2024-05-27T06:27:37.593466+0000","last_became_peered":"2024-05-27T06:27:37.593466+0000","last_unstale":"2024-05-27T06:27:45.560389+0000","last_undegraded":"2024-05-27T06:27:45.560389+0000","last_fullsized":"2024-05-27T06:27:45.560389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:26:32.568342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562028+0000","last_change":"2024-05-27T06:27:38.601653+0000","last_active":"2024-05-27T06:27:45.562028+0000","last_peered":"2024-05-27T06:27:45.562028+0000","last_clean":"2024-05-27T06:27:45.562028+0000","last_became_active":"2024-05-27T06:27:38.601248+0000","last_became_peered":"2024-05-27T06:27:38.601248+0000","last_unstale":"2024-05-27T06:27:45.562028+0000","last_undegraded":"2024-05-27T06:27:45.562028+0000","last_fullsized":"2024-05-27T06:27:45.562028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:53.536742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641377+0000","last_change":"2024-05-27T06:27:42.676302+0000","last_active":"2024-05-27T06:27:43.641377+0000","last_peered":"2024-05-27T06:27:43.641377+0000","last_clean":"2024-05-27T06:27:43.641377+0000","last_became_active":"2024-05-27T06:27:42.673036+0000","last_became_peered":"2024-05-27T06:27:42.673036+0000","last_unstale":"2024-05-27T06:27:43.641377+0000","last_undegraded":"2024-05-27T06:27:43.641377+0000","last_fullsized":"2024-05-27T06:27:43.641377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:25:34.504656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560872+0000","last_change":"2024-05-27T06:27:37.599394+0000","last_active":"2024-05-27T06:27:45.560872+0000","last_peered":"2024-05-27T06:27:45.560872+0000","last_clean":"2024-05-27T06:27:45.560872+0000","last_became_active":"2024-05-27T06:27:37.598995+0000","last_became_peered":"2024-05-27T06:27:37.598995+0000","last_unstale":"2024-05-27T06:27:45.560872+0000","last_undegraded":"2024-05-27T06:27:45.560872+0000","last_fullsized":"2024-05-27T06:27:45.560872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:05:47.256329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562108+0000","last_change":"2024-05-27T06:27:38.595082+0000","last_active":"2024-05-27T06:27:45.562108+0000","last_peered":"2024-05-27T06:27:45.562108+0000","last_clean":"2024-05-27T06:27:45.562108+0000","last_became_active":"2024-05-27T06:27:38.594761+0000","last_became_peered":"2024-05-27T06:27:38.594761+0000","last_unstale":"2024-05-27T06:27:45.562108+0000","last_undegraded":"2024-05-27T06:27:45.562108+0000","last_fullsized":"2024-05-27T06:27:45.562108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:35.349266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641123+0000","last_change":"2024-05-27T06:27:42.657602+0000","last_active":"2024-05-27T06:27:43.641123+0000","last_peered":"2024-05-27T06:27:43.641123+0000","last_clean":"2024-05-27T06:27:43.641123+0000","last_became_active":"2024-05-27T06:27:42.657080+0000","last_became_peered":"2024-05-27T06:27:42.657080+0000","last_unstale":"2024-05-27T06:27:43.641123+0000","last_undegraded":"2024-05-27T06:27:43.641123+0000","last_fullsized":"2024-05-27T06:27:43.641123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:25:32.361553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561325+0000","last_change":"2024-05-27T06:27:38.588664+0000","last_active":"2024-05-27T06:27:45.561325+0000","last_peered":"2024-05-27T06:27:45.561325+0000","last_clean":"2024-05-27T06:27:45.561325+0000","last_became_active":"2024-05-27T06:27:38.588190+0000","last_became_peered":"2024-05-27T06:27:38.588190+0000","last_unstale":"2024-05-27T06:27:45.561325+0000","last_undegraded":"2024-05-27T06:27:45.561325+0000","last_fullsized":"2024-05-27T06:27:45.561325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:36:07.073192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561221+0000","last_change":"2024-05-27T06:27:37.593763+0000","last_active":"2024-05-27T06:27:45.561221+0000","last_peered":"2024-05-27T06:27:45.561221+0000","last_clean":"2024-05-27T06:27:45.561221+0000","last_became_active":"2024-05-27T06:27:37.593401+0000","last_became_peered":"2024-05-27T06:27:37.593401+0000","last_unstale":"2024-05-27T06:27:45.561221+0000","last_undegraded":"2024-05-27T06:27:45.561221+0000","last_fullsized":"2024-05-27T06:27:45.561221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:10.389223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.642016+0000","last_change":"2024-05-27T06:27:42.673785+0000","last_active":"2024-05-27T06:27:43.642016+0000","last_peered":"2024-05-27T06:27:43.642016+0000","last_clean":"2024-05-27T06:27:43.642016+0000","last_became_active":"2024-05-27T06:27:42.673292+0000","last_became_peered":"2024-05-27T06:27:42.673292+0000","last_unstale":"2024-05-27T06:27:43.642016+0000","last_undegraded":"2024-05-27T06:27:43.642016+0000","last_fullsized":"2024-05-27T06:27:43.642016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:30.051452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136563+0000","last_change":"2024-05-27T06:27:38.618042+0000","last_active":"2024-05-27T06:27:45.136563+0000","last_peered":"2024-05-27T06:27:45.136563+0000","last_clean":"2024-05-27T06:27:45.136563+0000","last_became_active":"2024-05-27T06:27:38.617706+0000","last_became_peered":"2024-05-27T06:27:38.617706+0000","last_unstale":"2024-05-27T06:27:45.136563+0000","last_undegraded":"2024-05-27T06:27:45.136563+0000","last_fullsized":"2024-05-27T06:27:45.136563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:25:28.290431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995400+0000","last_change":"2024-05-27T06:27:37.597113+0000","last_active":"2024-05-27T06:27:44.995400+0000","last_peered":"2024-05-27T06:27:44.995400+0000","last_clean":"2024-05-27T06:27:44.995400+0000","last_became_active":"2024-05-27T06:27:37.596735+0000","last_became_peered":"2024-05-27T06:27:37.596735+0000","last_unstale":"2024-05-27T06:27:44.995400+0000","last_undegraded":"2024-05-27T06:27:44.995400+0000","last_fullsized":"2024-05-27T06:27:44.995400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:39:09.133451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641559+0000","last_change":"2024-05-27T06:27:42.685192+0000","last_active":"2024-05-27T06:27:43.641559+0000","last_peered":"2024-05-27T06:27:43.641559+0000","last_clean":"2024-05-27T06:27:43.641559+0000","last_became_active":"2024-05-27T06:27:42.684722+0000","last_became_peered":"2024-05-27T06:27:42.684722+0000","last_unstale":"2024-05-27T06:27:43.641559+0000","last_undegraded":"2024-05-27T06:27:43.641559+0000","last_fullsized":"2024-05-27T06:27:43.641559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:29:09.440505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136801+0000","last_change":"2024-05-27T06:27:38.617808+0000","last_active":"2024-05-27T06:27:45.136801+0000","last_peered":"2024-05-27T06:27:45.136801+0000","last_clean":"2024-05-27T06:27:45.136801+0000","last_became_active":"2024-05-27T06:27:38.617484+0000","last_became_peered":"2024-05-27T06:27:38.617484+0000","last_unstale":"2024-05-27T06:27:45.136801+0000","last_undegraded":"2024-05-27T06:27:45.136801+0000","last_fullsized":"2024-05-27T06:27:45.136801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:43:18.651541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.994806+0000","last_change":"2024-05-27T06:27:37.600205+0000","last_active":"2024-05-27T06:27:44.994806+0000","last_peered":"2024-05-27T06:27:44.994806+0000","last_clean":"2024-05-27T06:27:44.994806+0000","last_became_active":"2024-05-27T06:27:37.599877+0000","last_became_peered":"2024-05-27T06:27:37.599877+0000","last_unstale":"2024-05-27T06:27:44.994806+0000","last_undegraded":"2024-05-27T06:27:44.994806+0000","last_fullsized":"2024-05-27T06:27:44.994806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:49:54.332511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995252+0000","last_change":"2024-05-27T06:27:42.673409+0000","last_active":"2024-05-27T06:27:44.995252+0000","last_peered":"2024-05-27T06:27:44.995252+0000","last_clean":"2024-05-27T06:27:44.995252+0000","last_became_active":"2024-05-27T06:27:42.672637+0000","last_became_peered":"2024-05-27T06:27:42.672637+0000","last_unstale":"2024-05-27T06:27:44.995252+0000","last_undegraded":"2024-05-27T06:27:44.995252+0000","last_fullsized":"2024-05-27T06:27:44.995252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:25.641088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641351+0000","last_change":"2024-05-27T06:27:38.587029+0000","last_active":"2024-05-27T06:27:43.641351+0000","last_peered":"2024-05-27T06:27:43.641351+0000","last_clean":"2024-05-27T06:27:43.641351+0000","last_became_active":"2024-05-27T06:27:38.586798+0000","last_became_peered":"2024-05-27T06:27:38.586798+0000","last_unstale":"2024-05-27T06:27:43.641351+0000","last_undegraded":"2024-05-27T06:27:43.641351+0000","last_fullsized":"2024-05-27T06:27:43.641351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:28.542049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561027+0000","last_change":"2024-05-27T06:27:37.585479+0000","last_active":"2024-05-27T06:27:45.561027+0000","last_peered":"2024-05-27T06:27:45.561027+0000","last_clean":"2024-05-27T06:27:45.561027+0000","last_became_active":"2024-05-27T06:27:37.585196+0000","last_became_peered":"2024-05-27T06:27:37.585196+0000","last_unstale":"2024-05-27T06:27:45.561027+0000","last_undegraded":"2024-05-27T06:27:45.561027+0000","last_fullsized":"2024-05-27T06:27:45.561027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:39:09.133451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641758+0000","last_change":"2024-05-27T06:27:42.673356+0000","last_active":"2024-05-27T06:27:43.641758+0000","last_peered":"2024-05-27T06:27:43.641758+0000","last_clean":"2024-05-27T06:27:43.641758+0000","last_became_active":"2024-05-27T06:27:42.672313+0000","last_became_peered":"2024-05-27T06:27:42.672313+0000","last_unstale":"2024-05-27T06:27:43.641758+0000","last_undegraded":"2024-05-27T06:27:43.641758+0000","last_fullsized":"2024-05-27T06:27:43.641758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:13:33.049711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.699037+0000","last_change":"2024-05-27T06:27:38.594812+0000","last_active":"2024-05-27T06:27:44.699037+0000","last_peered":"2024-05-27T06:27:44.699037+0000","last_clean":"2024-05-27T06:27:44.699037+0000","last_became_active":"2024-05-27T06:27:38.594510+0000","last_became_peered":"2024-05-27T06:27:38.594510+0000","last_unstale":"2024-05-27T06:27:44.699037+0000","last_undegraded":"2024-05-27T06:27:44.699037+0000","last_fullsized":"2024-05-27T06:27:44.699037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:47.314366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560621+0000","last_change":"2024-05-27T06:27:37.593100+0000","last_active":"2024-05-27T06:27:45.560621+0000","last_peered":"2024-05-27T06:27:45.560621+0000","last_clean":"2024-05-27T06:27:45.560621+0000","last_became_active":"2024-05-27T06:27:37.592805+0000","last_became_peered":"2024-05-27T06:27:37.592805+0000","last_unstale":"2024-05-27T06:27:45.560621+0000","last_undegraded":"2024-05-27T06:27:45.560621+0000","last_fullsized":"2024-05-27T06:27:45.560621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:27.532558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641244+0000","last_change":"2024-05-27T06:27:42.674749+0000","last_active":"2024-05-27T06:27:43.641244+0000","last_peered":"2024-05-27T06:27:43.641244+0000","last_clean":"2024-05-27T06:27:43.641244+0000","last_became_active":"2024-05-27T06:27:42.674306+0000","last_became_peered":"2024-05-27T06:27:42.674306+0000","last_unstale":"2024-05-27T06:27:43.641244+0000","last_undegraded":"2024-05-27T06:27:43.641244+0000","last_fullsized":"2024-05-27T06:27:43.641244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:36:05.667548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.137291+0000","last_change":"2024-05-27T06:27:38.600218+0000","last_active":"2024-05-27T06:27:45.137291+0000","last_peered":"2024-05-27T06:27:45.137291+0000","last_clean":"2024-05-27T06:27:45.137291+0000","last_became_active":"2024-05-27T06:27:38.599796+0000","last_became_peered":"2024-05-27T06:27:38.599796+0000","last_unstale":"2024-05-27T06:27:45.137291+0000","last_undegraded":"2024-05-27T06:27:45.137291+0000","last_fullsized":"2024-05-27T06:27:45.137291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:25:30.433535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995470+0000","last_change":"2024-05-27T06:27:37.594420+0000","last_active":"2024-05-27T06:27:44.995470+0000","last_peered":"2024-05-27T06:27:44.995470+0000","last_clean":"2024-05-27T06:27:44.995470+0000","last_became_active":"2024-05-27T06:27:37.593946+0000","last_became_peered":"2024-05-27T06:27:37.593946+0000","last_unstale":"2024-05-27T06:27:44.995470+0000","last_undegraded":"2024-05-27T06:27:44.995470+0000","last_fullsized":"2024-05-27T06:27:44.995470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:26:32.568342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136310+0000","last_change":"2024-05-27T06:27:42.685574+0000","last_active":"2024-05-27T06:27:45.136310+0000","last_peered":"2024-05-27T06:27:45.136310+0000","last_clean":"2024-05-27T06:27:45.136310+0000","last_became_active":"2024-05-27T06:27:42.685158+0000","last_became_peered":"2024-05-27T06:27:42.685158+0000","last_unstale":"2024-05-27T06:27:45.136310+0000","last_undegraded":"2024-05-27T06:27:45.136310+0000","last_fullsized":"2024-05-27T06:27:45.136310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:21:58.228721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995447+0000","last_change":"2024-05-27T06:27:38.609767+0000","last_active":"2024-05-27T06:27:44.995447+0000","last_peered":"2024-05-27T06:27:44.995447+0000","last_clean":"2024-05-27T06:27:44.995447+0000","last_became_active":"2024-05-27T06:27:38.603315+0000","last_became_peered":"2024-05-27T06:27:38.603315+0000","last_unstale":"2024-05-27T06:27:44.995447+0000","last_undegraded":"2024-05-27T06:27:44.995447+0000","last_fullsized":"2024-05-27T06:27:44.995447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:47.314366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560615+0000","last_change":"2024-05-27T06:27:37.599180+0000","last_active":"2024-05-27T06:27:45.560615+0000","last_peered":"2024-05-27T06:27:45.560615+0000","last_clean":"2024-05-27T06:27:45.560615+0000","last_became_active":"2024-05-27T06:27:37.598944+0000","last_became_peered":"2024-05-27T06:27:37.598944+0000","last_unstale":"2024-05-27T06:27:45.560615+0000","last_undegraded":"2024-05-27T06:27:45.560615+0000","last_fullsized":"2024-05-27T06:27:45.560615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:49:54.332511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698527+0000","last_change":"2024-05-27T06:27:42.676516+0000","last_active":"2024-05-27T06:27:44.698527+0000","last_peered":"2024-05-27T06:27:44.698527+0000","last_clean":"2024-05-27T06:27:44.698527+0000","last_became_active":"2024-05-27T06:27:42.674971+0000","last_became_peered":"2024-05-27T06:27:42.674971+0000","last_unstale":"2024-05-27T06:27:44.698527+0000","last_undegraded":"2024-05-27T06:27:44.698527+0000","last_fullsized":"2024-05-27T06:27:44.698527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:31:27.862446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562261+0000","last_change":"2024-05-27T06:27:38.596128+0000","last_active":"2024-05-27T06:27:45.562261+0000","last_peered":"2024-05-27T06:27:45.562261+0000","last_clean":"2024-05-27T06:27:45.562261+0000","last_became_active":"2024-05-27T06:27:38.595919+0000","last_became_peered":"2024-05-27T06:27:38.595919+0000","last_unstale":"2024-05-27T06:27:45.562261+0000","last_undegraded":"2024-05-27T06:27:45.562261+0000","last_fullsized":"2024-05-27T06:27:45.562261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:31:23.791324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995552+0000","last_change":"2024-05-27T06:27:37.593456+0000","last_active":"2024-05-27T06:27:44.995552+0000","last_peered":"2024-05-27T06:27:44.995552+0000","last_clean":"2024-05-27T06:27:44.995552+0000","last_became_active":"2024-05-27T06:27:37.592873+0000","last_became_peered":"2024-05-27T06:27:37.592873+0000","last_unstale":"2024-05-27T06:27:44.995552+0000","last_undegraded":"2024-05-27T06:27:44.995552+0000","last_fullsized":"2024-05-27T06:27:44.995552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:05:47.256329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.994952+0000","last_change":"2024-05-27T06:27:42.678385+0000","last_active":"2024-05-27T06:27:44.994952+0000","last_peered":"2024-05-27T06:27:44.994952+0000","last_clean":"2024-05-27T06:27:44.994952+0000","last_became_active":"2024-05-27T06:27:42.677822+0000","last_became_peered":"2024-05-27T06:27:42.677822+0000","last_unstale":"2024-05-27T06:27:44.994952+0000","last_undegraded":"2024-05-27T06:27:44.994952+0000","last_fullsized":"2024-05-27T06:27:44.994952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:31:27.862446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641909+0000","last_change":"2024-05-27T06:27:38.579066+0000","last_active":"2024-05-27T06:27:43.641909+0000","last_peered":"2024-05-27T06:27:43.641909+0000","last_clean":"2024-05-27T06:27:43.641909+0000","last_became_active":"2024-05-27T06:27:38.577426+0000","last_became_peered":"2024-05-27T06:27:38.577426+0000","last_unstale":"2024-05-27T06:27:43.641909+0000","last_undegraded":"2024-05-27T06:27:43.641909+0000","last_fullsized":"2024-05-27T06:27:43.641909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:11.398713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561828+0000","last_change":"2024-05-27T06:27:37.601204+0000","last_active":"2024-05-27T06:27:45.561828+0000","last_peered":"2024-05-27T06:27:45.561828+0000","last_clean":"2024-05-27T06:27:45.561828+0000","last_became_active":"2024-05-27T06:27:37.599178+0000","last_became_peered":"2024-05-27T06:27:37.599178+0000","last_unstale":"2024-05-27T06:27:45.561828+0000","last_undegraded":"2024-05-27T06:27:45.561828+0000","last_fullsized":"2024-05-27T06:27:45.561828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:10.389223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995594+0000","last_change":"2024-05-27T06:27:42.672415+0000","last_active":"2024-05-27T06:27:44.995594+0000","last_peered":"2024-05-27T06:27:44.995594+0000","last_clean":"2024-05-27T06:27:44.995594+0000","last_became_active":"2024-05-27T06:27:42.671247+0000","last_became_peered":"2024-05-27T06:27:42.671247+0000","last_unstale":"2024-05-27T06:27:44.995594+0000","last_undegraded":"2024-05-27T06:27:44.995594+0000","last_fullsized":"2024-05-27T06:27:44.995594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:21:58.228721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.994829+0000","last_change":"2024-05-27T06:27:38.601418+0000","last_active":"2024-05-27T06:27:44.994829+0000","last_peered":"2024-05-27T06:27:44.994829+0000","last_clean":"2024-05-27T06:27:44.994829+0000","last_became_active":"2024-05-27T06:27:38.600709+0000","last_became_peered":"2024-05-27T06:27:38.600709+0000","last_unstale":"2024-05-27T06:27:44.994829+0000","last_undegraded":"2024-05-27T06:27:44.994829+0000","last_fullsized":"2024-05-27T06:27:44.994829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:10:49.565828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.640446+0000","last_change":"2024-05-27T06:27:37.597493+0000","last_active":"2024-05-27T06:27:43.640446+0000","last_peered":"2024-05-27T06:27:43.640446+0000","last_clean":"2024-05-27T06:27:43.640446+0000","last_became_active":"2024-05-27T06:27:37.597007+0000","last_became_peered":"2024-05-27T06:27:37.597007+0000","last_unstale":"2024-05-27T06:27:43.640446+0000","last_undegraded":"2024-05-27T06:27:43.640446+0000","last_fullsized":"2024-05-27T06:27:43.640446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:39:09.133451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995343+0000","last_change":"2024-05-27T06:27:42.672189+0000","last_active":"2024-05-27T06:27:44.995343+0000","last_peered":"2024-05-27T06:27:44.995343+0000","last_clean":"2024-05-27T06:27:44.995343+0000","last_became_active":"2024-05-27T06:27:42.671679+0000","last_became_peered":"2024-05-27T06:27:42.671679+0000","last_unstale":"2024-05-27T06:27:44.995343+0000","last_undegraded":"2024-05-27T06:27:44.995343+0000","last_fullsized":"2024-05-27T06:27:44.995343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:56:11.868706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698082+0000","last_change":"2024-05-27T06:27:38.579100+0000","last_active":"2024-05-27T06:27:44.698082+0000","last_peered":"2024-05-27T06:27:44.698082+0000","last_clean":"2024-05-27T06:27:44.698082+0000","last_became_active":"2024-05-27T06:27:38.578133+0000","last_became_peered":"2024-05-27T06:27:38.578133+0000","last_unstale":"2024-05-27T06:27:44.698082+0000","last_undegraded":"2024-05-27T06:27:44.698082+0000","last_fullsized":"2024-05-27T06:27:44.698082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:52:56.162405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561032+0000","last_change":"2024-05-27T06:27:37.589413+0000","last_active":"2024-05-27T06:27:45.561032+0000","last_peered":"2024-05-27T06:27:45.561032+0000","last_clean":"2024-05-27T06:27:45.561032+0000","last_became_active":"2024-05-27T06:27:37.589095+0000","last_became_peered":"2024-05-27T06:27:37.589095+0000","last_unstale":"2024-05-27T06:27:45.561032+0000","last_undegraded":"2024-05-27T06:27:45.561032+0000","last_fullsized":"2024-05-27T06:27:45.561032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:27.532558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698947+0000","last_change":"2024-05-27T06:27:42.672540+0000","last_active":"2024-05-27T06:27:44.698947+0000","last_peered":"2024-05-27T06:27:44.698947+0000","last_clean":"2024-05-27T06:27:44.698947+0000","last_became_active":"2024-05-27T06:27:42.672001+0000","last_became_peered":"2024-05-27T06:27:42.672001+0000","last_unstale":"2024-05-27T06:27:44.698947+0000","last_undegraded":"2024-05-27T06:27:44.698947+0000","last_fullsized":"2024-05-27T06:27:44.698947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:56:11.868706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136536+0000","last_change":"2024-05-27T06:27:38.592046+0000","last_active":"2024-05-27T06:27:45.136536+0000","last_peered":"2024-05-27T06:27:45.136536+0000","last_clean":"2024-05-27T06:27:45.136536+0000","last_became_active":"2024-05-27T06:27:38.591693+0000","last_became_peered":"2024-05-27T06:27:38.591693+0000","last_unstale":"2024-05-27T06:27:45.136536+0000","last_undegraded":"2024-05-27T06:27:45.136536+0000","last_fullsized":"2024-05-27T06:27:45.136536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:10:49.565828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561713+0000","last_change":"2024-05-27T06:27:37.588339+0000","last_active":"2024-05-27T06:27:45.561713+0000","last_peered":"2024-05-27T06:27:45.561713+0000","last_clean":"2024-05-27T06:27:45.561713+0000","last_became_active":"2024-05-27T06:27:37.587997+0000","last_became_peered":"2024-05-27T06:27:37.587997+0000","last_unstale":"2024-05-27T06:27:45.561713+0000","last_undegraded":"2024-05-27T06:27:45.561713+0000","last_fullsized":"2024-05-27T06:27:45.561713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:05:47.256329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561179+0000","last_change":"2024-05-27T06:27:28.692457+0000","last_active":"2024-05-27T06:27:45.561179+0000","last_peered":"2024-05-27T06:27:45.561179+0000","last_clean":"2024-05-27T06:27:45.561179+0000","last_became_active":"2024-05-27T06:27:28.691290+0000","last_became_peered":"2024-05-27T06:27:28.691290+0000","last_unstale":"2024-05-27T06:27:45.561179+0000","last_undegraded":"2024-05-27T06:27:45.561179+0000","last_fullsized":"2024-05-27T06:27:45.561179+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_clean_scrub_stamp":"2024-05-27T06:27:26.991915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:45.563728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559963+0000","last_change":"2024-05-27T06:27:42.675952+0000","last_active":"2024-05-27T06:27:45.559963+0000","last_peered":"2024-05-27T06:27:45.559963+0000","last_clean":"2024-05-27T06:27:45.559963+0000","last_became_active":"2024-05-27T06:27:42.675456+0000","last_became_peered":"2024-05-27T06:27:42.675456+0000","last_unstale":"2024-05-27T06:27:45.559963+0000","last_undegraded":"2024-05-27T06:27:45.559963+0000","last_fullsized":"2024-05-27T06:27:45.559963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:30.051452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560151+0000","last_change":"2024-05-27T06:27:38.594241+0000","last_active":"2024-05-27T06:27:45.560151+0000","last_peered":"2024-05-27T06:27:45.560151+0000","last_clean":"2024-05-27T06:27:45.560151+0000","last_became_active":"2024-05-27T06:27:38.593947+0000","last_became_peered":"2024-05-27T06:27:38.593947+0000","last_unstale":"2024-05-27T06:27:45.560151+0000","last_undegraded":"2024-05-27T06:27:45.560151+0000","last_fullsized":"2024-05-27T06:27:45.560151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:53.536742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641007+0000","last_change":"2024-05-27T06:27:37.591342+0000","last_active":"2024-05-27T06:27:43.641007+0000","last_peered":"2024-05-27T06:27:43.641007+0000","last_clean":"2024-05-27T06:27:43.641007+0000","last_became_active":"2024-05-27T06:27:37.591027+0000","last_became_peered":"2024-05-27T06:27:37.591027+0000","last_unstale":"2024-05-27T06:27:43.641007+0000","last_undegraded":"2024-05-27T06:27:43.641007+0000","last_fullsized":"2024-05-27T06:27:43.641007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:27.532558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559661+0000","last_change":"2024-05-27T06:27:42.681211+0000","last_active":"2024-05-27T06:27:45.559661+0000","last_peered":"2024-05-27T06:27:45.559661+0000","last_clean":"2024-05-27T06:27:45.559661+0000","last_became_active":"2024-05-27T06:27:42.680695+0000","last_became_peered":"2024-05-27T06:27:42.680695+0000","last_unstale":"2024-05-27T06:27:45.559661+0000","last_undegraded":"2024-05-27T06:27:45.559661+0000","last_fullsized":"2024-05-27T06:27:45.559661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:57.607864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562099+0000","last_change":"2024-05-27T06:27:38.596719+0000","last_active":"2024-05-27T06:27:45.562099+0000","last_peered":"2024-05-27T06:27:45.562099+0000","last_clean":"2024-05-27T06:27:45.562099+0000","last_became_active":"2024-05-27T06:27:38.596458+0000","last_became_peered":"2024-05-27T06:27:38.596458+0000","last_unstale":"2024-05-27T06:27:45.562099+0000","last_undegraded":"2024-05-27T06:27:45.562099+0000","last_fullsized":"2024-05-27T06:27:45.562099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:25.980330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995382+0000","last_change":"2024-05-27T06:27:37.587248+0000","last_active":"2024-05-27T06:27:44.995382+0000","last_peered":"2024-05-27T06:27:44.995382+0000","last_clean":"2024-05-27T06:27:44.995382+0000","last_became_active":"2024-05-27T06:27:37.586914+0000","last_became_peered":"2024-05-27T06:27:37.586914+0000","last_unstale":"2024-05-27T06:27:44.995382+0000","last_undegraded":"2024-05-27T06:27:44.995382+0000","last_fullsized":"2024-05-27T06:27:44.995382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:10.389223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698571+0000","last_change":"2024-05-27T06:27:42.674862+0000","last_active":"2024-05-27T06:27:44.698571+0000","last_peered":"2024-05-27T06:27:44.698571+0000","last_clean":"2024-05-27T06:27:44.698571+0000","last_became_active":"2024-05-27T06:27:42.674435+0000","last_became_peered":"2024-05-27T06:27:42.674435+0000","last_unstale":"2024-05-27T06:27:44.698571+0000","last_undegraded":"2024-05-27T06:27:44.698571+0000","last_fullsized":"2024-05-27T06:27:44.698571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:25.641088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561573+0000","last_change":"2024-05-27T06:27:38.593263+0000","last_active":"2024-05-27T06:27:45.561573+0000","last_peered":"2024-05-27T06:27:45.561573+0000","last_clean":"2024-05-27T06:27:45.561573+0000","last_became_active":"2024-05-27T06:27:38.592852+0000","last_became_peered":"2024-05-27T06:27:38.592852+0000","last_unstale":"2024-05-27T06:27:45.561573+0000","last_undegraded":"2024-05-27T06:27:45.561573+0000","last_fullsized":"2024-05-27T06:27:45.561573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:21.569967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641310+0000","last_change":"2024-05-27T06:27:37.599453+0000","last_active":"2024-05-27T06:27:43.641310+0000","last_peered":"2024-05-27T06:27:43.641310+0000","last_clean":"2024-05-27T06:27:43.641310+0000","last_became_active":"2024-05-27T06:27:37.599122+0000","last_became_peered":"2024-05-27T06:27:37.599122+0000","last_unstale":"2024-05-27T06:27:43.641310+0000","last_undegraded":"2024-05-27T06:27:43.641310+0000","last_fullsized":"2024-05-27T06:27:43.641310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:10.389223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559414+0000","last_change":"2024-05-27T06:27:42.667965+0000","last_active":"2024-05-27T06:27:45.559414+0000","last_peered":"2024-05-27T06:27:45.559414+0000","last_clean":"2024-05-27T06:27:45.559414+0000","last_became_active":"2024-05-27T06:27:42.667525+0000","last_became_peered":"2024-05-27T06:27:42.667525+0000","last_unstale":"2024-05-27T06:27:45.559414+0000","last_undegraded":"2024-05-27T06:27:45.559414+0000","last_fullsized":"2024-05-27T06:27:45.559414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:39:45.712130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561139+0000","last_change":"2024-05-27T06:27:38.593273+0000","last_active":"2024-05-27T06:27:45.561139+0000","last_peered":"2024-05-27T06:27:45.561139+0000","last_clean":"2024-05-27T06:27:45.561139+0000","last_became_active":"2024-05-27T06:27:38.592904+0000","last_became_peered":"2024-05-27T06:27:38.592904+0000","last_unstale":"2024-05-27T06:27:45.561139+0000","last_undegraded":"2024-05-27T06:27:45.561139+0000","last_fullsized":"2024-05-27T06:27:45.561139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:13:28.978589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.642001+0000","last_change":"2024-05-27T06:27:37.588652+0000","last_active":"2024-05-27T06:27:43.642001+0000","last_peered":"2024-05-27T06:27:43.642001+0000","last_clean":"2024-05-27T06:27:43.642001+0000","last_became_active":"2024-05-27T06:27:37.587893+0000","last_became_peered":"2024-05-27T06:27:37.587893+0000","last_unstale":"2024-05-27T06:27:43.642001+0000","last_undegraded":"2024-05-27T06:27:43.642001+0000","last_fullsized":"2024-05-27T06:27:43.642001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:29:42.916475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641001+0000","last_change":"2024-05-27T06:27:42.673669+0000","last_active":"2024-05-27T06:27:43.641001+0000","last_peered":"2024-05-27T06:27:43.641001+0000","last_clean":"2024-05-27T06:27:43.641001+0000","last_became_active":"2024-05-27T06:27:42.672239+0000","last_became_peered":"2024-05-27T06:27:42.672239+0000","last_unstale":"2024-05-27T06:27:43.641001+0000","last_undegraded":"2024-05-27T06:27:43.641001+0000","last_fullsized":"2024-05-27T06:27:43.641001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:12:01.383034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560187+0000","last_change":"2024-05-27T06:27:38.592051+0000","last_active":"2024-05-27T06:27:45.560187+0000","last_peered":"2024-05-27T06:27:45.560187+0000","last_clean":"2024-05-27T06:27:45.560187+0000","last_became_active":"2024-05-27T06:27:38.591691+0000","last_became_peered":"2024-05-27T06:27:38.591691+0000","last_unstale":"2024-05-27T06:27:45.560187+0000","last_undegraded":"2024-05-27T06:27:45.560187+0000","last_fullsized":"2024-05-27T06:27:45.560187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:24:46.797590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.640005+0000","last_change":"2024-05-27T06:27:37.581720+0000","last_active":"2024-05-27T06:27:43.640005+0000","last_peered":"2024-05-27T06:27:43.640005+0000","last_clean":"2024-05-27T06:27:43.640005+0000","last_became_active":"2024-05-27T06:27:37.581315+0000","last_became_peered":"2024-05-27T06:27:37.581315+0000","last_unstale":"2024-05-27T06:27:43.640005+0000","last_undegraded":"2024-05-27T06:27:43.640005+0000","last_fullsized":"2024-05-27T06:27:43.640005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:52:20.552058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698884+0000","last_change":"2024-05-27T06:27:42.663374+0000","last_active":"2024-05-27T06:27:44.698884+0000","last_peered":"2024-05-27T06:27:44.698884+0000","last_clean":"2024-05-27T06:27:44.698884+0000","last_became_active":"2024-05-27T06:27:42.662889+0000","last_became_peered":"2024-05-27T06:27:42.662889+0000","last_unstale":"2024-05-27T06:27:44.698884+0000","last_undegraded":"2024-05-27T06:27:44.698884+0000","last_fullsized":"2024-05-27T06:27:44.698884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:54:35.677824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559633+0000","last_change":"2024-05-27T06:27:38.583434+0000","last_active":"2024-05-27T06:27:45.559633+0000","last_peered":"2024-05-27T06:27:45.559633+0000","last_clean":"2024-05-27T06:27:45.559633+0000","last_became_active":"2024-05-27T06:27:38.582843+0000","last_became_peered":"2024-05-27T06:27:38.582843+0000","last_unstale":"2024-05-27T06:27:45.559633+0000","last_undegraded":"2024-05-27T06:27:45.559633+0000","last_fullsized":"2024-05-27T06:27:45.559633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:41:11.973047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559966+0000","last_change":"2024-05-27T06:27:37.589051+0000","last_active":"2024-05-27T06:27:45.559966+0000","last_peered":"2024-05-27T06:27:45.559966+0000","last_clean":"2024-05-27T06:27:45.559966+0000","last_became_active":"2024-05-27T06:27:37.588633+0000","last_became_peered":"2024-05-27T06:27:37.588633+0000","last_unstale":"2024-05-27T06:27:45.559966+0000","last_undegraded":"2024-05-27T06:27:45.559966+0000","last_fullsized":"2024-05-27T06:27:45.559966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:05:47.256329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.137194+0000","last_change":"2024-05-27T06:27:42.686386+0000","last_active":"2024-05-27T06:27:45.137194+0000","last_peered":"2024-05-27T06:27:45.137194+0000","last_clean":"2024-05-27T06:27:45.137194+0000","last_became_active":"2024-05-27T06:27:42.685755+0000","last_became_peered":"2024-05-27T06:27:42.685755+0000","last_unstale":"2024-05-27T06:27:45.137194+0000","last_undegraded":"2024-05-27T06:27:45.137194+0000","last_fullsized":"2024-05-27T06:27:45.137194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:37:17.435617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561197+0000","last_change":"2024-05-27T06:27:38.593634+0000","last_active":"2024-05-27T06:27:45.561197+0000","last_peered":"2024-05-27T06:27:45.561197+0000","last_clean":"2024-05-27T06:27:45.561197+0000","last_became_active":"2024-05-27T06:27:38.593201+0000","last_became_peered":"2024-05-27T06:27:38.593201+0000","last_unstale":"2024-05-27T06:27:45.561197+0000","last_undegraded":"2024-05-27T06:27:45.561197+0000","last_fullsized":"2024-05-27T06:27:45.561197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:25:30.433535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561742+0000","last_change":"2024-05-27T06:27:37.596337+0000","last_active":"2024-05-27T06:27:45.561742+0000","last_peered":"2024-05-27T06:27:45.561742+0000","last_clean":"2024-05-27T06:27:45.561742+0000","last_became_active":"2024-05-27T06:27:37.596071+0000","last_became_peered":"2024-05-27T06:27:37.596071+0000","last_unstale":"2024-05-27T06:27:45.561742+0000","last_undegraded":"2024-05-27T06:27:45.561742+0000","last_fullsized":"2024-05-27T06:27:45.561742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:27.532558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136738+0000","last_change":"2024-05-27T06:27:42.686370+0000","last_active":"2024-05-27T06:27:45.136738+0000","last_peered":"2024-05-27T06:27:45.136738+0000","last_clean":"2024-05-27T06:27:45.136738+0000","last_became_active":"2024-05-27T06:27:42.685792+0000","last_became_peered":"2024-05-27T06:27:42.685792+0000","last_unstale":"2024-05-27T06:27:45.136738+0000","last_undegraded":"2024-05-27T06:27:45.136738+0000","last_fullsized":"2024-05-27T06:27:45.136738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:28:22.687108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698347+0000","last_change":"2024-05-27T06:27:38.594222+0000","last_active":"2024-05-27T06:27:44.698347+0000","last_peered":"2024-05-27T06:27:44.698347+0000","last_clean":"2024-05-27T06:27:44.698347+0000","last_became_active":"2024-05-27T06:27:38.593632+0000","last_became_peered":"2024-05-27T06:27:38.593632+0000","last_unstale":"2024-05-27T06:27:44.698347+0000","last_undegraded":"2024-05-27T06:27:44.698347+0000","last_fullsized":"2024-05-27T06:27:44.698347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:00:49.009171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698666+0000","last_change":"2024-05-27T06:27:37.589344+0000","last_active":"2024-05-27T06:27:44.698666+0000","last_peered":"2024-05-27T06:27:44.698666+0000","last_clean":"2024-05-27T06:27:44.698666+0000","last_became_active":"2024-05-27T06:27:37.588387+0000","last_became_peered":"2024-05-27T06:27:37.588387+0000","last_unstale":"2024-05-27T06:27:44.698666+0000","last_undegraded":"2024-05-27T06:27:44.698666+0000","last_fullsized":"2024-05-27T06:27:44.698666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:32:06.800381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562338+0000","last_change":"2024-05-27T06:27:42.673810+0000","last_active":"2024-05-27T06:27:45.562338+0000","last_peered":"2024-05-27T06:27:45.562338+0000","last_clean":"2024-05-27T06:27:45.562338+0000","last_became_active":"2024-05-27T06:27:42.673431+0000","last_became_peered":"2024-05-27T06:27:42.673431+0000","last_unstale":"2024-05-27T06:27:45.562338+0000","last_undegraded":"2024-05-27T06:27:45.562338+0000","last_fullsized":"2024-05-27T06:27:45.562338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:00:08.939251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560009+0000","last_change":"2024-05-27T06:27:38.599269+0000","last_active":"2024-05-27T06:27:45.560009+0000","last_peered":"2024-05-27T06:27:45.560009+0000","last_clean":"2024-05-27T06:27:45.560009+0000","last_became_active":"2024-05-27T06:27:38.598937+0000","last_became_peered":"2024-05-27T06:27:38.598937+0000","last_unstale":"2024-05-27T06:27:45.560009+0000","last_undegraded":"2024-05-27T06:27:45.560009+0000","last_fullsized":"2024-05-27T06:27:45.560009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:29:05.369384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:49.604485+0000","last_change":"2024-05-27T06:27:37.601137+0000","last_active":"2024-05-27T06:27:49.604485+0000","last_peered":"2024-05-27T06:27:49.604485+0000","last_clean":"2024-05-27T06:27:49.604485+0000","last_became_active":"2024-05-27T06:27:37.597839+0000","last_became_peered":"2024-05-27T06:27:37.597839+0000","last_unstale":"2024-05-27T06:27:49.604485+0000","last_undegraded":"2024-05-27T06:27:49.604485+0000","last_fullsized":"2024-05-27T06:27:49.604485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:10.389223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995265+0000","last_change":"2024-05-27T06:27:42.677071+0000","last_active":"2024-05-27T06:27:44.995265+0000","last_peered":"2024-05-27T06:27:44.995265+0000","last_clean":"2024-05-27T06:27:44.995265+0000","last_became_active":"2024-05-27T06:27:42.676468+0000","last_became_peered":"2024-05-27T06:27:42.676468+0000","last_unstale":"2024-05-27T06:27:44.995265+0000","last_undegraded":"2024-05-27T06:27:44.995265+0000","last_fullsized":"2024-05-27T06:27:44.995265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:54:35.677824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641784+0000","last_change":"2024-05-27T06:27:38.595005+0000","last_active":"2024-05-27T06:27:43.641784+0000","last_peered":"2024-05-27T06:27:43.641784+0000","last_clean":"2024-05-27T06:27:43.641784+0000","last_became_active":"2024-05-27T06:27:38.594686+0000","last_became_peered":"2024-05-27T06:27:38.594686+0000","last_unstale":"2024-05-27T06:27:43.641784+0000","last_undegraded":"2024-05-27T06:27:43.641784+0000","last_fullsized":"2024-05-27T06:27:43.641784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:26:33.577833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995173+0000","last_change":"2024-05-27T06:27:37.602334+0000","last_active":"2024-05-27T06:27:44.995173+0000","last_peered":"2024-05-27T06:27:44.995173+0000","last_clean":"2024-05-27T06:27:44.995173+0000","last_became_active":"2024-05-27T06:27:37.601956+0000","last_became_peered":"2024-05-27T06:27:37.601956+0000","last_unstale":"2024-05-27T06:27:44.995173+0000","last_undegraded":"2024-05-27T06:27:44.995173+0000","last_fullsized":"2024-05-27T06:27:44.995173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:27.532558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641965+0000","last_change":"2024-05-27T06:27:42.675917+0000","last_active":"2024-05-27T06:27:43.641965+0000","last_peered":"2024-05-27T06:27:43.641965+0000","last_clean":"2024-05-27T06:27:43.641965+0000","last_became_active":"2024-05-27T06:27:42.672667+0000","last_became_peered":"2024-05-27T06:27:42.672667+0000","last_unstale":"2024-05-27T06:27:43.641965+0000","last_undegraded":"2024-05-27T06:27:43.641965+0000","last_fullsized":"2024-05-27T06:27:43.641965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:57.607864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698963+0000","last_change":"2024-05-27T06:27:38.593445+0000","last_active":"2024-05-27T06:27:44.698963+0000","last_peered":"2024-05-27T06:27:44.698963+0000","last_clean":"2024-05-27T06:27:44.698963+0000","last_became_active":"2024-05-27T06:27:38.593177+0000","last_became_peered":"2024-05-27T06:27:38.593177+0000","last_unstale":"2024-05-27T06:27:44.698963+0000","last_undegraded":"2024-05-27T06:27:44.698963+0000","last_fullsized":"2024-05-27T06:27:44.698963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:25:28.290431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562220+0000","last_change":"2024-05-27T06:27:37.591786+0000","last_active":"2024-05-27T06:27:45.562220+0000","last_peered":"2024-05-27T06:27:45.562220+0000","last_clean":"2024-05-27T06:27:45.562220+0000","last_became_active":"2024-05-27T06:27:37.591376+0000","last_became_peered":"2024-05-27T06:27:37.591376+0000","last_unstale":"2024-05-27T06:27:45.562220+0000","last_undegraded":"2024-05-27T06:27:45.562220+0000","last_fullsized":"2024-05-27T06:27:45.562220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:26:32.568342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136705+0000","last_change":"2024-05-27T06:27:42.685562+0000","last_active":"2024-05-27T06:27:45.136705+0000","last_peered":"2024-05-27T06:27:45.136705+0000","last_clean":"2024-05-27T06:27:45.136705+0000","last_became_active":"2024-05-27T06:27:42.685102+0000","last_became_peered":"2024-05-27T06:27:42.685102+0000","last_unstale":"2024-05-27T06:27:45.136705+0000","last_undegraded":"2024-05-27T06:27:45.136705+0000","last_fullsized":"2024-05-27T06:27:45.136705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:00:08.939251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562310+0000","last_change":"2024-05-27T06:27:38.595953+0000","last_active":"2024-05-27T06:27:45.562310+0000","last_peered":"2024-05-27T06:27:45.562310+0000","last_clean":"2024-05-27T06:27:45.562310+0000","last_became_active":"2024-05-27T06:27:38.595628+0000","last_became_peered":"2024-05-27T06:27:38.595628+0000","last_unstale":"2024-05-27T06:27:45.562310+0000","last_undegraded":"2024-05-27T06:27:45.562310+0000","last_fullsized":"2024-05-27T06:27:45.562310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:36:01.596426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560492+0000","last_change":"2024-05-27T06:27:37.600029+0000","last_active":"2024-05-27T06:27:45.560492+0000","last_peered":"2024-05-27T06:27:45.560492+0000","last_clean":"2024-05-27T06:27:45.560492+0000","last_became_active":"2024-05-27T06:27:37.599416+0000","last_became_peered":"2024-05-27T06:27:37.599416+0000","last_unstale":"2024-05-27T06:27:45.560492+0000","last_undegraded":"2024-05-27T06:27:45.560492+0000","last_fullsized":"2024-05-27T06:27:45.560492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:52:20.552058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136431+0000","last_change":"2024-05-27T06:27:42.668152+0000","last_active":"2024-05-27T06:27:45.136431+0000","last_peered":"2024-05-27T06:27:45.136431+0000","last_clean":"2024-05-27T06:27:45.136431+0000","last_became_active":"2024-05-27T06:27:42.667699+0000","last_became_peered":"2024-05-27T06:27:42.667699+0000","last_unstale":"2024-05-27T06:27:45.136431+0000","last_undegraded":"2024-05-27T06:27:45.136431+0000","last_fullsized":"2024-05-27T06:27:45.136431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:39:45.712130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698461+0000","last_change":"2024-05-27T06:27:42.674408+0000","last_active":"2024-05-27T06:27:44.698461+0000","last_peered":"2024-05-27T06:27:44.698461+0000","last_clean":"2024-05-27T06:27:44.698461+0000","last_became_active":"2024-05-27T06:27:42.673922+0000","last_became_peered":"2024-05-27T06:27:42.673922+0000","last_unstale":"2024-05-27T06:27:44.698461+0000","last_undegraded":"2024-05-27T06:27:44.698461+0000","last_fullsized":"2024-05-27T06:27:44.698461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:39.420388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.994666+0000","last_change":"2024-05-27T06:27:38.612241+0000","last_active":"2024-05-27T06:27:44.994666+0000","last_peered":"2024-05-27T06:27:44.994666+0000","last_clean":"2024-05-27T06:27:44.994666+0000","last_became_active":"2024-05-27T06:27:38.611812+0000","last_became_peered":"2024-05-27T06:27:38.611812+0000","last_unstale":"2024-05-27T06:27:44.994666+0000","last_undegraded":"2024-05-27T06:27:44.994666+0000","last_fullsized":"2024-05-27T06:27:44.994666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:43:18.651541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560424+0000","last_change":"2024-05-27T06:27:37.588619+0000","last_active":"2024-05-27T06:27:45.560424+0000","last_peered":"2024-05-27T06:27:45.560424+0000","last_clean":"2024-05-27T06:27:45.560424+0000","last_became_active":"2024-05-27T06:27:37.588234+0000","last_became_peered":"2024-05-27T06:27:37.588234+0000","last_unstale":"2024-05-27T06:27:45.560424+0000","last_undegraded":"2024-05-27T06:27:45.560424+0000","last_fullsized":"2024-05-27T06:27:45.560424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:39:09.133451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560396+0000","last_change":"2024-05-27T06:27:42.675463+0000","last_active":"2024-05-27T06:27:45.560396+0000","last_peered":"2024-05-27T06:27:45.560396+0000","last_clean":"2024-05-27T06:27:45.560396+0000","last_became_active":"2024-05-27T06:27:42.674944+0000","last_became_peered":"2024-05-27T06:27:42.674944+0000","last_unstale":"2024-05-27T06:27:45.560396+0000","last_undegraded":"2024-05-27T06:27:45.560396+0000","last_fullsized":"2024-05-27T06:27:45.560396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:39.420388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136773+0000","last_change":"2024-05-27T06:27:38.602470+0000","last_active":"2024-05-27T06:27:45.136773+0000","last_peered":"2024-05-27T06:27:45.136773+0000","last_clean":"2024-05-27T06:27:45.136773+0000","last_became_active":"2024-05-27T06:27:38.602168+0000","last_became_peered":"2024-05-27T06:27:38.602168+0000","last_unstale":"2024-05-27T06:27:45.136773+0000","last_undegraded":"2024-05-27T06:27:45.136773+0000","last_fullsized":"2024-05-27T06:27:45.136773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:41:11.973047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136564+0000","last_change":"2024-05-27T06:27:37.594520+0000","last_active":"2024-05-27T06:27:45.136564+0000","last_peered":"2024-05-27T06:27:45.136564+0000","last_clean":"2024-05-27T06:27:45.136564+0000","last_became_active":"2024-05-27T06:27:37.594241+0000","last_became_peered":"2024-05-27T06:27:37.594241+0000","last_unstale":"2024-05-27T06:27:45.136564+0000","last_undegraded":"2024-05-27T06:27:45.136564+0000","last_fullsized":"2024-05-27T06:27:45.136564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:32:06.800381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559944+0000","last_change":"2024-05-27T06:27:37.584323+0000","last_active":"2024-05-27T06:27:45.559944+0000","last_peered":"2024-05-27T06:27:45.559944+0000","last_clean":"2024-05-27T06:27:45.559944+0000","last_became_active":"2024-05-27T06:27:37.583455+0000","last_became_peered":"2024-05-27T06:27:37.583455+0000","last_unstale":"2024-05-27T06:27:45.559944+0000","last_undegraded":"2024-05-27T06:27:45.559944+0000","last_fullsized":"2024-05-27T06:27:45.559944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:39:09.133451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698607+0000","last_change":"2024-05-27T06:27:38.574453+0000","last_active":"2024-05-27T06:27:44.698607+0000","last_peered":"2024-05-27T06:27:44.698607+0000","last_clean":"2024-05-27T06:27:44.698607+0000","last_became_active":"2024-05-27T06:27:38.574187+0000","last_became_peered":"2024-05-27T06:27:38.574187+0000","last_unstale":"2024-05-27T06:27:44.698607+0000","last_undegraded":"2024-05-27T06:27:44.698607+0000","last_fullsized":"2024-05-27T06:27:44.698607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:10:49.565828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.640927+0000","last_change":"2024-05-27T06:27:42.685818+0000","last_active":"2024-05-27T06:27:43.640927+0000","last_peered":"2024-05-27T06:27:43.640927+0000","last_clean":"2024-05-27T06:27:43.640927+0000","last_became_active":"2024-05-27T06:27:42.685168+0000","last_became_peered":"2024-05-27T06:27:42.685168+0000","last_unstale":"2024-05-27T06:27:43.640927+0000","last_undegraded":"2024-05-27T06:27:43.640927+0000","last_fullsized":"2024-05-27T06:27:43.640927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:53:00.233527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136653+0000","last_change":"2024-05-27T06:27:37.593851+0000","last_active":"2024-05-27T06:27:45.136653+0000","last_peered":"2024-05-27T06:27:45.136653+0000","last_clean":"2024-05-27T06:27:45.136653+0000","last_became_active":"2024-05-27T06:27:37.593555+0000","last_became_peered":"2024-05-27T06:27:37.593555+0000","last_unstale":"2024-05-27T06:27:45.136653+0000","last_undegraded":"2024-05-27T06:27:45.136653+0000","last_fullsized":"2024-05-27T06:27:45.136653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:13:32.135455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641290+0000","last_change":"2024-05-27T06:27:38.581691+0000","last_active":"2024-05-27T06:27:43.641290+0000","last_peered":"2024-05-27T06:27:43.641290+0000","last_clean":"2024-05-27T06:27:43.641290+0000","last_became_active":"2024-05-27T06:27:38.581340+0000","last_became_peered":"2024-05-27T06:27:38.581340+0000","last_unstale":"2024-05-27T06:27:43.641290+0000","last_undegraded":"2024-05-27T06:27:43.641290+0000","last_fullsized":"2024-05-27T06:27:43.641290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:49:55.342001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.137183+0000","last_change":"2024-05-27T06:27:42.685248+0000","last_active":"2024-05-27T06:27:45.137183+0000","last_peered":"2024-05-27T06:27:45.137183+0000","last_clean":"2024-05-27T06:27:45.137183+0000","last_became_active":"2024-05-27T06:27:42.684742+0000","last_became_peered":"2024-05-27T06:27:42.684742+0000","last_unstale":"2024-05-27T06:27:45.137183+0000","last_undegraded":"2024-05-27T06:27:45.137183+0000","last_fullsized":"2024-05-27T06:27:45.137183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:02:03.498823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559395+0000","last_change":"2024-05-27T06:27:38.583155+0000","last_active":"2024-05-27T06:27:45.559395+0000","last_peered":"2024-05-27T06:27:45.559395+0000","last_clean":"2024-05-27T06:27:45.559395+0000","last_became_active":"2024-05-27T06:27:38.582419+0000","last_became_peered":"2024-05-27T06:27:38.582419+0000","last_unstale":"2024-05-27T06:27:45.559395+0000","last_undegraded":"2024-05-27T06:27:45.559395+0000","last_fullsized":"2024-05-27T06:27:45.559395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:11:57.311912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.640034+0000","last_change":"2024-05-27T06:27:38.590551+0000","last_active":"2024-05-27T06:27:43.640034+0000","last_peered":"2024-05-27T06:27:43.640034+0000","last_clean":"2024-05-27T06:27:43.640034+0000","last_became_active":"2024-05-27T06:27:38.590245+0000","last_became_peered":"2024-05-27T06:27:38.590245+0000","last_unstale":"2024-05-27T06:27:43.640034+0000","last_undegraded":"2024-05-27T06:27:43.640034+0000","last_fullsized":"2024-05-27T06:27:43.640034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:49:55.342001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561694+0000","last_change":"2024-05-27T06:27:38.597109+0000","last_active":"2024-05-27T06:27:45.561694+0000","last_peered":"2024-05-27T06:27:45.561694+0000","last_clean":"2024-05-27T06:27:45.561694+0000","last_became_active":"2024-05-27T06:27:38.596436+0000","last_became_peered":"2024-05-27T06:27:38.596436+0000","last_unstale":"2024-05-27T06:27:45.561694+0000","last_undegraded":"2024-05-27T06:27:45.561694+0000","last_fullsized":"2024-05-27T06:27:45.561694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:29:05.369384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698590+0000","last_change":"2024-05-27T06:27:38.592354+0000","last_active":"2024-05-27T06:27:44.698590+0000","last_peered":"2024-05-27T06:27:44.698590+0000","last_clean":"2024-05-27T06:27:44.698590+0000","last_became_active":"2024-05-27T06:27:38.591629+0000","last_became_peered":"2024-05-27T06:27:38.591629+0000","last_unstale":"2024-05-27T06:27:44.698590+0000","last_undegraded":"2024-05-27T06:27:44.698590+0000","last_fullsized":"2024-05-27T06:27:44.698590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:43:18.651541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136957+0000","last_change":"2024-05-27T06:27:38.600703+0000","last_active":"2024-05-27T06:27:45.136957+0000","last_peered":"2024-05-27T06:27:45.136957+0000","last_clean":"2024-05-27T06:27:45.136957+0000","last_became_active":"2024-05-27T06:27:38.598995+0000","last_became_peered":"2024-05-27T06:27:38.598995+0000","last_unstale":"2024-05-27T06:27:45.136957+0000","last_undegraded":"2024-05-27T06:27:45.136957+0000","last_fullsized":"2024-05-27T06:27:45.136957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:47.314366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.994968+0000","last_change":"2024-05-27T06:27:38.591611+0000","last_active":"2024-05-27T06:27:44.994968+0000","last_peered":"2024-05-27T06:27:44.994968+0000","last_clean":"2024-05-27T06:27:44.994968+0000","last_became_active":"2024-05-27T06:27:38.591257+0000","last_became_peered":"2024-05-27T06:27:38.591257+0000","last_unstale":"2024-05-27T06:27:44.994968+0000","last_undegraded":"2024-05-27T06:27:44.994968+0000","last_fullsized":"2024-05-27T06:27:44.994968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:11:57.311912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560497+0000","last_change":"2024-05-27T06:27:38.601653+0000","last_active":"2024-05-27T06:27:45.560497+0000","last_peered":"2024-05-27T06:27:45.560497+0000","last_clean":"2024-05-27T06:27:45.560497+0000","last_became_active":"2024-05-27T06:27:38.601350+0000","last_became_peered":"2024-05-27T06:27:38.601350+0000","last_unstale":"2024-05-27T06:27:45.560497+0000","last_undegraded":"2024-05-27T06:27:45.560497+0000","last_fullsized":"2024-05-27T06:27:45.560497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:47.314366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.137255+0000","last_change":"2024-05-27T06:27:38.595137+0000","last_active":"2024-05-27T06:27:45.137255+0000","last_peered":"2024-05-27T06:27:45.137255+0000","last_clean":"2024-05-27T06:27:45.137255+0000","last_became_active":"2024-05-27T06:27:38.594672+0000","last_became_peered":"2024-05-27T06:27:38.594672+0000","last_unstale":"2024-05-27T06:27:45.137255+0000","last_undegraded":"2024-05-27T06:27:45.137255+0000","last_fullsized":"2024-05-27T06:27:45.137255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:36:01.596426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560306+0000","last_change":"2024-05-27T06:27:38.604733+0000","last_active":"2024-05-27T06:27:45.560306+0000","last_peered":"2024-05-27T06:27:45.560306+0000","last_clean":"2024-05-27T06:27:45.560306+0000","last_became_active":"2024-05-27T06:27:38.604412+0000","last_became_peered":"2024-05-27T06:27:38.604412+0000","last_unstale":"2024-05-27T06:27:45.560306+0000","last_undegraded":"2024-05-27T06:27:45.560306+0000","last_fullsized":"2024-05-27T06:27:45.560306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:25:28.290431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136468+0000","last_change":"2024-05-27T06:27:38.594417+0000","last_active":"2024-05-27T06:27:45.136468+0000","last_peered":"2024-05-27T06:27:45.136468+0000","last_clean":"2024-05-27T06:27:45.136468+0000","last_became_active":"2024-05-27T06:27:38.594093+0000","last_became_peered":"2024-05-27T06:27:38.594093+0000","last_unstale":"2024-05-27T06:27:45.136468+0000","last_undegraded":"2024-05-27T06:27:45.136468+0000","last_fullsized":"2024-05-27T06:27:45.136468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:36:07.073192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561566+0000","last_change":"2024-05-27T06:27:38.595842+0000","last_active":"2024-05-27T06:27:45.561566+0000","last_peered":"2024-05-27T06:27:45.561566+0000","last_clean":"2024-05-27T06:27:45.561566+0000","last_became_active":"2024-05-27T06:27:38.595187+0000","last_became_peered":"2024-05-27T06:27:38.595187+0000","last_unstale":"2024-05-27T06:27:45.561566+0000","last_undegraded":"2024-05-27T06:27:45.561566+0000","last_fullsized":"2024-05-27T06:27:45.561566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:25:30.433535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698434+0000","last_change":"2024-05-27T06:27:38.596103+0000","last_active":"2024-05-27T06:27:44.698434+0000","last_peered":"2024-05-27T06:27:44.698434+0000","last_clean":"2024-05-27T06:27:44.698434+0000","last_became_active":"2024-05-27T06:27:38.595235+0000","last_became_peered":"2024-05-27T06:27:38.595235+0000","last_unstale":"2024-05-27T06:27:44.698434+0000","last_undegraded":"2024-05-27T06:27:44.698434+0000","last_fullsized":"2024-05-27T06:27:44.698434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:41:11.973047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561763+0000","last_change":"2024-05-27T06:27:38.589402+0000","last_active":"2024-05-27T06:27:45.561763+0000","last_peered":"2024-05-27T06:27:45.561763+0000","last_clean":"2024-05-27T06:27:45.561763+0000","last_became_active":"2024-05-27T06:27:38.588485+0000","last_became_peered":"2024-05-27T06:27:38.588485+0000","last_unstale":"2024-05-27T06:27:45.561763+0000","last_undegraded":"2024-05-27T06:27:45.561763+0000","last_fullsized":"2024-05-27T06:27:45.561763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:25:28.290431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560506+0000","last_change":"2024-05-27T06:27:38.604825+0000","last_active":"2024-05-27T06:27:45.560506+0000","last_peered":"2024-05-27T06:27:45.560506+0000","last_clean":"2024-05-27T06:27:45.560506+0000","last_became_active":"2024-05-27T06:27:38.604493+0000","last_became_peered":"2024-05-27T06:27:38.604493+0000","last_unstale":"2024-05-27T06:27:45.560506+0000","last_undegraded":"2024-05-27T06:27:45.560506+0000","last_fullsized":"2024-05-27T06:27:45.560506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:35.349266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641191+0000","last_change":"2024-05-27T06:27:38.589333+0000","last_active":"2024-05-27T06:27:43.641191+0000","last_peered":"2024-05-27T06:27:43.641191+0000","last_clean":"2024-05-27T06:27:43.641191+0000","last_became_active":"2024-05-27T06:27:38.588557+0000","last_became_peered":"2024-05-27T06:27:38.588557+0000","last_unstale":"2024-05-27T06:27:43.641191+0000","last_undegraded":"2024-05-27T06:27:43.641191+0000","last_fullsized":"2024-05-27T06:27:43.641191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:04:46.051655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562481+0000","last_change":"2024-05-27T06:27:38.595781+0000","last_active":"2024-05-27T06:27:45.562481+0000","last_peered":"2024-05-27T06:27:45.562481+0000","last_clean":"2024-05-27T06:27:45.562481+0000","last_became_active":"2024-05-27T06:27:38.595427+0000","last_became_peered":"2024-05-27T06:27:38.595427+0000","last_unstale":"2024-05-27T06:27:45.562481+0000","last_undegraded":"2024-05-27T06:27:45.562481+0000","last_fullsized":"2024-05-27T06:27:45.562481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:21.569967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560183+0000","last_change":"2024-05-27T06:27:38.603388+0000","last_active":"2024-05-27T06:27:45.560183+0000","last_peered":"2024-05-27T06:27:45.560183+0000","last_clean":"2024-05-27T06:27:45.560183+0000","last_became_active":"2024-05-27T06:27:38.602534+0000","last_became_peered":"2024-05-27T06:27:38.602534+0000","last_unstale":"2024-05-27T06:27:45.560183+0000","last_undegraded":"2024-05-27T06:27:45.560183+0000","last_fullsized":"2024-05-27T06:27:45.560183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:11:57.311912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.994752+0000","last_change":"2024-05-27T06:27:38.597804+0000","last_active":"2024-05-27T06:27:44.994752+0000","last_peered":"2024-05-27T06:27:44.994752+0000","last_clean":"2024-05-27T06:27:44.994752+0000","last_became_active":"2024-05-27T06:27:38.597501+0000","last_became_peered":"2024-05-27T06:27:38.597501+0000","last_unstale":"2024-05-27T06:27:44.994752+0000","last_undegraded":"2024-05-27T06:27:44.994752+0000","last_fullsized":"2024-05-27T06:27:44.994752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:36:07.073192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698683+0000","last_change":"2024-05-27T06:27:38.595971+0000","last_active":"2024-05-27T06:27:44.698683+0000","last_peered":"2024-05-27T06:27:44.698683+0000","last_clean":"2024-05-27T06:27:44.698683+0000","last_became_active":"2024-05-27T06:27:38.595550+0000","last_became_peered":"2024-05-27T06:27:38.595550+0000","last_unstale":"2024-05-27T06:27:44.698683+0000","last_undegraded":"2024-05-27T06:27:44.698683+0000","last_fullsized":"2024-05-27T06:27:44.698683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:44:31.285463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136539+0000","last_change":"2024-05-27T06:27:38.587249+0000","last_active":"2024-05-27T06:27:45.136539+0000","last_peered":"2024-05-27T06:27:45.136539+0000","last_clean":"2024-05-27T06:27:45.136539+0000","last_became_active":"2024-05-27T06:27:38.586880+0000","last_became_peered":"2024-05-27T06:27:38.586880+0000","last_unstale":"2024-05-27T06:27:45.136539+0000","last_undegraded":"2024-05-27T06:27:45.136539+0000","last_fullsized":"2024-05-27T06:27:45.136539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:11:57.311912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641615+0000","last_change":"2024-05-27T06:27:38.588337+0000","last_active":"2024-05-27T06:27:43.641615+0000","last_peered":"2024-05-27T06:27:43.641615+0000","last_clean":"2024-05-27T06:27:43.641615+0000","last_became_active":"2024-05-27T06:27:38.587989+0000","last_became_peered":"2024-05-27T06:27:38.587989+0000","last_unstale":"2024-05-27T06:27:43.641615+0000","last_undegraded":"2024-05-27T06:27:43.641615+0000","last_fullsized":"2024-05-27T06:27:43.641615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:05:48.265820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560707+0000","last_change":"2024-05-27T06:27:38.589920+0000","last_active":"2024-05-27T06:27:45.560707+0000","last_peered":"2024-05-27T06:27:45.560707+0000","last_clean":"2024-05-27T06:27:45.560707+0000","last_became_active":"2024-05-27T06:27:38.588894+0000","last_became_peered":"2024-05-27T06:27:38.588894+0000","last_unstale":"2024-05-27T06:27:45.560707+0000","last_undegraded":"2024-05-27T06:27:45.560707+0000","last_fullsized":"2024-05-27T06:27:45.560707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:43:18.651541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560366+0000","last_change":"2024-05-27T06:27:38.589163+0000","last_active":"2024-05-27T06:27:45.560366+0000","last_peered":"2024-05-27T06:27:45.560366+0000","last_clean":"2024-05-27T06:27:45.560366+0000","last_became_active":"2024-05-27T06:27:38.588860+0000","last_became_peered":"2024-05-27T06:27:38.588860+0000","last_unstale":"2024-05-27T06:27:45.560366+0000","last_undegraded":"2024-05-27T06:27:45.560366+0000","last_fullsized":"2024-05-27T06:27:45.560366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:10:49.565828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561563+0000","last_change":"2024-05-27T06:27:38.592099+0000","last_active":"2024-05-27T06:27:45.561563+0000","last_peered":"2024-05-27T06:27:45.561563+0000","last_clean":"2024-05-27T06:27:45.561563+0000","last_became_active":"2024-05-27T06:27:38.591794+0000","last_became_peered":"2024-05-27T06:27:38.591794+0000","last_unstale":"2024-05-27T06:27:45.561563+0000","last_undegraded":"2024-05-27T06:27:45.561563+0000","last_fullsized":"2024-05-27T06:27:45.561563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:31:23.791324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136320+0000","last_change":"2024-05-27T06:27:38.591399+0000","last_active":"2024-05-27T06:27:45.136320+0000","last_peered":"2024-05-27T06:27:45.136320+0000","last_clean":"2024-05-27T06:27:45.136320+0000","last_became_active":"2024-05-27T06:27:38.591132+0000","last_became_peered":"2024-05-27T06:27:38.591132+0000","last_unstale":"2024-05-27T06:27:45.136320+0000","last_undegraded":"2024-05-27T06:27:45.136320+0000","last_fullsized":"2024-05-27T06:27:45.136320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:00:49.009171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560131+0000","last_change":"2024-05-27T06:27:38.606361+0000","last_active":"2024-05-27T06:27:45.560131+0000","last_peered":"2024-05-27T06:27:45.560131+0000","last_clean":"2024-05-27T06:27:45.560131+0000","last_became_active":"2024-05-27T06:27:38.605036+0000","last_became_peered":"2024-05-27T06:27:38.605036+0000","last_unstale":"2024-05-27T06:27:45.560131+0000","last_undegraded":"2024-05-27T06:27:45.560131+0000","last_fullsized":"2024-05-27T06:27:45.560131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:54:31.606702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561440+0000","last_change":"2024-05-27T06:27:38.594793+0000","last_active":"2024-05-27T06:27:45.561440+0000","last_peered":"2024-05-27T06:27:45.561440+0000","last_clean":"2024-05-27T06:27:45.561440+0000","last_became_active":"2024-05-27T06:27:38.594350+0000","last_became_peered":"2024-05-27T06:27:38.594350+0000","last_unstale":"2024-05-27T06:27:45.561440+0000","last_undegraded":"2024-05-27T06:27:45.561440+0000","last_fullsized":"2024-05-27T06:27:45.561440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:24:46.797590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560917+0000","last_change":"2024-05-27T06:27:38.600252+0000","last_active":"2024-05-27T06:27:45.560917+0000","last_peered":"2024-05-27T06:27:45.560917+0000","last_clean":"2024-05-27T06:27:45.560917+0000","last_became_active":"2024-05-27T06:27:38.599892+0000","last_became_peered":"2024-05-27T06:27:38.599892+0000","last_unstale":"2024-05-27T06:27:45.560917+0000","last_undegraded":"2024-05-27T06:27:45.560917+0000","last_fullsized":"2024-05-27T06:27:45.560917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:36:01.596426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561945+0000","last_change":"2024-05-27T06:27:38.595466+0000","last_active":"2024-05-27T06:27:45.561945+0000","last_peered":"2024-05-27T06:27:45.561945+0000","last_clean":"2024-05-27T06:27:45.561945+0000","last_became_active":"2024-05-27T06:27:38.593979+0000","last_became_peered":"2024-05-27T06:27:38.593979+0000","last_unstale":"2024-05-27T06:27:45.561945+0000","last_undegraded":"2024-05-27T06:27:45.561945+0000","last_fullsized":"2024-05-27T06:27:45.561945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:13:28.978589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698434+0000","last_change":"2024-05-27T06:27:38.581825+0000","last_active":"2024-05-27T06:27:44.698434+0000","last_peered":"2024-05-27T06:27:44.698434+0000","last_clean":"2024-05-27T06:27:44.698434+0000","last_became_active":"2024-05-27T06:27:38.580897+0000","last_became_peered":"2024-05-27T06:27:38.580897+0000","last_unstale":"2024-05-27T06:27:44.698434+0000","last_undegraded":"2024-05-27T06:27:44.698434+0000","last_fullsized":"2024-05-27T06:27:44.698434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:36:07.073192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995182+0000","last_change":"2024-05-27T06:27:38.596385+0000","last_active":"2024-05-27T06:27:44.995182+0000","last_peered":"2024-05-27T06:27:44.995182+0000","last_clean":"2024-05-27T06:27:44.995182+0000","last_became_active":"2024-05-27T06:27:38.595730+0000","last_became_peered":"2024-05-27T06:27:38.595730+0000","last_unstale":"2024-05-27T06:27:44.995182+0000","last_undegraded":"2024-05-27T06:27:44.995182+0000","last_fullsized":"2024-05-27T06:27:44.995182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:25:28.290431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561441+0000","last_change":"2024-05-27T06:27:38.591344+0000","last_active":"2024-05-27T06:27:45.561441+0000","last_peered":"2024-05-27T06:27:45.561441+0000","last_clean":"2024-05-27T06:27:45.561441+0000","last_became_active":"2024-05-27T06:27:38.591001+0000","last_became_peered":"2024-05-27T06:27:38.591001+0000","last_unstale":"2024-05-27T06:27:45.561441+0000","last_undegraded":"2024-05-27T06:27:45.561441+0000","last_fullsized":"2024-05-27T06:27:45.561441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:25.980330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T06:28:01.198 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-27T06:28:01.199 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-27T06:28:01.199 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-27T06:28:01.199 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-27T06:28:01.199 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-27T06:28:01.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.391+0000 7f32f2200640 1 Processor -- start 2024-05-27T06:28:01.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.391+0000 7f32f2200640 1 -- start start 2024-05-27T06:28:01.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.391+0000 7f32f2200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f32ec0cbf90 0x7f32ec06cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:01.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.391+0000 7f32f2200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f32ec06d500 0x7f32ec15cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:01.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.391+0000 7f32f2200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32ec15d930 con 0x7f32ec15d520 2024-05-27T06:28:01.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.391+0000 7f32f2200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f32ec06d910 con 0x7f32ec0cbf90 2024-05-27T06:28:01.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.391+0000 7f32f2200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f32ec15dbb0 con 0x7f32ec06d500 2024-05-27T06:28:01.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.391+0000 7f32eb400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f32ec0cbf90 0x7f32ec06cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:01.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.391+0000 7f32e2a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f32ec06d500 0x7f32ec15cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:01.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.391+0000 7f32eb400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f32ec0cbf90 0x7f32ec06cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:39578/0 (socket says 172.21.15.87:39578) 2024-05-27T06:28:01.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.391+0000 7f32ebe00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f32ec15d520 0x7f32ec0d1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.87:47534/0 (socket says 172.21.15.87:47534) 2024-05-27T06:28:01.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.391+0000 7f32eb400640 1 -- 172.21.15.87:0/897933323 learned_addr learned my addr 172.21.15.87:0/897933323 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:01.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.391+0000 7f32e2a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f32ec06d500 0x7f32ec15cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.87:44878/0 (socket says 172.21.15.87:44878) 2024-05-27T06:28:01.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.391+0000 7f32e2a00640 1 -- 172.21.15.87:0/897933323 >> v2:172.21.15.149:3300/0 conn(0x7f32ec0cbf90 msgr2=0x7f32ec06cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:01.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.391+0000 7f32e2a00640 1 --2- 172.21.15.87:0/897933323 >> v2:172.21.15.149:3300/0 conn(0x7f32ec0cbf90 0x7f32ec06cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:01.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.391+0000 7f32e2a00640 1 -- 172.21.15.87:0/897933323 >> v1:172.21.15.149:6789/0 conn(0x7f32ec15d520 legacy=0x7f32ec0d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:01.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.391+0000 7f32e2a00640 1 -- 172.21.15.87:0/897933323 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ec15de90 con 0x7f32ec06d500 2024-05-27T06:28:01.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.391+0000 7f32eb400640 1 --2- 172.21.15.87:0/897933323 >> v2:172.21.15.149:3300/0 conn(0x7f32ec0cbf90 0x7f32ec06cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:28:01.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.395+0000 7f32e2a00640 1 --2- 172.21.15.87:0/897933323 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f32ec06d500 0x7f32ec15cfe0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f32d40097c0 tx=0x7f32d401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ef45fdfbfb52138 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:01.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.395+0000 7f32eaa00640 1 -- 172.21.15.87:0/897933323 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d40b5070 con 0x7f32ec06d500 2024-05-27T06:28:01.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.395+0000 7f32eaa00640 1 -- 172.21.15.87:0/897933323 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d40a8990 con 0x7f32ec06d500 2024-05-27T06:28:01.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.395+0000 7f32eaa00640 1 -- 172.21.15.87:0/897933323 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d40a8d60 con 0x7f32ec06d500 2024-05-27T06:28:01.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.395+0000 7f32f2200640 1 -- 172.21.15.87:0/897933323 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f32ec06d500 msgr2=0x7f32ec15cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:01.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.395+0000 7f32f2200640 1 --2- 172.21.15.87:0/897933323 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f32ec06d500 0x7f32ec15cfe0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f32d40097c0 tx=0x7f32d401ec90 comp rx=0 tx=0).stop 2024-05-27T06:28:01.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.395+0000 7f32f2200640 1 -- 172.21.15.87:0/897933323 shutdown_connections 2024-05-27T06:28:01.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.395+0000 7f32f2200640 1 --2- 172.21.15.87:0/897933323 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f32ec06d500 0x7f32ec15cfe0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:01.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.395+0000 7f32f2200640 1 --2- 172.21.15.87:0/897933323 >> v2:172.21.15.149:3300/0 conn(0x7f32ec0cbf90 0x7f32ec06cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:01.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.395+0000 7f32f2200640 1 -- 172.21.15.87:0/897933323 >> 172.21.15.87:0/897933323 conn(0x7f32ec0b46b0 msgr2=0x7f32ec0b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:01.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.395+0000 7f32f2200640 1 -- 172.21.15.87:0/897933323 shutdown_connections 2024-05-27T06:28:01.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.395+0000 7f32f2200640 1 -- 172.21.15.87:0/897933323 wait complete. 2024-05-27T06:28:01.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.399+0000 7f32f2200640 1 Processor -- start 2024-05-27T06:28:01.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.399+0000 7f32f2200640 1 -- start start 2024-05-27T06:28:01.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.399+0000 7f32f2200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32ec06d500 0x7f32ec09a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:01.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.399+0000 7f32f2200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32ec0cbf90 0x7f32ec1553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:01.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.399+0000 7f32f2200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f32ec15d520 0x7f32ec15b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:01.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.399+0000 7f32f2200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec15e170 con 0x7f32ec06d500 2024-05-27T06:28:01.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.399+0000 7f32f2200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec06caa0 con 0x7f32ec0cbf90 2024-05-27T06:28:01.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.399+0000 7f32f2200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f32ec0cc3a0 con 0x7f32ec15d520 2024-05-27T06:28:01.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.399+0000 7f32eb400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32ec06d500 0x7f32ec09a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:01.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.399+0000 7f32eb400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32ec06d500 0x7f32ec09a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38068/0 (socket says 172.21.15.87:38068) 2024-05-27T06:28:01.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.399+0000 7f32eb400640 1 -- 172.21.15.87:0/594288868 learned_addr learned my addr 172.21.15.87:0/594288868 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:01.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.399+0000 7f32e2a00640 1 --2- 172.21.15.87:0/594288868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32ec0cbf90 0x7f32ec1553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:01.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.403+0000 7f32ebe00640 1 --2- 172.21.15.87:0/594288868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f32ec15d520 0x7f32ec15b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:01.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.403+0000 7f32e2a00640 1 -- 172.21.15.87:0/594288868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f32ec15d520 msgr2=0x7f32ec15b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:01.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.403+0000 7f32e2a00640 1 --2- 172.21.15.87:0/594288868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f32ec15d520 0x7f32ec15b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:01.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.403+0000 7f32e2a00640 1 -- 172.21.15.87:0/594288868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32ec06d500 msgr2=0x7f32ec09a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:01.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.403+0000 7f32e2a00640 1 --2- 172.21.15.87:0/594288868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32ec06d500 0x7f32ec09a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:01.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.403+0000 7f32e2a00640 1 -- 172.21.15.87:0/594288868 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ec159390 con 0x7f32ec0cbf90 2024-05-27T06:28:01.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.403+0000 7f32eb400640 1 --2- 172.21.15.87:0/594288868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32ec06d500 0x7f32ec09a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:28:01.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.403+0000 7f32e2a00640 1 --2- 172.21.15.87:0/594288868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32ec0cbf90 0x7f32ec1553c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f32d40af000 tx=0x7f32d401ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:01.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.403+0000 7f32e3e00640 1 -- 172.21.15.87:0/594288868 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d40bf070 con 0x7f32ec0cbf90 2024-05-27T06:28:01.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.403+0000 7f32e3e00640 1 -- 172.21.15.87:0/594288868 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d40b0720 con 0x7f32ec0cbf90 2024-05-27T06:28:01.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.403+0000 7f32e3e00640 1 -- 172.21.15.87:0/594288868 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d40b5040 con 0x7f32ec0cbf90 2024-05-27T06:28:01.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.403+0000 7f32f2200640 1 -- 172.21.15.87:0/594288868 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32ec159670 con 0x7f32ec0cbf90 2024-05-27T06:28:01.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.403+0000 7f32f2200640 1 -- 172.21.15.87:0/594288868 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32ec159c30 con 0x7f32ec0cbf90 2024-05-27T06:28:01.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.403+0000 7f32f2200640 1 -- 172.21.15.87:0/594288868 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32ec06aa30 con 0x7f32ec0cbf90 2024-05-27T06:28:01.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.403+0000 7f32e3e00640 1 -- 172.21.15.87:0/594288868 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f32d40c2070 con 0x7f32ec0cbf90 2024-05-27T06:28:01.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.407+0000 7f32e3e00640 1 --2- 172.21.15.87:0/594288868 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f32c806f400 0x7f32c8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:01.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.407+0000 7f32e3e00640 1 -- 172.21.15.87:0/594288868 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f32d412bb30 con 0x7f32ec0cbf90 2024-05-27T06:28:01.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.407+0000 7f32eb400640 1 --2- 172.21.15.87:0/594288868 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f32c806f400 0x7f32c8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:01.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.407+0000 7f32eb400640 1 --2- 172.21.15.87:0/594288868 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f32c806f400 0x7f32c8071910 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009630 tx=0x7f32dc009240 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:01.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.411+0000 7f32e3e00640 1 -- 172.21.15.87:0/594288868 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f32d40187f0 con 0x7f32ec0cbf90 2024-05-27T06:28:01.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.607+0000 7f32f2200640 1 -- 172.21.15.87:0/594288868 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f32ec06f600 con 0x7f32ec0cbf90 2024-05-27T06:28:01.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.611+0000 7f32e3e00640 1 -- 172.21.15.87:0/594288868 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+179545 (secure 0 0 0) 0x7f32d40f8200 con 0x7f32ec0cbf90 2024-05-27T06:28:01.609 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:01.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.615+0000 7f32f2200640 1 -- 172.21.15.87:0/594288868 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f32c806f400 msgr2=0x7f32c8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:01.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.615+0000 7f32f2200640 1 --2- 172.21.15.87:0/594288868 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f32c806f400 0x7f32c8071910 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009630 tx=0x7f32dc009240 comp rx=0 tx=0).stop 2024-05-27T06:28:01.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.615+0000 7f32f2200640 1 -- 172.21.15.87:0/594288868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32ec0cbf90 msgr2=0x7f32ec1553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:01.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.615+0000 7f32f2200640 1 --2- 172.21.15.87:0/594288868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32ec0cbf90 0x7f32ec1553c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f32d40af000 tx=0x7f32d401ba30 comp rx=0 tx=0).stop 2024-05-27T06:28:01.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.615+0000 7f32f2200640 1 -- 172.21.15.87:0/594288868 shutdown_connections 2024-05-27T06:28:01.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.615+0000 7f32f2200640 1 --2- 172.21.15.87:0/594288868 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f32c806f400 0x7f32c8071910 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:01.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.615+0000 7f32f2200640 1 --2- 172.21.15.87:0/594288868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f32ec15d520 0x7f32ec15b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:01.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.615+0000 7f32f2200640 1 --2- 172.21.15.87:0/594288868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32ec0cbf90 0x7f32ec1553c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:01.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.615+0000 7f32f2200640 1 --2- 172.21.15.87:0/594288868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32ec06d500 0x7f32ec09a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:01.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.615+0000 7f32f2200640 1 -- 172.21.15.87:0/594288868 >> 172.21.15.87:0/594288868 conn(0x7f32ec0b46b0 msgr2=0x7f32ec0d1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:01.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.615+0000 7f32f2200640 1 -- 172.21.15.87:0/594288868 shutdown_connections 2024-05-27T06:28:01.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.615+0000 7f32f2200640 1 -- 172.21.15.87:0/594288868 wait complete. 2024-05-27T06:28:01.630 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":5,"flags":0,"active_gid":4111,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2724754260},{"type":"v1","addr":"172.21.15.87:6833","nonce":2724754260}]},"active_addr":"172.21.15.87:6833/2724754260","active_change":"2024-05-27T06:27:18.548462+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":3782972786}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":2065717019}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":2900333946}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":1915326745}]}]} 2024-05-27T06:28:01.633 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-27T06:28:01.634 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-27T06:28:01.634 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T06:28:01.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.783+0000 7fd224600640 1 Processor -- start 2024-05-27T06:28:01.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.787+0000 7fd224600640 1 -- start start 2024-05-27T06:28:01.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.787+0000 7fd224600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd21c072eb0 0x7fd21c0d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:01.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.787+0000 7fd224600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd21c0d1c80 0x7fd21c0ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:01.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.787+0000 7fd224600640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd21c0d2090 con 0x7fd21c072aa0 2024-05-27T06:28:01.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.787+0000 7fd224600640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fd21c0cdd30 con 0x7fd21c072eb0 2024-05-27T06:28:01.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.787+0000 7fd224600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd21c0cd120 con 0x7fd21c0d1c80 2024-05-27T06:28:01.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.787+0000 7fd221200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd21c072eb0 0x7fd21c0d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:01.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.787+0000 7fd221c00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd21c072aa0 0x7fd21c06d820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:58720/0 (socket says 172.21.15.87:58720) 2024-05-27T06:28:01.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.787+0000 7fd221c00640 1 -- 172.21.15.87:0/2804492658 learned_addr learned my addr 172.21.15.87:0/2804492658 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:01.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.787+0000 7fd222600640 1 --2- 172.21.15.87:0/2804492658 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd21c0d1c80 0x7fd21c0ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:01.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.787+0000 7fd221200640 1 -- 172.21.15.87:0/2804492658 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd21c0d1c80 msgr2=0x7fd21c0ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:01.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.787+0000 7fd221200640 1 --2- 172.21.15.87:0/2804492658 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd21c0d1c80 0x7fd21c0ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:01.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.787+0000 7fd221200640 1 -- 172.21.15.87:0/2804492658 >> v1:172.21.15.87:6789/0 conn(0x7fd21c072aa0 legacy=0x7fd21c06d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:01.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.787+0000 7fd221200640 1 -- 172.21.15.87:0/2804492658 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c0cd400 con 0x7fd21c072eb0 2024-05-27T06:28:01.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.787+0000 7fd21be00640 1 -- 172.21.15.87:0/2804492658 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1294832719 0 0) 0x7fd21c0d2090 con 0x7fd21c072aa0 2024-05-27T06:28:01.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.791+0000 7fd221200640 1 --2- 172.21.15.87:0/2804492658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd21c072eb0 0x7fd21c0d1740 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd2080097c0 tx=0x7fd20801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c59aec5d65c9870 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:01.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.791+0000 7fd21be00640 1 -- 172.21.15.87:0/2804492658 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2080a7070 con 0x7fd21c072eb0 2024-05-27T06:28:01.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.791+0000 7fd21be00640 1 -- 172.21.15.87:0/2804492658 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2080b0070 con 0x7fd21c072eb0 2024-05-27T06:28:01.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.791+0000 7fd21be00640 1 -- 172.21.15.87:0/2804492658 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2080ab890 con 0x7fd21c072eb0 2024-05-27T06:28:01.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.791+0000 7fd224600640 1 -- 172.21.15.87:0/2804492658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd21c072eb0 msgr2=0x7fd21c0d1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:01.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.791+0000 7fd224600640 1 --2- 172.21.15.87:0/2804492658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd21c072eb0 0x7fd21c0d1740 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd2080097c0 tx=0x7fd20801c470 comp rx=0 tx=0).stop 2024-05-27T06:28:01.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.791+0000 7fd224600640 1 -- 172.21.15.87:0/2804492658 shutdown_connections 2024-05-27T06:28:01.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.791+0000 7fd224600640 1 --2- 172.21.15.87:0/2804492658 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd21c0d1c80 0x7fd21c0ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:01.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.791+0000 7fd224600640 1 --2- 172.21.15.87:0/2804492658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd21c072eb0 0x7fd21c0d1740 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:01.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.791+0000 7fd224600640 1 -- 172.21.15.87:0/2804492658 >> 172.21.15.87:0/2804492658 conn(0x7fd21c0b46b0 msgr2=0x7fd21c0b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:01.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.791+0000 7fd224600640 1 -- 172.21.15.87:0/2804492658 shutdown_connections 2024-05-27T06:28:01.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.791+0000 7fd224600640 1 -- 172.21.15.87:0/2804492658 wait complete. 2024-05-27T06:28:01.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.795+0000 7fd224600640 1 Processor -- start 2024-05-27T06:28:01.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.795+0000 7fd224600640 1 -- start start 2024-05-27T06:28:01.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.795+0000 7fd224600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd21c072aa0 0x7fd21c14cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:01.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.795+0000 7fd224600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd21c072eb0 0x7fd21c0c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:01.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.795+0000 7fd224600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd21c0d1c80 0x7fd21c15e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:01.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.795+0000 7fd224600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c0cccb0 con 0x7fd21c072aa0 2024-05-27T06:28:01.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.795+0000 7fd224600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c06df30 con 0x7fd21c072eb0 2024-05-27T06:28:01.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.795+0000 7fd224600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd21c0cce30 con 0x7fd21c0d1c80 2024-05-27T06:28:01.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.795+0000 7fd221c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd21c072aa0 0x7fd21c14cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:01.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.795+0000 7fd221c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd21c072aa0 0x7fd21c14cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38090/0 (socket says 172.21.15.87:38090) 2024-05-27T06:28:01.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.795+0000 7fd221c00640 1 -- 172.21.15.87:0/231102096 learned_addr learned my addr 172.21.15.87:0/231102096 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:01.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.795+0000 7fd222600640 1 --2- 172.21.15.87:0/231102096 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd21c0d1c80 0x7fd21c15e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:01.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.795+0000 7fd221200640 1 --2- 172.21.15.87:0/231102096 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd21c072eb0 0x7fd21c0c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:01.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.795+0000 7fd221c00640 1 -- 172.21.15.87:0/231102096 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd21c0d1c80 msgr2=0x7fd21c15e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:01.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.795+0000 7fd221c00640 1 --2- 172.21.15.87:0/231102096 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd21c0d1c80 0x7fd21c15e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:01.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.795+0000 7fd221c00640 1 -- 172.21.15.87:0/231102096 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd21c072eb0 msgr2=0x7fd21c0c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:01.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.795+0000 7fd221c00640 1 --2- 172.21.15.87:0/231102096 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd21c072eb0 0x7fd21c0c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:01.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.795+0000 7fd221c00640 1 -- 172.21.15.87:0/231102096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c14d4c0 con 0x7fd21c072aa0 2024-05-27T06:28:01.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.795+0000 7fd221c00640 1 --2- 172.21.15.87:0/231102096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd21c072aa0 0x7fd21c14cf80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd21000c460 tx=0x7fd21000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:01.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.795+0000 7fd219600640 1 -- 172.21.15.87:0/231102096 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd210018070 con 0x7fd21c072aa0 2024-05-27T06:28:01.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.795+0000 7fd219600640 1 -- 172.21.15.87:0/231102096 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd210007500 con 0x7fd21c072aa0 2024-05-27T06:28:01.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.795+0000 7fd219600640 1 -- 172.21.15.87:0/231102096 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd210004a30 con 0x7fd21c072aa0 2024-05-27T06:28:01.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.795+0000 7fd224600640 1 -- 172.21.15.87:0/231102096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd21c0c9e70 con 0x7fd21c072aa0 2024-05-27T06:28:01.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.799+0000 7fd224600640 1 -- 172.21.15.87:0/231102096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd21c0ca430 con 0x7fd21c072aa0 2024-05-27T06:28:01.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.799+0000 7fd224600640 1 -- 172.21.15.87:0/231102096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd21c06aa30 con 0x7fd21c072aa0 2024-05-27T06:28:01.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.799+0000 7fd219600640 1 -- 172.21.15.87:0/231102096 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd210004bd0 con 0x7fd21c072aa0 2024-05-27T06:28:01.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.799+0000 7fd219600640 1 --2- 172.21.15.87:0/231102096 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd1fc06f400 0x7fd1fc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:01.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.799+0000 7fd219600640 1 -- 172.21.15.87:0/231102096 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd21008e8d0 con 0x7fd21c072aa0 2024-05-27T06:28:01.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.799+0000 7fd221200640 1 --2- 172.21.15.87:0/231102096 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd1fc06f400 0x7fd1fc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:01.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.799+0000 7fd221200640 1 --2- 172.21.15.87:0/231102096 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd1fc06f400 0x7fd1fc071910 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd2080af000 tx=0x7fd2080a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:01.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.803+0000 7fd219600640 1 -- 172.21.15.87:0/231102096 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fd21005ad90 con 0x7fd21c072aa0 2024-05-27T06:28:01.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.967+0000 7fd224600640 1 -- 172.21.15.87:0/231102096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd21c06dd10 con 0x7fd21c072aa0 2024-05-27T06:28:01.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.967+0000 7fd219600640 1 -- 172.21.15.87:0/231102096 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7fd21005f090 con 0x7fd21c072aa0 2024-05-27T06:28:01.963 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:01.963 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:27:43.048854+0000","last_up_change":"2024-05-27T06:27:25.988592+0000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T06:27:26.590191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T06:27:35.840893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T06:27:36.929608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-27T06:27:40.638358+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6801","nonce":3674824716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6803","nonce":3674824716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6807","nonce":3674824716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6805","nonce":3674824716}]},"public_addr":"172.21.15.87:6801/3674824716","cluster_addr":"172.21.15.87:6803/3674824716","heartbeat_back_addr":"172.21.15.87:6807/3674824716","heartbeat_front_addr":"172.21.15.87:6805/3674824716","state":["exists","up"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6809","nonce":2443981288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6811","nonce":2443981288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6815","nonce":2443981288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6813","nonce":2443981288}]},"public_addr":"172.21.15.87:6809/2443981288","cluster_addr":"172.21.15.87:6811/2443981288","heartbeat_back_addr":"172.21.15.87:6815/2443981288","heartbeat_front_addr":"172.21.15.87:6813/2443981288","state":["exists","up"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6819","nonce":1441249238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6823","nonce":1441249238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6831","nonce":1441249238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6825","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6827","nonce":1441249238}]},"public_addr":"172.21.15.87:6819/1441249238","cluster_addr":"172.21.15.87:6823/1441249238","heartbeat_back_addr":"172.21.15.87:6831/1441249238","heartbeat_front_addr":"172.21.15.87:6827/1441249238","state":["exists","up"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6818","nonce":1173805234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6822","nonce":1173805234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6829","nonce":1173805234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6826","nonce":1173805234}]},"public_addr":"172.21.15.87:6818/1173805234","cluster_addr":"172.21.15.87:6822/1173805234","heartbeat_back_addr":"172.21.15.87:6829/1173805234","heartbeat_front_addr":"172.21.15.87:6826/1173805234","state":["exists","up"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6819","nonce":1551871079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6823","nonce":1551871079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6831","nonce":1551871079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6827","nonce":1551871079}]},"public_addr":"172.21.15.149:6819/1551871079","cluster_addr":"172.21.15.149:6823/1551871079","heartbeat_back_addr":"172.21.15.149:6831/1551871079","heartbeat_front_addr":"172.21.15.149:6827/1551871079","state":["exists","up"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6818","nonce":582864816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6822","nonce":582864816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6830","nonce":582864816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6826","nonce":582864816}]},"public_addr":"172.21.15.149:6818/582864816","cluster_addr":"172.21.15.149:6822/582864816","heartbeat_back_addr":"172.21.15.149:6830/582864816","heartbeat_front_addr":"172.21.15.149:6826/582864816","state":["exists","up"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6801","nonce":531351314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6803","nonce":531351314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6807","nonce":531351314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6805","nonce":531351314}]},"public_addr":"172.21.15.149:6801/531351314","cluster_addr":"172.21.15.149:6803/531351314","heartbeat_back_addr":"172.21.15.149:6807/531351314","heartbeat_front_addr":"172.21.15.149:6805/531351314","state":["exists","up"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6809","nonce":1171039913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6811","nonce":1171039913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6815","nonce":1171039913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6813","nonce":1171039913}]},"public_addr":"172.21.15.149:6809/1171039913","cluster_addr":"172.21.15.149:6811/1171039913","heartbeat_back_addr":"172.21.15.149:6815/1171039913","heartbeat_front_addr":"172.21.15.149:6813/1171039913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.589776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.819787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.767566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.683842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.038885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.120319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.687007+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.812832+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:28:01.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.967+0000 7fd224600640 1 -- 172.21.15.87:0/231102096 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd1fc06f400 msgr2=0x7fd1fc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:01.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.967+0000 7fd224600640 1 --2- 172.21.15.87:0/231102096 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd1fc06f400 0x7fd1fc071910 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd2080af000 tx=0x7fd2080a7000 comp rx=0 tx=0).stop 2024-05-27T06:28:01.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.967+0000 7fd224600640 1 -- 172.21.15.87:0/231102096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd21c072aa0 msgr2=0x7fd21c14cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:01.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.967+0000 7fd224600640 1 --2- 172.21.15.87:0/231102096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd21c072aa0 0x7fd21c14cf80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd21000c460 tx=0x7fd21000c920 comp rx=0 tx=0).stop 2024-05-27T06:28:01.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.967+0000 7fd224600640 1 -- 172.21.15.87:0/231102096 shutdown_connections 2024-05-27T06:28:01.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.967+0000 7fd224600640 1 --2- 172.21.15.87:0/231102096 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd1fc06f400 0x7fd1fc071910 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:01.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.967+0000 7fd224600640 1 --2- 172.21.15.87:0/231102096 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd21c0d1c80 0x7fd21c15e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:01.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.967+0000 7fd224600640 1 --2- 172.21.15.87:0/231102096 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd21c072eb0 0x7fd21c0c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:01.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.967+0000 7fd224600640 1 --2- 172.21.15.87:0/231102096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd21c072aa0 0x7fd21c14cf80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:01.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.967+0000 7fd224600640 1 -- 172.21.15.87:0/231102096 >> 172.21.15.87:0/231102096 conn(0x7fd21c0b46b0 msgr2=0x7fd21c0ae430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:01.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.967+0000 7fd224600640 1 -- 172.21.15.87:0/231102096 shutdown_connections 2024-05-27T06:28:01.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:01.967+0000 7fd224600640 1 -- 172.21.15.87:0/231102096 wait complete. 2024-05-27T06:28:01.985 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-27T06:28:01.985 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T06:28:02.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.135+0000 7f694ba00640 1 Processor -- start 2024-05-27T06:28:02.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.135+0000 7f694ba00640 1 -- start start 2024-05-27T06:28:02.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.135+0000 7f694ba00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69440cea40 0x7f6944158360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.135+0000 7f694ba00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69440b2cd0 con 0x7f69440d2010 2024-05-27T06:28:02.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.135+0000 7f694ba00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69440cdc80 con 0x7f69440b2fb0 2024-05-27T06:28:02.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.135+0000 7f694ba00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f69440ce5b0 con 0x7f69440cea40 2024-05-27T06:28:02.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.135+0000 7f693be00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f69440d2010 0x7f69440d2420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:58734/0 (socket says 172.21.15.87:58734) 2024-05-27T06:28:02.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.135+0000 7f693be00640 1 -- 172.21.15.87:0/380074462 learned_addr learned my addr 172.21.15.87:0/380074462 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:02.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.135+0000 7f6949000640 1 --2- 172.21.15.87:0/380074462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69440cea40 0x7f6944158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f6943e00640 1 -- 172.21.15.87:0/380074462 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1345253235 0 0) 0x7f69440b2cd0 con 0x7f69440d2010 2024-05-27T06:28:02.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f6943e00640 1 -- 172.21.15.87:0/380074462 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6928003530 con 0x7f69440d2010 2024-05-27T06:28:02.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f6943e00640 1 -- 172.21.15.87:0/380074462 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 862279878 0 0) 0x7f69440cdc80 con 0x7f69440b2fb0 2024-05-27T06:28:02.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f6943e00640 1 -- 172.21.15.87:0/380074462 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69440b2cd0 con 0x7f69440b2fb0 2024-05-27T06:28:02.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f6943e00640 1 -- 172.21.15.87:0/380074462 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2226848208 0 0) 0x7f6928003530 con 0x7f69440d2010 2024-05-27T06:28:02.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f6943e00640 1 -- 172.21.15.87:0/380074462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69440cea40 msgr2=0x7f6944158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:02.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f6943e00640 1 --2- 172.21.15.87:0/380074462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69440cea40 0x7f6944158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f6943e00640 1 -- 172.21.15.87:0/380074462 >> v1:172.21.15.149:6789/0 conn(0x7f69440b2fb0 legacy=0x7f69440b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f6943e00640 1 -- 172.21.15.87:0/380074462 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69440cdf60 con 0x7f69440d2010 2024-05-27T06:28:02.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f6943e00640 1 -- 172.21.15.87:0/380074462 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7f692c001720 con 0x7f69440d2010 2024-05-27T06:28:02.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f6943e00640 1 -- 172.21.15.87:0/380074462 >> v1:172.21.15.87:6789/0 conn(0x7f69440d2010 legacy=0x7f69440d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f6943e00640 1 --2- 172.21.15.87:0/380074462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6928003c90 0x7f69280040e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f6943e00640 1 --2- 172.21.15.87:0/380074462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6928004810 0x7f6928004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f6943e00640 1 --2- 172.21.15.87:0/380074462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6928005290 0x7f692800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f6943e00640 1 -- 172.21.15.87:0/380074462 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f69440ce5b0 con 0x7f6928005290 2024-05-27T06:28:02.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f6943e00640 1 -- 172.21.15.87:0/380074462 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f692800c1f0 con 0x7f6928004810 2024-05-27T06:28:02.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f6943e00640 1 -- 172.21.15.87:0/380074462 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f692800c3f0 con 0x7f6928003c90 2024-05-27T06:28:02.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f6949000640 1 --2- 172.21.15.87:0/380074462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69440cea40 0x7f6944158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:28:02.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f6949a00640 1 --2- 172.21.15.87:0/380074462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6928005290 0x7f692800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f693be00640 1 --2- 172.21.15.87:0/380074462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6928004810 0x7f6928004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f6949000640 1 --2- 172.21.15.87:0/380074462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6928003c90 0x7f69280040e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f6949a00640 1 -- 172.21.15.87:0/380074462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6928003c90 msgr2=0x7f69280040e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:02.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f6949a00640 1 --2- 172.21.15.87:0/380074462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6928003c90 0x7f69280040e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f6949a00640 1 -- 172.21.15.87:0/380074462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6928004810 msgr2=0x7f6928004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:02.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f6949a00640 1 --2- 172.21.15.87:0/380074462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6928004810 0x7f6928004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f6949a00640 1 -- 172.21.15.87:0/380074462 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6928003530 con 0x7f6928005290 2024-05-27T06:28:02.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f6949000640 1 --2- 172.21.15.87:0/380074462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6928003c90 0x7f69280040e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:02.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.139+0000 7f693be00640 1 --2- 172.21.15.87:0/380074462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6928004810 0x7f6928004c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:02.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.143+0000 7f6949a00640 1 --2- 172.21.15.87:0/380074462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6928005290 0x7f692800b9d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f693c0020b0 tx=0x7f693c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8c0a1ff3ab1646 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.143+0000 7f6943e00640 1 -- 172.21.15.87:0/380074462 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c001c50 con 0x7f6928005290 2024-05-27T06:28:02.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.143+0000 7f6943e00640 1 -- 172.21.15.87:0/380074462 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f693c006d60 con 0x7f6928005290 2024-05-27T06:28:02.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.143+0000 7f6943e00640 1 -- 172.21.15.87:0/380074462 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c003bc0 con 0x7f6928005290 2024-05-27T06:28:02.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.143+0000 7f694ba00640 1 -- 172.21.15.87:0/380074462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6928005290 msgr2=0x7f692800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.143+0000 7f694ba00640 1 --2- 172.21.15.87:0/380074462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6928005290 0x7f692800b9d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f693c0020b0 tx=0x7f693c01c920 comp rx=0 tx=0).stop 2024-05-27T06:28:02.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.143+0000 7f6949a00640 1 -- 172.21.15.87:0/380074462 reap_dead start 2024-05-27T06:28:02.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.143+0000 7f694ba00640 1 -- 172.21.15.87:0/380074462 shutdown_connections 2024-05-27T06:28:02.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.143+0000 7f694ba00640 1 -- 172.21.15.87:0/380074462 >> 172.21.15.87:0/380074462 conn(0x7f69440d3590 msgr2=0x7f69440d39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:02.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.143+0000 7f694ba00640 1 -- 172.21.15.87:0/380074462 shutdown_connections 2024-05-27T06:28:02.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.143+0000 7f694ba00640 1 -- 172.21.15.87:0/380074462 wait complete. 2024-05-27T06:28:02.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.143+0000 7f694ba00640 1 Processor -- start 2024-05-27T06:28:02.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.143+0000 7f694ba00640 1 -- start start 2024-05-27T06:28:02.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.147+0000 7f694ba00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6928005290 0x7f694414baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.147+0000 7f694ba00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69440c7280 0x7f69440c7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.147+0000 7f694ba00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6944071440 0x7f6944071850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.147+0000 7f694ba00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f69440d2d60 con 0x7f6944071440 2024-05-27T06:28:02.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.147+0000 7f694ba00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f694415f350 con 0x7f69440c7280 2024-05-27T06:28:02.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.147+0000 7f694ba00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f69440d2ee0 con 0x7f6928005290 2024-05-27T06:28:02.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.147+0000 7f6949a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6944071440 0x7f6944071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.147+0000 7f6949a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6944071440 0x7f6944071850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38102/0 (socket says 172.21.15.87:38102) 2024-05-27T06:28:02.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.147+0000 7f6949a00640 1 -- 172.21.15.87:0/1635439144 learned_addr learned my addr 172.21.15.87:0/1635439144 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:02.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.147+0000 7f693be00640 1 --2- 172.21.15.87:0/1635439144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69440c7280 0x7f69440c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.147+0000 7f6949000640 1 --2- 172.21.15.87:0/1635439144 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6928005290 0x7f694414baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.147+0000 7f6949a00640 1 -- 172.21.15.87:0/1635439144 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6928005290 msgr2=0x7f694414baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.147+0000 7f6949a00640 1 --2- 172.21.15.87:0/1635439144 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6928005290 0x7f694414baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.147+0000 7f6949a00640 1 -- 172.21.15.87:0/1635439144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69440c7280 msgr2=0x7f69440c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.147+0000 7f6949a00640 1 --2- 172.21.15.87:0/1635439144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69440c7280 0x7f69440c7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.147+0000 7f6949a00640 1 -- 172.21.15.87:0/1635439144 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6944071d90 con 0x7f6944071440 2024-05-27T06:28:02.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.147+0000 7f693be00640 1 --2- 172.21.15.87:0/1635439144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69440c7280 0x7f69440c7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:02.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.147+0000 7f6949a00640 1 --2- 172.21.15.87:0/1635439144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6944071440 0x7f6944071850 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f693c005040 tx=0x7f6928005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.147+0000 7f6941600640 1 -- 172.21.15.87:0/1635439144 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c001c50 con 0x7f6944071440 2024-05-27T06:28:02.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.147+0000 7f6941600640 1 -- 172.21.15.87:0/1635439144 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f693c006b60 con 0x7f6944071440 2024-05-27T06:28:02.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.147+0000 7f694ba00640 1 -- 172.21.15.87:0/1635439144 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69440c7fd0 con 0x7f6944071440 2024-05-27T06:28:02.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.147+0000 7f6941600640 1 -- 172.21.15.87:0/1635439144 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c007da0 con 0x7f6944071440 2024-05-27T06:28:02.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.147+0000 7f694ba00640 1 -- 172.21.15.87:0/1635439144 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f694406f1b0 con 0x7f6944071440 2024-05-27T06:28:02.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.147+0000 7f694ba00640 1 -- 172.21.15.87:0/1635439144 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69440caac0 con 0x7f6944071440 2024-05-27T06:28:02.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.151+0000 7f6941600640 1 -- 172.21.15.87:0/1635439144 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f693c0a5510 con 0x7f6944071440 2024-05-27T06:28:02.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.151+0000 7f6941600640 1 --2- 172.21.15.87:0/1635439144 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f692006f430 0x7f6920071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.151+0000 7f6941600640 1 -- 172.21.15.87:0/1635439144 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f693c1291b0 con 0x7f6944071440 2024-05-27T06:28:02.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.151+0000 7f6949000640 1 --2- 172.21.15.87:0/1635439144 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f692006f430 0x7f6920071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.151+0000 7f6949000640 1 --2- 172.21.15.87:0/1635439144 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f692006f430 0x7f6920071940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f69440d1fe0 tx=0x7f6934008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.155+0000 7f6941600640 1 -- 172.21.15.87:0/1635439144 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f69440caac0 con 0x7f6944071440 2024-05-27T06:28:02.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.311+0000 7f694ba00640 1 -- 172.21.15.87:0/1635439144 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f69441562d0 con 0x7f6944071440 2024-05-27T06:28:02.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.315+0000 7f6941600640 1 -- 172.21.15.87:0/1635439144 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7f693c0be060 con 0x7f6944071440 2024-05-27T06:28:02.311 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:02.311 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:27:43.048854+0000","last_up_change":"2024-05-27T06:27:25.988592+0000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T06:27:26.590191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T06:27:35.840893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T06:27:36.929608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-27T06:27:40.638358+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6801","nonce":3674824716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6803","nonce":3674824716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6807","nonce":3674824716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6805","nonce":3674824716}]},"public_addr":"172.21.15.87:6801/3674824716","cluster_addr":"172.21.15.87:6803/3674824716","heartbeat_back_addr":"172.21.15.87:6807/3674824716","heartbeat_front_addr":"172.21.15.87:6805/3674824716","state":["exists","up"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6809","nonce":2443981288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6811","nonce":2443981288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6815","nonce":2443981288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6813","nonce":2443981288}]},"public_addr":"172.21.15.87:6809/2443981288","cluster_addr":"172.21.15.87:6811/2443981288","heartbeat_back_addr":"172.21.15.87:6815/2443981288","heartbeat_front_addr":"172.21.15.87:6813/2443981288","state":["exists","up"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6819","nonce":1441249238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6823","nonce":1441249238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6831","nonce":1441249238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6825","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6827","nonce":1441249238}]},"public_addr":"172.21.15.87:6819/1441249238","cluster_addr":"172.21.15.87:6823/1441249238","heartbeat_back_addr":"172.21.15.87:6831/1441249238","heartbeat_front_addr":"172.21.15.87:6827/1441249238","state":["exists","up"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6818","nonce":1173805234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6822","nonce":1173805234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6829","nonce":1173805234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6826","nonce":1173805234}]},"public_addr":"172.21.15.87:6818/1173805234","cluster_addr":"172.21.15.87:6822/1173805234","heartbeat_back_addr":"172.21.15.87:6829/1173805234","heartbeat_front_addr":"172.21.15.87:6826/1173805234","state":["exists","up"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6819","nonce":1551871079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6823","nonce":1551871079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6831","nonce":1551871079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6827","nonce":1551871079}]},"public_addr":"172.21.15.149:6819/1551871079","cluster_addr":"172.21.15.149:6823/1551871079","heartbeat_back_addr":"172.21.15.149:6831/1551871079","heartbeat_front_addr":"172.21.15.149:6827/1551871079","state":["exists","up"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6818","nonce":582864816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6822","nonce":582864816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6830","nonce":582864816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6826","nonce":582864816}]},"public_addr":"172.21.15.149:6818/582864816","cluster_addr":"172.21.15.149:6822/582864816","heartbeat_back_addr":"172.21.15.149:6830/582864816","heartbeat_front_addr":"172.21.15.149:6826/582864816","state":["exists","up"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6801","nonce":531351314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6803","nonce":531351314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6807","nonce":531351314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6805","nonce":531351314}]},"public_addr":"172.21.15.149:6801/531351314","cluster_addr":"172.21.15.149:6803/531351314","heartbeat_back_addr":"172.21.15.149:6807/531351314","heartbeat_front_addr":"172.21.15.149:6805/531351314","state":["exists","up"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6809","nonce":1171039913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6811","nonce":1171039913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6815","nonce":1171039913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6813","nonce":1171039913}]},"public_addr":"172.21.15.149:6809/1171039913","cluster_addr":"172.21.15.149:6811/1171039913","heartbeat_back_addr":"172.21.15.149:6815/1171039913","heartbeat_front_addr":"172.21.15.149:6813/1171039913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.589776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.819787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.767566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.683842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.038885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.120319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.687007+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.812832+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:28:02.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.315+0000 7f694ba00640 1 -- 172.21.15.87:0/1635439144 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f692006f430 msgr2=0x7f6920071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.315+0000 7f694ba00640 1 --2- 172.21.15.87:0/1635439144 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f692006f430 0x7f6920071940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f69440d1fe0 tx=0x7f6934008040 comp rx=0 tx=0).stop 2024-05-27T06:28:02.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.315+0000 7f694ba00640 1 -- 172.21.15.87:0/1635439144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6944071440 msgr2=0x7f6944071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.315+0000 7f694ba00640 1 --2- 172.21.15.87:0/1635439144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6944071440 0x7f6944071850 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f693c005040 tx=0x7f6928005840 comp rx=0 tx=0).stop 2024-05-27T06:28:02.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.315+0000 7f694ba00640 1 -- 172.21.15.87:0/1635439144 shutdown_connections 2024-05-27T06:28:02.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.315+0000 7f694ba00640 1 --2- 172.21.15.87:0/1635439144 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f692006f430 0x7f6920071940 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.315+0000 7f694ba00640 1 --2- 172.21.15.87:0/1635439144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6944071440 0x7f6944071850 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.315+0000 7f694ba00640 1 --2- 172.21.15.87:0/1635439144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69440c7280 0x7f69440c7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.315+0000 7f694ba00640 1 --2- 172.21.15.87:0/1635439144 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6928005290 0x7f694414baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.315+0000 7f694ba00640 1 -- 172.21.15.87:0/1635439144 >> 172.21.15.87:0/1635439144 conn(0x7f69440d3590 msgr2=0x7f69440b7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:02.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.315+0000 7f694ba00640 1 -- 172.21.15.87:0/1635439144 shutdown_connections 2024-05-27T06:28:02.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.315+0000 7f694ba00640 1 -- 172.21.15.87:0/1635439144 wait complete. 2024-05-27T06:28:02.332 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-27T06:28:02.333 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-27T06:28:02.333 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-27T06:28:02.333 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-27T06:28:02.334 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-27T06:28:02.334 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-27T06:28:02.334 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-27T06:28:02.335 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-27T06:28:02.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.607+0000 7fa6d8a00640 1 Processor -- start 2024-05-27T06:28:02.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.607+0000 7f2efe200640 1 Processor -- start 2024-05-27T06:28:02.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.607+0000 7f2efe200640 1 -- start start 2024-05-27T06:28:02.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.611+0000 7f2efe200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ef8164060 0x7f2ef80d07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.607+0000 7fa6d8a00640 1 -- start start 2024-05-27T06:28:02.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.611+0000 7fa6d8a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa6d406daf0 0x7fa6d41640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.611+0000 7f2efe200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ef806d640 con 0x7f2ef80c4340 2024-05-27T06:28:02.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.611+0000 7f2efe200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ef806d920 con 0x7f2ef806ea20 2024-05-27T06:28:02.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.611+0000 7fa6d8a00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6d40d07a0 con 0x7fa6d406cb00 2024-05-27T06:28:02.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.611+0000 7f2efe200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2ef8164470 con 0x7f2ef8164060 2024-05-27T06:28:02.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.611+0000 7fa6d8a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6d40d0a80 con 0x7fa6d40cdc40 2024-05-27T06:28:02.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.611+0000 7fa6d1400640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fa6d40cdc40 0x7fa6d40ce050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.87:47564/0 (socket says 172.21.15.87:47564) 2024-05-27T06:28:02.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.611+0000 7fa6d1400640 1 -- 172.21.15.87:0/1437753751 learned_addr learned my addr 172.21.15.87:0/1437753751 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:02.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.611+0000 7f2efd800640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2ef806ea20 0x7f2ef806ee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.87:47562/0 (socket says 172.21.15.87:47562) 2024-05-27T06:28:02.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.611+0000 7f2efd800640 1 -- 172.21.15.87:0/745809794 learned_addr learned my addr 172.21.15.87:0/745809794 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:02.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.611+0000 7fa6d8a00640 1 -- 172.21.15.87:0/1437753751 --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fa6d40d0d60 con 0x7fa6d406daf0 2024-05-27T06:28:02.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.611+0000 7f2efce00640 1 --2- 172.21.15.87:0/745809794 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ef8164060 0x7f2ef80d07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.611+0000 7f2ef7400640 1 -- 172.21.15.87:0/745809794 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3084178781 0 0) 0x7f2ef806d920 con 0x7f2ef806ea20 2024-05-27T06:28:02.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.611+0000 7f2ef7400640 1 -- 172.21.15.87:0/745809794 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2edc003530 con 0x7f2ef806ea20 2024-05-27T06:28:02.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.611+0000 7f2ef7400640 1 -- 172.21.15.87:0/745809794 <== mon.1 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4220321587 0 0) 0x7f2edc003530 con 0x7f2ef806ea20 2024-05-27T06:28:02.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.611+0000 7f2efce00640 1 -- 172.21.15.87:0/745809794 >> v1:172.21.15.149:6789/0 conn(0x7f2ef806ea20 legacy=0x7f2ef806ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.611+0000 7fa6d1e00640 1 --2- 172.21.15.87:0/1437753751 >> v2:172.21.15.87:3300/0 conn(0x7fa6d406daf0 0x7fa6d41640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.611+0000 7fa6d0a00640 1 -- 172.21.15.87:0/1437753751 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3491054743 0 0) 0x7fa6d40d0a80 con 0x7fa6d40cdc40 2024-05-27T06:28:02.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.611+0000 7fa6d0a00640 1 -- 172.21.15.87:0/1437753751 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6b8003530 con 0x7fa6d40cdc40 2024-05-27T06:28:02.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.615+0000 7fa6d0a00640 1 -- 172.21.15.87:0/1437753751 <== mon.1 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4012225314 0 0) 0x7fa6b8003530 con 0x7fa6d40cdc40 2024-05-27T06:28:02.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.615+0000 7fa6d0a00640 1 -- 172.21.15.87:0/1437753751 >> v2:172.21.15.87:3300/0 conn(0x7fa6d406daf0 msgr2=0x7fa6d41640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:02.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.611+0000 7f2efce00640 1 -- 172.21.15.87:0/745809794 >> v1:172.21.15.87:6789/0 conn(0x7f2ef80c4340 legacy=0x7f2ef80c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:02.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.611+0000 7f2efce00640 1 -- 172.21.15.87:0/745809794 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef806dc00 con 0x7f2ef8164060 2024-05-27T06:28:02.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.615+0000 7fa6d0a00640 1 --2- 172.21.15.87:0/1437753751 >> v2:172.21.15.87:3300/0 conn(0x7fa6d406daf0 0x7fa6d41640e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.615+0000 7fc95ee00640 1 Processor -- start 2024-05-27T06:28:02.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.615+0000 7fa6d0a00640 1 -- 172.21.15.87:0/1437753751 >> v1:172.21.15.87:6789/0 conn(0x7fa6d406cb00 legacy=0x7fa6d406cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.615+0000 7fa6d0a00640 1 -- 172.21.15.87:0/1437753751 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d40d0450 con 0x7fa6d40cdc40 2024-05-27T06:28:02.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.615+0000 7fa6d0a00640 1 -- 172.21.15.87:0/1437753751 <== mon.1 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7fa6c0001700 con 0x7fa6d40cdc40 2024-05-27T06:28:02.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.615+0000 7fa6d1e00640 1 --2- 172.21.15.87:0/1437753751 >> v2:172.21.15.87:3300/0 conn(0x7fa6d406daf0 0x7fa6d41640e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:28:02.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.615+0000 7fa6d0a00640 1 -- 172.21.15.87:0/1437753751 >> v1:172.21.15.149:6789/0 conn(0x7fa6d40cdc40 legacy=0x7fa6d40ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.615+0000 7fa6d0a00640 1 --2- 172.21.15.87:0/1437753751 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6b8003a60 0x7fa6b8003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.615+0000 7fa6d0a00640 1 --2- 172.21.15.87:0/1437753751 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6b8004810 0x7fa6b8004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.615+0000 7fa6d0a00640 1 --2- 172.21.15.87:0/1437753751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6b8005360 0x7fa6b800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.615+0000 7fa6d0a00640 1 -- 172.21.15.87:0/1437753751 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d40d0d60 con 0x7fa6b8003a60 2024-05-27T06:28:02.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.615+0000 7fa6d0a00640 1 -- 172.21.15.87:0/1437753751 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b800c260 con 0x7fa6b8005360 2024-05-27T06:28:02.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.615+0000 7fa6d0a00640 1 -- 172.21.15.87:0/1437753751 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa6b800c460 con 0x7fa6b8004810 2024-05-27T06:28:02.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.615+0000 7fa6d2800640 1 --2- 172.21.15.87:0/1437753751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6b8005360 0x7fa6b800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.615+0000 7fa6d1e00640 1 --2- 172.21.15.87:0/1437753751 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6b8003a60 0x7fa6b8003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.615+0000 7fc95ee00640 1 -- start start 2024-05-27T06:28:02.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.615+0000 7fc95ee00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc958167cd0 0x7fc9581680e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.615+0000 7fc95ee00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc95806c7b0 0x7fc95806cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.619+0000 7fc95ee00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc958073c70 con 0x7fc9580d08f0 2024-05-27T06:28:02.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.619+0000 7fc94f400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc958167cd0 0x7fc9581680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.619+0000 7fc94f400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc958167cd0 0x7fc9581680e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38122/0 (socket says 172.21.15.87:38122) 2024-05-27T06:28:02.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.619+0000 7fc94f400640 1 -- 172.21.15.87:0/2265270092 learned_addr learned my addr 172.21.15.87:0/2265270092 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:02.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.619+0000 7fc95ee00640 1 -- 172.21.15.87:0/2265270092 --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fc958070700 con 0x7fc958167cd0 2024-05-27T06:28:02.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.619+0000 7fc95ee00640 1 -- 172.21.15.87:0/2265270092 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc958168620 con 0x7fc95806c7b0 2024-05-27T06:28:02.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.619+0000 7fc95ce00640 1 --2- 172.21.15.87:0/2265270092 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc95806c7b0 0x7fc95806cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.615+0000 7fa6d1400640 1 --2- 172.21.15.87:0/1437753751 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6b8004810 0x7fa6b8004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.619+0000 7fa6d2800640 1 -- 172.21.15.87:0/1437753751 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6b8004810 msgr2=0x7fa6b8004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:02.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.619+0000 7fa6d2800640 1 --2- 172.21.15.87:0/1437753751 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6b8004810 0x7fa6b8004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.619+0000 7fa6d2800640 1 -- 172.21.15.87:0/1437753751 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6b8003a60 msgr2=0x7fa6b8003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:02.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.619+0000 7fa6d2800640 1 --2- 172.21.15.87:0/1437753751 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6b8003a60 0x7fa6b8003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.619+0000 7fa6d2800640 1 -- 172.21.15.87:0/1437753751 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6b8003530 con 0x7fa6b8005360 2024-05-27T06:28:02.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.619+0000 7f723b000640 1 Processor -- start 2024-05-27T06:28:02.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.619+0000 7f723b000640 1 -- start start 2024-05-27T06:28:02.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.619+0000 7f2efce00640 1 --2- 172.21.15.87:0/745809794 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ef8164060 0x7f2ef80d07d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009770 tx=0x7f2ee401c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b193c6b9f39158 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.619+0000 7fc95ce00640 1 -- 172.21.15.87:0/2265270092 >> v2:172.21.15.87:3300/0 conn(0x7fc958167cd0 msgr2=0x7fc9581680e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:02.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.619+0000 7fc95ce00640 1 --2- 172.21.15.87:0/2265270092 >> v2:172.21.15.87:3300/0 conn(0x7fc958167cd0 0x7fc9581680e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.619+0000 7fc95ce00640 1 -- 172.21.15.87:0/2265270092 >> v1:172.21.15.87:6789/0 conn(0x7fc9580d08f0 legacy=0x7fc958073480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:02.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.619+0000 7fc95ce00640 1 -- 172.21.15.87:0/2265270092 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95806fdd0 con 0x7fc95806c7b0 2024-05-27T06:28:02.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7f2ef7400640 1 -- 172.21.15.87:0/745809794 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee40b0070 con 0x7f2ef8164060 2024-05-27T06:28:02.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7f2ef7400640 1 -- 172.21.15.87:0/745809794 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee40ab400 con 0x7f2ef8164060 2024-05-27T06:28:02.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7f2ef7400640 1 -- 172.21.15.87:0/745809794 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee40b0070 con 0x7f2ef8164060 2024-05-27T06:28:02.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7f723b000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f72340b51d0 0x7f723406c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7f2efe200640 1 -- 172.21.15.87:0/745809794 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ef8164060 msgr2=0x7f2ef80d07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7f2efe200640 1 --2- 172.21.15.87:0/745809794 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ef8164060 0x7f2ef80d07d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009770 tx=0x7f2ee401c350 comp rx=0 tx=0).stop 2024-05-27T06:28:02.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7fa6d2800640 1 -- 172.21.15.87:0/1437753751 reap_dead start 2024-05-27T06:28:02.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7f723a600640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f723415cc60 0x7f723415fd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:58776/0 (socket says 172.21.15.87:58776) 2024-05-27T06:28:02.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7f97f1400640 1 Processor -- start 2024-05-27T06:28:02.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7f97f1400640 1 -- start start 2024-05-27T06:28:02.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7f723a600640 1 -- 172.21.15.87:0/50617936 learned_addr learned my addr 172.21.15.87:0/50617936 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:02.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7f2efe200640 1 -- 172.21.15.87:0/745809794 shutdown_connections 2024-05-27T06:28:02.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7fa6d2800640 1 --2- 172.21.15.87:0/1437753751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6b8005360 0x7fa6b800b9d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa6d40ced10 tx=0x7fa6cc01c710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=104bafa770c3cf49 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7f2efe200640 1 --2- 172.21.15.87:0/745809794 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ef8164060 0x7f2ef80d07d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7f2efe200640 1 -- 172.21.15.87:0/745809794 >> 172.21.15.87:0/745809794 conn(0x7f2ef80d1370 msgr2=0x7f2ef80d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:02.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7fa6d0a00640 1 -- 172.21.15.87:0/1437753751 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc001ae0 con 0x7fa6b8005360 2024-05-27T06:28:02.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7fa6d0a00640 1 -- 172.21.15.87:0/1437753751 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6cc003b80 con 0x7fa6b8005360 2024-05-27T06:28:02.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7fc95ce00640 1 --2- 172.21.15.87:0/2265270092 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc95806c7b0 0x7fc95806cbc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc950009d90 tx=0x7fc95001c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2aaba9d62d8848ed server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7f723b000640 1 -- 172.21.15.87:0/50617936 --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72340b55e0 con 0x7f723415cc60 2024-05-27T06:28:02.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7f723b000640 1 -- 172.21.15.87:0/50617936 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7234070910 con 0x7f723406cc60 2024-05-27T06:28:02.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7f7239c00640 1 --2- 172.21.15.87:0/50617936 >> v2:172.21.15.87:3300/0 conn(0x7f72340b51d0 0x7f723406c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7f723b000640 1 -- 172.21.15.87:0/50617936 --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f7234070bf0 con 0x7f72340b51d0 2024-05-27T06:28:02.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7f2efe200640 1 -- 172.21.15.87:0/745809794 shutdown_connections 2024-05-27T06:28:02.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7f7233e00640 1 -- 172.21.15.87:0/50617936 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1086696426 0 0) 0x7f7234070910 con 0x7f723406cc60 2024-05-27T06:28:02.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7f7233e00640 1 -- 172.21.15.87:0/50617936 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f721c003530 con 0x7f723406cc60 2024-05-27T06:28:02.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7fc957400640 1 -- 172.21.15.87:0/2265270092 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9500a8640 con 0x7fc95806c7b0 2024-05-27T06:28:02.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7fc957400640 1 -- 172.21.15.87:0/2265270092 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9500a87e0 con 0x7fc95806c7b0 2024-05-27T06:28:02.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7fc957400640 1 -- 172.21.15.87:0/2265270092 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9500a8bb0 con 0x7fc95806c7b0 2024-05-27T06:28:02.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7f2efe200640 1 -- 172.21.15.87:0/745809794 wait complete. 2024-05-27T06:28:02.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7f97f1400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f97ec0b7f00 0x7f97ec15ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7f97f1400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f97ec0d2050 0x7f97ec0d2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.623+0000 7f97f1400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97ec0ceed0 0x7f97ec0cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f946da00640 1 Processor -- start 2024-05-27T06:28:02.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7fa6d8a00640 1 -- 172.21.15.87:0/1437753751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6b8005360 msgr2=0x7fa6b800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7fa6d8a00640 1 --2- 172.21.15.87:0/1437753751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6b8005360 0x7fa6b800b9d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa6d40ced10 tx=0x7fa6cc01c710 comp rx=0 tx=0).stop 2024-05-27T06:28:02.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f7233e00640 1 -- 172.21.15.87:0/50617936 <== mon.1 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 898007933 0 0) 0x7f721c003530 con 0x7f723406cc60 2024-05-27T06:28:02.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f7233e00640 1 -- 172.21.15.87:0/50617936 >> v2:172.21.15.87:3300/0 conn(0x7f72340b51d0 msgr2=0x7f723406c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:02.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7fa6d8a00640 1 -- 172.21.15.87:0/1437753751 shutdown_connections 2024-05-27T06:28:02.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7fa6d8a00640 1 --2- 172.21.15.87:0/1437753751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6b8005360 0x7fa6b800b9d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7fa6d8a00640 1 -- 172.21.15.87:0/1437753751 >> 172.21.15.87:0/1437753751 conn(0x7fa6d40b4850 msgr2=0x7fa6d40b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:02.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7fa6d8a00640 1 -- 172.21.15.87:0/1437753751 shutdown_connections 2024-05-27T06:28:02.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f7233e00640 1 --2- 172.21.15.87:0/50617936 >> v2:172.21.15.87:3300/0 conn(0x7f72340b51d0 0x7f723406c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f7233e00640 1 -- 172.21.15.87:0/50617936 >> v1:172.21.15.87:6789/0 conn(0x7f723415cc60 legacy=0x7f723415fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f7233e00640 1 -- 172.21.15.87:0/50617936 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72340b46f0 con 0x7f723406cc60 2024-05-27T06:28:02.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f7233e00640 1 -- 172.21.15.87:0/50617936 <== mon.1 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7f7220001700 con 0x7f723406cc60 2024-05-27T06:28:02.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f7233e00640 1 -- 172.21.15.87:0/50617936 >> v1:172.21.15.149:6789/0 conn(0x7f723406cc60 legacy=0x7f723415f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f7233e00640 1 --2- 172.21.15.87:0/50617936 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f721c0042f0 0x7f721c0037b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f7233e00640 1 --2- 172.21.15.87:0/50617936 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f721c004810 0x7f721c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f7233e00640 1 --2- 172.21.15.87:0/50617936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f721c0052b0 0x7f721c00cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f97ebe00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f97ec0b7f00 0x7f97ec15ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f97ebe00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f97ec0b7f00 0x7f97ec15ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38130/0 (socket says 172.21.15.87:38130) 2024-05-27T06:28:02.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f97f1400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f97ec158430 con 0x7f97ec0b7f00 2024-05-27T06:28:02.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f97f1400640 1 -- 172.21.15.87:0/1074547806 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f97ec0b8310 con 0x7f97ec0d2050 2024-05-27T06:28:02.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f97ebe00640 1 -- 172.21.15.87:0/1074547806 learned_addr learned my addr 172.21.15.87:0/1074547806 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:02.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f97f1400640 1 -- 172.21.15.87:0/1074547806 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f97ec0d29a0 con 0x7f97ec0ceed0 2024-05-27T06:28:02.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f97eb400640 1 --2- 172.21.15.87:0/1074547806 >> v2:172.21.15.149:3300/0 conn(0x7f97ec0d2050 0x7f97ec0d2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f946da00640 1 -- start start 2024-05-27T06:28:02.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7fa6d8a00640 1 -- 172.21.15.87:0/1437753751 wait complete. 2024-05-27T06:28:02.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f7233e00640 1 -- 172.21.15.87:0/50617936 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7234070bf0 con 0x7f721c0052b0 2024-05-27T06:28:02.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f7233e00640 1 -- 172.21.15.87:0/50617936 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f721c00d350 con 0x7f721c004810 2024-05-27T06:28:02.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f7233e00640 1 -- 172.21.15.87:0/50617936 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f721c005a20 con 0x7f721c0042f0 2024-05-27T06:28:02.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f723a600640 1 --2- 172.21.15.87:0/50617936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f721c0052b0 0x7f721c00cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f9fb6000640 1 Processor -- start 2024-05-27T06:28:02.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f9fb6000640 1 -- start start 2024-05-27T06:28:02.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f97f0a00640 1 --2- 172.21.15.87:0/1074547806 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97ec0ceed0 0x7f97ec0cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f7239c00640 1 --2- 172.21.15.87:0/50617936 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f721c0042f0 0x7f721c0037b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f7239200640 1 --2- 172.21.15.87:0/50617936 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f721c004810 0x7f721c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f97ebe00640 1 -- 172.21.15.87:0/1074547806 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97ec0ceed0 msgr2=0x7f97ec0cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:02.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f97ebe00640 1 --2- 172.21.15.87:0/1074547806 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97ec0ceed0 0x7f97ec0cf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f97ebe00640 1 -- 172.21.15.87:0/1074547806 >> v2:172.21.15.149:3300/0 conn(0x7f97ec0d2050 msgr2=0x7f97ec0d2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:02.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f97ebe00640 1 --2- 172.21.15.87:0/1074547806 >> v2:172.21.15.149:3300/0 conn(0x7f97ec0d2050 0x7f97ec0d2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f97ebe00640 1 -- 172.21.15.87:0/1074547806 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97ec0ce990 con 0x7f97ec0b7f00 2024-05-27T06:28:02.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f723a600640 1 -- 172.21.15.87:0/50617936 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f721c0042f0 msgr2=0x7f721c0037b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:02.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f723a600640 1 --2- 172.21.15.87:0/50617936 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f721c0042f0 0x7f721c0037b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f723a600640 1 -- 172.21.15.87:0/50617936 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f721c004810 msgr2=0x7f721c004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:02.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f723a600640 1 --2- 172.21.15.87:0/50617936 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f721c004810 0x7f721c004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7fd691c00640 1 Processor -- start 2024-05-27T06:28:02.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f946da00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94680d45a0 0x7f94680d49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7fa6d8a00640 1 Processor -- start 2024-05-27T06:28:02.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fa6d8a00640 1 -- start start 2024-05-27T06:28:02.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fa6d8a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6b8005360 0x7fa6d41527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fa6d8a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6d415c2b0 0x7fa6d4166f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fa6d8a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6d41553e0 0x7fa6d41674b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fa6d8a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d41640e0 con 0x7fa6b8005360 2024-05-27T06:28:02.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fa6d8a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d406e110 con 0x7fa6d415c2b0 2024-05-27T06:28:02.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fa6d8a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa6d4164260 con 0x7fa6d41553e0 2024-05-27T06:28:02.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fc95ee00640 1 -- 172.21.15.87:0/2265270092 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc95806c7b0 msgr2=0x7fc95806cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fc95ee00640 1 --2- 172.21.15.87:0/2265270092 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc95806c7b0 0x7fc95806cbc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc950009d90 tx=0x7fc95001c790 comp rx=0 tx=0).stop 2024-05-27T06:28:02.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fc95ee00640 1 -- 172.21.15.87:0/2265270092 shutdown_connections 2024-05-27T06:28:02.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fc95ee00640 1 --2- 172.21.15.87:0/2265270092 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc95806c7b0 0x7fc95806cbc0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fc95ee00640 1 --2- 172.21.15.87:0/2265270092 >> v2:172.21.15.87:3300/0 conn(0x7fc958167cd0 0x7fc9581680e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fc95ee00640 1 -- 172.21.15.87:0/2265270092 >> 172.21.15.87:0/2265270092 conn(0x7fc9580b2fb0 msgr2=0x7fc9580b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:02.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fc95ee00640 1 -- 172.21.15.87:0/2265270092 shutdown_connections 2024-05-27T06:28:02.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7f723a600640 1 -- 172.21.15.87:0/50617936 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72340b46f0 con 0x7f721c0052b0 2024-05-27T06:28:02.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f7239c00640 1 --2- 172.21.15.87:0/50617936 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f721c0042f0 0x7f721c0037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:02.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f9fb6000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9fb00d08f0 0x7f9fb0073480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f9fb6000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9fb0167cd0 0x7f9fb01680e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f9fb6000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fb01646e0 0x7f9fb0164af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f9fb6000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f9fb0070700 con 0x7f9fb00d08f0 2024-05-27T06:28:02.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f9fb6000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f9fb0073c70 con 0x7f9fb0167cd0 2024-05-27T06:28:02.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f9fb6000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9fb0168620 con 0x7f9fb01646e0 2024-05-27T06:28:02.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f9fafe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fb01646e0 0x7f9fb0164af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f9faf400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9fb00d08f0 0x7f9fb0073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f9fafe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fb01646e0 0x7f9fb0164af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.87:44994/0 (socket says 172.21.15.87:44994) 2024-05-27T06:28:02.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f9fafe00640 1 -- 172.21.15.87:0/2962461932 learned_addr learned my addr 172.21.15.87:0/2962461932 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:02.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f9faea00640 1 --2- 172.21.15.87:0/2962461932 >> v2:172.21.15.149:3300/0 conn(0x7f9fb0167cd0 0x7f9fb01680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f9fafe00640 1 -- 172.21.15.87:0/2962461932 >> v2:172.21.15.149:3300/0 conn(0x7f9fb0167cd0 msgr2=0x7f9fb01680e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:02.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f9fafe00640 1 --2- 172.21.15.87:0/2962461932 >> v2:172.21.15.149:3300/0 conn(0x7f9fb0167cd0 0x7f9fb01680e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f9fafe00640 1 -- 172.21.15.87:0/2962461932 >> v2:172.21.15.87:3300/0 conn(0x7f9fb00d08f0 msgr2=0x7f9fb0073480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:02.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f9fafe00640 1 --2- 172.21.15.87:0/2962461932 >> v2:172.21.15.87:3300/0 conn(0x7f9fb00d08f0 0x7f9fb0073480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f9fafe00640 1 -- 172.21.15.87:0/2962461932 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb00739c0 con 0x7f9fb01646e0 2024-05-27T06:28:02.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f9faea00640 1 --2- 172.21.15.87:0/2962461932 >> v2:172.21.15.149:3300/0 conn(0x7f9fb0167cd0 0x7f9fb01680e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:02.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f9467e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f94680d0b00 0x7f9468163e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.87:47576/0 (socket says 172.21.15.87:47576) 2024-05-27T06:28:02.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f9467400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94680d45a0 0x7f94680d49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f9467400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94680d45a0 0x7f94680d49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.87:44992/0 (socket says 172.21.15.87:44992) 2024-05-27T06:28:02.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f9467e00640 1 -- 172.21.15.87:0/1880528255 learned_addr learned my addr 172.21.15.87:0/1880528255 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:02.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f946da00640 1 -- 172.21.15.87:0/1880528255 --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94680d4ef0 con 0x7f94680b9360 2024-05-27T06:28:02.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f946da00640 1 -- 172.21.15.87:0/1880528255 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f946809d490 con 0x7f94680d0b00 2024-05-27T06:28:02.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f946da00640 1 -- 172.21.15.87:0/1880528255 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f94680d1df0 con 0x7f94680d45a0 2024-05-27T06:28:02.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f9466a00640 1 -- 172.21.15.87:0/1880528255 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4088251442 0 0) 0x7f946809d490 con 0x7f94680d0b00 2024-05-27T06:28:02.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.627+0000 7fd691c00640 1 -- start start 2024-05-27T06:28:02.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fa6d2800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6d41553e0 0x7fa6d41674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fa6d2800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6d41553e0 0x7fa6d41674b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.87:44996/0 (socket says 172.21.15.87:44996) 2024-05-27T06:28:02.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fa6d2800640 1 -- 172.21.15.87:0/861038122 learned_addr learned my addr 172.21.15.87:0/861038122 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:02.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f9466a00640 1 -- 172.21.15.87:0/1880528255 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f944c003530 con 0x7f94680d0b00 2024-05-27T06:28:02.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fd691c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd68c167cd0 0x7fd68c1680e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fd691c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd68c06c7b0 0x7fd68c06cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fd691c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd68c073c70 con 0x7fd68c0d08f0 2024-05-27T06:28:02.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fd691c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fd68c070700 con 0x7fd68c167cd0 2024-05-27T06:28:02.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fd691c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd68c168620 con 0x7fd68c06c7b0 2024-05-27T06:28:02.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f7239200640 1 --2- 172.21.15.87:0/50617936 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f721c004810 0x7f721c004c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:02.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fd68aa00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fd68c0d08f0 0x7fd68c073480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.87:47584/0 (socket says 172.21.15.87:47584) 2024-05-27T06:28:02.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fd68aa00640 1 -- 172.21.15.87:0/2875746032 learned_addr learned my addr 172.21.15.87:0/2875746032 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:02.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fd68b400640 1 --2- 172.21.15.87:0/2875746032 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd68c06c7b0 0x7fd68c06cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fd682000640 1 --2- 172.21.15.87:0/2875746032 >> v2:172.21.15.149:3300/0 conn(0x7fd68c167cd0 0x7fd68c1680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f9467400640 1 -- 172.21.15.87:0/1880528255 >> v1:172.21.15.149:6789/0 conn(0x7f94680d0b00 legacy=0x7f9468163e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f9467400640 1 -- 172.21.15.87:0/1880528255 >> v1:172.21.15.87:6789/0 conn(0x7f94680b9360 legacy=0x7f94680b9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:02.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f9467400640 1 -- 172.21.15.87:0/1880528255 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94680d0f10 con 0x7f94680d45a0 2024-05-27T06:28:02.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fa6d1e00640 1 --2- 172.21.15.87:0/861038122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6b8005360 0x7fa6d41527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f97ebe00640 1 --2- 172.21.15.87:0/1074547806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97ec0b7f00 0x7f97ec15ea20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f97ec0b2b50 tx=0x7f97d801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520c2093ec64e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7f2efe200640 1 Processor -- start 2024-05-27T06:28:02.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fd68a000640 1 -- 172.21.15.87:0/2875746032 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1317626453 0 0) 0x7fd67c001120 con 0x7fd68c0d08f0 2024-05-27T06:28:02.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fd68a000640 1 -- 172.21.15.87:0/2875746032 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd670003530 con 0x7fd68c0d08f0 2024-05-27T06:28:02.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.631+0000 7fc95ee00640 1 -- 172.21.15.87:0/2265270092 wait complete. 2024-05-27T06:28:02.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7fd68b400640 1 -- 172.21.15.87:0/2875746032 >> v2:172.21.15.149:3300/0 conn(0x7fd68c167cd0 msgr2=0x7fd68c1680e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:02.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7fd68b400640 1 --2- 172.21.15.87:0/2875746032 >> v2:172.21.15.149:3300/0 conn(0x7fd68c167cd0 0x7fd68c1680e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7fd68a000640 1 -- 172.21.15.87:0/2875746032 <== mon.1 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1575988027 0 0) 0x7fd670003530 con 0x7fd68c0d08f0 2024-05-27T06:28:02.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7fd68b400640 1 -- 172.21.15.87:0/2875746032 >> v1:172.21.15.149:6789/0 conn(0x7fd68c0d08f0 legacy=0x7fd68c073480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7fa6d2800640 1 -- 172.21.15.87:0/861038122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6d415c2b0 msgr2=0x7fa6d4166f70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-27T06:28:02.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7fa6d2800640 1 --2- 172.21.15.87:0/861038122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6d415c2b0 0x7fa6d4166f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7fa6d2800640 1 -- 172.21.15.87:0/861038122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6b8005360 msgr2=0x7fa6d41527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7fa6d2800640 1 --2- 172.21.15.87:0/861038122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6b8005360 0x7fa6d41527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7fa6d2800640 1 -- 172.21.15.87:0/861038122 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d4160da0 con 0x7fa6d41553e0 2024-05-27T06:28:02.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7fa6d1e00640 1 --2- 172.21.15.87:0/861038122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6b8005360 0x7fa6d41527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:28:02.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7f2efe200640 1 -- start start 2024-05-27T06:28:02.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7f97eaa00640 1 -- 172.21.15.87:0/1074547806 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d80b0070 con 0x7f97ec0b7f00 2024-05-27T06:28:02.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7f97eaa00640 1 -- 172.21.15.87:0/1074547806 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97d80ab600 con 0x7f97ec0b7f00 2024-05-27T06:28:02.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7f97eaa00640 1 -- 172.21.15.87:0/1074547806 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d80ab9d0 con 0x7f97ec0b7f00 2024-05-27T06:28:02.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7f723a600640 1 -- 172.21.15.87:0/50617936 reap_dead start 2024-05-27T06:28:02.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7fd68b400640 1 -- 172.21.15.87:0/2875746032 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68c06fdd0 con 0x7fd68c06c7b0 2024-05-27T06:28:02.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7fa6d2800640 1 --2- 172.21.15.87:0/861038122 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6d41553e0 0x7fa6d41674b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc01cbf0 tx=0x7fa6b8005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7f723a600640 1 --2- 172.21.15.87:0/50617936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f721c0052b0 0x7f721c00cae0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f722c00c160 tx=0x7f722c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb98e99319bd1ed2 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7f97f1400640 1 -- 172.21.15.87:0/1074547806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97ec0b7f00 msgr2=0x7f97ec15ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7f97f1400640 1 --2- 172.21.15.87:0/1074547806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97ec0b7f00 0x7f97ec15ea20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f97ec0b2b50 tx=0x7f97d801c4b0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7f97f1400640 1 -- 172.21.15.87:0/1074547806 shutdown_connections 2024-05-27T06:28:02.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7f97f1400640 1 --2- 172.21.15.87:0/1074547806 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97ec0ceed0 0x7f97ec0cf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7f97f1400640 1 --2- 172.21.15.87:0/1074547806 >> v2:172.21.15.149:3300/0 conn(0x7f97ec0d2050 0x7f97ec0d2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7f97f1400640 1 --2- 172.21.15.87:0/1074547806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97ec0b7f00 0x7f97ec15ea20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7f97f1400640 1 -- 172.21.15.87:0/1074547806 >> 172.21.15.87:0/1074547806 conn(0x7f97ec0b4f60 msgr2=0x7f97ec0b5370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:02.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7f97f1400640 1 -- 172.21.15.87:0/1074547806 shutdown_connections 2024-05-27T06:28:02.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7f2efe200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ef806ea20 0x7f2ef81662f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7f2efe200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ef80c4340 0x7f2ef8158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7f2efe200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ef8164060 0x7f2ef815dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7f2efe200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef8171fe0 con 0x7f2ef8164060 2024-05-27T06:28:02.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7f2efe200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef8171e60 con 0x7f2ef806ea20 2024-05-27T06:28:02.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7f2efe200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2ef8172160 con 0x7f2ef80c4340 2024-05-27T06:28:02.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7fa6ca000640 1 -- 172.21.15.87:0/861038122 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc005270 con 0x7fa6d41553e0 2024-05-27T06:28:02.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7fa6ca000640 1 -- 172.21.15.87:0/861038122 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6cc0b8070 con 0x7fa6d41553e0 2024-05-27T06:28:02.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7fa6d8a00640 1 -- 172.21.15.87:0/861038122 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d4161080 con 0x7fa6d41553e0 2024-05-27T06:28:02.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7fa6d8a00640 1 -- 172.21.15.87:0/861038122 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d41657b0 con 0x7fa6d41553e0 2024-05-27T06:28:02.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7fa6ca000640 1 -- 172.21.15.87:0/861038122 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc005650 con 0x7fa6d41553e0 2024-05-27T06:28:02.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7fc95ee00640 1 Processor -- start 2024-05-27T06:28:02.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7fc95ee00640 1 -- start start 2024-05-27T06:28:02.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7f9fafe00640 1 --2- 172.21.15.87:0/2962461932 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fb01646e0 0x7f9fb0164af0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9fb01687d0 tx=0x7f9fa801c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f45f620af2c1c4fb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7fd682000640 1 --2- 172.21.15.87:0/2875746032 >> v2:172.21.15.149:3300/0 conn(0x7fd68c167cd0 0x7fd68c1680e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:28:02.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f2efce00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ef806ea20 0x7f2ef81662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f2efd800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ef8164060 0x7f2ef815dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f2efce00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ef806ea20 0x7f2ef81662f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:39682/0 (socket says 172.21.15.87:39682) 2024-05-27T06:28:02.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f2efce00640 1 -- 172.21.15.87:0/2915212340 learned_addr learned my addr 172.21.15.87:0/2915212340 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:02.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f9467400640 1 --2- 172.21.15.87:0/1880528255 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94680d45a0 0x7f94680d49b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9460009dc0 tx=0x7f946001c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=433858a543a75a3e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f2ef7e00640 1 --2- 172.21.15.87:0/2915212340 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ef80c4340 0x7f2ef8158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f9466a00640 1 -- 172.21.15.87:0/1880528255 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94600b2070 con 0x7f94680d45a0 2024-05-27T06:28:02.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f2efce00640 1 -- 172.21.15.87:0/2915212340 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ef80c4340 msgr2=0x7f2ef8158480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f2efce00640 1 --2- 172.21.15.87:0/2915212340 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ef80c4340 0x7f2ef8158480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f2efce00640 1 -- 172.21.15.87:0/2915212340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ef8164060 msgr2=0x7f2ef815dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f2efce00640 1 --2- 172.21.15.87:0/2915212340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ef8164060 0x7f2ef815dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f9466a00640 1 -- 172.21.15.87:0/1880528255 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94600a5720 con 0x7f94680d45a0 2024-05-27T06:28:02.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f9466a00640 1 -- 172.21.15.87:0/1880528255 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94600b2070 con 0x7f94680d45a0 2024-05-27T06:28:02.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f2efce00640 1 -- 172.21.15.87:0/2915212340 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef81589c0 con 0x7f2ef806ea20 2024-05-27T06:28:02.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.635+0000 7f97f1400640 1 -- 172.21.15.87:0/1074547806 wait complete. 2024-05-27T06:28:02.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f97f1400640 1 Processor -- start 2024-05-27T06:28:02.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f9fae000640 1 -- 172.21.15.87:0/2962461932 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa80a5670 con 0x7f9fb01646e0 2024-05-27T06:28:02.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f9fae000640 1 -- 172.21.15.87:0/2962461932 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa80a5810 con 0x7f9fb01646e0 2024-05-27T06:28:02.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f9fae000640 1 -- 172.21.15.87:0/2962461932 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa80a5be0 con 0x7f9fb01646e0 2024-05-27T06:28:02.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f7233e00640 1 -- 172.21.15.87:0/50617936 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c001f30 con 0x7f721c0052b0 2024-05-27T06:28:02.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f7233e00640 1 -- 172.21.15.87:0/50617936 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f722c0a9070 con 0x7f721c0052b0 2024-05-27T06:28:02.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f97f1400640 1 -- start start 2024-05-27T06:28:02.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7fd68b400640 1 --2- 172.21.15.87:0/2875746032 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd68c06c7b0 0x7fd68c06cbc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd684009d90 tx=0x7fd68401c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac83615998cdae84 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f2efce00640 1 --2- 172.21.15.87:0/2915212340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ef806ea20 0x7f2ef81662f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2ee401c180 tx=0x7f2ee40190f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7fd68a000640 1 -- 172.21.15.87:0/2875746032 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6840ac070 con 0x7fd68c06c7b0 2024-05-27T06:28:02.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7fd68a000640 1 -- 172.21.15.87:0/2875746032 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6840a64a0 con 0x7fd68c06c7b0 2024-05-27T06:28:02.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7fd68a000640 1 -- 172.21.15.87:0/2875746032 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c0018b0 con 0x7fd68c06c7b0 2024-05-27T06:28:02.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f2ef4c00640 1 -- 172.21.15.87:0/2915212340 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee40b0040 con 0x7f2ef806ea20 2024-05-27T06:28:02.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f2ef4c00640 1 -- 172.21.15.87:0/2915212340 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee40bb070 con 0x7f2ef806ea20 2024-05-27T06:28:02.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f2ef4c00640 1 -- 172.21.15.87:0/2915212340 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef806fd50 con 0x7f2ef806ea20 2024-05-27T06:28:02.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f9fb6000640 1 -- 172.21.15.87:0/2962461932 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fb01646e0 msgr2=0x7f9fb0164af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f9fb6000640 1 --2- 172.21.15.87:0/2962461932 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fb01646e0 0x7f9fb0164af0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9fb01687d0 tx=0x7f9fa801c9f0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f946da00640 1 -- 172.21.15.87:0/1880528255 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94680d45a0 msgr2=0x7f94680d49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f946da00640 1 --2- 172.21.15.87:0/1880528255 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94680d45a0 0x7f94680d49b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9460009dc0 tx=0x7f946001c7b0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7fc95ee00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc95806c7b0 0x7fc9580aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f723b000640 1 -- 172.21.15.87:0/50617936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f721c0052b0 msgr2=0x7f721c00cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f723b000640 1 --2- 172.21.15.87:0/50617936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f721c0052b0 0x7f721c00cae0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f722c00c160 tx=0x7f722c01c930 comp rx=0 tx=0).stop 2024-05-27T06:28:02.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f7233e00640 1 -- 172.21.15.87:0/50617936 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c0a5a80 con 0x7f721c0052b0 2024-05-27T06:28:02.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f946da00640 1 -- 172.21.15.87:0/1880528255 shutdown_connections 2024-05-27T06:28:02.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f946da00640 1 --2- 172.21.15.87:0/1880528255 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94680d45a0 0x7f94680d49b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f946da00640 1 -- 172.21.15.87:0/1880528255 >> 172.21.15.87:0/1880528255 conn(0x7f94680d55e0 msgr2=0x7f94680d59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:02.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f9fb6000640 1 -- 172.21.15.87:0/2962461932 shutdown_connections 2024-05-27T06:28:02.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f9fb6000640 1 --2- 172.21.15.87:0/2962461932 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fb01646e0 0x7f9fb0164af0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f9fb6000640 1 --2- 172.21.15.87:0/2962461932 >> v2:172.21.15.149:3300/0 conn(0x7f9fb0167cd0 0x7f9fb01680e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f9fb6000640 1 --2- 172.21.15.87:0/2962461932 >> v2:172.21.15.87:3300/0 conn(0x7f9fb00d08f0 0x7f9fb0073480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f2efe200640 1 -- 172.21.15.87:0/2915212340 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ef80cc6a0 con 0x7f2ef806ea20 2024-05-27T06:28:02.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f9fb6000640 1 -- 172.21.15.87:0/2962461932 >> 172.21.15.87:0/2962461932 conn(0x7f9fb00b2fb0 msgr2=0x7f9fb00b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:02.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7fc95ee00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9580d08f0 0x7fc958156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f946da00640 1 -- 172.21.15.87:0/1880528255 shutdown_connections 2024-05-27T06:28:02.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f2efe200640 1 -- 172.21.15.87:0/2915212340 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ef80cbbc0 con 0x7f2ef806ea20 2024-05-27T06:28:02.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7fa6d8a00640 1 -- 172.21.15.87:0/861038122 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa6ac001040 con 0x7fa6d41553e0 2024-05-27T06:28:02.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7fa6ca000640 1 -- 172.21.15.87:0/861038122 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa6cc0b2070 con 0x7fa6d41553e0 2024-05-27T06:28:02.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7fc957e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc95806c7b0 0x7fc9580aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7fc957e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc95806c7b0 0x7fc9580aee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:39698/0 (socket says 172.21.15.87:39698) 2024-05-27T06:28:02.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7fc957e00640 1 -- 172.21.15.87:0/2810945938 learned_addr learned my addr 172.21.15.87:0/2810945938 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:02.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7fc95ee00640 1 --2- 172.21.15.87:0/2810945938 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc958167cd0 0x7fc958165810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7fc95ee00640 1 -- 172.21.15.87:0/2810945938 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc958171400 con 0x7fc9580d08f0 2024-05-27T06:28:02.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f9fb6000640 1 -- 172.21.15.87:0/2962461932 shutdown_connections 2024-05-27T06:28:02.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f97f1400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97ec0b7f00 0x7f97ec14a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f97f1400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97ec0ceed0 0x7f97ec14fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f97f1400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97ec0d2050 0x7f97ec152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f97ebe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97ec0b7f00 0x7f97ec14a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f946da00640 1 -- 172.21.15.87:0/1880528255 wait complete. 2024-05-27T06:28:02.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7fd691c00640 1 -- 172.21.15.87:0/2875746032 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd68c06c7b0 msgr2=0x7fd68c06cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7fd691c00640 1 --2- 172.21.15.87:0/2875746032 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd68c06c7b0 0x7fd68c06cbc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd684009d90 tx=0x7fd68401c8b0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7fc95ee00640 1 -- 172.21.15.87:0/2810945938 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc958171280 con 0x7fc95806c7b0 2024-05-27T06:28:02.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7fc95ce00640 1 --2- 172.21.15.87:0/2810945938 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc958167cd0 0x7fc958165810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7fc95ee00640 1 -- 172.21.15.87:0/2810945938 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc958171580 con 0x7fc958167cd0 2024-05-27T06:28:02.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7fc94f400640 1 --2- 172.21.15.87:0/2810945938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9580d08f0 0x7fc958156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.639+0000 7f9fb6000640 1 -- 172.21.15.87:0/2962461932 wait complete. 2024-05-27T06:28:02.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f97ebe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97ec0b7f00 0x7f97ec14a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38180/0 (socket says 172.21.15.87:38180) 2024-05-27T06:28:02.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f97ebe00640 1 -- 172.21.15.87:0/1311130759 learned_addr learned my addr 172.21.15.87:0/1311130759 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:02.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f97eb400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97ec0ceed0 0x7f97ec14fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f97f1400640 1 -- 172.21.15.87:0/1311130759 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f97ec0ce6b0 con 0x7f97ec0b7f00 2024-05-27T06:28:02.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f97f1400640 1 -- 172.21.15.87:0/1311130759 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f97ec0cfc30 con 0x7f97ec0d2050 2024-05-27T06:28:02.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f97f1400640 1 -- 172.21.15.87:0/1311130759 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f97ec0cdac0 con 0x7f97ec0ceed0 2024-05-27T06:28:02.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7fd691c00640 1 -- 172.21.15.87:0/2875746032 shutdown_connections 2024-05-27T06:28:02.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7fd691c00640 1 --2- 172.21.15.87:0/2875746032 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd68c06c7b0 0x7fd68c06cbc0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7fd691c00640 1 --2- 172.21.15.87:0/2875746032 >> v2:172.21.15.149:3300/0 conn(0x7fd68c167cd0 0x7fd68c1680e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7fd691c00640 1 -- 172.21.15.87:0/2875746032 >> 172.21.15.87:0/2875746032 conn(0x7fd68c0b2fb0 msgr2=0x7fd68c0b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:02.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f97f0a00640 1 --2- 172.21.15.87:0/1311130759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97ec0d2050 0x7f97ec152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7fd691c00640 1 -- 172.21.15.87:0/2875746032 shutdown_connections 2024-05-27T06:28:02.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f2efe200640 1 -- 172.21.15.87:0/2915212340 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2ef80cb690 con 0x7f2ef806ea20 2024-05-27T06:28:02.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7fc957e00640 1 -- 172.21.15.87:0/2810945938 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc958167cd0 msgr2=0x7fc958165810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7fc957e00640 1 --2- 172.21.15.87:0/2810945938 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc958167cd0 0x7fc958165810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7fc957e00640 1 -- 172.21.15.87:0/2810945938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9580d08f0 msgr2=0x7fc958156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7fc957e00640 1 --2- 172.21.15.87:0/2810945938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9580d08f0 0x7fc958156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f97f0a00640 1 -- 172.21.15.87:0/1311130759 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97ec0ceed0 msgr2=0x7f97ec14fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f97f0a00640 1 --2- 172.21.15.87:0/1311130759 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97ec0ceed0 0x7f97ec14fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f97f0a00640 1 -- 172.21.15.87:0/1311130759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97ec0b7f00 msgr2=0x7f97ec14a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f97f0a00640 1 --2- 172.21.15.87:0/1311130759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97ec0b7f00 0x7f97ec14a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f97f0a00640 1 -- 172.21.15.87:0/1311130759 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97ec150550 con 0x7f97ec0d2050 2024-05-27T06:28:02.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f2ef4c00640 1 -- 172.21.15.87:0/2915212340 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2ee40b3070 con 0x7f2ef806ea20 2024-05-27T06:28:02.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7fa6ca000640 1 --2- 172.21.15.87:0/861038122 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa6b406f500 0x7fa6b4071a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7fa6ca000640 1 -- 172.21.15.87:0/861038122 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa6cc1289d0 con 0x7fa6d41553e0 2024-05-27T06:28:02.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7fa6ca000640 1 --2- 172.21.15.87:0/861038122 >> [v2:172.21.15.87:6808/2443981288,v1:172.21.15.87:6809/2443981288] conn(0x7fa6b4078cd0 0x7fa6b407b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7fa6ca000640 1 -- 172.21.15.87:0/861038122 --> [v2:172.21.15.87:6808/2443981288,v1:172.21.15.87:6809/2443981288] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa6cc004d90 con 0x7fa6b4078cd0 2024-05-27T06:28:02.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7fa6ca000640 1 -- 172.21.15.87:0/861038122 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa6cc12f050 con 0x7fa6d41553e0 2024-05-27T06:28:02.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7fc957e00640 1 -- 172.21.15.87:0/2810945938 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9580af390 con 0x7fc95806c7b0 2024-05-27T06:28:02.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f97f0a00640 1 --2- 172.21.15.87:0/1311130759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97ec0d2050 0x7f97ec152fb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f97e4007d70 tx=0x7f97e400e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7fd691c00640 1 -- 172.21.15.87:0/2875746032 wait complete. 2024-05-27T06:28:02.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7fa6d1400640 1 --2- 172.21.15.87:0/861038122 >> [v2:172.21.15.87:6808/2443981288,v1:172.21.15.87:6809/2443981288] conn(0x7fa6b4078cd0 0x7fa6b407b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f946da00640 1 Processor -- start 2024-05-27T06:28:02.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f9fb6000640 1 Processor -- start 2024-05-27T06:28:02.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7fa6d1e00640 1 --2- 172.21.15.87:0/861038122 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa6b406f500 0x7fa6b4071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f97e3e00640 1 -- 172.21.15.87:0/1311130759 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e400edd0 con 0x7f97ec0d2050 2024-05-27T06:28:02.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f97e3e00640 1 -- 172.21.15.87:0/1311130759 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97e40039a0 con 0x7f97ec0d2050 2024-05-27T06:28:02.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f97e3e00640 1 -- 172.21.15.87:0/1311130759 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e4003d90 con 0x7f97ec0d2050 2024-05-27T06:28:02.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f723b000640 1 -- 172.21.15.87:0/50617936 shutdown_connections 2024-05-27T06:28:02.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f723b000640 1 --2- 172.21.15.87:0/50617936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f721c0052b0 0x7f721c00cae0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f723b000640 1 -- 172.21.15.87:0/50617936 >> 172.21.15.87:0/50617936 conn(0x7f72340b3d80 msgr2=0x7f72340d1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:02.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f723b000640 1 -- 172.21.15.87:0/50617936 shutdown_connections 2024-05-27T06:28:02.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f9fb6000640 1 -- start start 2024-05-27T06:28:02.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7fc957e00640 1 --2- 172.21.15.87:0/2810945938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc95806c7b0 0x7fc9580aee50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc94000b410 tx=0x7fc94000b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f97f1400640 1 -- 172.21.15.87:0/1311130759 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97ec14eb80 con 0x7f97ec0d2050 2024-05-27T06:28:02.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f97f1400640 1 -- 172.21.15.87:0/1311130759 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97ec14f140 con 0x7f97ec0d2050 2024-05-27T06:28:02.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f2ef4c00640 1 --2- 172.21.15.87:0/2915212340 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2ed806f450 0x7f2ed8071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f2ef4c00640 1 -- 172.21.15.87:0/2915212340 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2ee41290e0 con 0x7f2ef806ea20 2024-05-27T06:28:02.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f2ef4c00640 1 --2- 172.21.15.87:0/2915212340 >> [v2:172.21.15.87:6800/3674824716,v1:172.21.15.87:6801/3674824716] conn(0x7f2ed8078c10 0x7f2ed807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f2ef4c00640 1 -- 172.21.15.87:0/2915212340 --> [v2:172.21.15.87:6800/3674824716,v1:172.21.15.87:6801/3674824716] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2ee40c4ec0 con 0x7f2ed8078c10 2024-05-27T06:28:02.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f2ef4c00640 1 -- 172.21.15.87:0/2915212340 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2ee4130050 con 0x7f2ef806ea20 2024-05-27T06:28:02.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f946da00640 1 -- start start 2024-05-27T06:28:02.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7fd691c00640 1 Processor -- start 2024-05-27T06:28:02.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f2efd800640 1 --2- 172.21.15.87:0/2915212340 >> [v2:172.21.15.87:6800/3674824716,v1:172.21.15.87:6801/3674824716] conn(0x7f2ed8078c10 0x7f2ed807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7fc954c00640 1 -- 172.21.15.87:0/2810945938 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc940015020 con 0x7fc95806c7b0 2024-05-27T06:28:02.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7fd691c00640 1 -- start start 2024-05-27T06:28:02.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7fa6d1400640 1 --2- 172.21.15.87:0/861038122 >> [v2:172.21.15.87:6808/2443981288,v1:172.21.15.87:6809/2443981288] conn(0x7fa6b4078cd0 0x7fa6b407b160 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f946da00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94680b9360 0x7f946815c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7fc954c00640 1 -- 172.21.15.87:0/2810945938 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc940011830 con 0x7fc95806c7b0 2024-05-27T06:28:02.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f2efd800640 1 --2- 172.21.15.87:0/2915212340 >> [v2:172.21.15.87:6800/3674824716,v1:172.21.15.87:6801/3674824716] conn(0x7f2ed8078c10 0x7f2ed807b0a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7fc95ee00640 1 -- 172.21.15.87:0/2810945938 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc958142830 con 0x7fc95806c7b0 2024-05-27T06:28:02.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7fc95ee00640 1 -- 172.21.15.87:0/2810945938 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc958142df0 con 0x7fc95806c7b0 2024-05-27T06:28:02.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f9fb6000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fb00d08f0 0x7f9fb01539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f9fb6000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fb01646e0 0x7f9fb01666d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f9fb6000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fb0167cd0 0x7f9fb015b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f9fb6000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb01655c0 con 0x7f9fb0167cd0 2024-05-27T06:28:02.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f9fb6000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb0165440 con 0x7f9fb01646e0 2024-05-27T06:28:02.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f9fb6000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9fb006cfc0 con 0x7f9fb00d08f0 2024-05-27T06:28:02.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f9faf400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fb00d08f0 0x7f9fb01539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f946da00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94680d0b00 0x7f94680ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f946da00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94680d45a0 0x7f94680cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f946da00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f94680ba290 con 0x7f94680b9360 2024-05-27T06:28:02.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f946da00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9468073f00 con 0x7f94680d45a0 2024-05-27T06:28:02.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f946da00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f94680ba410 con 0x7f94680d0b00 2024-05-27T06:28:02.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f9467e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94680b9360 0x7f946815c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f9467e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94680b9360 0x7f946815c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38186/0 (socket says 172.21.15.87:38186) 2024-05-27T06:28:02.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f9467e00640 1 -- 172.21.15.87:0/1036175189 learned_addr learned my addr 172.21.15.87:0/1036175189 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:02.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f9467400640 1 --2- 172.21.15.87:0/1036175189 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94680d0b00 0x7f94680ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.643+0000 7f723b000640 1 -- 172.21.15.87:0/50617936 wait complete. 2024-05-27T06:28:02.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f9faf400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fb00d08f0 0x7f9fb01539f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.87:45046/0 (socket says 172.21.15.87:45046) 2024-05-27T06:28:02.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f9faf400640 1 -- 172.21.15.87:0/2283478199 learned_addr learned my addr 172.21.15.87:0/2283478199 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:02.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f9faea00640 1 --2- 172.21.15.87:0/2283478199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fb01646e0 0x7f9fb01666d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7fc954c00640 1 -- 172.21.15.87:0/2810945938 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc940011c20 con 0x7fc95806c7b0 2024-05-27T06:28:02.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f9fafe00640 1 --2- 172.21.15.87:0/2283478199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fb0167cd0 0x7f9fb015b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f9faf400640 1 -- 172.21.15.87:0/2283478199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fb01646e0 msgr2=0x7f9fb01666d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f9faf400640 1 --2- 172.21.15.87:0/2283478199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fb01646e0 0x7f9fb01666d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f9faf400640 1 -- 172.21.15.87:0/2283478199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fb0167cd0 msgr2=0x7f9fb015b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f9faf400640 1 --2- 172.21.15.87:0/2283478199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fb0167cd0 0x7f9fb015b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f9faf400640 1 -- 172.21.15.87:0/2283478199 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb015c4b0 con 0x7f9fb00d08f0 2024-05-27T06:28:02.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f97f1400640 1 -- 172.21.15.87:0/1311130759 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f97c4001040 con 0x7f97ec0d2050 2024-05-27T06:28:02.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f9faf400640 1 --2- 172.21.15.87:0/2283478199 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fb00d08f0 0x7f9fb01539f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00e870 tx=0x7f9f9c00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f97e3e00640 1 -- 172.21.15.87:0/1311130759 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f97e401b020 con 0x7f97ec0d2050 2024-05-27T06:28:02.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7fd691c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd68c06c7b0 0x7fd68c155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7fd691c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd68c0d08f0 0x7fd68c1630d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f9467e00640 1 -- 172.21.15.87:0/1036175189 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94680d0b00 msgr2=0x7f94680ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f9467e00640 1 --2- 172.21.15.87:0/1036175189 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94680d0b00 0x7f94680ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f946d000640 1 --2- 172.21.15.87:0/1036175189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94680d45a0 0x7f94680cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7fa6d1e00640 1 --2- 172.21.15.87:0/861038122 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa6b406f500 0x7fa6b4071a10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40093f0 tx=0x7fa6c4009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f723b000640 1 Processor -- start 2024-05-27T06:28:02.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f9467e00640 1 -- 172.21.15.87:0/1036175189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94680d45a0 msgr2=0x7f94680cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f9467e00640 1 --2- 172.21.15.87:0/1036175189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94680d45a0 0x7f94680cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f9467e00640 1 -- 172.21.15.87:0/1036175189 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f946815c540 con 0x7f94680b9360 2024-05-27T06:28:02.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f946d000640 1 --2- 172.21.15.87:0/1036175189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94680d45a0 0x7f94680cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:02.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f723b000640 1 -- start start 2024-05-27T06:28:02.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f9fa7400640 1 -- 172.21.15.87:0/2283478199 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c017070 con 0x7f9fb00d08f0 2024-05-27T06:28:02.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f9fa7400640 1 -- 172.21.15.87:0/2283478199 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f9c00ee60 con 0x7f9fb00d08f0 2024-05-27T06:28:02.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f9fa7400640 1 -- 172.21.15.87:0/2283478199 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c00cb80 con 0x7f9fb00d08f0 2024-05-27T06:28:02.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f9467e00640 1 --2- 172.21.15.87:0/1036175189 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94680b9360 0x7f946815c000 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f945400c400 tx=0x7f945400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7fd68aa00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd68c06c7b0 0x7fd68c155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7fd68aa00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd68c06c7b0 0x7fd68c155bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38200/0 (socket says 172.21.15.87:38200) 2024-05-27T06:28:02.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.647+0000 7f2ef7e00640 1 --2- 172.21.15.87:0/2915212340 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2ed806f450 0x7f2ed8071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f2ef4c00640 1 -- 172.21.15.87:0/2915212340 <== osd.0 v2:172.21.15.87:6800/3674824716 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2ee40c4ec0 con 0x7f2ed8078c10 2024-05-27T06:28:02.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7fd68aa00640 1 -- 172.21.15.87:0/1656163183 learned_addr learned my addr 172.21.15.87:0/1656163183 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:02.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7fd691c00640 1 --2- 172.21.15.87:0/1656163183 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd68c167cd0 0x7fd68c163610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7fd682000640 1 --2- 172.21.15.87:0/1656163183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd68c0d08f0 0x7fd68c1630d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7fd691c00640 1 -- 172.21.15.87:0/1656163183 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c171400 con 0x7fd68c06c7b0 2024-05-27T06:28:02.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7fd691c00640 1 -- 172.21.15.87:0/1656163183 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c171280 con 0x7fd68c0d08f0 2024-05-27T06:28:02.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7fd691c00640 1 -- 172.21.15.87:0/1656163183 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd68c171580 con 0x7fd68c167cd0 2024-05-27T06:28:02.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7fd68b400640 1 --2- 172.21.15.87:0/1656163183 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd68c167cd0 0x7fd68c163610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7fd682000640 1 -- 172.21.15.87:0/1656163183 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd68c167cd0 msgr2=0x7fd68c163610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7fd682000640 1 --2- 172.21.15.87:0/1656163183 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd68c167cd0 0x7fd68c163610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7fd682000640 1 -- 172.21.15.87:0/1656163183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd68c06c7b0 msgr2=0x7fd68c155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7fd682000640 1 --2- 172.21.15.87:0/1656163183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd68c06c7b0 0x7fd68c155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7fd682000640 1 -- 172.21.15.87:0/1656163183 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68c15d610 con 0x7fd68c0d08f0 2024-05-27T06:28:02.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7fd68b400640 1 --2- 172.21.15.87:0/1656163183 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd68c167cd0 0x7fd68c163610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:02.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7fc95ee00640 1 -- 172.21.15.87:0/2810945938 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc930001040 con 0x7fc95806c7b0 2024-05-27T06:28:02.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f9fb6000640 1 -- 172.21.15.87:0/2283478199 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fb015c790 con 0x7f9fb00d08f0 2024-05-27T06:28:02.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f9fb6000640 1 -- 172.21.15.87:0/2283478199 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fb015cd50 con 0x7f9fb00d08f0 2024-05-27T06:28:02.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f9fb6000640 1 -- 172.21.15.87:0/2283478199 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9fb006aa30 con 0x7f9fb00d08f0 2024-05-27T06:28:02.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f97e3e00640 1 --2- 172.21.15.87:0/1311130759 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f97cc06f500 0x7f97cc071a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f97e3e00640 1 -- 172.21.15.87:0/1311130759 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f97e408f4b0 con 0x7f97ec0d2050 2024-05-27T06:28:02.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f97e3e00640 1 --2- 172.21.15.87:0/1311130759 >> [v2:172.21.15.149:6816/582864816,v1:172.21.15.149:6818/582864816] conn(0x7f97cc078c40 0x7f97cc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f97e3e00640 1 -- 172.21.15.87:0/1311130759 --> [v2:172.21.15.149:6816/582864816,v1:172.21.15.149:6818/582864816] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f97cc07b7a0 con 0x7f97cc078c40 2024-05-27T06:28:02.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f97eb400640 1 --2- 172.21.15.87:0/1311130759 >> [v2:172.21.15.149:6816/582864816,v1:172.21.15.149:6818/582864816] conn(0x7f97cc078c40 0x7f97cc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f97ebe00640 1 --2- 172.21.15.87:0/1311130759 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f97cc06f500 0x7f97cc071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f945fe00640 1 -- 172.21.15.87:0/1036175189 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9454017070 con 0x7f94680b9360 2024-05-27T06:28:02.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f945fe00640 1 -- 172.21.15.87:0/1036175189 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9454005cf0 con 0x7f94680b9360 2024-05-27T06:28:02.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f945fe00640 1 -- 172.21.15.87:0/1036175189 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94540072f0 con 0x7f94680b9360 2024-05-27T06:28:02.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f946da00640 1 -- 172.21.15.87:0/1036175189 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f946815c990 con 0x7f94680b9360 2024-05-27T06:28:02.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7f946da00640 1 -- 172.21.15.87:0/1036175189 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f946815cf50 con 0x7f94680b9360 2024-05-27T06:28:02.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7fa6ca000640 1 -- 172.21.15.87:0/861038122 <== osd.1 v2:172.21.15.87:6808/2443981288 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa6cc004d90 con 0x7fa6b4078cd0 2024-05-27T06:28:02.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.651+0000 7fc954c00640 1 -- 172.21.15.87:0/2810945938 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc940018020 con 0x7fc95806c7b0 2024-05-27T06:28:02.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f723b000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f721c0052b0 0x7f7234153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f723b000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7234155970 0x7f7234146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f723b000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72341f57c0 0x7f72340cf970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f723b000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f72340d13d0 con 0x7f721c0052b0 2024-05-27T06:28:02.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f723b000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7234070770 con 0x7f72341f57c0 2024-05-27T06:28:02.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f723b000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f72340b4cb0 con 0x7f7234155970 2024-05-27T06:28:02.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f97eb400640 1 --2- 172.21.15.87:0/1311130759 >> [v2:172.21.15.149:6816/582864816,v1:172.21.15.149:6818/582864816] conn(0x7f97cc078c40 0x7f97cc07b0d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7fd682000640 1 --2- 172.21.15.87:0/1656163183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd68c0d08f0 0x7fd68c1630d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd67400e8e0 tx=0x7fd67400eda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f7239c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f721c0052b0 0x7f7234153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f7239c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f721c0052b0 0x7f7234153a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38206/0 (socket says 172.21.15.87:38206) 2024-05-27T06:28:02.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f7239c00640 1 -- 172.21.15.87:0/2328993797 learned_addr learned my addr 172.21.15.87:0/2328993797 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:02.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f946da00640 1 -- 172.21.15.87:0/1036175189 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f946815d610 con 0x7f94680b9360 2024-05-27T06:28:02.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7fd683400640 1 -- 172.21.15.87:0/1656163183 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd674017070 con 0x7fd68c0d08f0 2024-05-27T06:28:02.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7fd683400640 1 -- 172.21.15.87:0/1656163183 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd67400c8e0 con 0x7fd68c0d08f0 2024-05-27T06:28:02.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7fd683400640 1 -- 172.21.15.87:0/1656163183 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67400cc90 con 0x7fd68c0d08f0 2024-05-27T06:28:02.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7fd691c00640 1 -- 172.21.15.87:0/1656163183 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd68c162310 con 0x7fd68c0d08f0 2024-05-27T06:28:02.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f2ef7e00640 1 --2- 172.21.15.87:0/2915212340 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2ed806f450 0x7f2ed8071960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2ef806f210 tx=0x7f2ee8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f7239200640 1 --2- 172.21.15.87:0/2328993797 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7234155970 0x7f7234146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f723a600640 1 --2- 172.21.15.87:0/2328993797 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72341f57c0 0x7f72340cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f7239c00640 1 -- 172.21.15.87:0/2328993797 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7234155970 msgr2=0x7f7234146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f7239c00640 1 --2- 172.21.15.87:0/2328993797 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7234155970 0x7f7234146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f7239c00640 1 -- 172.21.15.87:0/2328993797 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72341f57c0 msgr2=0x7f72340cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f7239c00640 1 --2- 172.21.15.87:0/2328993797 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72341f57c0 0x7f72340cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f7239c00640 1 -- 172.21.15.87:0/2328993797 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7234150420 con 0x7f721c0052b0 2024-05-27T06:28:02.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f97ebe00640 1 --2- 172.21.15.87:0/1311130759 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f97cc06f500 0x7f97cc071a10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f97d801c4f0 tx=0x7f97d8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f97e3e00640 1 -- 172.21.15.87:0/1311130759 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f97e4096050 con 0x7f97ec0d2050 2024-05-27T06:28:02.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f97e3e00640 1 -- 172.21.15.87:0/1311130759 <== osd.5 v2:172.21.15.149:6816/582864816 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f97cc07b7a0 con 0x7f97cc078c40 2024-05-27T06:28:02.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f945fe00640 1 -- 172.21.15.87:0/1036175189 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f945401a070 con 0x7f94680b9360 2024-05-27T06:28:02.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7fd691c00640 1 -- 172.21.15.87:0/1656163183 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd68c1628d0 con 0x7fd68c0d08f0 2024-05-27T06:28:02.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f7239c00640 1 --2- 172.21.15.87:0/2328993797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f721c0052b0 0x7f7234153a00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7228009fd0 tx=0x7f7228011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f723a600640 1 --2- 172.21.15.87:0/2328993797 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72341f57c0 0x7f72340cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:28:02.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f7239200640 1 --2- 172.21.15.87:0/2328993797 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7234155970 0x7f7234146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:02.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f7231600640 1 -- 172.21.15.87:0/2328993797 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7228004220 con 0x7f721c0052b0 2024-05-27T06:28:02.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f7231600640 1 -- 172.21.15.87:0/2328993797 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72280043c0 con 0x7f721c0052b0 2024-05-27T06:28:02.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f723b000640 1 -- 172.21.15.87:0/2328993797 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7234151550 con 0x7f721c0052b0 2024-05-27T06:28:02.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f7231600640 1 -- 172.21.15.87:0/2328993797 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7228015870 con 0x7f721c0052b0 2024-05-27T06:28:02.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f723b000640 1 -- 172.21.15.87:0/2328993797 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72341f52a0 con 0x7f721c0052b0 2024-05-27T06:28:02.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7fd67be00640 1 -- 172.21.15.87:0/1656163183 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd68c162cb0 con 0x7fd68c0d08f0 2024-05-27T06:28:02.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7fc954c00640 1 --2- 172.21.15.87:0/2810945938 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc93406f4d0 0x7fc9340719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7fc954c00640 1 -- 172.21.15.87:0/2810945938 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc94008f440 con 0x7fc95806c7b0 2024-05-27T06:28:02.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7fc954c00640 1 --2- 172.21.15.87:0/2810945938 >> [v2:172.21.15.87:6817/1441249238,v1:172.21.15.87:6819/1441249238] conn(0x7fc934078c20 0x7fc93407b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7fc954c00640 1 -- 172.21.15.87:0/2810945938 --> [v2:172.21.15.87:6817/1441249238,v1:172.21.15.87:6819/1441249238] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc94000de50 con 0x7fc934078c20 2024-05-27T06:28:02.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f945fe00640 1 --2- 172.21.15.87:0/1036175189 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f944806f450 0x7f9448071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.655+0000 7f723b000640 1 -- 172.21.15.87:0/2328993797 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f72340508e0 con 0x7f721c0052b0 2024-05-27T06:28:02.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.659+0000 7f945fe00640 1 -- 172.21.15.87:0/1036175189 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f945408e860 con 0x7f94680b9360 2024-05-27T06:28:02.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.659+0000 7f9467400640 1 --2- 172.21.15.87:0/1036175189 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f944806f450 0x7f9448071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.659+0000 7f945fe00640 1 --2- 172.21.15.87:0/1036175189 >> [v2:172.21.15.149:6800/531351314,v1:172.21.15.149:6801/531351314] conn(0x7f9448078c20 0x7f944807b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.659+0000 7f945fe00640 1 -- 172.21.15.87:0/1036175189 --> [v2:172.21.15.149:6800/531351314,v1:172.21.15.149:6801/531351314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f944807b780 con 0x7f9448078c20 2024-05-27T06:28:02.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.659+0000 7f945fe00640 1 -- 172.21.15.87:0/1036175189 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f94540932c0 con 0x7f94680b9360 2024-05-27T06:28:02.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.659+0000 7f946d000640 1 --2- 172.21.15.87:0/1036175189 >> [v2:172.21.15.149:6800/531351314,v1:172.21.15.149:6801/531351314] conn(0x7f9448078c20 0x7f944807b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.659+0000 7f9467400640 1 --2- 172.21.15.87:0/1036175189 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f944806f450 0x7f9448071960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f94600af000 tx=0x7f94600a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.659+0000 7f946d000640 1 --2- 172.21.15.87:0/1036175189 >> [v2:172.21.15.149:6800/531351314,v1:172.21.15.149:6801/531351314] conn(0x7f9448078c20 0x7f944807b0b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.659+0000 7fc95ce00640 1 --2- 172.21.15.87:0/2810945938 >> [v2:172.21.15.87:6817/1441249238,v1:172.21.15.87:6819/1441249238] conn(0x7fc934078c20 0x7fc93407b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.659+0000 7fc94f400640 1 --2- 172.21.15.87:0/2810945938 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc93406f4d0 0x7fc9340719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.659+0000 7fc94f400640 1 --2- 172.21.15.87:0/2810945938 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc93406f4d0 0x7fc9340719e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc958164280 tx=0x7fc948008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.659+0000 7f945fe00640 1 -- 172.21.15.87:0/1036175189 <== osd.6 v2:172.21.15.149:6800/531351314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f944807b780 con 0x7f9448078c20 2024-05-27T06:28:02.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.659+0000 7f7231600640 1 -- 172.21.15.87:0/2328993797 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7228015a10 con 0x7f721c0052b0 2024-05-27T06:28:02.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.659+0000 7fc95ce00640 1 --2- 172.21.15.87:0/2810945938 >> [v2:172.21.15.87:6817/1441249238,v1:172.21.15.87:6819/1441249238] conn(0x7fc934078c20 0x7fc93407b0b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.663+0000 7f9fa7400640 1 -- 172.21.15.87:0/2283478199 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9f9c01a070 con 0x7f9fb00d08f0 2024-05-27T06:28:02.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.663+0000 7f7231600640 1 --2- 172.21.15.87:0/2328993797 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f721406f4d0 0x7f72140719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.659+0000 7fd683400640 1 -- 172.21.15.87:0/1656163183 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd67401a070 con 0x7fd68c0d08f0 2024-05-27T06:28:02.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.663+0000 7fd683400640 1 --2- 172.21.15.87:0/1656163183 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd66806f4d0 0x7fd6680719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.663+0000 7fd683400640 1 -- 172.21.15.87:0/1656163183 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd67408f830 con 0x7fd68c0d08f0 2024-05-27T06:28:02.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.663+0000 7fd683400640 1 --2- 172.21.15.87:0/1656163183 >> [v2:172.21.15.149:6808/1171039913,v1:172.21.15.149:6809/1171039913] conn(0x7fd668078c90 0x7fd66807b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.663+0000 7fd683400640 1 -- 172.21.15.87:0/1656163183 --> [v2:172.21.15.149:6808/1171039913,v1:172.21.15.149:6809/1171039913] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd674008eb0 con 0x7fd668078c90 2024-05-27T06:28:02.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.663+0000 7fd683400640 1 -- 172.21.15.87:0/1656163183 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd6740942a0 con 0x7fd68c0d08f0 2024-05-27T06:28:02.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.663+0000 7fc954c00640 1 -- 172.21.15.87:0/2810945938 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc940096050 con 0x7fc95806c7b0 2024-05-27T06:28:02.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.663+0000 7f7231600640 1 -- 172.21.15.87:0/2328993797 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f722808fbd0 con 0x7f721c0052b0 2024-05-27T06:28:02.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.663+0000 7f7231600640 1 --2- 172.21.15.87:0/2328993797 >> [v2:172.21.15.87:6816/1173805234,v1:172.21.15.87:6818/1173805234] conn(0x7f7214078c90 0x7f721407b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.663+0000 7f7231600640 1 -- 172.21.15.87:0/2328993797 --> [v2:172.21.15.87:6816/1173805234,v1:172.21.15.87:6818/1173805234] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7228020e70 con 0x7f7214078c90 2024-05-27T06:28:02.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.663+0000 7f7231600640 1 -- 172.21.15.87:0/2328993797 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f722808ffc0 con 0x7f721c0052b0 2024-05-27T06:28:02.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.663+0000 7fd68aa00640 1 --2- 172.21.15.87:0/1656163183 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd66806f4d0 0x7fd6680719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.663+0000 7fd68b400640 1 --2- 172.21.15.87:0/1656163183 >> [v2:172.21.15.149:6808/1171039913,v1:172.21.15.149:6809/1171039913] conn(0x7fd668078c90 0x7fd66807b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.663+0000 7f723a600640 1 --2- 172.21.15.87:0/2328993797 >> [v2:172.21.15.87:6816/1173805234,v1:172.21.15.87:6818/1173805234] conn(0x7f7214078c90 0x7f721407b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.663+0000 7f7239200640 1 --2- 172.21.15.87:0/2328993797 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f721406f4d0 0x7f72140719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.663+0000 7fc954c00640 1 -- 172.21.15.87:0/2810945938 <== osd.2 v2:172.21.15.87:6817/1441249238 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc94000de50 con 0x7fc934078c20 2024-05-27T06:28:02.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.663+0000 7f9fa7400640 1 --2- 172.21.15.87:0/2283478199 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9f9006f450 0x7f9f90071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.663+0000 7f723a600640 1 --2- 172.21.15.87:0/2328993797 >> [v2:172.21.15.87:6816/1173805234,v1:172.21.15.87:6818/1173805234] conn(0x7f7214078c90 0x7f721407b120 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.663+0000 7f9fa7400640 1 -- 172.21.15.87:0/2283478199 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9f9c08fae0 con 0x7f9fb00d08f0 2024-05-27T06:28:02.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.663+0000 7f9fa7400640 1 --2- 172.21.15.87:0/2283478199 >> [v2:172.21.15.149:6817/1551871079,v1:172.21.15.149:6819/1551871079] conn(0x7f9f90078c20 0x7f9f9007b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.663+0000 7f9fa7400640 1 -- 172.21.15.87:0/2283478199 --> [v2:172.21.15.149:6817/1551871079,v1:172.21.15.149:6819/1551871079] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9f9c016ec0 con 0x7f9f90078c20 2024-05-27T06:28:02.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.663+0000 7f9fa7400640 1 -- 172.21.15.87:0/2283478199 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9f9c08ffc0 con 0x7f9fb00d08f0 2024-05-27T06:28:02.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.663+0000 7f9fafe00640 1 --2- 172.21.15.87:0/2283478199 >> [v2:172.21.15.149:6817/1551871079,v1:172.21.15.149:6819/1551871079] conn(0x7f9f90078c20 0x7f9f9007b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.667+0000 7f9faea00640 1 --2- 172.21.15.87:0/2283478199 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9f9006f450 0x7f9f90071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.667+0000 7f9fafe00640 1 --2- 172.21.15.87:0/2283478199 >> [v2:172.21.15.149:6817/1551871079,v1:172.21.15.149:6819/1551871079] conn(0x7f9f90078c20 0x7f9f9007b0b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.667+0000 7f7231600640 1 -- 172.21.15.87:0/2328993797 <== osd.3 v2:172.21.15.87:6816/1173805234 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7228020e70 con 0x7f7214078c90 2024-05-27T06:28:02.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.667+0000 7f7239200640 1 --2- 172.21.15.87:0/2328993797 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f721406f4d0 0x7f72140719e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7220001870 tx=0x7f7220001940 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.667+0000 7f9fa7400640 1 -- 172.21.15.87:0/2283478199 <== osd.4 v2:172.21.15.149:6817/1551871079 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9f9c016ec0 con 0x7f9f90078c20 2024-05-27T06:28:02.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.667+0000 7f9faea00640 1 --2- 172.21.15.87:0/2283478199 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9f9006f450 0x7f9f90071960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0165c20 tx=0x7f9fa0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.667+0000 7fd68aa00640 1 --2- 172.21.15.87:0/1656163183 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd66806f4d0 0x7fd6680719e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd67c001ec0 tx=0x7fd67c001cf0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.667+0000 7fd68b400640 1 --2- 172.21.15.87:0/1656163183 >> [v2:172.21.15.149:6808/1171039913,v1:172.21.15.149:6809/1171039913] conn(0x7fd668078c90 0x7fd66807b120 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.671+0000 7fd683400640 1 -- 172.21.15.87:0/1656163183 <== osd.7 v2:172.21.15.149:6808/1171039913 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd674008eb0 con 0x7fd668078c90 2024-05-27T06:28:02.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.683+0000 7f2efe200640 1 -- 172.21.15.87:0/2915212340 --> [v2:172.21.15.87:6800/3674824716,v1:172.21.15.87:6801/3674824716] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2ef80508e0 con 0x7f2ed8078c10 2024-05-27T06:28:02.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.687+0000 7f2ef4c00640 1 -- 172.21.15.87:0/2915212340 <== osd.0 v2:172.21.15.87:6800/3674824716 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2ef80508e0 con 0x7f2ed8078c10 2024-05-27T06:28:02.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.687+0000 7f97f1400640 1 -- 172.21.15.87:0/1311130759 --> [v2:172.21.15.149:6816/582864816,v1:172.21.15.149:6818/582864816] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f97c4002de0 con 0x7f97cc078c40 2024-05-27T06:28:02.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.687+0000 7f2eee000640 1 -- 172.21.15.87:0/2915212340 >> [v2:172.21.15.87:6800/3674824716,v1:172.21.15.87:6801/3674824716] conn(0x7f2ed8078c10 msgr2=0x7f2ed807b0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.687+0000 7f97e3e00640 1 -- 172.21.15.87:0/1311130759 <== osd.5 v2:172.21.15.149:6816/582864816 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f97c4002de0 con 0x7f97cc078c40 2024-05-27T06:28:02.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.687+0000 7f946da00640 1 -- 172.21.15.87:0/1036175189 --> [v2:172.21.15.149:6800/531351314,v1:172.21.15.149:6801/531351314] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f94680508e0 con 0x7f9448078c20 2024-05-27T06:28:02.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.687+0000 7f2eee000640 1 --2- 172.21.15.87:0/2915212340 >> [v2:172.21.15.87:6800/3674824716,v1:172.21.15.87:6801/3674824716] conn(0x7f2ed8078c10 0x7f2ed807b0a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.687+0000 7f2eee000640 1 -- 172.21.15.87:0/2915212340 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2ed806f450 msgr2=0x7f2ed8071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.687+0000 7f2eee000640 1 --2- 172.21.15.87:0/2915212340 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2ed806f450 0x7f2ed8071960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2ef806f210 tx=0x7f2ee8008040 comp rx=0 tx=0).stop 2024-05-27T06:28:02.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.687+0000 7fa6d8a00640 1 -- 172.21.15.87:0/861038122 --> [v2:172.21.15.87:6808/2443981288,v1:172.21.15.87:6809/2443981288] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa6ac002de0 con 0x7fa6b4078cd0 2024-05-27T06:28:02.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.687+0000 7f2eee000640 1 -- 172.21.15.87:0/2915212340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ef806ea20 msgr2=0x7f2ef81662f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.687+0000 7f2eee000640 1 --2- 172.21.15.87:0/2915212340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ef806ea20 0x7f2ef81662f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2ee401c180 tx=0x7f2ee40190f0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.687+0000 7f97f1400640 1 -- 172.21.15.87:0/1311130759 >> [v2:172.21.15.149:6816/582864816,v1:172.21.15.149:6818/582864816] conn(0x7f97cc078c40 msgr2=0x7f97cc07b0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.687+0000 7f97f1400640 1 --2- 172.21.15.87:0/1311130759 >> [v2:172.21.15.149:6816/582864816,v1:172.21.15.149:6818/582864816] conn(0x7f97cc078c40 0x7f97cc07b0d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.687+0000 7f2efd800640 1 -- 172.21.15.87:0/2915212340 reap_dead start 2024-05-27T06:28:02.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.687+0000 7f2eee000640 1 -- 172.21.15.87:0/2915212340 shutdown_connections 2024-05-27T06:28:02.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.687+0000 7f2eee000640 1 -- 172.21.15.87:0/2915212340 >> 172.21.15.87:0/2915212340 conn(0x7f2ef80d1370 msgr2=0x7f2ef80734d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:02.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.687+0000 7f2eee000640 1 -- 172.21.15.87:0/2915212340 shutdown_connections 2024-05-27T06:28:02.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.687+0000 7f2eee000640 1 -- 172.21.15.87:0/2915212340 wait complete. 2024-05-27T06:28:02.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.687+0000 7fa6ca000640 1 -- 172.21.15.87:0/861038122 <== osd.1 v2:172.21.15.87:6808/2443981288 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa6ac002de0 con 0x7fa6b4078cd0 2024-05-27T06:28:02.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.687+0000 7f97f1400640 1 -- 172.21.15.87:0/1311130759 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f97cc06f500 msgr2=0x7f97cc071a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.687+0000 7f97f1400640 1 --2- 172.21.15.87:0/1311130759 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f97cc06f500 0x7f97cc071a10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f97d801c4f0 tx=0x7f97d8008040 comp rx=0 tx=0).stop 2024-05-27T06:28:02.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.687+0000 7f97f1400640 1 -- 172.21.15.87:0/1311130759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97ec0d2050 msgr2=0x7f97ec152fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.687+0000 7f97f1400640 1 --2- 172.21.15.87:0/1311130759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97ec0d2050 0x7f97ec152fb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f97e4007d70 tx=0x7f97e400e4b0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.687+0000 7f97f0a00640 1 -- 172.21.15.87:0/1311130759 reap_dead start 2024-05-27T06:28:02.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.687+0000 7fa6d8a00640 1 -- 172.21.15.87:0/861038122 >> [v2:172.21.15.87:6808/2443981288,v1:172.21.15.87:6809/2443981288] conn(0x7fa6b4078cd0 msgr2=0x7fa6b407b160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.687+0000 7fa6d8a00640 1 --2- 172.21.15.87:0/861038122 >> [v2:172.21.15.87:6808/2443981288,v1:172.21.15.87:6809/2443981288] conn(0x7fa6b4078cd0 0x7fa6b407b160 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.687+0000 7f945fe00640 1 -- 172.21.15.87:0/1036175189 <== osd.6 v2:172.21.15.149:6800/531351314 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f94680508e0 con 0x7f9448078c20 2024-05-27T06:28:02.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.691+0000 7fa6d8a00640 1 -- 172.21.15.87:0/861038122 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa6b406f500 msgr2=0x7fa6b4071a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.691+0000 7fa6d8a00640 1 --2- 172.21.15.87:0/861038122 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa6b406f500 0x7fa6b4071a10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40093f0 tx=0x7fa6c4009190 comp rx=0 tx=0).stop 2024-05-27T06:28:02.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.691+0000 7fa6d8a00640 1 -- 172.21.15.87:0/861038122 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6d41553e0 msgr2=0x7fa6d41674b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.691+0000 7fa6d8a00640 1 --2- 172.21.15.87:0/861038122 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6d41553e0 0x7fa6d41674b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc01cbf0 tx=0x7fa6b8005840 comp rx=0 tx=0).stop 2024-05-27T06:28:02.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.691+0000 7fa6d2800640 1 -- 172.21.15.87:0/861038122 reap_dead start 2024-05-27T06:28:02.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.691+0000 7f97f1400640 1 -- 172.21.15.87:0/1311130759 shutdown_connections 2024-05-27T06:28:02.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.691+0000 7f97f1400640 1 -- 172.21.15.87:0/1311130759 >> 172.21.15.87:0/1311130759 conn(0x7f97ec0b4f60 msgr2=0x7f97ec15f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:02.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.691+0000 7f97f1400640 1 -- 172.21.15.87:0/1311130759 shutdown_connections 2024-05-27T06:28:02.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.691+0000 7fa6d8a00640 1 -- 172.21.15.87:0/861038122 shutdown_connections 2024-05-27T06:28:02.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.691+0000 7fa6d8a00640 1 -- 172.21.15.87:0/861038122 >> 172.21.15.87:0/861038122 conn(0x7fa6d40b4850 msgr2=0x7fa6d4068740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:02.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.691+0000 7f97f1400640 1 -- 172.21.15.87:0/1311130759 wait complete. 2024-05-27T06:28:02.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.691+0000 7fa6d8a00640 1 -- 172.21.15.87:0/861038122 shutdown_connections 2024-05-27T06:28:02.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.691+0000 7fa6d8a00640 1 -- 172.21.15.87:0/861038122 wait complete. 2024-05-27T06:28:02.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.691+0000 7f946da00640 1 -- 172.21.15.87:0/1036175189 >> [v2:172.21.15.149:6800/531351314,v1:172.21.15.149:6801/531351314] conn(0x7f9448078c20 msgr2=0x7f944807b0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.691+0000 7f946da00640 1 --2- 172.21.15.87:0/1036175189 >> [v2:172.21.15.149:6800/531351314,v1:172.21.15.149:6801/531351314] conn(0x7f9448078c20 0x7f944807b0b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.691+0000 7f946da00640 1 -- 172.21.15.87:0/1036175189 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f944806f450 msgr2=0x7f9448071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.691+0000 7f946da00640 1 --2- 172.21.15.87:0/1036175189 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f944806f450 0x7f9448071960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f94600af000 tx=0x7f94600a7070 comp rx=0 tx=0).stop 2024-05-27T06:28:02.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.691+0000 7f946da00640 1 -- 172.21.15.87:0/1036175189 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94680b9360 msgr2=0x7f946815c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.691+0000 7f946da00640 1 --2- 172.21.15.87:0/1036175189 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94680b9360 0x7f946815c000 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f945400c400 tx=0x7f945400c8c0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.691+0000 7f946d000640 1 -- 172.21.15.87:0/1036175189 reap_dead start 2024-05-27T06:28:02.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.691+0000 7f946da00640 1 -- 172.21.15.87:0/1036175189 shutdown_connections 2024-05-27T06:28:02.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.691+0000 7f946da00640 1 -- 172.21.15.87:0/1036175189 >> 172.21.15.87:0/1036175189 conn(0x7f94680d55e0 msgr2=0x7f9468164e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:02.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.691+0000 7f946da00640 1 -- 172.21.15.87:0/1036175189 shutdown_connections 2024-05-27T06:28:02.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.691+0000 7f946da00640 1 -- 172.21.15.87:0/1036175189 wait complete. 2024-05-27T06:28:02.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.691+0000 7fc95ee00640 1 -- 172.21.15.87:0/2810945938 --> [v2:172.21.15.87:6817/1441249238,v1:172.21.15.87:6819/1441249238] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc930002de0 con 0x7fc934078c20 2024-05-27T06:28:02.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.695+0000 7fc954c00640 1 -- 172.21.15.87:0/2810945938 <== osd.2 v2:172.21.15.87:6817/1441249238 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc930002de0 con 0x7fc934078c20 2024-05-27T06:28:02.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.695+0000 7fc94d600640 1 -- 172.21.15.87:0/2810945938 >> [v2:172.21.15.87:6817/1441249238,v1:172.21.15.87:6819/1441249238] conn(0x7fc934078c20 msgr2=0x7fc93407b0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.695+0000 7fc94d600640 1 --2- 172.21.15.87:0/2810945938 >> [v2:172.21.15.87:6817/1441249238,v1:172.21.15.87:6819/1441249238] conn(0x7fc934078c20 0x7fc93407b0b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.695+0000 7f9fb6000640 1 -- 172.21.15.87:0/2283478199 --> [v2:172.21.15.149:6817/1551871079,v1:172.21.15.149:6819/1551871079] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9fb015cf90 con 0x7f9f90078c20 2024-05-27T06:28:02.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.695+0000 7fc94d600640 1 -- 172.21.15.87:0/2810945938 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc93406f4d0 msgr2=0x7fc9340719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.695+0000 7fc94d600640 1 --2- 172.21.15.87:0/2810945938 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc93406f4d0 0x7fc9340719e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc958164280 tx=0x7fc948008040 comp rx=0 tx=0).stop 2024-05-27T06:28:02.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.695+0000 7fc94d600640 1 -- 172.21.15.87:0/2810945938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc95806c7b0 msgr2=0x7fc9580aee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.695+0000 7fc94d600640 1 --2- 172.21.15.87:0/2810945938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc95806c7b0 0x7fc9580aee50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc94000b410 tx=0x7fc94000b8d0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.695+0000 7f9fa7400640 1 -- 172.21.15.87:0/2283478199 <== osd.4 v2:172.21.15.149:6817/1551871079 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9fb015cf90 con 0x7f9f90078c20 2024-05-27T06:28:02.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.695+0000 7fc95ce00640 1 -- 172.21.15.87:0/2810945938 reap_dead start 2024-05-27T06:28:02.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.695+0000 7fc94d600640 1 -- 172.21.15.87:0/2810945938 shutdown_connections 2024-05-27T06:28:02.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.695+0000 7fc94d600640 1 -- 172.21.15.87:0/2810945938 >> 172.21.15.87:0/2810945938 conn(0x7fc9580b2fb0 msgr2=0x7fc95806f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:02.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.695+0000 7fc94d600640 1 -- 172.21.15.87:0/2810945938 shutdown_connections 2024-05-27T06:28:02.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.695+0000 7fc94d600640 1 -- 172.21.15.87:0/2810945938 wait complete. 2024-05-27T06:28:02.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.695+0000 7f9fb6000640 1 -- 172.21.15.87:0/2283478199 >> [v2:172.21.15.149:6817/1551871079,v1:172.21.15.149:6819/1551871079] conn(0x7f9f90078c20 msgr2=0x7f9f9007b0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.695+0000 7f9fb6000640 1 --2- 172.21.15.87:0/2283478199 >> [v2:172.21.15.149:6817/1551871079,v1:172.21.15.149:6819/1551871079] conn(0x7f9f90078c20 0x7f9f9007b0b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.699+0000 7f9fb6000640 1 -- 172.21.15.87:0/2283478199 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9f9006f450 msgr2=0x7f9f90071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.699+0000 7f9fb6000640 1 --2- 172.21.15.87:0/2283478199 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9f9006f450 0x7f9f90071960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0165c20 tx=0x7f9fa0008040 comp rx=0 tx=0).stop 2024-05-27T06:28:02.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.699+0000 7f9fb6000640 1 -- 172.21.15.87:0/2283478199 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fb00d08f0 msgr2=0x7f9fb01539f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.699+0000 7f9fb6000640 1 --2- 172.21.15.87:0/2283478199 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fb00d08f0 0x7f9fb01539f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00e870 tx=0x7f9f9c00ed30 comp rx=0 tx=0).stop 2024-05-27T06:28:02.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.699+0000 7f9fafe00640 1 -- 172.21.15.87:0/2283478199 reap_dead start 2024-05-27T06:28:02.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.699+0000 7f9fb6000640 1 -- 172.21.15.87:0/2283478199 shutdown_connections 2024-05-27T06:28:02.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.699+0000 7f9fb6000640 1 -- 172.21.15.87:0/2283478199 >> 172.21.15.87:0/2283478199 conn(0x7f9fb00b2fb0 msgr2=0x7f9fb0161860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:02.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.699+0000 7f723b000640 1 -- 172.21.15.87:0/2328993797 --> [v2:172.21.15.87:6816/1173805234,v1:172.21.15.87:6818/1173805234] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f723406f7b0 con 0x7f7214078c90 2024-05-27T06:28:02.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.699+0000 7f9fb6000640 1 -- 172.21.15.87:0/2283478199 shutdown_connections 2024-05-27T06:28:02.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.699+0000 7f9fb6000640 1 -- 172.21.15.87:0/2283478199 wait complete. 2024-05-27T06:28:02.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.699+0000 7fd67be00640 1 -- 172.21.15.87:0/1656163183 --> [v2:172.21.15.149:6808/1171039913,v1:172.21.15.149:6809/1171039913] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd68c15d3c0 con 0x7fd668078c90 2024-05-27T06:28:02.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.699+0000 7f7231600640 1 -- 172.21.15.87:0/2328993797 <== osd.3 v2:172.21.15.87:6816/1173805234 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f723406f7b0 con 0x7f7214078c90 2024-05-27T06:28:02.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.699+0000 7fd683400640 1 -- 172.21.15.87:0/1656163183 <== osd.7 v2:172.21.15.149:6808/1171039913 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd68c15d3c0 con 0x7fd668078c90 2024-05-27T06:28:02.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.703+0000 7f723b000640 1 -- 172.21.15.87:0/2328993797 >> [v2:172.21.15.87:6816/1173805234,v1:172.21.15.87:6818/1173805234] conn(0x7f7214078c90 msgr2=0x7f721407b120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.703+0000 7f723b000640 1 --2- 172.21.15.87:0/2328993797 >> [v2:172.21.15.87:6816/1173805234,v1:172.21.15.87:6818/1173805234] conn(0x7f7214078c90 0x7f721407b120 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.703+0000 7f723b000640 1 -- 172.21.15.87:0/2328993797 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f721406f4d0 msgr2=0x7f72140719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.703+0000 7f723b000640 1 --2- 172.21.15.87:0/2328993797 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f721406f4d0 0x7f72140719e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7220001870 tx=0x7f7220001940 comp rx=0 tx=0).stop 2024-05-27T06:28:02.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.703+0000 7f723b000640 1 -- 172.21.15.87:0/2328993797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f721c0052b0 msgr2=0x7f7234153a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.703+0000 7f723b000640 1 --2- 172.21.15.87:0/2328993797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f721c0052b0 0x7f7234153a00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7228009fd0 tx=0x7f7228011a60 comp rx=0 tx=0).stop 2024-05-27T06:28:02.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.703+0000 7f723a600640 1 -- 172.21.15.87:0/2328993797 reap_dead start 2024-05-27T06:28:02.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.703+0000 7f723b000640 1 -- 172.21.15.87:0/2328993797 shutdown_connections 2024-05-27T06:28:02.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.703+0000 7fd67be00640 1 -- 172.21.15.87:0/1656163183 >> [v2:172.21.15.149:6808/1171039913,v1:172.21.15.149:6809/1171039913] conn(0x7fd668078c90 msgr2=0x7fd66807b120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.703+0000 7f723b000640 1 -- 172.21.15.87:0/2328993797 >> 172.21.15.87:0/2328993797 conn(0x7f72340b3d80 msgr2=0x7f723415bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:02.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.703+0000 7fd67be00640 1 --2- 172.21.15.87:0/1656163183 >> [v2:172.21.15.149:6808/1171039913,v1:172.21.15.149:6809/1171039913] conn(0x7fd668078c90 0x7fd66807b120 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.703+0000 7f723b000640 1 -- 172.21.15.87:0/2328993797 shutdown_connections 2024-05-27T06:28:02.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.703+0000 7f723b000640 1 -- 172.21.15.87:0/2328993797 wait complete. 2024-05-27T06:28:02.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.703+0000 7fd67be00640 1 -- 172.21.15.87:0/1656163183 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd66806f4d0 msgr2=0x7fd6680719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.703+0000 7fd67be00640 1 --2- 172.21.15.87:0/1656163183 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd66806f4d0 0x7fd6680719e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd67c001ec0 tx=0x7fd67c001cf0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.703+0000 7fd67be00640 1 -- 172.21.15.87:0/1656163183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd68c0d08f0 msgr2=0x7fd68c1630d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.703+0000 7fd67be00640 1 --2- 172.21.15.87:0/1656163183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd68c0d08f0 0x7fd68c1630d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd67400e8e0 tx=0x7fd67400eda0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.703+0000 7fd68b400640 1 -- 172.21.15.87:0/1656163183 reap_dead start 2024-05-27T06:28:02.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.703+0000 7fd67be00640 1 -- 172.21.15.87:0/1656163183 shutdown_connections 2024-05-27T06:28:02.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.703+0000 7fd67be00640 1 -- 172.21.15.87:0/1656163183 >> 172.21.15.87:0/1656163183 conn(0x7fd68c0b2fb0 msgr2=0x7fd68c06f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:02.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.703+0000 7fd67be00640 1 -- 172.21.15.87:0/1656163183 shutdown_connections 2024-05-27T06:28:02.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.703+0000 7fd67be00640 1 -- 172.21.15.87:0/1656163183 wait complete. 2024-05-27T06:28:02.730 INFO:teuthology.orchestra.run.smithi087.stdout:55834574859 2024-05-27T06:28:02.730 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-27T06:28:02.735 INFO:teuthology.orchestra.run.smithi087.stdout:55834574859 2024-05-27T06:28:02.735 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-27T06:28:02.737 INFO:teuthology.orchestra.run.smithi087.stdout:55834574859 2024-05-27T06:28:02.738 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-27T06:28:02.739 INFO:teuthology.orchestra.run.smithi087.stdout:55834574859 2024-05-27T06:28:02.739 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-27T06:28:02.748 INFO:teuthology.orchestra.run.smithi087.stdout:55834574860 2024-05-27T06:28:02.748 INFO:teuthology.orchestra.run.smithi087.stdout:55834574859 2024-05-27T06:28:02.748 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-27T06:28:02.749 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-27T06:28:02.750 INFO:teuthology.orchestra.run.smithi087.stdout:55834574859 2024-05-27T06:28:02.750 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-27T06:28:02.751 INFO:teuthology.orchestra.run.smithi087.stdout:55834574858 2024-05-27T06:28:02.751 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-27T06:28:02.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.975+0000 7fa572800640 1 Processor -- start 2024-05-27T06:28:02.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.975+0000 7fa572800640 1 -- start start 2024-05-27T06:28:02.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.975+0000 7fbe30c00640 1 Processor -- start 2024-05-27T06:28:02.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.975+0000 7fbe30c00640 1 -- start start 2024-05-27T06:28:02.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.979+0000 7fa572800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa56c164620 0x7fa56c0d5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.979+0000 7fa572800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa56c0d60e0 0x7fa56c0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.979+0000 7fbe30c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe2c15f8d0 0x7fbe2c15fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.979+0000 7fbe30c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbe2c160220 0x7fbe2c15c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.979+0000 7fa572800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa56c0b7690 0x7fa56c0b7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.979+0000 7fa572800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fa56c0b7fe0 con 0x7fa56c164620 2024-05-27T06:28:02.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.979+0000 7fa56be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa56c0b7690 0x7fa56c0b7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.979+0000 7fbe2a800640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fbe2c15c820 0x7fbe2c15cc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:58806/0 (socket says 172.21.15.87:58806) 2024-05-27T06:28:02.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.979+0000 7fa56be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa56c0b7690 0x7fa56c0b7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.87:45096/0 (socket says 172.21.15.87:45096) 2024-05-27T06:28:02.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.979+0000 7fbe29400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbe2c160220 0x7fbe2c15c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.979+0000 7fa56be00640 1 -- 172.21.15.87:0/2473406352 learned_addr learned my addr 172.21.15.87:0/2473406352 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:02.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.979+0000 7fbe29400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbe2c160220 0x7fbe2c15c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:39784/0 (socket says 172.21.15.87:39784) 2024-05-27T06:28:02.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.979+0000 7fbe2a800640 1 -- 172.21.15.87:0/2282350231 learned_addr learned my addr 172.21.15.87:0/2282350231 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:02.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.979+0000 7fa56aa00640 1 --2- 172.21.15.87:0/2473406352 >> v2:172.21.15.149:3300/0 conn(0x7fa56c0d60e0 0x7fa56c0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.979+0000 7fa572800640 1 -- 172.21.15.87:0/2473406352 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fa56c160570 con 0x7fa56c0d60e0 2024-05-27T06:28:02.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.979+0000 7fa572800640 1 -- 172.21.15.87:0/2473406352 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa56c164a30 con 0x7fa56c0b7690 2024-05-27T06:28:02.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.979+0000 7fbe30c00640 1 -- 172.21.15.87:0/2282350231 --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe2c06f6d0 con 0x7fbe2c15c820 2024-05-27T06:28:02.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.983+0000 7fbe30c00640 1 -- 172.21.15.87:0/2282350231 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fbe2c06f9b0 con 0x7fbe2c160220 2024-05-27T06:28:02.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.983+0000 7fbe30c00640 1 -- 172.21.15.87:0/2282350231 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbe2c06fc90 con 0x7fbe2c15f8d0 2024-05-27T06:28:02.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.983+0000 7fa56b400640 1 --2- 172.21.15.87:0/2473406352 >> v2:172.21.15.87:3300/0 conn(0x7fa56c164620 0x7fa56c0d5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.983+0000 7fbe29e00640 1 --2- 172.21.15.87:0/2282350231 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe2c15f8d0 0x7fbe2c15fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.983+0000 7fa56aa00640 1 -- 172.21.15.87:0/2473406352 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa56c0b7690 msgr2=0x7fa56c0b7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:02.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.983+0000 7fbe29400640 1 -- 172.21.15.87:0/2282350231 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe2c15f8d0 msgr2=0x7fbe2c15fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:02.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.983+0000 7fbe29400640 1 --2- 172.21.15.87:0/2282350231 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe2c15f8d0 0x7fbe2c15fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.983+0000 7fbe29400640 1 -- 172.21.15.87:0/2282350231 >> v1:172.21.15.87:6789/0 conn(0x7fbe2c15c820 legacy=0x7fbe2c15cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.983+0000 7fbe29400640 1 -- 172.21.15.87:0/2282350231 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe2c06ff70 con 0x7fbe2c160220 2024-05-27T06:28:02.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.983+0000 7fa56aa00640 1 --2- 172.21.15.87:0/2473406352 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa56c0b7690 0x7fa56c0b7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.983+0000 7fa56aa00640 1 -- 172.21.15.87:0/2473406352 >> v2:172.21.15.87:3300/0 conn(0x7fa56c164620 msgr2=0x7fa56c0d5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:02.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.983+0000 7fa56aa00640 1 --2- 172.21.15.87:0/2473406352 >> v2:172.21.15.87:3300/0 conn(0x7fa56c164620 0x7fa56c0d5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.983+0000 7fa56aa00640 1 -- 172.21.15.87:0/2473406352 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56c0d64f0 con 0x7fa56c0d60e0 2024-05-27T06:28:02.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.987+0000 7f9cf2c00640 1 Processor -- start 2024-05-27T06:28:02.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.987+0000 7f9cf2c00640 1 -- start start 2024-05-27T06:28:02.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.987+0000 7fa56aa00640 1 --2- 172.21.15.87:0/2473406352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa56c0d60e0 0x7fa56c0b7150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa56c0d24e0 tx=0x7fa55c01c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f815d0f1e03e0c90 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.987+0000 7fbe29400640 1 --2- 172.21.15.87:0/2282350231 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe2c160220 0x7fbe2c15c2e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c00b870 tx=0x7fbe1c01c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a19d77534b96a9f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:02.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.987+0000 7fa56a000640 1 -- 172.21.15.87:0/2473406352 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0b0070 con 0x7fa56c0d60e0 2024-05-27T06:28:02.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.987+0000 7fa56a000640 1 -- 172.21.15.87:0/2473406352 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa55c0ab600 con 0x7fa56c0d60e0 2024-05-27T06:28:02.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.987+0000 7fbe28a00640 1 -- 172.21.15.87:0/2282350231 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c0b2070 con 0x7fbe2c160220 2024-05-27T06:28:02.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.987+0000 7fbe28a00640 1 -- 172.21.15.87:0/2282350231 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe1c0a5980 con 0x7fbe2c160220 2024-05-27T06:28:02.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.987+0000 7fbe28a00640 1 -- 172.21.15.87:0/2282350231 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c0a5d50 con 0x7fbe2c160220 2024-05-27T06:28:02.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.987+0000 7fa56a000640 1 -- 172.21.15.87:0/2473406352 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0ab9d0 con 0x7fa56c0d60e0 2024-05-27T06:28:02.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7fe6f9400640 1 Processor -- start 2024-05-27T06:28:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7fa572800640 1 -- 172.21.15.87:0/2473406352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa56c0d60e0 msgr2=0x7fa56c0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7fa572800640 1 --2- 172.21.15.87:0/2473406352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa56c0d60e0 0x7fa56c0b7150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa56c0d24e0 tx=0x7fa55c01c330 comp rx=0 tx=0).stop 2024-05-27T06:28:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7fbe30c00640 1 -- 172.21.15.87:0/2282350231 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe2c160220 msgr2=0x7fbe2c15c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7fbe30c00640 1 --2- 172.21.15.87:0/2282350231 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe2c160220 0x7fbe2c15c2e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c00b870 tx=0x7fbe1c01c8a0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7fa572800640 1 -- 172.21.15.87:0/2473406352 shutdown_connections 2024-05-27T06:28:02.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7fa572800640 1 --2- 172.21.15.87:0/2473406352 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa56c0b7690 0x7fa56c0b7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7fa572800640 1 --2- 172.21.15.87:0/2473406352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa56c0d60e0 0x7fa56c0b7150 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7fa572800640 1 --2- 172.21.15.87:0/2473406352 >> v2:172.21.15.87:3300/0 conn(0x7fa56c164620 0x7fa56c0d5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7fa572800640 1 -- 172.21.15.87:0/2473406352 >> 172.21.15.87:0/2473406352 conn(0x7fa56c09ec10 msgr2=0x7fa56c08cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:02.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7fbe30c00640 1 -- 172.21.15.87:0/2282350231 shutdown_connections 2024-05-27T06:28:02.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7fbe30c00640 1 --2- 172.21.15.87:0/2282350231 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe2c160220 0x7fbe2c15c2e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7fbe30c00640 1 --2- 172.21.15.87:0/2282350231 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe2c15f8d0 0x7fbe2c15fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7fbe30c00640 1 -- 172.21.15.87:0/2282350231 >> 172.21.15.87:0/2282350231 conn(0x7fbe2c0b2fb0 msgr2=0x7fbe2c0b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:02.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7fe6f9400640 1 -- start start 2024-05-27T06:28:02.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7fbe30c00640 1 -- 172.21.15.87:0/2282350231 shutdown_connections 2024-05-27T06:28:02.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7fbe30c00640 1 -- 172.21.15.87:0/2282350231 wait complete. 2024-05-27T06:28:02.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7f9cf2c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cec0d2f20 0x7f9cec15e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7f9cf2c00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cec0d1d90 con 0x7f9cec0b3580 2024-05-27T06:28:02.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7f9cf2c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cec0d2030 con 0x7f9cec0d2b10 2024-05-27T06:28:02.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7f9cf2c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9cec0b6780 con 0x7f9cec0d2f20 2024-05-27T06:28:02.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7f9cf1800640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f9cec0d2b10 0x7f9cec0b2e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.87:47586/0 (socket says 172.21.15.87:47586) 2024-05-27T06:28:02.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7f9cf1800640 1 -- 172.21.15.87:0/2486630932 learned_addr learned my addr 172.21.15.87:0/2486630932 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:02.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7fa572800640 1 -- 172.21.15.87:0/2473406352 shutdown_connections 2024-05-27T06:28:02.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7f9cf2200640 1 --2- 172.21.15.87:0/2486630932 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cec0d2f20 0x7f9cec15e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7fa572800640 1 -- 172.21.15.87:0/2473406352 wait complete. 2024-05-27T06:28:02.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7f9cebe00640 1 -- 172.21.15.87:0/2486630932 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1936700666 0 0) 0x7f9cec0d1d90 con 0x7f9cec0b3580 2024-05-27T06:28:02.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7f9cebe00640 1 -- 172.21.15.87:0/2486630932 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cd4003530 con 0x7f9cec0b3580 2024-05-27T06:28:02.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7f9cf2200640 1 -- 172.21.15.87:0/2486630932 >> v1:172.21.15.149:6789/0 conn(0x7f9cec0d2b10 legacy=0x7f9cec0b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7f9cf2200640 1 -- 172.21.15.87:0/2486630932 >> v1:172.21.15.87:6789/0 conn(0x7f9cec0b3580 legacy=0x7f9cec15dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.991+0000 7f9cf2200640 1 -- 172.21.15.87:0/2486630932 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cec0d2310 con 0x7f9cec0d2f20 2024-05-27T06:28:02.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.995+0000 7fbe30c00640 1 Processor -- start 2024-05-27T06:28:02.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.995+0000 7fbe30c00640 1 -- start start 2024-05-27T06:28:02.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.995+0000 7fe6f9400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6f40b0e20 0x7fe6f415cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.995+0000 7fe6f9400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe6f415cff0 0x7fe6f40d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.995+0000 7fe6f9400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6f40d2100 con 0x7fe6f40d1cf0 2024-05-27T06:28:02.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.995+0000 7fe6f9400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fe6f40b1c60 con 0x7fe6f415cff0 2024-05-27T06:28:02.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.995+0000 7fe6f9400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe6f40b1370 con 0x7fe6f40b0e20 2024-05-27T06:28:02.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.995+0000 7fa572800640 1 Processor -- start 2024-05-27T06:28:02.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.995+0000 7fa572800640 1 -- start start 2024-05-27T06:28:02.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.995+0000 7fe6f1e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe6f415cff0 0x7fe6f40d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.995+0000 7fe6f1e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe6f415cff0 0x7fe6f40d17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:39786/0 (socket says 172.21.15.87:39786) 2024-05-27T06:28:02.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.995+0000 7fe6f1e00640 1 -- 172.21.15.87:0/3656229016 learned_addr learned my addr 172.21.15.87:0/3656229016 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:02.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.995+0000 7fe6f2800640 1 --2- 172.21.15.87:0/3656229016 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6f40b0e20 0x7fe6f415cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.995+0000 7fe6f1400640 1 -- 172.21.15.87:0/3656229016 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3655755217 0 0) 0x7fe6ec0014a0 con 0x7fe6f40d1cf0 2024-05-27T06:28:02.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.995+0000 7fe6f1400640 1 -- 172.21.15.87:0/3656229016 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6d8003530 con 0x7fe6f40d1cf0 2024-05-27T06:28:02.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.995+0000 7fe6f1e00640 1 -- 172.21.15.87:0/3656229016 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6f40b0e20 msgr2=0x7fe6f415cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:02.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.995+0000 7fe6f1e00640 1 --2- 172.21.15.87:0/3656229016 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6f40b0e20 0x7fe6f415cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:02.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.995+0000 7fe6f1e00640 1 -- 172.21.15.87:0/3656229016 >> v1:172.21.15.149:6789/0 conn(0x7fe6f40d1cf0 legacy=0x7fe6f4073e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:02.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.995+0000 7fe6f1e00640 1 -- 172.21.15.87:0/3656229016 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6f415fb40 con 0x7fe6f415cff0 2024-05-27T06:28:02.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fbe30c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe2c15c820 0x7fbe2c0ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fbe30c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe2c15f8d0 0x7fbe2c0cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fbe29e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe2c15c820 0x7fbe2c0ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fbe29e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe2c15c820 0x7fbe2c0ce9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.87:45126/0 (socket says 172.21.15.87:45126) 2024-05-27T06:28:02.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fbe29e00640 1 -- 172.21.15.87:0/692743179 learned_addr learned my addr 172.21.15.87:0/692743179 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:02.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fbe30c00640 1 --2- 172.21.15.87:0/692743179 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe2c160220 0x7fbe2c155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fbe29400640 1 --2- 172.21.15.87:0/692743179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe2c15f8d0 0x7fbe2c0cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fbe30c00640 1 -- 172.21.15.87:0/692743179 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2c072a70 con 0x7fbe2c15f8d0 2024-05-27T06:28:02.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fbe30c00640 1 -- 172.21.15.87:0/692743179 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2c06f470 con 0x7fbe2c160220 2024-05-27T06:28:02.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fbe30c00640 1 -- 172.21.15.87:0/692743179 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbe2c072bf0 con 0x7fbe2c15c820 2024-05-27T06:28:02.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fa572800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa56c0b7690 0x7fa56c0ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fa572800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa56c0d60e0 0x7fa56c0b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fa572800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa56c164620 0x7fa56c0b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:02.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fa56b400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa56c0b7690 0x7fa56c0ceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fa56b400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa56c0b7690 0x7fa56c0ceee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:39800/0 (socket says 172.21.15.87:39800) 2024-05-27T06:28:02.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fa572800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c0d2050 con 0x7fa56c0d60e0 2024-05-27T06:28:02.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fa572800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c0d1d70 con 0x7fa56c0b7690 2024-05-27T06:28:02.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fa572800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa56c0d1460 con 0x7fa56c164620 2024-05-27T06:28:02.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fbe2a800640 1 --2- 172.21.15.87:0/692743179 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe2c160220 0x7fbe2c155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fa56be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa56c164620 0x7fa56c0b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fa56be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa56c164620 0x7fa56c0b63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.87:45128/0 (socket says 172.21.15.87:45128) 2024-05-27T06:28:02.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fa56be00640 1 -- 172.21.15.87:0/3076306012 learned_addr learned my addr 172.21.15.87:0/3076306012 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:02.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fa56aa00640 1 --2- 172.21.15.87:0/3076306012 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa56c0d60e0 0x7fa56c0b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:02.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7f9cf2200640 1 --2- 172.21.15.87:0/2486630932 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cec0d2f20 0x7f9cec15e490 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4009dc0 tx=0x7f9ce401c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=354ef15e4e55dacc server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fa56be00640 1 -- 172.21.15.87:0/3076306012 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa56c0b7690 msgr2=0x7fa56c0ceee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fa56be00640 1 --2- 172.21.15.87:0/3076306012 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa56c0b7690 0x7fa56c0ceee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fa56be00640 1 -- 172.21.15.87:0/3076306012 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa56c0d60e0 msgr2=0x7fa56c0b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fa56be00640 1 --2- 172.21.15.87:0/3076306012 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa56c0d60e0 0x7fa56c0b5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fa56be00640 1 -- 172.21.15.87:0/3076306012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56c14f9d0 con 0x7fa56c164620 2024-05-27T06:28:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fa56b400640 1 --2- 172.21.15.87:0/3076306012 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa56c0b7690 0x7fa56c0ceee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:03.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fbe2a800640 1 -- 172.21.15.87:0/692743179 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe2c15c820 msgr2=0x7fbe2c0ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7f9cebe00640 1 -- 172.21.15.87:0/2486630932 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce40b2070 con 0x7f9cec0d2f20 2024-05-27T06:28:03.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7f9cebe00640 1 -- 172.21.15.87:0/2486630932 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce40a5960 con 0x7f9cec0d2f20 2024-05-27T06:28:03.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fbe2a800640 1 --2- 172.21.15.87:0/692743179 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe2c15c820 0x7fbe2c0ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fbe2a800640 1 -- 172.21.15.87:0/692743179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe2c15f8d0 msgr2=0x7fbe2c0cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fbe2a800640 1 --2- 172.21.15.87:0/692743179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe2c15f8d0 0x7fbe2c0cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:02.999+0000 7fbe2a800640 1 -- 172.21.15.87:0/692743179 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe2c0ce3e0 con 0x7fbe2c160220 2024-05-27T06:28:03.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.003+0000 7fa56be00640 1 --2- 172.21.15.87:0/3076306012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa56c164620 0x7fa56c0b63d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa564007ac0 tx=0x7fa564007f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:03.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.003+0000 7fbe2a800640 1 --2- 172.21.15.87:0/692743179 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe2c160220 0x7fbe2c155f60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe1800c390 tx=0x7fbe1800c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:03.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.003+0000 7f9cebe00640 1 -- 172.21.15.87:0/2486630932 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce40b2070 con 0x7f9cec0d2f20 2024-05-27T06:28:03.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.003+0000 7fa563400640 1 -- 172.21.15.87:0/3076306012 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56400dc40 con 0x7fa56c164620 2024-05-27T06:28:03.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.003+0000 7fa563400640 1 -- 172.21.15.87:0/3076306012 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa56400de00 con 0x7fa56c164620 2024-05-27T06:28:03.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.003+0000 7fbe22000640 1 -- 172.21.15.87:0/692743179 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe18017070 con 0x7fbe2c160220 2024-05-27T06:28:03.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.003+0000 7fbe22000640 1 -- 172.21.15.87:0/692743179 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe18005d10 con 0x7fbe2c160220 2024-05-27T06:28:03.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.003+0000 7fbe22000640 1 -- 172.21.15.87:0/692743179 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe18007310 con 0x7fbe2c160220 2024-05-27T06:28:03.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.003+0000 7fa572800640 1 -- 172.21.15.87:0/3076306012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa56c14fcb0 con 0x7fa56c164620 2024-05-27T06:28:03.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.003+0000 7fa572800640 1 -- 172.21.15.87:0/3076306012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa56c06cc50 con 0x7fa56c164620 2024-05-27T06:28:03.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.003+0000 7fa563400640 1 -- 172.21.15.87:0/3076306012 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa564003be0 con 0x7fa56c164620 2024-05-27T06:28:03.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.003+0000 7fbe30c00640 1 -- 172.21.15.87:0/692743179 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe2c09d6e0 con 0x7fbe2c160220 2024-05-27T06:28:03.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.003+0000 7fbe30c00640 1 -- 172.21.15.87:0/692743179 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe2c0ce6c0 con 0x7fbe2c160220 2024-05-27T06:28:03.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.003+0000 7f9cf2c00640 1 -- 172.21.15.87:0/2486630932 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cec0d2f20 msgr2=0x7f9cec15e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.003+0000 7f9cf2c00640 1 --2- 172.21.15.87:0/2486630932 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cec0d2f20 0x7f9cec15e490 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4009dc0 tx=0x7f9ce401c9b0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.003+0000 7fe6f1e00640 1 --2- 172.21.15.87:0/3656229016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6f415cff0 0x7fe6f40d17b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4008870 tx=0x7fe6e401e9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf0c89a724135214 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:03.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.003+0000 7fe6f1400640 1 -- 172.21.15.87:0/3656229016 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e40ad070 con 0x7fe6f415cff0 2024-05-27T06:28:03.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.003+0000 7fe6f1400640 1 -- 172.21.15.87:0/3656229016 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e40a7920 con 0x7fe6f415cff0 2024-05-27T06:28:03.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.003+0000 7fe6f1400640 1 -- 172.21.15.87:0/3656229016 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e40a7cf0 con 0x7fe6f415cff0 2024-05-27T06:28:03.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.007+0000 7fbe30c00640 1 -- 172.21.15.87:0/692743179 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe2c0ce150 con 0x7fbe2c160220 2024-05-27T06:28:03.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.007+0000 7fe6f9400640 1 -- 172.21.15.87:0/3656229016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6f415cff0 msgr2=0x7fe6f40d17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.007+0000 7fe6f9400640 1 --2- 172.21.15.87:0/3656229016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6f415cff0 0x7fe6f40d17b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4008870 tx=0x7fe6e401e9e0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.007+0000 7f9cf2c00640 1 -- 172.21.15.87:0/2486630932 shutdown_connections 2024-05-27T06:28:03.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.007+0000 7f9cf2c00640 1 --2- 172.21.15.87:0/2486630932 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cec0d2f20 0x7f9cec15e490 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.007+0000 7f9cf2c00640 1 -- 172.21.15.87:0/2486630932 >> 172.21.15.87:0/2486630932 conn(0x7f9cec0d35c0 msgr2=0x7f9cec0d39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:03.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.007+0000 7fa572800640 1 -- 172.21.15.87:0/3076306012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5440052a0 con 0x7fa56c164620 2024-05-27T06:28:03.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.007+0000 7fe6f9400640 1 -- 172.21.15.87:0/3656229016 shutdown_connections 2024-05-27T06:28:03.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.007+0000 7fe6f9400640 1 --2- 172.21.15.87:0/3656229016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6f415cff0 0x7fe6f40d17b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.007+0000 7fe6f9400640 1 --2- 172.21.15.87:0/3656229016 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6f40b0e20 0x7fe6f415cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.007+0000 7fe6f9400640 1 -- 172.21.15.87:0/3656229016 >> 172.21.15.87:0/3656229016 conn(0x7fe6f4072ca0 msgr2=0x7fe6f40b6290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:03.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.007+0000 7fa563400640 1 -- 172.21.15.87:0/3076306012 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa56401c020 con 0x7fa56c164620 2024-05-27T06:28:03.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.007+0000 7f9cf2c00640 1 -- 172.21.15.87:0/2486630932 shutdown_connections 2024-05-27T06:28:03.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.007+0000 7f9cf2c00640 1 -- 172.21.15.87:0/2486630932 wait complete. 2024-05-27T06:28:03.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.007+0000 7fe6f9400640 1 -- 172.21.15.87:0/3656229016 shutdown_connections 2024-05-27T06:28:03.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.007+0000 7fe6f9400640 1 -- 172.21.15.87:0/3656229016 wait complete. 2024-05-27T06:28:03.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.007+0000 7fbe22000640 1 -- 172.21.15.87:0/692743179 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbe1801a070 con 0x7fbe2c160220 2024-05-27T06:28:03.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.007+0000 7fbe22000640 1 --2- 172.21.15.87:0/692743179 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbe0c06f4d0 0x7fbe0c0719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.011+0000 7fbe22000640 1 -- 172.21.15.87:0/692743179 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbe1808eb30 con 0x7fbe2c160220 2024-05-27T06:28:03.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.011+0000 7fbe29e00640 1 --2- 172.21.15.87:0/692743179 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbe0c06f4d0 0x7fbe0c0719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.011+0000 7fa563400640 1 --2- 172.21.15.87:0/3076306012 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa54c06f400 0x7fa54c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.011+0000 7fa563400640 1 -- 172.21.15.87:0/3076306012 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa56408f250 con 0x7fa56c164620 2024-05-27T06:28:03.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.011+0000 7fa56b400640 1 --2- 172.21.15.87:0/3076306012 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa54c06f400 0x7fa54c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.011+0000 7f9cf2c00640 1 Processor -- start 2024-05-27T06:28:03.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.011+0000 7fe6f9400640 1 Processor -- start 2024-05-27T06:28:03.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.011+0000 7fa56b400640 1 --2- 172.21.15.87:0/3076306012 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa54c06f400 0x7fa54c071910 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa558006fd0 tx=0x7fa558008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:03.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.011+0000 7fbe22000640 1 -- 172.21.15.87:0/692743179 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fbe1805b070 con 0x7fbe2c160220 2024-05-27T06:28:03.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.011+0000 7f9cf2c00640 1 -- start start 2024-05-27T06:28:03.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.011+0000 7fe6f9400640 1 -- start start 2024-05-27T06:28:03.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7f9cf2c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cec0b3580 0x7f9cec071240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7f9cf2c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cec0d2b10 0x7f9cec1593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7f9cf2c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cec0d2f20 0x7f9cec1604d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7f9cf2c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9cec16be00 con 0x7f9cec0b3580 2024-05-27T06:28:03.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7f9cf2c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9cec16bc80 con 0x7f9cec0d2f20 2024-05-27T06:28:03.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7f9cf2c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9cec16bf80 con 0x7f9cec0d2b10 2024-05-27T06:28:03.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7fe6f9400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6f40b0e20 0x7fe6f40cf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7fe6f9400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6f40d1cf0 0x7fe6f41fd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7fe6f2800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6f40b0e20 0x7fe6f40cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7f9cf1800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cec0b3580 0x7f9cec071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7f9cf1800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cec0b3580 0x7f9cec071240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38232/0 (socket says 172.21.15.87:38232) 2024-05-27T06:28:03.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7fe6f2800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6f40b0e20 0x7fe6f40cf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38242/0 (socket says 172.21.15.87:38242) 2024-05-27T06:28:03.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7f9cf1800640 1 -- 172.21.15.87:0/3289031138 learned_addr learned my addr 172.21.15.87:0/3289031138 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:03.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7f9cf0e00640 1 --2- 172.21.15.87:0/3289031138 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cec0d2b10 0x7f9cec1593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7fe6f2800640 1 -- 172.21.15.87:0/107292465 learned_addr learned my addr 172.21.15.87:0/107292465 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:03.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7fe6f9400640 1 --2- 172.21.15.87:0/107292465 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6f415cff0 0x7fe6f409c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7f9cf1800640 1 -- 172.21.15.87:0/3289031138 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cec0d2b10 msgr2=0x7f9cec1593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7f9cf1800640 1 --2- 172.21.15.87:0/3289031138 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cec0d2b10 0x7f9cec1593d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7f9cf1800640 1 -- 172.21.15.87:0/3289031138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cec0d2f20 msgr2=0x7f9cec1604d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-27T06:28:03.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7f9cf1800640 1 --2- 172.21.15.87:0/3289031138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cec0d2f20 0x7f9cec1604d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7f9cf1800640 1 -- 172.21.15.87:0/3289031138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cec070480 con 0x7f9cec0b3580 2024-05-27T06:28:03.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7fe6f9400640 1 -- 172.21.15.87:0/107292465 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f4168ea0 con 0x7fe6f40b0e20 2024-05-27T06:28:03.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7fe6f9400640 1 -- 172.21.15.87:0/107292465 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f4168d20 con 0x7fe6f40d1cf0 2024-05-27T06:28:03.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7fe6f1e00640 1 --2- 172.21.15.87:0/107292465 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6f40d1cf0 0x7fe6f41fd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7fbe29e00640 1 --2- 172.21.15.87:0/692743179 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbe0c06f4d0 0x7fbe0c0719e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400dfd0 tx=0x7fbe2400f040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:03.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7fe6f3200640 1 --2- 172.21.15.87:0/107292465 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6f415cff0 0x7fe6f409c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7fe6f9400640 1 -- 172.21.15.87:0/107292465 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe6f4169020 con 0x7fe6f415cff0 2024-05-27T06:28:03.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7fa563400640 1 -- 172.21.15.87:0/3076306012 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa564010070 con 0x7fa56c164620 2024-05-27T06:28:03.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7f9cf1800640 1 --2- 172.21.15.87:0/3289031138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cec0b3580 0x7f9cec071240 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00c400 tx=0x7f9cdc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:03.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.015+0000 7f9ce9600640 1 -- 172.21.15.87:0/3289031138 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc017070 con 0x7f9cec0b3580 2024-05-27T06:28:03.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.019+0000 7f9cf2c00640 1 -- 172.21.15.87:0/3289031138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cec070760 con 0x7f9cec0b3580 2024-05-27T06:28:03.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.019+0000 7f9cf2c00640 1 -- 172.21.15.87:0/3289031138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cec070d20 con 0x7f9cec0b3580 2024-05-27T06:28:03.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.019+0000 7fe6f3200640 1 -- 172.21.15.87:0/107292465 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6f40d1cf0 msgr2=0x7fe6f41fd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.019+0000 7fe6f3200640 1 --2- 172.21.15.87:0/107292465 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6f40d1cf0 0x7fe6f41fd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.019+0000 7fe6f3200640 1 -- 172.21.15.87:0/107292465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6f40b0e20 msgr2=0x7fe6f40cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.019+0000 7fe6f3200640 1 --2- 172.21.15.87:0/107292465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6f40b0e20 0x7fe6f40cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.019+0000 7fe6f3200640 1 -- 172.21.15.87:0/107292465 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6f40ceab0 con 0x7fe6f415cff0 2024-05-27T06:28:03.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.019+0000 7fe6f1e00640 1 --2- 172.21.15.87:0/107292465 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6f40d1cf0 0x7fe6f41fd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:03.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.019+0000 7fe6f3200640 1 --2- 172.21.15.87:0/107292465 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6f415cff0 0x7fe6f409c440 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00c730 tx=0x7fe6ec00cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:03.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.019+0000 7f9cf2c00640 1 -- 172.21.15.87:0/3289031138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cec0508e0 con 0x7f9cec0b3580 2024-05-27T06:28:03.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.023+0000 7f9ce9600640 1 -- 172.21.15.87:0/3289031138 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cdc005cf0 con 0x7f9cec0b3580 2024-05-27T06:28:03.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.023+0000 7f9ce9600640 1 -- 172.21.15.87:0/3289031138 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc007310 con 0x7f9cec0b3580 2024-05-27T06:28:03.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.019+0000 7fe6eaa00640 1 -- 172.21.15.87:0/107292465 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec017070 con 0x7fe6f415cff0 2024-05-27T06:28:03.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.019+0000 7fe6f9400640 1 -- 172.21.15.87:0/107292465 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6f4158710 con 0x7fe6f415cff0 2024-05-27T06:28:03.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.019+0000 7fe6f9400640 1 -- 172.21.15.87:0/107292465 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6f4158cd0 con 0x7fe6f415cff0 2024-05-27T06:28:03.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.019+0000 7fe6eaa00640 1 -- 172.21.15.87:0/107292465 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ec003b80 con 0x7fe6f415cff0 2024-05-27T06:28:03.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.023+0000 7fe6eaa00640 1 -- 172.21.15.87:0/107292465 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec017070 con 0x7fe6f415cff0 2024-05-27T06:28:03.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.023+0000 7f9ce9600640 1 -- 172.21.15.87:0/3289031138 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9cdc01a070 con 0x7f9cec0b3580 2024-05-27T06:28:03.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.023+0000 7fe6f9400640 1 -- 172.21.15.87:0/107292465 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6cc0052a0 con 0x7fe6f415cff0 2024-05-27T06:28:03.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.023+0000 7f9ce9600640 1 --2- 172.21.15.87:0/3289031138 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9cd006f430 0x7f9cd0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.023+0000 7f9ce9600640 1 -- 172.21.15.87:0/3289031138 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9cdc08e770 con 0x7f9cec0b3580 2024-05-27T06:28:03.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.023+0000 7f9cf0e00640 1 --2- 172.21.15.87:0/3289031138 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9cd006f430 0x7f9cd0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.027+0000 7fe6eaa00640 1 -- 172.21.15.87:0/107292465 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe6ec01a070 con 0x7fe6f415cff0 2024-05-27T06:28:03.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.027+0000 7fe6eaa00640 1 --2- 172.21.15.87:0/107292465 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe6d406f830 0x7fe6d4071d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.027+0000 7fe6eaa00640 1 -- 172.21.15.87:0/107292465 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe6ec003980 con 0x7fe6f415cff0 2024-05-27T06:28:03.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.027+0000 7fe6f2800640 1 --2- 172.21.15.87:0/107292465 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe6d406f830 0x7fe6d4071d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.027+0000 7f9cf0e00640 1 --2- 172.21.15.87:0/3289031138 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9cd006f430 0x7f9cd0071940 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0007fd0 tx=0x7f9ce0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:03.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.031+0000 7fe6f2800640 1 --2- 172.21.15.87:0/107292465 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe6d406f830 0x7fe6d4071d40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0009b80 tx=0x7fe6e0009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:03.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.031+0000 7fe6eaa00640 1 -- 172.21.15.87:0/107292465 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe6f40d2100 con 0x7fe6f415cff0 2024-05-27T06:28:03.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.035+0000 7f9ce9600640 1 -- 172.21.15.87:0/3289031138 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f9cdc05aeb0 con 0x7f9cec0b3580 2024-05-27T06:28:03.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.059+0000 7f24fbe00640 1 Processor -- start 2024-05-27T06:28:03.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.059+0000 7f24fbe00640 1 -- start start 2024-05-27T06:28:03.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.063+0000 7f24fbe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f24fc15be70 0x7f24fc0d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.063+0000 7f24fbe00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24fc06e150 con 0x7f24fc06dd40 2024-05-27T06:28:03.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.063+0000 7f24fbe00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24fc06e3e0 con 0x7f24fc0d15c0 2024-05-27T06:28:03.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.063+0000 7f24fbe00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f24fc0d01b0 con 0x7f24fc15be70 2024-05-27T06:28:03.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.063+0000 7f24fa000640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f24fc0d15c0 0x7f24fc0cb9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.87:47610/0 (socket says 172.21.15.87:47610) 2024-05-27T06:28:03.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.063+0000 7f24fa000640 1 -- 172.21.15.87:0/334939519 learned_addr learned my addr 172.21.15.87:0/334939519 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:03.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.063+0000 7f24fb400640 1 --2- 172.21.15.87:0/334939519 >> v2:172.21.15.149:3300/0 conn(0x7f24fc15be70 0x7f24fc0d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.067+0000 7f24f9600640 1 -- 172.21.15.87:0/334939519 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3054947478 0 0) 0x7f24fc06e150 con 0x7f24fc06dd40 2024-05-27T06:28:03.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.067+0000 7f24f9600640 1 -- 172.21.15.87:0/334939519 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24e0003530 con 0x7f24fc06dd40 2024-05-27T06:28:03.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.067+0000 7f24f9600640 1 -- 172.21.15.87:0/334939519 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1802384637 0 0) 0x7f24e0003530 con 0x7f24fc06dd40 2024-05-27T06:28:03.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.067+0000 7f24f9600640 1 -- 172.21.15.87:0/334939519 >> v2:172.21.15.149:3300/0 conn(0x7f24fc15be70 msgr2=0x7f24fc0d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:03.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.067+0000 7f24f9600640 1 --2- 172.21.15.87:0/334939519 >> v2:172.21.15.149:3300/0 conn(0x7f24fc15be70 0x7f24fc0d0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.067+0000 7f24f9600640 1 -- 172.21.15.87:0/334939519 >> v1:172.21.15.149:6789/0 conn(0x7f24fc0d15c0 legacy=0x7f24fc0cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.067+0000 7f24f9600640 1 -- 172.21.15.87:0/334939519 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24fc0cfb60 con 0x7f24fc06dd40 2024-05-27T06:28:03.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.067+0000 7f24f9600640 1 -- 172.21.15.87:0/334939519 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7f24ec001770 con 0x7f24fc06dd40 2024-05-27T06:28:03.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.067+0000 7f24f9600640 1 -- 172.21.15.87:0/334939519 >> v1:172.21.15.87:6789/0 conn(0x7f24fc06dd40 legacy=0x7f24fc0d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.067+0000 7f24f9600640 1 --2- 172.21.15.87:0/334939519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24e0003a60 0x7f24e0003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.067+0000 7f24f9600640 1 --2- 172.21.15.87:0/334939519 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24e0004810 0x7f24e0004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.067+0000 7f24f9600640 1 --2- 172.21.15.87:0/334939519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24e0005360 0x7f24e000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.067+0000 7f24f9600640 1 -- 172.21.15.87:0/334939519 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f24fc0d01b0 con 0x7f24e0003a60 2024-05-27T06:28:03.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.067+0000 7f24f9600640 1 -- 172.21.15.87:0/334939519 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f24e000c290 con 0x7f24e0005360 2024-05-27T06:28:03.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.067+0000 7f24f9600640 1 -- 172.21.15.87:0/334939519 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f24e000c490 con 0x7f24e0004810 2024-05-27T06:28:03.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.067+0000 7f24faa00640 1 --2- 172.21.15.87:0/334939519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24e0003a60 0x7f24e0003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.067+0000 7f83dbe00640 1 Processor -- start 2024-05-27T06:28:03.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.067+0000 7f83dbe00640 1 -- start start 2024-05-27T06:28:03.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.071+0000 7f24faa00640 1 -- 172.21.15.87:0/334939519 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24e0004810 msgr2=0x7f24e0004c20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-27T06:28:03.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.071+0000 7f24fb400640 1 --2- 172.21.15.87:0/334939519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24e0005360 0x7f24e000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.071+0000 7f24faa00640 1 --2- 172.21.15.87:0/334939519 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24e0004810 0x7f24e0004c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.071+0000 7f24faa00640 1 -- 172.21.15.87:0/334939519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24e0005360 msgr2=0x7f24e000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:03.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.071+0000 7f24faa00640 1 --2- 172.21.15.87:0/334939519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24e0005360 0x7f24e000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.071+0000 7f24faa00640 1 -- 172.21.15.87:0/334939519 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e0003530 con 0x7f24e0003a60 2024-05-27T06:28:03.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.071+0000 7f24fb400640 1 --2- 172.21.15.87:0/334939519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24e0005360 0x7f24e000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:03.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.071+0000 7f24fb400640 1 -- 172.21.15.87:0/334939519 reap_dead start 2024-05-27T06:28:03.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.071+0000 7f83dbe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f83dc0d1850 0x7f83dc0cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.071+0000 7f83daa00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f83dc0b17e0 0x7f83dc06d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.87:47624/0 (socket says 172.21.15.87:47624) 2024-05-27T06:28:03.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.071+0000 7f83daa00640 1 -- 172.21.15.87:0/1432116174 learned_addr learned my addr 172.21.15.87:0/1432116174 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:03.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.071+0000 7f83db400640 1 --2- 172.21.15.87:0/1432116174 >> v2:172.21.15.149:3300/0 conn(0x7f83dc0d1850 0x7f83dc0cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.071+0000 7f83dbe00640 1 -- 172.21.15.87:0/1432116174 --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83dc0b1bf0 con 0x7f83dc06e0b0 2024-05-27T06:28:03.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.071+0000 7f83dbe00640 1 -- 172.21.15.87:0/1432116174 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83dc0d2290 con 0x7f83dc0b17e0 2024-05-27T06:28:03.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f83dbe00640 1 -- 172.21.15.87:0/1432116174 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f83dc0b1350 con 0x7f83dc0d1850 2024-05-27T06:28:03.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f24faa00640 1 --2- 172.21.15.87:0/334939519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24e0003a60 0x7f24e0003ed0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00c190 tx=0x7f24ec01caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74bc593aa01c7a65 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:03.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f83d9600640 1 -- 172.21.15.87:0/1432116174 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3936397842 0 0) 0x7f83dc0b1bf0 con 0x7f83dc06e0b0 2024-05-27T06:28:03.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f83d9600640 1 -- 172.21.15.87:0/1432116174 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83c0003dc0 con 0x7f83dc06e0b0 2024-05-27T06:28:03.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f83d9600640 1 -- 172.21.15.87:0/1432116174 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 782263052 0 0) 0x7f83dc0d2290 con 0x7f83dc0b17e0 2024-05-27T06:28:03.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f24f9600640 1 -- 172.21.15.87:0/334939519 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec007cb0 con 0x7f24e0003a60 2024-05-27T06:28:03.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f24f9600640 1 -- 172.21.15.87:0/334939519 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24ec0a9020 con 0x7f24e0003a60 2024-05-27T06:28:03.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f24f9600640 1 -- 172.21.15.87:0/334939519 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec005310 con 0x7f24e0003a60 2024-05-27T06:28:03.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f83d9600640 1 -- 172.21.15.87:0/1432116174 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83c0003610 con 0x7f83dc0b17e0 2024-05-27T06:28:03.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f83d9600640 1 -- 172.21.15.87:0/1432116174 <== mon.1 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2854076024 0 0) 0x7f83c0003610 con 0x7f83dc0b17e0 2024-05-27T06:28:03.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f83d9600640 1 -- 172.21.15.87:0/1432116174 >> v2:172.21.15.149:3300/0 conn(0x7f83dc0d1850 msgr2=0x7f83dc0cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:03.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f83d9600640 1 --2- 172.21.15.87:0/1432116174 >> v2:172.21.15.149:3300/0 conn(0x7f83dc0d1850 0x7f83dc0cfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f83d9600640 1 -- 172.21.15.87:0/1432116174 >> v1:172.21.15.87:6789/0 conn(0x7f83dc06e0b0 legacy=0x7f83dc0cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f83d9600640 1 -- 172.21.15.87:0/1432116174 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83dc0b2790 con 0x7f83dc0b17e0 2024-05-27T06:28:03.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f83d9600640 1 -- 172.21.15.87:0/1432116174 <== mon.1 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7f83cc001730 con 0x7f83dc0b17e0 2024-05-27T06:28:03.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f83d9600640 1 -- 172.21.15.87:0/1432116174 >> v1:172.21.15.149:6789/0 conn(0x7f83dc0b17e0 legacy=0x7f83dc06d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f83d9600640 1 --2- 172.21.15.87:0/1432116174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83c0004040 0x7f83c0004450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f83d9600640 1 --2- 172.21.15.87:0/1432116174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83c0004990 0x7f83c00050a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f24fbe00640 1 -- 172.21.15.87:0/334939519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24e0003a60 msgr2=0x7f24e0003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f24fbe00640 1 --2- 172.21.15.87:0/334939519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24e0003a60 0x7f24e0003ed0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00c190 tx=0x7f24ec01caa0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f83d9600640 1 --2- 172.21.15.87:0/1432116174 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83c00055e0 0x7f83c0005a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f83d9600640 1 -- 172.21.15.87:0/1432116174 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f83dc0b1350 con 0x7f83c0004040 2024-05-27T06:28:03.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f83d9600640 1 -- 172.21.15.87:0/1432116174 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f83c00084c0 con 0x7f83c0004990 2024-05-27T06:28:03.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f83d9600640 1 -- 172.21.15.87:0/1432116174 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f83c00086c0 con 0x7f83c00055e0 2024-05-27T06:28:03.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f83daa00640 1 --2- 172.21.15.87:0/1432116174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83c0004040 0x7f83c0004450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f83da000640 1 --2- 172.21.15.87:0/1432116174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83c0004990 0x7f83c00050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f83db400640 1 --2- 172.21.15.87:0/1432116174 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83c00055e0 0x7f83c0005a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f24fbe00640 1 -- 172.21.15.87:0/334939519 shutdown_connections 2024-05-27T06:28:03.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f24fbe00640 1 --2- 172.21.15.87:0/334939519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24e0003a60 0x7f24e0003ed0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f24fbe00640 1 -- 172.21.15.87:0/334939519 >> 172.21.15.87:0/334939519 conn(0x7f24fc0b42c0 msgr2=0x7f24fc0b46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:03.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f5a77000640 1 Processor -- start 2024-05-27T06:28:03.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f5a77000640 1 -- start start 2024-05-27T06:28:03.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f83daa00640 1 -- 172.21.15.87:0/1432116174 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83c00055e0 msgr2=0x7f83c0005a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:03.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f83daa00640 1 --2- 172.21.15.87:0/1432116174 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83c00055e0 0x7f83c0005a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f83daa00640 1 -- 172.21.15.87:0/1432116174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83c0004990 msgr2=0x7f83c00050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:03.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f83daa00640 1 --2- 172.21.15.87:0/1432116174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83c0004990 0x7f83c00050a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f83daa00640 1 -- 172.21.15.87:0/1432116174 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c0003610 con 0x7f83c0004040 2024-05-27T06:28:03.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f83db400640 1 -- 172.21.15.87:0/1432116174 reap_dead start 2024-05-27T06:28:03.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f5a77000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5a701645f0 0x7f5a700d4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f5a77000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5a700d5ab0 0x7f5a700d5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f5a6f400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5a700d5ab0 0x7f5a700d5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f5a6f400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5a700d5ab0 0x7f5a700d5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:39856/0 (socket says 172.21.15.87:39856) 2024-05-27T06:28:03.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.079+0000 7f5a75000640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f5a700d13f0 0x7f5a700d1800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.87:47640/0 (socket says 172.21.15.87:47640) 2024-05-27T06:28:03.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.079+0000 7f5a6fe00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5a701645f0 0x7f5a700d4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.079+0000 7f5a6fe00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5a701645f0 0x7f5a700d4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38270/0 (socket says 172.21.15.87:38270) 2024-05-27T06:28:03.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.079+0000 7f0393200640 1 Processor -- start 2024-05-27T06:28:03.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.079+0000 7f5a6f400640 1 -- 172.21.15.87:0/2463902167 learned_addr learned my addr 172.21.15.87:0/2463902167 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:03.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.079+0000 7f0393200640 1 -- start start 2024-05-27T06:28:03.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.079+0000 7f5a77000640 1 -- 172.21.15.87:0/2463902167 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a700d30b0 con 0x7f5a700d13f0 2024-05-27T06:28:03.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.079+0000 7f5a77000640 1 -- 172.21.15.87:0/2463902167 --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f5a700d6400 con 0x7f5a701645f0 2024-05-27T06:28:03.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.079+0000 7f5a77000640 1 -- 172.21.15.87:0/2463902167 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f5a700d54a0 con 0x7f5a700d5ab0 2024-05-27T06:28:03.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.079+0000 7f83daa00640 1 --2- 172.21.15.87:0/1432116174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83c0004040 0x7f83c0004450 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f83cc00c190 tx=0x7f83cc01cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b38cbcd2ef31bf server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:03.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.075+0000 7f24fbe00640 1 -- 172.21.15.87:0/334939519 shutdown_connections 2024-05-27T06:28:03.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.079+0000 7f24fbe00640 1 -- 172.21.15.87:0/334939519 wait complete. 2024-05-27T06:28:03.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.079+0000 7f24fbe00640 1 Processor -- start 2024-05-27T06:28:03.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f83d9600640 1 -- 172.21.15.87:0/1432116174 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83cc007c90 con 0x7f83c0004040 2024-05-27T06:28:03.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f24fbe00640 1 -- start start 2024-05-27T06:28:03.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f0393200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f03940d2b10 0x7f03940b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f0393200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03940d2f20 0x7f03940b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f83d9600640 1 -- 172.21.15.87:0/1432116174 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83cc0a9070 con 0x7f83c0004040 2024-05-27T06:28:03.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f83d9600640 1 -- 172.21.15.87:0/1432116174 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83cc005d20 con 0x7f83c0004040 2024-05-27T06:28:03.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f0393200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03940d1d90 con 0x7f03940cde20 2024-05-27T06:28:03.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f0393200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f03940b6780 con 0x7f03940d2b10 2024-05-27T06:28:03.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f0391400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03940d2f20 0x7f03940b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f0392800640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f03940cde20 0x7f03940ce230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.87:47644/0 (socket says 172.21.15.87:47644) 2024-05-27T06:28:03.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f0392800640 1 -- 172.21.15.87:0/306528684 learned_addr learned my addr 172.21.15.87:0/306528684 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:03.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f0393200640 1 -- 172.21.15.87:0/306528684 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f03940d2030 con 0x7f03940d2f20 2024-05-27T06:28:03.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f83dbe00640 1 -- 172.21.15.87:0/1432116174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83c0004040 msgr2=0x7f83c0004450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.079+0000 7f5a6f400640 1 -- 172.21.15.87:0/2463902167 >> v2:172.21.15.87:3300/0 conn(0x7f5a701645f0 msgr2=0x7f5a700d4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:03.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.079+0000 7f5a6f400640 1 --2- 172.21.15.87:0/2463902167 >> v2:172.21.15.87:3300/0 conn(0x7f5a701645f0 0x7f5a700d4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.079+0000 7f5a6f400640 1 -- 172.21.15.87:0/2463902167 >> v1:172.21.15.149:6789/0 conn(0x7f5a700d13f0 legacy=0x7f5a700d1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.079+0000 7f5a6f400640 1 -- 172.21.15.87:0/2463902167 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7008dcc0 con 0x7f5a700d5ab0 2024-05-27T06:28:03.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f83dbe00640 1 --2- 172.21.15.87:0/1432116174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83c0004040 0x7f83c0004450 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f83cc00c190 tx=0x7f83cc01cae0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f83dbe00640 1 -- 172.21.15.87:0/1432116174 shutdown_connections 2024-05-27T06:28:03.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f83dbe00640 1 --2- 172.21.15.87:0/1432116174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83c0004040 0x7f83c0004450 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f83dbe00640 1 -- 172.21.15.87:0/1432116174 >> 172.21.15.87:0/1432116174 conn(0x7f83dc0b42c0 msgr2=0x7f83dc0b46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:03.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f0391400640 1 -- 172.21.15.87:0/306528684 >> v2:172.21.15.87:3300/0 conn(0x7f03940d2b10 msgr2=0x7f03940b2e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-27T06:28:03.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f0391400640 1 --2- 172.21.15.87:0/306528684 >> v2:172.21.15.87:3300/0 conn(0x7f03940d2b10 0x7f03940b2e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f0391400640 1 -- 172.21.15.87:0/306528684 >> v1:172.21.15.149:6789/0 conn(0x7f03940cde20 legacy=0x7f03940ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:03.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f0391400640 1 -- 172.21.15.87:0/306528684 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03940d2310 con 0x7f03940d2f20 2024-05-27T06:28:03.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f24fbe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24e0003a60 0x7f24fc15e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f24fbe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24fc15b290 0x7f24fc209350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f24fbe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24fc15b6a0 0x7f24fc209890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f24fbe00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f24fc0d16c0 con 0x7f24fc15b6a0 2024-05-27T06:28:03.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f24fbe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f24fc0d1c00 con 0x7f24e0003a60 2024-05-27T06:28:03.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f24fbe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f24fc0d1840 con 0x7f24fc15b290 2024-05-27T06:28:03.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f83dbe00640 1 -- 172.21.15.87:0/1432116174 shutdown_connections 2024-05-27T06:28:03.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f83dbe00640 1 -- 172.21.15.87:0/1432116174 wait complete. 2024-05-27T06:28:03.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.083+0000 7f24faa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24e0003a60 0x7f24fc15e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.087+0000 7f24faa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24e0003a60 0x7f24fc15e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:39870/0 (socket says 172.21.15.87:39870) 2024-05-27T06:28:03.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.087+0000 7f24faa00640 1 -- 172.21.15.87:0/1812802379 learned_addr learned my addr 172.21.15.87:0/1812802379 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:03.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.087+0000 7f24fb400640 1 --2- 172.21.15.87:0/1812802379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24fc15b6a0 0x7f24fc209890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.087+0000 7f5a6f400640 1 --2- 172.21.15.87:0/2463902167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a700d5ab0 0x7f5a700d5ec0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5a700b8250 tx=0x7f5a6001c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa5ee1eecd0d1663 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:03.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.087+0000 7f24faa00640 1 -- 172.21.15.87:0/1812802379 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24fc15b290 msgr2=0x7f24fc209350 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-27T06:28:03.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.087+0000 7f24faa00640 1 --2- 172.21.15.87:0/1812802379 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24fc15b290 0x7f24fc209350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.087+0000 7f24faa00640 1 -- 172.21.15.87:0/1812802379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24fc15b6a0 msgr2=0x7f24fc209890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.087+0000 7f24faa00640 1 --2- 172.21.15.87:0/1812802379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24fc15b6a0 0x7f24fc209890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.087+0000 7f24faa00640 1 -- 172.21.15.87:0/1812802379 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24fc09c0f0 con 0x7f24e0003a60 2024-05-27T06:28:03.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.087+0000 7f24faa00640 1 --2- 172.21.15.87:0/1812802379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24e0003a60 0x7f24fc15e460 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00c190 tx=0x7f24e0005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:03.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.087+0000 7f5a6ea00640 1 -- 172.21.15.87:0/2463902167 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a600b0070 con 0x7f5a700d5ab0 2024-05-27T06:28:03.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.087+0000 7f5a6ea00640 1 -- 172.21.15.87:0/2463902167 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a60004230 con 0x7f5a700d5ab0 2024-05-27T06:28:03.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.087+0000 7f5a6ea00640 1 -- 172.21.15.87:0/2463902167 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a60003620 con 0x7f5a700d5ab0 2024-05-27T06:28:03.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.087+0000 7f83dbe00640 1 Processor -- start 2024-05-27T06:28:03.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.087+0000 7f5a77000640 1 -- 172.21.15.87:0/2463902167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a700d5ab0 msgr2=0x7f5a700d5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.087+0000 7f5a77000640 1 --2- 172.21.15.87:0/2463902167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a700d5ab0 0x7f5a700d5ec0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5a700b8250 tx=0x7f5a6001c3d0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.087+0000 7f24f2a00640 1 -- 172.21.15.87:0/1812802379 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec001d30 con 0x7f24e0003a60 2024-05-27T06:28:03.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.087+0000 7f24f2a00640 1 -- 172.21.15.87:0/1812802379 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24ec001730 con 0x7f24e0003a60 2024-05-27T06:28:03.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.087+0000 7f24fbe00640 1 -- 172.21.15.87:0/1812802379 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24fc0c8590 con 0x7f24e0003a60 2024-05-27T06:28:03.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.087+0000 7f24f2a00640 1 -- 172.21.15.87:0/1812802379 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec007250 con 0x7f24e0003a60 2024-05-27T06:28:03.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.087+0000 7f24fbe00640 1 -- 172.21.15.87:0/1812802379 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24fc0c8830 con 0x7f24e0003a60 2024-05-27T06:28:03.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.087+0000 7f83dbe00640 1 -- start start 2024-05-27T06:28:03.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.087+0000 7f5a77000640 1 -- 172.21.15.87:0/2463902167 shutdown_connections 2024-05-27T06:28:03.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.087+0000 7f5a77000640 1 --2- 172.21.15.87:0/2463902167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a700d5ab0 0x7f5a700d5ec0 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5a700b8250 tx=0x7f5a6001c3d0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.087+0000 7f5a77000640 1 --2- 172.21.15.87:0/2463902167 >> v2:172.21.15.87:3300/0 conn(0x7f5a701645f0 0x7f5a700d4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.087+0000 7f5a77000640 1 -- 172.21.15.87:0/2463902167 >> 172.21.15.87:0/2463902167 conn(0x7f5a7009ec10 msgr2=0x7f5a7008cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:03.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.091+0000 7f83dbe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83c0004040 0x7f83dc0916b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.091+0000 7f83dbe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83dc20dfd0 0x7f83dc092770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.091+0000 7f83daa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83c0004040 0x7f83dc0916b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.091+0000 7f83dbe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83dc20e3e0 0x7f83dc092cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.091+0000 7f83dbe00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f83dc06dd70 con 0x7f83dc20dfd0 2024-05-27T06:28:03.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.091+0000 7f83dbe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f83dc0d1c60 con 0x7f83c0004040 2024-05-27T06:28:03.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.091+0000 7f83dbe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f83dc06def0 con 0x7f83dc20e3e0 2024-05-27T06:28:03.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.091+0000 7f83da000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83dc20dfd0 0x7f83dc092770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.091+0000 7f83da000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83dc20dfd0 0x7f83dc092770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38296/0 (socket says 172.21.15.87:38296) 2024-05-27T06:28:03.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.091+0000 7f83da000640 1 -- 172.21.15.87:0/968678178 learned_addr learned my addr 172.21.15.87:0/968678178 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:03.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.091+0000 7f5a77000640 1 -- 172.21.15.87:0/2463902167 shutdown_connections 2024-05-27T06:28:03.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.091+0000 7f5a77000640 1 -- 172.21.15.87:0/2463902167 wait complete. 2024-05-27T06:28:03.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.091+0000 7f0391400640 1 --2- 172.21.15.87:0/306528684 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03940d2f20 0x7f03940b33b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f03940d1140 tx=0x7f038001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b260673c64b49126 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:03.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.091+0000 7f24f2a00640 1 -- 172.21.15.87:0/1812802379 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f24ec0073f0 con 0x7f24e0003a60 2024-05-27T06:28:03.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.091+0000 7f83daa00640 1 -- 172.21.15.87:0/968678178 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83dc20e3e0 msgr2=0x7f83dc092cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.091+0000 7f83daa00640 1 --2- 172.21.15.87:0/968678178 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83dc20e3e0 0x7f83dc092cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.091+0000 7f83daa00640 1 -- 172.21.15.87:0/968678178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83dc20dfd0 msgr2=0x7f83dc092770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.091+0000 7f83daa00640 1 --2- 172.21.15.87:0/968678178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83dc20dfd0 0x7f83dc092770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.091+0000 7f83daa00640 1 -- 172.21.15.87:0/968678178 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83dc094a20 con 0x7f83c0004040 2024-05-27T06:28:03.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.095+0000 7f83daa00640 1 --2- 172.21.15.87:0/968678178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83c0004040 0x7f83dc0916b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f83cc009000 tx=0x7f83c00060d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:03.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.095+0000 7f0390a00640 1 -- 172.21.15.87:0/306528684 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03800b0070 con 0x7f03940d2f20 2024-05-27T06:28:03.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.095+0000 7f24f2a00640 1 --2- 172.21.15.87:0/1812802379 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f24dc06f500 0x7f24dc071a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.095+0000 7f0390a00640 1 -- 172.21.15.87:0/306528684 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03800ab600 con 0x7f03940d2f20 2024-05-27T06:28:03.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.095+0000 7f0390a00640 1 -- 172.21.15.87:0/306528684 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03800ab9d0 con 0x7f03940d2f20 2024-05-27T06:28:03.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.095+0000 7f24f2a00640 1 -- 172.21.15.87:0/1812802379 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f24ec128840 con 0x7f24e0003a60 2024-05-27T06:28:03.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.095+0000 7f24fbe00640 1 -- 172.21.15.87:0/1812802379 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d40052a0 con 0x7f24e0003a60 2024-05-27T06:28:03.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.095+0000 7f24fa000640 1 --2- 172.21.15.87:0/1812802379 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f24dc06f500 0x7f24dc071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.095+0000 7f83d3400640 1 -- 172.21.15.87:0/968678178 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83cc007240 con 0x7f83c0004040 2024-05-27T06:28:03.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.095+0000 7f83d3400640 1 -- 172.21.15.87:0/968678178 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83cc0073e0 con 0x7f83c0004040 2024-05-27T06:28:03.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.095+0000 7f0393200640 1 -- 172.21.15.87:0/306528684 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03940d2f20 msgr2=0x7f03940b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.095+0000 7f0393200640 1 --2- 172.21.15.87:0/306528684 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03940d2f20 0x7f03940b33b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f03940d1140 tx=0x7f038001c4c0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.095+0000 7f83d3400640 1 -- 172.21.15.87:0/968678178 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83cc0047f0 con 0x7f83c0004040 2024-05-27T06:28:03.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.095+0000 7f0393200640 1 -- 172.21.15.87:0/306528684 shutdown_connections 2024-05-27T06:28:03.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.095+0000 7f0393200640 1 --2- 172.21.15.87:0/306528684 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03940d2f20 0x7f03940b33b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.095+0000 7f0393200640 1 --2- 172.21.15.87:0/306528684 >> v2:172.21.15.87:3300/0 conn(0x7f03940d2b10 0x7f03940b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.095+0000 7f0393200640 1 -- 172.21.15.87:0/306528684 >> 172.21.15.87:0/306528684 conn(0x7f03940d35c0 msgr2=0x7f03940d39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:03.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.095+0000 7f0393200640 1 -- 172.21.15.87:0/306528684 shutdown_connections 2024-05-27T06:28:03.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.095+0000 7f5a77000640 1 Processor -- start 2024-05-27T06:28:03.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.095+0000 7f0393200640 1 -- 172.21.15.87:0/306528684 wait complete. 2024-05-27T06:28:03.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.095+0000 7f5a77000640 1 -- start start 2024-05-27T06:28:03.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.095+0000 7f24fa000640 1 --2- 172.21.15.87:0/1812802379 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f24dc06f500 0x7f24dc071a10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f24fc0ca300 tx=0x7f24e8007a30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:03.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.095+0000 7f83dbe00640 1 -- 172.21.15.87:0/968678178 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83dc09b2e0 con 0x7f83c0004040 2024-05-27T06:28:03.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.095+0000 7f83dbe00640 1 -- 172.21.15.87:0/968678178 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83dc09b8a0 con 0x7f83c0004040 2024-05-27T06:28:03.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.099+0000 7f83dbe00640 1 -- 172.21.15.87:0/968678178 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83dc0508e0 con 0x7f83c0004040 2024-05-27T06:28:03.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.099+0000 7f5a77000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a700d13f0 0x7f5a7015af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.099+0000 7f0393200640 1 Processor -- start 2024-05-27T06:28:03.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.099+0000 7f0393200640 1 -- start start 2024-05-27T06:28:03.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.099+0000 7f5a6fe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a700d13f0 0x7f5a7015af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.099+0000 7f5a77000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a701645f0 0x7f5a701fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.099+0000 7f5a77000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a700b22a0 0x7f5a700b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.099+0000 7f5a77000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5a70168460 con 0x7f5a700d13f0 2024-05-27T06:28:03.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.099+0000 7f5a77000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5a70168180 con 0x7f5a700b22a0 2024-05-27T06:28:03.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.099+0000 7f5a77000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5a70168740 con 0x7f5a701645f0 2024-05-27T06:28:03.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.099+0000 7f24f2a00640 1 -- 172.21.15.87:0/1812802379 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f24ec016890 con 0x7f24e0003a60 2024-05-27T06:28:03.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.099+0000 7f5a6fe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a700d13f0 0x7f5a7015af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38306/0 (socket says 172.21.15.87:38306) 2024-05-27T06:28:03.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.099+0000 7f5a75000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a700b22a0 0x7f5a700b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.099+0000 7f5a75000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a700b22a0 0x7f5a700b26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:39888/0 (socket says 172.21.15.87:39888) 2024-05-27T06:28:03.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.099+0000 7f5a75000640 1 -- 172.21.15.87:0/3047270133 learned_addr learned my addr 172.21.15.87:0/3047270133 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:03.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.103+0000 7f0393200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03940cde20 0x7f03941fdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.103+0000 7f0393200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03940d2b10 0x7f039406f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.103+0000 7f0393200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03940d2f20 0x7f039406fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.103+0000 7f0393200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f039406e0c0 con 0x7f03940cde20 2024-05-27T06:28:03.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.103+0000 7f0393200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f039415f1a0 con 0x7f03940d2f20 2024-05-27T06:28:03.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.103+0000 7f0393200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f039406e240 con 0x7f03940d2b10 2024-05-27T06:28:03.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.103+0000 7f5a75000640 1 -- 172.21.15.87:0/3047270133 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a701645f0 msgr2=0x7f5a701fe380 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-27T06:28:03.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.103+0000 7f5a75000640 1 --2- 172.21.15.87:0/3047270133 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a701645f0 0x7f5a701fe380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.103+0000 7f5a75000640 1 -- 172.21.15.87:0/3047270133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a700d13f0 msgr2=0x7f5a7015af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.103+0000 7f5a75000640 1 --2- 172.21.15.87:0/3047270133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a700d13f0 0x7f5a7015af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.103+0000 7f5a75000640 1 -- 172.21.15.87:0/3047270133 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a700b2bf0 con 0x7f5a700b22a0 2024-05-27T06:28:03.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.103+0000 7f5a6fe00640 1 --2- 172.21.15.87:0/3047270133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a700d13f0 0x7f5a7015af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:03.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.103+0000 7f5a75000640 1 --2- 172.21.15.87:0/3047270133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a700b22a0 0x7f5a700b26b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00fad0 tx=0x7f5a5c00ff90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:03.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.103+0000 7f0391e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03940cde20 0x7f03941fdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.103+0000 7f0391400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03940d2b10 0x7f039406f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.103+0000 7f0392800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03940d2f20 0x7f039406fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.103+0000 7f0391e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03940cde20 0x7f03941fdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38310/0 (socket says 172.21.15.87:38310) 2024-05-27T06:28:03.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.103+0000 7f0391e00640 1 -- 172.21.15.87:0/3177816892 learned_addr learned my addr 172.21.15.87:0/3177816892 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:03.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.103+0000 7f83d3400640 1 -- 172.21.15.87:0/968678178 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f83cc0b6030 con 0x7f83c0004040 2024-05-27T06:28:03.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.103+0000 7f0391e00640 1 -- 172.21.15.87:0/3177816892 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03940d2b10 msgr2=0x7f039406f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.103+0000 7f0391e00640 1 --2- 172.21.15.87:0/3177816892 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03940d2b10 0x7f039406f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.103+0000 7f0391e00640 1 -- 172.21.15.87:0/3177816892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03940d2f20 msgr2=0x7f039406fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.103+0000 7f0391e00640 1 --2- 172.21.15.87:0/3177816892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03940d2f20 0x7f039406fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.103+0000 7f0391e00640 1 -- 172.21.15.87:0/3177816892 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03940b9410 con 0x7f03940cde20 2024-05-27T06:28:03.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.103+0000 7f0391400640 1 --2- 172.21.15.87:0/3177816892 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03940d2b10 0x7f039406f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:03.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.107+0000 7f0391e00640 1 --2- 172.21.15.87:0/3177816892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03940cde20 0x7f03941fdc60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f038c00ba10 tx=0x7f038c00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:03.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.107+0000 7f5a67e00640 1 -- 172.21.15.87:0/3047270133 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c01b070 con 0x7f5a700b22a0 2024-05-27T06:28:03.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.107+0000 7f5a67e00640 1 -- 172.21.15.87:0/3047270133 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a5c00a4e0 con 0x7f5a700b22a0 2024-05-27T06:28:03.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.107+0000 7f5a67e00640 1 -- 172.21.15.87:0/3047270133 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c007a70 con 0x7f5a700b22a0 2024-05-27T06:28:03.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.107+0000 7f038a000640 1 -- 172.21.15.87:0/3177816892 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038c019070 con 0x7f03940cde20 2024-05-27T06:28:03.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.107+0000 7f5a77000640 1 -- 172.21.15.87:0/3047270133 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7006f5f0 con 0x7f5a700b22a0 2024-05-27T06:28:03.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.107+0000 7f5a77000640 1 -- 172.21.15.87:0/3047270133 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a701ff1d0 con 0x7f5a700b22a0 2024-05-27T06:28:03.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.107+0000 7f83d3400640 1 --2- 172.21.15.87:0/968678178 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f83bc06f4d0 0x7f83bc0719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.107+0000 7f83d3400640 1 -- 172.21.15.87:0/968678178 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f83cc128cc0 con 0x7f83c0004040 2024-05-27T06:28:03.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.107+0000 7f83da000640 1 --2- 172.21.15.87:0/968678178 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f83bc06f4d0 0x7f83bc0719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.107+0000 7f038a000640 1 -- 172.21.15.87:0/3177816892 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f038c00cb70 con 0x7f03940cde20 2024-05-27T06:28:03.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.107+0000 7f038a000640 1 -- 172.21.15.87:0/3177816892 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038c014440 con 0x7f03940cde20 2024-05-27T06:28:03.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.107+0000 7f0393200640 1 -- 172.21.15.87:0/3177816892 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f039416b480 con 0x7f03940cde20 2024-05-27T06:28:03.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.107+0000 7f0393200640 1 -- 172.21.15.87:0/3177816892 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f039414b870 con 0x7f03940cde20 2024-05-27T06:28:03.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.107+0000 7f5a77000640 1 -- 172.21.15.87:0/3047270133 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a701fec40 con 0x7f5a700b22a0 2024-05-27T06:28:03.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.107+0000 7f83d3400640 1 -- 172.21.15.87:0/968678178 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f83cc016890 con 0x7f83c0004040 2024-05-27T06:28:03.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.111+0000 7f83da000640 1 --2- 172.21.15.87:0/968678178 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f83bc06f4d0 0x7f83bc0719e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f83dc09e430 tx=0x7f83c8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:03.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.111+0000 7f037f400640 1 -- 172.21.15.87:0/3177816892 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03680052a0 con 0x7f03940cde20 2024-05-27T06:28:03.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.111+0000 7f5a67e00640 1 -- 172.21.15.87:0/3047270133 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5a5c007c10 con 0x7f5a700b22a0 2024-05-27T06:28:03.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.115+0000 7f5a67e00640 1 --2- 172.21.15.87:0/3047270133 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5a5006f400 0x7f5a50071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.115+0000 7f5a67e00640 1 -- 172.21.15.87:0/3047270133 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5a5c091e10 con 0x7f5a700b22a0 2024-05-27T06:28:03.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.115+0000 7f038a000640 1 -- 172.21.15.87:0/3177816892 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f038c01c070 con 0x7f03940cde20 2024-05-27T06:28:03.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.115+0000 7f038a000640 1 --2- 172.21.15.87:0/3177816892 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f037406f400 0x7f0374071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:03.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.115+0000 7f038a000640 1 -- 172.21.15.87:0/3177816892 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f038c08f240 con 0x7f03940cde20 2024-05-27T06:28:03.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.115+0000 7f5a6fe00640 1 --2- 172.21.15.87:0/3047270133 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5a5006f400 0x7f5a50071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.119+0000 7f0391400640 1 --2- 172.21.15.87:0/3177816892 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f037406f400 0x7f0374071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:03.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.119+0000 7f0391400640 1 --2- 172.21.15.87:0/3177816892 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f037406f400 0x7f0374071910 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f03800ad000 tx=0x7f03800a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:03.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.119+0000 7f5a67e00640 1 -- 172.21.15.87:0/3047270133 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f5a700b2bf0 con 0x7f5a700b22a0 2024-05-27T06:28:03.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.123+0000 7f5a6fe00640 1 --2- 172.21.15.87:0/3047270133 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5a5006f400 0x7f5a50071910 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5a7006f870 tx=0x7f5a6800b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:03.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.123+0000 7f038a000640 1 -- 172.21.15.87:0/3177816892 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f038c05b790 con 0x7f03940cde20 2024-05-27T06:28:03.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.339+0000 7fa572800640 1 -- 172.21.15.87:0/3076306012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fa544005860 con 0x7fa56c164620 2024-05-27T06:28:03.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.343+0000 7fa563400640 1 -- 172.21.15.87:0/3076306012 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa56405bf60 con 0x7fa56c164620 2024-05-27T06:28:03.339 INFO:teuthology.orchestra.run.smithi087.stdout:55834574858 2024-05-27T06:28:03.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.347+0000 7fa572800640 1 -- 172.21.15.87:0/3076306012 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa54c06f400 msgr2=0x7fa54c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.347+0000 7fa572800640 1 --2- 172.21.15.87:0/3076306012 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa54c06f400 0x7fa54c071910 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa558006fd0 tx=0x7fa558008040 comp rx=0 tx=0).stop 2024-05-27T06:28:03.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.347+0000 7fa572800640 1 -- 172.21.15.87:0/3076306012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa56c164620 msgr2=0x7fa56c0b63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.347+0000 7fa572800640 1 --2- 172.21.15.87:0/3076306012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa56c164620 0x7fa56c0b63d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa564007ac0 tx=0x7fa564007f80 comp rx=0 tx=0).stop 2024-05-27T06:28:03.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.347+0000 7fa572800640 1 -- 172.21.15.87:0/3076306012 shutdown_connections 2024-05-27T06:28:03.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.347+0000 7fa572800640 1 --2- 172.21.15.87:0/3076306012 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa54c06f400 0x7fa54c071910 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.347+0000 7fa572800640 1 --2- 172.21.15.87:0/3076306012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa56c164620 0x7fa56c0b63d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.347+0000 7fa572800640 1 --2- 172.21.15.87:0/3076306012 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa56c0d60e0 0x7fa56c0b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.347+0000 7fa572800640 1 --2- 172.21.15.87:0/3076306012 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa56c0b7690 0x7fa56c0ceee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.347+0000 7fa572800640 1 -- 172.21.15.87:0/3076306012 >> 172.21.15.87:0/3076306012 conn(0x7fa56c09ec10 msgr2=0x7fa56c0d3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:03.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.347+0000 7fa572800640 1 -- 172.21.15.87:0/3076306012 shutdown_connections 2024-05-27T06:28:03.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.347+0000 7fa572800640 1 -- 172.21.15.87:0/3076306012 wait complete. 2024-05-27T06:28:03.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.347+0000 7fbe30c00640 1 -- 172.21.15.87:0/692743179 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fbe2c06aa30 con 0x7fbe2c160220 2024-05-27T06:28:03.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.351+0000 7fbe22000640 1 -- 172.21.15.87:0/692743179 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbe1805f370 con 0x7fbe2c160220 2024-05-27T06:28:03.346 INFO:teuthology.orchestra.run.smithi087.stdout:55834574858 2024-05-27T06:28:03.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.359+0000 7fbe30c00640 1 -- 172.21.15.87:0/692743179 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbe0c06f4d0 msgr2=0x7fbe0c0719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.359+0000 7fbe30c00640 1 --2- 172.21.15.87:0/692743179 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbe0c06f4d0 0x7fbe0c0719e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400dfd0 tx=0x7fbe2400f040 comp rx=0 tx=0).stop 2024-05-27T06:28:03.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.359+0000 7fbe30c00640 1 -- 172.21.15.87:0/692743179 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe2c160220 msgr2=0x7fbe2c155f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.359+0000 7fbe30c00640 1 --2- 172.21.15.87:0/692743179 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe2c160220 0x7fbe2c155f60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe1800c390 tx=0x7fbe1800c850 comp rx=0 tx=0).stop 2024-05-27T06:28:03.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.359+0000 7fbe30c00640 1 -- 172.21.15.87:0/692743179 shutdown_connections 2024-05-27T06:28:03.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.359+0000 7fbe30c00640 1 --2- 172.21.15.87:0/692743179 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbe0c06f4d0 0x7fbe0c0719e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.359+0000 7fbe30c00640 1 --2- 172.21.15.87:0/692743179 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe2c160220 0x7fbe2c155f60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.359+0000 7fbe30c00640 1 --2- 172.21.15.87:0/692743179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe2c15f8d0 0x7fbe2c0cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.359+0000 7fbe30c00640 1 --2- 172.21.15.87:0/692743179 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe2c15c820 0x7fbe2c0ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.359+0000 7fbe30c00640 1 -- 172.21.15.87:0/692743179 >> 172.21.15.87:0/692743179 conn(0x7fbe2c0b2fb0 msgr2=0x7fbe2c068be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:03.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.359+0000 7fbe30c00640 1 -- 172.21.15.87:0/692743179 shutdown_connections 2024-05-27T06:28:03.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.359+0000 7fbe30c00640 1 -- 172.21.15.87:0/692743179 wait complete. 2024-05-27T06:28:03.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.375+0000 7f9cf2c00640 1 -- 172.21.15.87:0/3289031138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9cec0d16e0 con 0x7f9cec0b3580 2024-05-27T06:28:03.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.379+0000 7fe6f9400640 1 -- 172.21.15.87:0/107292465 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe6cc005860 con 0x7fe6f415cff0 2024-05-27T06:28:03.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.379+0000 7f9ce9600640 1 -- 172.21.15.87:0/3289031138 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9cdc05f1b0 con 0x7f9cec0b3580 2024-05-27T06:28:03.374 INFO:teuthology.orchestra.run.smithi087.stdout:55834574858 2024-05-27T06:28:03.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.379+0000 7fe6eaa00640 1 -- 172.21.15.87:0/107292465 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe6ec05b1a0 con 0x7fe6f415cff0 2024-05-27T06:28:03.376 INFO:teuthology.orchestra.run.smithi087.stdout:55834574858 2024-05-27T06:28:03.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.379+0000 7f9cf2c00640 1 -- 172.21.15.87:0/3289031138 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9cd006f430 msgr2=0x7f9cd0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.379+0000 7f9cf2c00640 1 --2- 172.21.15.87:0/3289031138 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9cd006f430 0x7f9cd0071940 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0007fd0 tx=0x7f9ce0009040 comp rx=0 tx=0).stop 2024-05-27T06:28:03.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.379+0000 7f9cf2c00640 1 -- 172.21.15.87:0/3289031138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cec0b3580 msgr2=0x7f9cec071240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.379+0000 7f9cf2c00640 1 --2- 172.21.15.87:0/3289031138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cec0b3580 0x7f9cec071240 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00c400 tx=0x7f9cdc00c8c0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.379+0000 7f9cf2c00640 1 -- 172.21.15.87:0/3289031138 shutdown_connections 2024-05-27T06:28:03.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.379+0000 7f9cf2c00640 1 --2- 172.21.15.87:0/3289031138 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9cd006f430 0x7f9cd0071940 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.379+0000 7f9cf2c00640 1 --2- 172.21.15.87:0/3289031138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cec0d2f20 0x7f9cec1604d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.379+0000 7f9cf2c00640 1 --2- 172.21.15.87:0/3289031138 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cec0d2b10 0x7f9cec1593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.379+0000 7f9cf2c00640 1 --2- 172.21.15.87:0/3289031138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cec0b3580 0x7f9cec071240 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.379+0000 7f9cf2c00640 1 -- 172.21.15.87:0/3289031138 >> 172.21.15.87:0/3289031138 conn(0x7f9cec0d35c0 msgr2=0x7f9cec15dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:03.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.383+0000 7f9cf2c00640 1 -- 172.21.15.87:0/3289031138 shutdown_connections 2024-05-27T06:28:03.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.383+0000 7f9cf2c00640 1 -- 172.21.15.87:0/3289031138 wait complete. 2024-05-27T06:28:03.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.383+0000 7fe6f9400640 1 -- 172.21.15.87:0/107292465 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe6d406f830 msgr2=0x7fe6d4071d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.383+0000 7fe6f9400640 1 --2- 172.21.15.87:0/107292465 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe6d406f830 0x7fe6d4071d40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0009b80 tx=0x7fe6e0009190 comp rx=0 tx=0).stop 2024-05-27T06:28:03.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.383+0000 7fe6f9400640 1 -- 172.21.15.87:0/107292465 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6f415cff0 msgr2=0x7fe6f409c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.383+0000 7fe6f9400640 1 --2- 172.21.15.87:0/107292465 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6f415cff0 0x7fe6f409c440 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00c730 tx=0x7fe6ec00cbf0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.383+0000 7fe6f9400640 1 -- 172.21.15.87:0/107292465 shutdown_connections 2024-05-27T06:28:03.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.383+0000 7fe6f9400640 1 --2- 172.21.15.87:0/107292465 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe6d406f830 0x7fe6d4071d40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.383+0000 7fe6f9400640 1 --2- 172.21.15.87:0/107292465 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6f415cff0 0x7fe6f409c440 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.383+0000 7fe6f9400640 1 --2- 172.21.15.87:0/107292465 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6f40d1cf0 0x7fe6f41fd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.383+0000 7fe6f9400640 1 --2- 172.21.15.87:0/107292465 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6f40b0e20 0x7fe6f40cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.383+0000 7fe6f9400640 1 -- 172.21.15.87:0/107292465 >> 172.21.15.87:0/107292465 conn(0x7fe6f4072ca0 msgr2=0x7fe6f40b3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:03.381 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.5 2024-05-27T06:28:03.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.383+0000 7fe6f9400640 1 -- 172.21.15.87:0/107292465 shutdown_connections 2024-05-27T06:28:03.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.387+0000 7fe6f9400640 1 -- 172.21.15.87:0/107292465 wait complete. 2024-05-27T06:28:03.390 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.1 2024-05-27T06:28:03.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.6 2024-05-27T06:28:03.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.419+0000 7f5a77000640 1 -- 172.21.15.87:0/3047270133 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f5a7006aa30 con 0x7f5a700b22a0 2024-05-27T06:28:03.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.0 2024-05-27T06:28:03.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.419+0000 7f5a67e00640 1 -- 172.21.15.87:0/3047270133 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5a5c05e920 con 0x7f5a700b22a0 2024-05-27T06:28:03.417 INFO:teuthology.orchestra.run.smithi087.stdout:55834574859 2024-05-27T06:28:03.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.423+0000 7f5a77000640 1 -- 172.21.15.87:0/3047270133 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5a5006f400 msgr2=0x7f5a50071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.423+0000 7f5a77000640 1 --2- 172.21.15.87:0/3047270133 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5a5006f400 0x7f5a50071910 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5a7006f870 tx=0x7f5a6800b040 comp rx=0 tx=0).stop 2024-05-27T06:28:03.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.423+0000 7f5a77000640 1 -- 172.21.15.87:0/3047270133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a700b22a0 msgr2=0x7f5a700b26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.423+0000 7f5a77000640 1 --2- 172.21.15.87:0/3047270133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a700b22a0 0x7f5a700b26b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00fad0 tx=0x7f5a5c00ff90 comp rx=0 tx=0).stop 2024-05-27T06:28:03.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.423+0000 7f5a77000640 1 -- 172.21.15.87:0/3047270133 shutdown_connections 2024-05-27T06:28:03.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.423+0000 7f5a77000640 1 --2- 172.21.15.87:0/3047270133 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5a5006f400 0x7f5a50071910 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.423+0000 7f5a77000640 1 --2- 172.21.15.87:0/3047270133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a700b22a0 0x7f5a700b26b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.423+0000 7f5a77000640 1 --2- 172.21.15.87:0/3047270133 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a701645f0 0x7f5a701fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.423+0000 7f5a77000640 1 --2- 172.21.15.87:0/3047270133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a700d13f0 0x7f5a7015af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.423+0000 7f5a77000640 1 -- 172.21.15.87:0/3047270133 >> 172.21.15.87:0/3047270133 conn(0x7f5a7009ec10 msgr2=0x7f5a7015ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:03.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.423+0000 7f5a77000640 1 -- 172.21.15.87:0/3047270133 shutdown_connections 2024-05-27T06:28:03.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.423+0000 7f5a77000640 1 -- 172.21.15.87:0/3047270133 wait complete. 2024-05-27T06:28:03.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.435+0000 7f83dbe00640 1 -- 172.21.15.87:0/968678178 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f83dc091bf0 con 0x7f83c0004040 2024-05-27T06:28:03.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.435+0000 7f83d3400640 1 -- 172.21.15.87:0/968678178 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f83cc016890 con 0x7f83c0004040 2024-05-27T06:28:03.432 INFO:teuthology.orchestra.run.smithi087.stdout:55834574858 2024-05-27T06:28:03.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.439+0000 7f83dbe00640 1 -- 172.21.15.87:0/968678178 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f83bc06f4d0 msgr2=0x7f83bc0719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.439+0000 7f83dbe00640 1 --2- 172.21.15.87:0/968678178 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f83bc06f4d0 0x7f83bc0719e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f83dc09e430 tx=0x7f83c8009040 comp rx=0 tx=0).stop 2024-05-27T06:28:03.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.439+0000 7f83dbe00640 1 -- 172.21.15.87:0/968678178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83c0004040 msgr2=0x7f83dc0916b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.439+0000 7f83dbe00640 1 --2- 172.21.15.87:0/968678178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83c0004040 0x7f83dc0916b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f83cc009000 tx=0x7f83c00060d0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.439+0000 7f83dbe00640 1 -- 172.21.15.87:0/968678178 shutdown_connections 2024-05-27T06:28:03.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.439+0000 7f83dbe00640 1 --2- 172.21.15.87:0/968678178 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f83bc06f4d0 0x7f83bc0719e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.439+0000 7f83dbe00640 1 --2- 172.21.15.87:0/968678178 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83dc20e3e0 0x7f83dc092cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.439+0000 7f83dbe00640 1 --2- 172.21.15.87:0/968678178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83dc20dfd0 0x7f83dc092770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.439+0000 7f83dbe00640 1 --2- 172.21.15.87:0/968678178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83c0004040 0x7f83dc0916b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.439+0000 7f83dbe00640 1 -- 172.21.15.87:0/968678178 >> 172.21.15.87:0/968678178 conn(0x7f83dc0b42c0 msgr2=0x7f83dc0ae620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:03.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.439+0000 7f24fbe00640 1 -- 172.21.15.87:0/1812802379 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f24d4005590 con 0x7f24e0003a60 2024-05-27T06:28:03.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.439+0000 7f83dbe00640 1 -- 172.21.15.87:0/968678178 shutdown_connections 2024-05-27T06:28:03.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.439+0000 7f83dbe00640 1 -- 172.21.15.87:0/968678178 wait complete. 2024-05-27T06:28:03.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.439+0000 7f24f2a00640 1 -- 172.21.15.87:0/1812802379 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f24ec0f5460 con 0x7f24e0003a60 2024-05-27T06:28:03.437 INFO:teuthology.orchestra.run.smithi087.stdout:55834574858 2024-05-27T06:28:03.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.443+0000 7f24fbe00640 1 -- 172.21.15.87:0/1812802379 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f24dc06f500 msgr2=0x7f24dc071a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.443+0000 7f24fbe00640 1 --2- 172.21.15.87:0/1812802379 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f24dc06f500 0x7f24dc071a10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f24fc0ca300 tx=0x7f24e8007a30 comp rx=0 tx=0).stop 2024-05-27T06:28:03.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.443+0000 7f24fbe00640 1 -- 172.21.15.87:0/1812802379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24e0003a60 msgr2=0x7f24fc15e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.443+0000 7f24fbe00640 1 --2- 172.21.15.87:0/1812802379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24e0003a60 0x7f24fc15e460 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00c190 tx=0x7f24e0005840 comp rx=0 tx=0).stop 2024-05-27T06:28:03.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.443+0000 7f24fbe00640 1 -- 172.21.15.87:0/1812802379 shutdown_connections 2024-05-27T06:28:03.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.443+0000 7f24fbe00640 1 --2- 172.21.15.87:0/1812802379 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f24dc06f500 0x7f24dc071a10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.443+0000 7f24fbe00640 1 --2- 172.21.15.87:0/1812802379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24fc15b6a0 0x7f24fc209890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.443+0000 7f24fbe00640 1 --2- 172.21.15.87:0/1812802379 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24fc15b290 0x7f24fc209350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.443+0000 7f24fbe00640 1 --2- 172.21.15.87:0/1812802379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24e0003a60 0x7f24fc15e460 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.443+0000 7f24fbe00640 1 -- 172.21.15.87:0/1812802379 >> 172.21.15.87:0/1812802379 conn(0x7f24fc0b42c0 msgr2=0x7f24fc0ae940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:03.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.443+0000 7f24fbe00640 1 -- 172.21.15.87:0/1812802379 shutdown_connections 2024-05-27T06:28:03.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.443+0000 7f24fbe00640 1 -- 172.21.15.87:0/1812802379 wait complete. 2024-05-27T06:28:03.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.3 2024-05-27T06:28:03.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.455+0000 7f037f400640 1 -- 172.21.15.87:0/3177816892 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f0368005590 con 0x7f03940cde20 2024-05-27T06:28:03.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.455+0000 7f038a000640 1 -- 172.21.15.87:0/3177816892 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f038c05fa90 con 0x7f03940cde20 2024-05-27T06:28:03.451 INFO:teuthology.orchestra.run.smithi087.stdout:55834574857 2024-05-27T06:28:03.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.459+0000 7f037f400640 1 -- 172.21.15.87:0/3177816892 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f037406f400 msgr2=0x7f0374071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.459+0000 7f037f400640 1 --2- 172.21.15.87:0/3177816892 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f037406f400 0x7f0374071910 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f03800ad000 tx=0x7f03800a6000 comp rx=0 tx=0).stop 2024-05-27T06:28:03.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.459+0000 7f037f400640 1 -- 172.21.15.87:0/3177816892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03940cde20 msgr2=0x7f03941fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:03.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.459+0000 7f037f400640 1 --2- 172.21.15.87:0/3177816892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03940cde20 0x7f03941fdc60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f038c00ba10 tx=0x7f038c00bed0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.459+0000 7f037f400640 1 -- 172.21.15.87:0/3177816892 shutdown_connections 2024-05-27T06:28:03.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.459+0000 7f037f400640 1 --2- 172.21.15.87:0/3177816892 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f037406f400 0x7f0374071910 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.459+0000 7f037f400640 1 --2- 172.21.15.87:0/3177816892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03940d2f20 0x7f039406fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.459+0000 7f037f400640 1 --2- 172.21.15.87:0/3177816892 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03940d2b10 0x7f039406f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.459+0000 7f037f400640 1 --2- 172.21.15.87:0/3177816892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03940cde20 0x7f03941fdc60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:03.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.459+0000 7f037f400640 1 -- 172.21.15.87:0/3177816892 >> 172.21.15.87:0/3177816892 conn(0x7f03940d35c0 msgr2=0x7f039415bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:03.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.459+0000 7f037f400640 1 -- 172.21.15.87:0/3177816892 shutdown_connections 2024-05-27T06:28:03.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:03.459+0000 7f037f400640 1 -- 172.21.15.87:0/3177816892 wait complete. 2024-05-27T06:28:03.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.7 2024-05-27T06:28:03.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.4 2024-05-27T06:28:03.474 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.2 2024-05-27T06:28:04.382 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-27T06:28:04.390 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-27T06:28:04.406 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-27T06:28:04.417 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-27T06:28:04.442 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-27T06:28:04.459 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-27T06:28:04.462 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-27T06:28:04.474 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-27T06:28:04.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.607+0000 7f502f000640 1 Processor -- start 2024-05-27T06:28:04.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.607+0000 7f502f000640 1 -- start start 2024-05-27T06:28:04.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.611+0000 7f502f000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f50280b31f0 0x7f50280b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.611+0000 7f502f000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50280ae9b0 0x7f50280aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.611+0000 7f502f000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50280b3b40 con 0x7f50280ce210 2024-05-27T06:28:04.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.611+0000 7f502d000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50280ae9b0 0x7f50280aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.611+0000 7f502d000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50280ae9b0 0x7f50280aedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.87:45202/0 (socket says 172.21.15.87:45202) 2024-05-27T06:28:04.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.611+0000 7f502d000640 1 -- 172.21.15.87:0/1690031923 learned_addr learned my addr 172.21.15.87:0/1690031923 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:04.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.611+0000 7f502f000640 1 -- 172.21.15.87:0/1690031923 --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f50280ce910 con 0x7f50280b31f0 2024-05-27T06:28:04.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.611+0000 7f5027400640 1 --2- 172.21.15.87:0/1690031923 >> v2:172.21.15.87:3300/0 conn(0x7f50280b31f0 0x7f50280b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.611+0000 7f502f000640 1 -- 172.21.15.87:0/1690031923 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f50280cebf0 con 0x7f50280ae9b0 2024-05-27T06:28:04.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.611+0000 7f502d000640 1 -- 172.21.15.87:0/1690031923 >> v2:172.21.15.87:3300/0 conn(0x7f50280b31f0 msgr2=0x7f50280b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:04.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.611+0000 7f502d000640 1 --2- 172.21.15.87:0/1690031923 >> v2:172.21.15.87:3300/0 conn(0x7f50280b31f0 0x7f50280b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.611+0000 7f502d000640 1 -- 172.21.15.87:0/1690031923 >> v1:172.21.15.149:6789/0 conn(0x7f50280ce210 legacy=0x7f502806ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.611+0000 7f502d000640 1 -- 172.21.15.87:0/1690031923 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50280ae1b0 con 0x7f50280ae9b0 2024-05-27T06:28:04.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.619+0000 7f502d000640 1 --2- 172.21.15.87:0/1690031923 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50280ae9b0 0x7f50280aedc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5014009870 tx=0x7f501401c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=976e19a91cf74cb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:04.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.619+0000 7f5026a00640 1 -- 172.21.15.87:0/1690031923 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50140b1070 con 0x7f50280ae9b0 2024-05-27T06:28:04.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.619+0000 7f5026a00640 1 -- 172.21.15.87:0/1690031923 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50140ac620 con 0x7f50280ae9b0 2024-05-27T06:28:04.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.619+0000 7f5026a00640 1 -- 172.21.15.87:0/1690031923 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50140aca30 con 0x7f50280ae9b0 2024-05-27T06:28:04.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.619+0000 7f502f000640 1 -- 172.21.15.87:0/1690031923 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50280ae9b0 msgr2=0x7f50280aedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.619+0000 7f502f000640 1 --2- 172.21.15.87:0/1690031923 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50280ae9b0 0x7f50280aedc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5014009870 tx=0x7f501401c4f0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.619+0000 7f502f000640 1 -- 172.21.15.87:0/1690031923 shutdown_connections 2024-05-27T06:28:04.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.619+0000 7f502f000640 1 --2- 172.21.15.87:0/1690031923 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50280ae9b0 0x7f50280aedc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.619+0000 7f502f000640 1 --2- 172.21.15.87:0/1690031923 >> v2:172.21.15.87:3300/0 conn(0x7f50280b31f0 0x7f50280b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.619+0000 7f502f000640 1 -- 172.21.15.87:0/1690031923 >> 172.21.15.87:0/1690031923 conn(0x7f50280729f0 msgr2=0x7f50280b6600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:04.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.619+0000 7f502f000640 1 -- 172.21.15.87:0/1690031923 shutdown_connections 2024-05-27T06:28:04.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.619+0000 7f502f000640 1 -- 172.21.15.87:0/1690031923 wait complete. 2024-05-27T06:28:04.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.623+0000 7f502f000640 1 Processor -- start 2024-05-27T06:28:04.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.627+0000 7f502f000640 1 -- start start 2024-05-27T06:28:04.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.627+0000 7f502f000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50280ae9b0 0x7f502809ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.627+0000 7f502f000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50280b31f0 0x7f50281ef6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.627+0000 7f502f000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50280ce210 0x7f50280d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.631+0000 7f5027e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50280ae9b0 0x7f502809ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.631+0000 7f5027400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50280b31f0 0x7f50281ef6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.631+0000 7f5027e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50280ae9b0 0x7f502809ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.87:45206/0 (socket says 172.21.15.87:45206) 2024-05-27T06:28:04.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.631+0000 7f5027400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50280b31f0 0x7f50281ef6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:39902/0 (socket says 172.21.15.87:39902) 2024-05-27T06:28:04.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.631+0000 7f502d000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50280ce210 0x7f50280d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.631+0000 7f502d000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50280ce210 0x7f50280d05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38340/0 (socket says 172.21.15.87:38340) 2024-05-27T06:28:04.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.631+0000 7f5027e00640 1 -- 172.21.15.87:0/926619054 learned_addr learned my addr 172.21.15.87:0/926619054 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:04.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.631+0000 7f502f000640 1 -- 172.21.15.87:0/926619054 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5028168d20 con 0x7f50280ce210 2024-05-27T06:28:04.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.631+0000 7f502f000640 1 -- 172.21.15.87:0/926619054 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5028168ba0 con 0x7f50280b31f0 2024-05-27T06:28:04.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.631+0000 7f502f000640 1 -- 172.21.15.87:0/926619054 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5028168ea0 con 0x7f50280ae9b0 2024-05-27T06:28:04.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.631+0000 7f5027e00640 1 -- 172.21.15.87:0/926619054 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50280b31f0 msgr2=0x7f50281ef6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.631+0000 7f5027e00640 1 --2- 172.21.15.87:0/926619054 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50280b31f0 0x7f50281ef6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.631+0000 7f5027e00640 1 -- 172.21.15.87:0/926619054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50280ce210 msgr2=0x7f50280d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.635+0000 7f5027e00640 1 --2- 172.21.15.87:0/926619054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50280ce210 0x7f50280d05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.635+0000 7f5027e00640 1 -- 172.21.15.87:0/926619054 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f502809df70 con 0x7f50280ae9b0 2024-05-27T06:28:04.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.635+0000 7f5027400640 1 --2- 172.21.15.87:0/926619054 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50280b31f0 0x7f50281ef6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:28:04.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.635+0000 7f502d000640 1 --2- 172.21.15.87:0/926619054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50280ce210 0x7f50280d05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:28:04.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.635+0000 7f5027e00640 1 --2- 172.21.15.87:0/926619054 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50280ae9b0 0x7f502809ed30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f501800c3f0 tx=0x7f501800c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:04.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.635+0000 7f501fe00640 1 -- 172.21.15.87:0/926619054 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5018017070 con 0x7f50280ae9b0 2024-05-27T06:28:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.635+0000 7f501fe00640 1 -- 172.21.15.87:0/926619054 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50180052d0 con 0x7f50280ae9b0 2024-05-27T06:28:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.635+0000 7f501fe00640 1 -- 172.21.15.87:0/926619054 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5018003840 con 0x7f50280ae9b0 2024-05-27T06:28:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.635+0000 7f502f000640 1 -- 172.21.15.87:0/926619054 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f502809e250 con 0x7f50280ae9b0 2024-05-27T06:28:04.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.635+0000 7f502f000640 1 -- 172.21.15.87:0/926619054 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f502809e810 con 0x7f50280ae9b0 2024-05-27T06:28:04.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.639+0000 7f501d600640 1 -- 172.21.15.87:0/926619054 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50280508e0 con 0x7f50280ae9b0 2024-05-27T06:28:04.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.639+0000 7f501fe00640 1 -- 172.21.15.87:0/926619054 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f501801a070 con 0x7f50280ae9b0 2024-05-27T06:28:04.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.643+0000 7f501fe00640 1 --2- 172.21.15.87:0/926619054 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f500806f430 0x7f5008071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.643+0000 7f501fe00640 1 -- 172.21.15.87:0/926619054 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f501808e850 con 0x7f50280ae9b0 2024-05-27T06:28:04.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.643+0000 7f5027400640 1 --2- 172.21.15.87:0/926619054 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f500806f430 0x7f5008071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.643+0000 7f5027400640 1 --2- 172.21.15.87:0/926619054 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f500806f430 0x7f5008071940 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5020009fd0 tx=0x7f502000c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:04.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.647+0000 7f501fe00640 1 -- 172.21.15.87:0/926619054 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f50280b3b40 con 0x7f50280ae9b0 2024-05-27T06:28:04.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.675+0000 7f58b9000640 1 Processor -- start 2024-05-27T06:28:04.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.679+0000 7f58b9000640 1 -- start start 2024-05-27T06:28:04.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.679+0000 7fea9ba00640 1 Processor -- start 2024-05-27T06:28:04.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.679+0000 7fea9ba00640 1 -- start start 2024-05-27T06:28:04.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.679+0000 7fea9ba00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea9415ded0 0x7fea9406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.679+0000 7fea9ba00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fea9415e6b0 0x7fea9415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.679+0000 7fea9ba00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea940b04d0 con 0x7fea9406c720 2024-05-27T06:28:04.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.679+0000 7fea9ba00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fea940b0a20 con 0x7fea9415e6b0 2024-05-27T06:28:04.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.679+0000 7fea9ba00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fea940b2a20 con 0x7fea9415ded0 2024-05-27T06:28:04.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.679+0000 7f58b9000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58b40c4a50 0x7f58b40d07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.679+0000 7f58b9000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f58b406ea20 0x7f58b406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.679+0000 7fea99000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea9415ded0 0x7fea9406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.683+0000 7fea99000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea9415ded0 0x7fea9406dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.87:45220/0 (socket says 172.21.15.87:45220) 2024-05-27T06:28:04.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.683+0000 7fea99000640 1 -- 172.21.15.87:0/1695790788 learned_addr learned my addr 172.21.15.87:0/1695790788 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:04.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.683+0000 7f58b9000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b406d640 con 0x7f58b4164060 2024-05-27T06:28:04.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.683+0000 7f58b9000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f58b4164470 con 0x7f58b406ea20 2024-05-27T06:28:04.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.683+0000 7f58b9000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f58b406d920 con 0x7f58b40c4a50 2024-05-27T06:28:04.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.683+0000 7fea99a00640 1 --2- 172.21.15.87:0/1695790788 >> v2:172.21.15.87:3300/0 conn(0x7fea9415e6b0 0x7fea9415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.683+0000 7f58b2a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58b40c4a50 0x7f58b40d07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.683+0000 7fea99000640 1 -- 172.21.15.87:0/1695790788 >> v2:172.21.15.87:3300/0 conn(0x7fea9415e6b0 msgr2=0x7fea9415eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:04.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.683+0000 7fea99000640 1 --2- 172.21.15.87:0/1695790788 >> v2:172.21.15.87:3300/0 conn(0x7fea9415e6b0 0x7fea9415eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.683+0000 7fea99000640 1 -- 172.21.15.87:0/1695790788 >> v1:172.21.15.87:6789/0 conn(0x7fea9406c720 legacy=0x7fea9406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:04.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.683+0000 7fea99000640 1 -- 172.21.15.87:0/1695790788 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea940b0740 con 0x7fea9415ded0 2024-05-27T06:28:04.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.683+0000 7fea99a00640 1 --2- 172.21.15.87:0/1695790788 >> v2:172.21.15.87:3300/0 conn(0x7fea9415e6b0 0x7fea9415eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:04.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.683+0000 7f58b3e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f58b406ea20 0x7f58b406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.683+0000 7f58b3400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f58b4164060 0x7f58b40c4340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:58832/0 (socket says 172.21.15.87:58832) 2024-05-27T06:28:04.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.683+0000 7f58b3400640 1 -- 172.21.15.87:0/2492029090 learned_addr learned my addr 172.21.15.87:0/2492029090 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:04.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.683+0000 7f58b3e00640 1 -- 172.21.15.87:0/2492029090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58b40c4a50 msgr2=0x7f58b40d07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:04.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.683+0000 7f58b3e00640 1 --2- 172.21.15.87:0/2492029090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58b40c4a50 0x7f58b40d07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.683+0000 7f58b3e00640 1 -- 172.21.15.87:0/2492029090 >> v1:172.21.15.87:6789/0 conn(0x7f58b4164060 legacy=0x7f58b40c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:04.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.683+0000 7f58b3e00640 1 -- 172.21.15.87:0/2492029090 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b406dc00 con 0x7f58b406ea20 2024-05-27T06:28:04.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.687+0000 7f1005c00640 1 Processor -- start 2024-05-27T06:28:04.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.687+0000 7fea99000640 1 --2- 172.21.15.87:0/1695790788 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea9415ded0 0x7fea9406dc00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fea88009870 tx=0x7fea8801c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=130e9161f69b8187 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:04.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.687+0000 7f1005c00640 1 -- start start 2024-05-27T06:28:04.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.687+0000 7fea93400640 1 -- 172.21.15.87:0/1695790788 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea880aa650 con 0x7fea9415ded0 2024-05-27T06:28:04.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.687+0000 7fea93400640 1 -- 172.21.15.87:0/1695790788 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea880af070 con 0x7fea9415ded0 2024-05-27T06:28:04.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.687+0000 7fea93400640 1 -- 172.21.15.87:0/1695790788 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea880aaa10 con 0x7fea9415ded0 2024-05-27T06:28:04.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.687+0000 7f58b3e00640 1 --2- 172.21.15.87:0/2492029090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58b406ea20 0x7f58b406ee30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f58ac009d90 tx=0x7f58ac01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e3e1da7e7478d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:04.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7fea9ba00640 1 -- 172.21.15.87:0/1695790788 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea9415ded0 msgr2=0x7fea9406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7fea9ba00640 1 --2- 172.21.15.87:0/1695790788 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea9415ded0 0x7fea9406dc00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fea88009870 tx=0x7fea8801c4d0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7f58b2000640 1 -- 172.21.15.87:0/2492029090 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ac0b2070 con 0x7f58b406ea20 2024-05-27T06:28:04.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7fea9ba00640 1 -- 172.21.15.87:0/1695790788 shutdown_connections 2024-05-27T06:28:04.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7fea9ba00640 1 --2- 172.21.15.87:0/1695790788 >> v2:172.21.15.87:3300/0 conn(0x7fea9415e6b0 0x7fea9415eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7fea9ba00640 1 --2- 172.21.15.87:0/1695790788 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea9415ded0 0x7fea9406dc00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7fea9ba00640 1 -- 172.21.15.87:0/1695790788 >> 172.21.15.87:0/1695790788 conn(0x7fea94072ca0 msgr2=0x7fea940b6290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:04.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7f58b2000640 1 -- 172.21.15.87:0/2492029090 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58ac0a5980 con 0x7f58b406ea20 2024-05-27T06:28:04.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7f1005c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0ff8057620 0x7f0ff8057da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7f1005c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0ff803e430 0x7f0ff8006ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7f1005c00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ff80586f0 con 0x7f0ff80582e0 2024-05-27T06:28:04.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7f1005c00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f0ff8007910 con 0x7f0ff803e430 2024-05-27T06:28:04.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7f0fff400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f0ff80582e0 0x7f0ff80063b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:58852/0 (socket says 172.21.15.87:58852) 2024-05-27T06:28:04.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7f1005c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f0ff8007bf0 con 0x7f0ff8057620 2024-05-27T06:28:04.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7f0fff400640 1 -- 172.21.15.87:0/1224147616 learned_addr learned my addr 172.21.15.87:0/1224147616 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:04.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7f58b2000640 1 -- 172.21.15.87:0/2492029090 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ac0a5d50 con 0x7f58b406ea20 2024-05-27T06:28:04.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7f1005200640 1 --2- 172.21.15.87:0/1224147616 >> v2:172.21.15.87:3300/0 conn(0x7f0ff803e430 0x7f0ff8006ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7f58b9000640 1 -- 172.21.15.87:0/2492029090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58b406ea20 msgr2=0x7f58b406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7f0ffea00640 1 -- 172.21.15.87:0/1224147616 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2455353249 0 0) 0x7f0ff4001120 con 0x7f0ff80582e0 2024-05-27T06:28:04.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7f58b9000640 1 --2- 172.21.15.87:0/2492029090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58b406ea20 0x7f58b406ee30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f58ac009d90 tx=0x7f58ac01c960 comp rx=0 tx=0).stop 2024-05-27T06:28:04.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7f0ffea00640 1 -- 172.21.15.87:0/1224147616 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fe8003530 con 0x7f0ff80582e0 2024-05-27T06:28:04.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7fea9ba00640 1 -- 172.21.15.87:0/1695790788 shutdown_connections 2024-05-27T06:28:04.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7fea9ba00640 1 -- 172.21.15.87:0/1695790788 wait complete. 2024-05-27T06:28:04.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7f58b9000640 1 -- 172.21.15.87:0/2492029090 shutdown_connections 2024-05-27T06:28:04.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7f58b9000640 1 --2- 172.21.15.87:0/2492029090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58b406ea20 0x7f58b406ee30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7f58b9000640 1 --2- 172.21.15.87:0/2492029090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58b40c4a50 0x7f58b40d07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7f58b9000640 1 -- 172.21.15.87:0/2492029090 >> 172.21.15.87:0/2492029090 conn(0x7f58b40d1370 msgr2=0x7f58b40d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:04.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7f58b9000640 1 -- 172.21.15.87:0/2492029090 shutdown_connections 2024-05-27T06:28:04.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.695+0000 7f58b9000640 1 -- 172.21.15.87:0/2492029090 wait complete. 2024-05-27T06:28:04.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7f1005200640 1 -- 172.21.15.87:0/1224147616 >> v2:172.21.15.149:3300/0 conn(0x7f0ff8057620 msgr2=0x7f0ff8057da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:04.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7f1005200640 1 --2- 172.21.15.87:0/1224147616 >> v2:172.21.15.149:3300/0 conn(0x7f0ff8057620 0x7f0ff8057da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7f1005200640 1 -- 172.21.15.87:0/1224147616 >> v1:172.21.15.87:6789/0 conn(0x7f0ff80582e0 legacy=0x7f0ff80063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.691+0000 7f1005200640 1 -- 172.21.15.87:0/1224147616 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff803cc20 con 0x7f0ff803e430 2024-05-27T06:28:04.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.695+0000 7fea9ba00640 1 Processor -- start 2024-05-27T06:28:04.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.695+0000 7fea9ba00640 1 -- start start 2024-05-27T06:28:04.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.695+0000 7f58b9000640 1 Processor -- start 2024-05-27T06:28:04.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.699+0000 7f1005200640 1 --2- 172.21.15.87:0/1224147616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ff803e430 0x7f0ff8006ac0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1000000b70 tx=0x7f10000990c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9fb5e22c3d79905 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:04.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.699+0000 7f58b9000640 1 -- start start 2024-05-27T06:28:04.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.699+0000 7f0ffea00640 1 -- 172.21.15.87:0/1224147616 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1000121d00 con 0x7f0ff803e430 2024-05-27T06:28:04.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.699+0000 7fea9ba00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea9406c720 0x7fea9409e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.699+0000 7f0ffea00640 1 -- 172.21.15.87:0/1224147616 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1000129440 con 0x7f0ff803e430 2024-05-27T06:28:04.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.699+0000 7f0ffea00640 1 -- 172.21.15.87:0/1224147616 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1000129870 con 0x7f0ff803e430 2024-05-27T06:28:04.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.699+0000 7fea9ba00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea9415ded0 0x7fea9409a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.699+0000 7fea9ba00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea9415e6b0 0x7fea9409a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.699+0000 7f58b9000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58b406ea20 0x7f58b415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.699+0000 7f58b9000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58b4164060 0x7f58b409a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.699+0000 7fea93e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea9415ded0 0x7fea9409a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.699+0000 7fea93e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea9415ded0 0x7fea9409a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:39918/0 (socket says 172.21.15.87:39918) 2024-05-27T06:28:04.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.699+0000 7fea93e00640 1 -- 172.21.15.87:0/3168168280 learned_addr learned my addr 172.21.15.87:0/3168168280 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:04.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.699+0000 7fea9ba00640 1 -- 172.21.15.87:0/3168168280 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fea940ae5b0 con 0x7fea9415e6b0 2024-05-27T06:28:04.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.699+0000 7fea9ba00640 1 -- 172.21.15.87:0/3168168280 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fea940ae430 con 0x7fea9415ded0 2024-05-27T06:28:04.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7fea9ba00640 1 -- 172.21.15.87:0/3168168280 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fea940ae730 con 0x7fea9406c720 2024-05-27T06:28:04.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7fea99a00640 1 --2- 172.21.15.87:0/3168168280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea9415e6b0 0x7fea9409a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7f58b9000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58b40b7510 0x7f58b41659c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7f58b9000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f58b4170fd0 con 0x7f58b4164060 2024-05-27T06:28:04.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7f1005c00640 1 -- 172.21.15.87:0/1224147616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ff803e430 msgr2=0x7f0ff8006ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7f1005c00640 1 --2- 172.21.15.87:0/1224147616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ff803e430 0x7f0ff8006ac0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1000000b70 tx=0x7f10000990c0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7f58b3400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58b406ea20 0x7f58b415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7f58b2a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58b4164060 0x7f58b409a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7f58b2a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58b4164060 0x7f58b409a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38398/0 (socket says 172.21.15.87:38398) 2024-05-27T06:28:04.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7f58b2a00640 1 -- 172.21.15.87:0/4203988752 learned_addr learned my addr 172.21.15.87:0/4203988752 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:04.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7f58b9000640 1 -- 172.21.15.87:0/4203988752 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f58b4170e50 con 0x7f58b406ea20 2024-05-27T06:28:04.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7f58b3e00640 1 --2- 172.21.15.87:0/4203988752 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58b40b7510 0x7f58b41659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7f58b9000640 1 -- 172.21.15.87:0/4203988752 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f58b4171150 con 0x7f58b40b7510 2024-05-27T06:28:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7fea99a00640 1 -- 172.21.15.87:0/3168168280 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea9406c720 msgr2=0x7fea9409e880 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-27T06:28:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7fea99a00640 1 --2- 172.21.15.87:0/3168168280 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea9406c720 0x7fea9409e880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7f58b2a00640 1 -- 172.21.15.87:0/4203988752 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58b40b7510 msgr2=0x7f58b41659c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7f58b2a00640 1 --2- 172.21.15.87:0/4203988752 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58b40b7510 0x7f58b41659c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7f58b2a00640 1 -- 172.21.15.87:0/4203988752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58b406ea20 msgr2=0x7f58b415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7f58b2a00640 1 --2- 172.21.15.87:0/4203988752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58b406ea20 0x7f58b415fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7fea99a00640 1 -- 172.21.15.87:0/3168168280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea9415ded0 msgr2=0x7fea9409a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7fea99a00640 1 --2- 172.21.15.87:0/3168168280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea9415ded0 0x7fea9409a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7f58b2a00640 1 -- 172.21.15.87:0/4203988752 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b41605e0 con 0x7f58b4164060 2024-05-27T06:28:04.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7fea99a00640 1 -- 172.21.15.87:0/3168168280 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea94146450 con 0x7fea9415e6b0 2024-05-27T06:28:04.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7f58b3400640 1 --2- 172.21.15.87:0/4203988752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58b406ea20 0x7f58b415fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:04.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7f1005c00640 1 -- 172.21.15.87:0/1224147616 shutdown_connections 2024-05-27T06:28:04.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7fea99a00640 1 --2- 172.21.15.87:0/3168168280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea9415e6b0 0x7fea9409a7f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fea8c007d10 tx=0x7fea8c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:04.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7f1005c00640 1 --2- 172.21.15.87:0/1224147616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ff803e430 0x7f0ff8006ac0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7f58b2a00640 1 --2- 172.21.15.87:0/4203988752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58b4164060 0x7f58b409a250 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f58a400d620 tx=0x7f58a400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:04.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7f1005c00640 1 --2- 172.21.15.87:0/1224147616 >> v2:172.21.15.149:3300/0 conn(0x7f0ff8057620 0x7f0ff8057da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7f1005c00640 1 -- 172.21.15.87:0/1224147616 >> 172.21.15.87:0/1224147616 conn(0x7f0ff803ac60 msgr2=0x7f0ff803b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:04.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7fea90c00640 1 -- 172.21.15.87:0/3168168280 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8c01a070 con 0x7fea9415e6b0 2024-05-27T06:28:04.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7f1005c00640 1 -- 172.21.15.87:0/1224147616 shutdown_connections 2024-05-27T06:28:04.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7f1005c00640 1 -- 172.21.15.87:0/1224147616 wait complete. 2024-05-27T06:28:04.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7fea90c00640 1 -- 172.21.15.87:0/3168168280 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea8c0039a0 con 0x7fea9415e6b0 2024-05-27T06:28:04.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7fea90c00640 1 -- 172.21.15.87:0/3168168280 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8c003d70 con 0x7fea9415e6b0 2024-05-27T06:28:04.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7fea9ba00640 1 -- 172.21.15.87:0/3168168280 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea94146730 con 0x7fea9415e6b0 2024-05-27T06:28:04.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7f58ab400640 1 -- 172.21.15.87:0/4203988752 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a400b620 con 0x7f58b4164060 2024-05-27T06:28:04.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7f58ab400640 1 -- 172.21.15.87:0/4203988752 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a4019070 con 0x7f58b4164060 2024-05-27T06:28:04.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.703+0000 7fea9ba00640 1 -- 172.21.15.87:0/3168168280 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea9415b710 con 0x7fea9415e6b0 2024-05-27T06:28:04.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.707+0000 7f58b9000640 1 -- 172.21.15.87:0/4203988752 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58b40b9280 con 0x7f58b4164060 2024-05-27T06:28:04.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.707+0000 7f58b9000640 1 -- 172.21.15.87:0/4203988752 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58b40bade0 con 0x7f58b4164060 2024-05-27T06:28:04.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.707+0000 7f58ab400640 1 -- 172.21.15.87:0/4203988752 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a400b9e0 con 0x7f58b4164060 2024-05-27T06:28:04.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.707+0000 7f58b9000640 1 -- 172.21.15.87:0/4203988752 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f588c0052a0 con 0x7f58b4164060 2024-05-27T06:28:04.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.707+0000 7fea9ba00640 1 -- 172.21.15.87:0/3168168280 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea9415b970 con 0x7fea9415e6b0 2024-05-27T06:28:04.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.711+0000 7f1005c00640 1 Processor -- start 2024-05-27T06:28:04.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.711+0000 7f1005c00640 1 -- start start 2024-05-27T06:28:04.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.711+0000 7fea90c00640 1 -- 172.21.15.87:0/3168168280 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fea8c01d070 con 0x7fea9415e6b0 2024-05-27T06:28:04.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.711+0000 7fea90c00640 1 --2- 172.21.15.87:0/3168168280 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fea7406f430 0x7fea74071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.715+0000 7f1005c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ff803e430 0x7f0ff8052d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.715+0000 7fea99000640 1 --2- 172.21.15.87:0/3168168280 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fea7406f430 0x7fea74071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.715+0000 7f1005c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ff8057620 0x7f0ff80ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.715+0000 7f1005c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ff80582e0 0x7f0ff80d8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.715+0000 7f0fffe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ff803e430 0x7f0ff8052d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.715+0000 7f0fffe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ff803e430 0x7f0ff8052d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38408/0 (socket says 172.21.15.87:38408) 2024-05-27T06:28:04.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.715+0000 7f0fff400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ff8057620 0x7f0ff80ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.715+0000 7f0fff400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ff8057620 0x7f0ff80ca130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:39928/0 (socket says 172.21.15.87:39928) 2024-05-27T06:28:04.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.715+0000 7f0fffe00640 1 -- 172.21.15.87:0/2723717684 learned_addr learned my addr 172.21.15.87:0/2723717684 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:04.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.715+0000 7f1005c00640 1 -- 172.21.15.87:0/2723717684 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff80f0580 con 0x7f0ff803e430 2024-05-27T06:28:04.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.715+0000 7f1005c00640 1 -- 172.21.15.87:0/2723717684 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff80f0400 con 0x7f0ff8057620 2024-05-27T06:28:04.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.715+0000 7f1005c00640 1 -- 172.21.15.87:0/2723717684 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff80f0700 con 0x7f0ff80582e0 2024-05-27T06:28:04.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.715+0000 7fea99000640 1 --2- 172.21.15.87:0/3168168280 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fea7406f430 0x7fea74071940 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fea880ae000 tx=0x7fea880a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:04.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.715+0000 7f1005200640 1 --2- 172.21.15.87:0/2723717684 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ff80582e0 0x7f0ff80d8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.715+0000 7f0fff400640 1 -- 172.21.15.87:0/2723717684 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ff80582e0 msgr2=0x7f0ff80d8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.715+0000 7f0fff400640 1 --2- 172.21.15.87:0/2723717684 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ff80582e0 0x7f0ff80d8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.715+0000 7f0fff400640 1 -- 172.21.15.87:0/2723717684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ff803e430 msgr2=0x7f0ff8052d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.715+0000 7f0fff400640 1 --2- 172.21.15.87:0/2723717684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ff803e430 0x7f0ff8052d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.715+0000 7f0fff400640 1 -- 172.21.15.87:0/2723717684 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff80ca670 con 0x7f0ff8057620 2024-05-27T06:28:04.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.715+0000 7f0fff400640 1 --2- 172.21.15.87:0/2723717684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ff8057620 0x7f0ff80ca130 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400c760 tx=0x7f0ff400cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:04.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.715+0000 7f58ab400640 1 -- 172.21.15.87:0/4203988752 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f58a400bb80 con 0x7f58b4164060 2024-05-27T06:28:04.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.719+0000 7f0fefe00640 1 -- 172.21.15.87:0/2723717684 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff40058c0 con 0x7f0ff8057620 2024-05-27T06:28:04.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.719+0000 7f0fefe00640 1 -- 172.21.15.87:0/2723717684 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ff4005a60 con 0x7f0ff8057620 2024-05-27T06:28:04.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.719+0000 7f0fefe00640 1 -- 172.21.15.87:0/2723717684 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4005e30 con 0x7f0ff8057620 2024-05-27T06:28:04.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.719+0000 7f58ab400640 1 --2- 172.21.15.87:0/4203988752 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f589406f400 0x7f5894071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.719+0000 7f58ab400640 1 -- 172.21.15.87:0/4203988752 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f58a4090370 con 0x7f58b4164060 2024-05-27T06:28:04.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.719+0000 7f1005c00640 1 -- 172.21.15.87:0/2723717684 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ff80daf50 con 0x7f0ff8057620 2024-05-27T06:28:04.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.719+0000 7f1005c00640 1 -- 172.21.15.87:0/2723717684 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ff80db510 con 0x7f0ff8057620 2024-05-27T06:28:04.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.719+0000 7f58b3400640 1 --2- 172.21.15.87:0/4203988752 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f589406f400 0x7f5894071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.719+0000 7f1005c00640 1 -- 172.21.15.87:0/2723717684 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fdc0052a0 con 0x7f0ff8057620 2024-05-27T06:28:04.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.723+0000 7f58b3400640 1 --2- 172.21.15.87:0/4203988752 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f589406f400 0x7f5894071910 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f58b406ca50 tx=0x7f58a0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:04.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.723+0000 7f0fefe00640 1 -- 172.21.15.87:0/2723717684 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0ff4007070 con 0x7f0ff8057620 2024-05-27T06:28:04.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.723+0000 7fea90c00640 1 -- 172.21.15.87:0/3168168280 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fea8c058670 con 0x7fea9415e6b0 2024-05-27T06:28:04.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.723+0000 7f58ab400640 1 -- 172.21.15.87:0/4203988752 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f58a405c940 con 0x7f58b4164060 2024-05-27T06:28:04.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.727+0000 7f0fefe00640 1 --2- 172.21.15.87:0/2723717684 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0fe406f4d0 0x7f0fe40719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.727+0000 7f0fffe00640 1 --2- 172.21.15.87:0/2723717684 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0fe406f4d0 0x7f0fe40719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.727+0000 7f0fffe00640 1 --2- 172.21.15.87:0/2723717684 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0fe406f4d0 0x7f0fe40719e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00099b0 tx=0x7f0ff0009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:04.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.727+0000 7f0fefe00640 1 -- 172.21.15.87:0/2723717684 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0ff408fa30 con 0x7f0ff8057620 2024-05-27T06:28:04.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.727+0000 7f0fefe00640 1 -- 172.21.15.87:0/2723717684 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f0ff80586f0 con 0x7f0ff8057620 2024-05-27T06:28:04.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.735+0000 7fea90c00640 1 -- 172.21.15.87:0/3168168280 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fea8c024020 con 0x7fea9415e6b0 2024-05-27T06:28:04.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.755+0000 7fcee3e00640 1 Processor -- start 2024-05-27T06:28:04.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.755+0000 7fcee3e00640 1 -- start start 2024-05-27T06:28:04.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.759+0000 7fcee3e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcee40cdbf0 0x7fcee406dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.759+0000 7fcee3e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcee415be70 0x7fcee40d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.759+0000 7fcee3e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcee406e3e0 con 0x7fcee40d0eb0 2024-05-27T06:28:04.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.759+0000 7fcee3e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fcee40d01b0 con 0x7fcee415be70 2024-05-27T06:28:04.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.759+0000 7fcee3e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcee40cfb60 con 0x7fcee40cdbf0 2024-05-27T06:28:04.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.759+0000 7fcee2000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcee415be70 0x7fcee40d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.759+0000 7fcee2000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcee415be70 0x7fcee40d0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:37850/0 (socket says 172.21.15.87:37850) 2024-05-27T06:28:04.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.759+0000 7fcee2000640 1 -- 172.21.15.87:0/463374296 learned_addr learned my addr 172.21.15.87:0/463374296 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:04.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.759+0000 7fcee2a00640 1 --2- 172.21.15.87:0/463374296 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcee40cdbf0 0x7fcee406dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.759+0000 7fcee1600640 1 -- 172.21.15.87:0/463374296 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 325060804 0 0) 0x7fcee406e3e0 con 0x7fcee40d0eb0 2024-05-27T06:28:04.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.759+0000 7fcee1600640 1 -- 172.21.15.87:0/463374296 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcec8003530 con 0x7fcee40d0eb0 2024-05-27T06:28:04.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.763+0000 7fcee2000640 1 -- 172.21.15.87:0/463374296 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcee40cdbf0 msgr2=0x7fcee406dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:04.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.763+0000 7fcee2000640 1 --2- 172.21.15.87:0/463374296 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcee40cdbf0 0x7fcee406dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.763+0000 7fcee2000640 1 -- 172.21.15.87:0/463374296 >> v1:172.21.15.149:6789/0 conn(0x7fcee40d0eb0 legacy=0x7fcee40d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.763+0000 7fcee2000640 1 -- 172.21.15.87:0/463374296 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee40cfe40 con 0x7fcee415be70 2024-05-27T06:28:04.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.767+0000 7fcee2000640 1 --2- 172.21.15.87:0/463374296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcee415be70 0x7fcee40d0640 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0076d0 tx=0x7fcedc01cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=763076d2f6d21378 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:04.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.767+0000 7fb3a3200640 1 Processor -- start 2024-05-27T06:28:04.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.767+0000 7fb3a3200640 1 -- start start 2024-05-27T06:28:04.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.767+0000 7fcee1600640 1 -- 172.21.15.87:0/463374296 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc0110d0 con 0x7fcee415be70 2024-05-27T06:28:04.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.767+0000 7fcee1600640 1 -- 172.21.15.87:0/463374296 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcedc011270 con 0x7fcee415be70 2024-05-27T06:28:04.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.767+0000 7fcee1600640 1 -- 172.21.15.87:0/463374296 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc011640 con 0x7fcee415be70 2024-05-27T06:28:04.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.767+0000 7f8299400640 1 Processor -- start 2024-05-27T06:28:04.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.767+0000 7fcee3e00640 1 -- 172.21.15.87:0/463374296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcee415be70 msgr2=0x7fcee40d0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.767+0000 7f8299400640 1 -- start start 2024-05-27T06:28:04.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.767+0000 7fcee3e00640 1 --2- 172.21.15.87:0/463374296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcee415be70 0x7fcee40d0640 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0076d0 tx=0x7fcedc01cf20 comp rx=0 tx=0).stop 2024-05-27T06:28:04.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.767+0000 7fcee3e00640 1 -- 172.21.15.87:0/463374296 shutdown_connections 2024-05-27T06:28:04.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.767+0000 7fcee3e00640 1 --2- 172.21.15.87:0/463374296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcee415be70 0x7fcee40d0640 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0076d0 tx=0x7fcedc01cf20 comp rx=0 tx=0).stop 2024-05-27T06:28:04.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.767+0000 7fcee3e00640 1 --2- 172.21.15.87:0/463374296 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcee40cdbf0 0x7fcee406dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.767+0000 7fcee3e00640 1 -- 172.21.15.87:0/463374296 >> 172.21.15.87:0/463374296 conn(0x7fcee40b42c0 msgr2=0x7fcee40b46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:04.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.767+0000 7fb3a3200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb3a40ccac0 0x7fb3a40cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.767+0000 7fb3a3200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3a40cced0 0x7fb3a40ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.767+0000 7fb3a3200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3a40707c0 con 0x7fb3a40b0250 2024-05-27T06:28:04.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.767+0000 7fb3a3200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fb3a40cba60 con 0x7fb3a40ccac0 2024-05-27T06:28:04.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.767+0000 7fb3a3200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb3a40cbd00 con 0x7fb3a40cced0 2024-05-27T06:28:04.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.767+0000 7fb756a00640 1 Processor -- start 2024-05-27T06:28:04.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.767+0000 7fb3a2800640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb3a40b0250 0x7fb3a40b0660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:53764/0 (socket says 172.21.15.87:53764) 2024-05-27T06:28:04.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.767+0000 7fb3a2800640 1 -- 172.21.15.87:0/2855810577 learned_addr learned my addr 172.21.15.87:0/2855810577 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:04.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb3a1e00640 1 --2- 172.21.15.87:0/2855810577 >> v2:172.21.15.87:3300/0 conn(0x7fb3a40ccac0 0x7fb3a40cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb3a1400640 1 --2- 172.21.15.87:0/2855810577 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3a40cced0 0x7fb3a40ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb3a0a00640 1 -- 172.21.15.87:0/2855810577 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1093904137 0 0) 0x7fb3a40707c0 con 0x7fb3a40b0250 2024-05-27T06:28:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb3a0a00640 1 -- 172.21.15.87:0/2855810577 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb388005740 con 0x7fb3a40b0250 2024-05-27T06:28:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb3a0a00640 1 -- 172.21.15.87:0/2855810577 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1021415713 0 0) 0x7fb388005740 con 0x7fb3a40b0250 2024-05-27T06:28:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb3a0a00640 1 -- 172.21.15.87:0/2855810577 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3a40cced0 msgr2=0x7fb3a40ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb3a0a00640 1 --2- 172.21.15.87:0/2855810577 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3a40cced0 0x7fb3a40ce2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb3a0a00640 1 -- 172.21.15.87:0/2855810577 >> v2:172.21.15.87:3300/0 conn(0x7fb3a40ccac0 msgr2=0x7fb3a40cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb3a0a00640 1 --2- 172.21.15.87:0/2855810577 >> v2:172.21.15.87:3300/0 conn(0x7fb3a40ccac0 0x7fb3a40cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb3a0a00640 1 -- 172.21.15.87:0/2855810577 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a40cbfe0 con 0x7fb3a40b0250 2024-05-27T06:28:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb3a0a00640 1 -- 172.21.15.87:0/2855810577 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7fb39c005270 con 0x7fb3a40b0250 2024-05-27T06:28:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb3a0a00640 1 -- 172.21.15.87:0/2855810577 >> v1:172.21.15.87:6789/0 conn(0x7fb3a40b0250 legacy=0x7fb3a40b0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb3a0a00640 1 --2- 172.21.15.87:0/2855810577 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb388005c20 0x7fb388006090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb3a0a00640 1 --2- 172.21.15.87:0/2855810577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb388006a20 0x7fb388006e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb3a0a00640 1 --2- 172.21.15.87:0/2855810577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb388007370 0x7fb38800dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb3a0a00640 1 -- 172.21.15.87:0/2855810577 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a40cba60 con 0x7fb388007370 2024-05-27T06:28:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb3a0a00640 1 -- 172.21.15.87:0/2855810577 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a40cbd00 con 0x7fb388006a20 2024-05-27T06:28:04.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb3a0a00640 1 -- 172.21.15.87:0/2855810577 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb38800e2d0 con 0x7fb388005c20 2024-05-27T06:28:04.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7f8299400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82940d1d60 0x7f82940ce280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7f8299400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f829406f500 0x7f829406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7f8299400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82940b30b0 con 0x7f82940cde70 2024-05-27T06:28:04.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7f8299400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f82940b3390 con 0x7f829406f500 2024-05-27T06:28:04.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7f8299400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f82940b3670 con 0x7f82940d1d60 2024-05-27T06:28:04.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7f8293200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f829406f500 0x7f829406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7f8293200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f829406f500 0x7f829406f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55288/0 (socket says 172.21.15.87:55288) 2024-05-27T06:28:04.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7f8293200640 1 -- 172.21.15.87:0/2187432075 learned_addr learned my addr 172.21.15.87:0/2187432075 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:04.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7f8293200640 1 -- 172.21.15.87:0/2187432075 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82940d1d60 msgr2=0x7f82940ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:04.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7f8293200640 1 --2- 172.21.15.87:0/2187432075 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82940d1d60 0x7f82940ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7f8293200640 1 -- 172.21.15.87:0/2187432075 >> v1:172.21.15.149:6789/0 conn(0x7f82940cde70 legacy=0x7f82940d1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:04.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7f8293200640 1 -- 172.21.15.87:0/2187432075 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82940b3950 con 0x7f829406f500 2024-05-27T06:28:04.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb756a00640 1 -- start start 2024-05-27T06:28:04.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb756a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb748006ce0 0x7fb7480dfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb756a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb748050b50 0x7fb748038b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb3a2800640 1 --2- 172.21.15.87:0/2855810577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb388007370 0x7fb38800dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb3a1400640 1 --2- 172.21.15.87:0/2855810577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb388006a20 0x7fb388006e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb3a2800640 1 -- 172.21.15.87:0/2855810577 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb388005c20 msgr2=0x7fb388006090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-27T06:28:04.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb3a2800640 1 --2- 172.21.15.87:0/2855810577 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb388005c20 0x7fb388006090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb3a2800640 1 -- 172.21.15.87:0/2855810577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb388006a20 msgr2=0x7fb388006e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:04.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb3a2800640 1 --2- 172.21.15.87:0/2855810577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb388006a20 0x7fb388006e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.775+0000 7fb756a00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb748007330 con 0x7fb7480e41e0 2024-05-27T06:28:04.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.771+0000 7fb3a2800640 1 -- 172.21.15.87:0/2855810577 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb388005740 con 0x7fb388007370 2024-05-27T06:28:04.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.775+0000 7fb756a00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fb7480070f0 con 0x7fb748006ce0 2024-05-27T06:28:04.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.775+0000 7fb756a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb748007610 con 0x7fb748050b50 2024-05-27T06:28:04.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.775+0000 7fb755600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb748006ce0 0x7fb7480dfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.775+0000 7fb754c00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb7480e41e0 0x7fb748050440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:53766/0 (socket says 172.21.15.87:53766) 2024-05-27T06:28:04.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.775+0000 7fb754c00640 1 -- 172.21.15.87:0/3231260379 learned_addr learned my addr 172.21.15.87:0/3231260379 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:04.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.775+0000 7fcee3e00640 1 -- 172.21.15.87:0/463374296 shutdown_connections 2024-05-27T06:28:04.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.775+0000 7fcee3e00640 1 -- 172.21.15.87:0/463374296 wait complete. 2024-05-27T06:28:04.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.775+0000 7fb755600640 1 -- 172.21.15.87:0/3231260379 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb748050b50 msgr2=0x7fb748038b50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-27T06:28:04.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.775+0000 7fb755600640 1 --2- 172.21.15.87:0/3231260379 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb748050b50 0x7fb748038b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.775+0000 7fb755600640 1 -- 172.21.15.87:0/3231260379 >> v1:172.21.15.87:6789/0 conn(0x7fb7480e41e0 legacy=0x7fb748050440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.775+0000 7fb755600640 1 -- 172.21.15.87:0/3231260379 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7480078f0 con 0x7fb748006ce0 2024-05-27T06:28:04.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.779+0000 7fcee3e00640 1 Processor -- start 2024-05-27T06:28:04.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.779+0000 7f8293200640 1 --2- 172.21.15.87:0/2187432075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f829406f500 0x7f829406f910 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f828c009e50 tx=0x7f828c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74898e5a13d72a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:04.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.779+0000 7fcee3e00640 1 -- start start 2024-05-27T06:28:04.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.779+0000 7f8291400640 1 -- 172.21.15.87:0/2187432075 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828c0a5670 con 0x7f829406f500 2024-05-27T06:28:04.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.779+0000 7fb3a2800640 1 --2- 172.21.15.87:0/2855810577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb388007370 0x7fb38800dbe0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb39c001700 tx=0x7fb39c01cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68af4ddf778794bb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:04.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.779+0000 7f8291400640 1 -- 172.21.15.87:0/2187432075 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f828c0a5810 con 0x7f829406f500 2024-05-27T06:28:04.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.779+0000 7fcee3e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcee40cdbf0 0x7fcee4147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.779+0000 7fcee3e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcee40d0eb0 0x7fcee40b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.779+0000 7fcee3e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcee409eb10 0x7fcee40ae110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.779+0000 7fcee3e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcee40cc560 con 0x7fcee409eb10 2024-05-27T06:28:04.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.779+0000 7f8291400640 1 -- 172.21.15.87:0/2187432075 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828c0a5be0 con 0x7f829406f500 2024-05-27T06:28:04.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.779+0000 7f8299400640 1 -- 172.21.15.87:0/2187432075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f829406f500 msgr2=0x7f829406f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.779+0000 7f8299400640 1 --2- 172.21.15.87:0/2187432075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f829406f500 0x7f829406f910 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f828c009e50 tx=0x7f828c01ca30 comp rx=0 tx=0).stop 2024-05-27T06:28:04.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.779+0000 7fcee3e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcee40cc3e0 con 0x7fcee40cdbf0 2024-05-27T06:28:04.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.779+0000 7fcee3e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcee4165c50 con 0x7fcee40d0eb0 2024-05-27T06:28:04.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.779+0000 7f8299400640 1 -- 172.21.15.87:0/2187432075 shutdown_connections 2024-05-27T06:28:04.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.779+0000 7f8299400640 1 --2- 172.21.15.87:0/2187432075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f829406f500 0x7f829406f910 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.779+0000 7f8299400640 1 --2- 172.21.15.87:0/2187432075 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82940d1d60 0x7f82940ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.779+0000 7f8299400640 1 -- 172.21.15.87:0/2187432075 >> 172.21.15.87:0/2187432075 conn(0x7f82940cffa0 msgr2=0x7f82940d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:04.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.779+0000 7fcee2a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcee40cdbf0 0x7fcee4147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.779+0000 7fcee2000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcee40d0eb0 0x7fcee40b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.779+0000 7fcee2000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcee40d0eb0 0x7fcee40b3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.87:47162/0 (socket says 172.21.15.87:47162) 2024-05-27T06:28:04.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.779+0000 7fcee2000640 1 -- 172.21.15.87:0/1438649721 learned_addr learned my addr 172.21.15.87:0/1438649721 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:04.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.783+0000 7fcee3400640 1 --2- 172.21.15.87:0/1438649721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcee409eb10 0x7fcee40ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.783+0000 7fcee2000640 1 -- 172.21.15.87:0/1438649721 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcee40cdbf0 msgr2=0x7fcee4147810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.783+0000 7fcee2000640 1 --2- 172.21.15.87:0/1438649721 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcee40cdbf0 0x7fcee4147810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.783+0000 7fcee2000640 1 -- 172.21.15.87:0/1438649721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcee409eb10 msgr2=0x7fcee40ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.783+0000 7fcee2000640 1 --2- 172.21.15.87:0/1438649721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcee409eb10 0x7fcee40ae110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.783+0000 7fcee2000640 1 -- 172.21.15.87:0/1438649721 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee4069b20 con 0x7fcee40d0eb0 2024-05-27T06:28:04.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.783+0000 7fcee3400640 1 --2- 172.21.15.87:0/1438649721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcee409eb10 0x7fcee40ae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:04.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.783+0000 7fb3a0a00640 1 -- 172.21.15.87:0/2855810577 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c008db0 con 0x7fb388007370 2024-05-27T06:28:04.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.779+0000 7f8299400640 1 -- 172.21.15.87:0/2187432075 shutdown_connections 2024-05-27T06:28:04.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.779+0000 7f8299400640 1 -- 172.21.15.87:0/2187432075 wait complete. 2024-05-27T06:28:04.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.783+0000 7fb755600640 1 --2- 172.21.15.87:0/3231260379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb748006ce0 0x7fb7480dfc50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb7440097c0 tx=0x7fb74401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ffae779a2fbc051 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:04.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.783+0000 7fb3a0a00640 1 -- 172.21.15.87:0/2855810577 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb39c008270 con 0x7fb388007370 2024-05-27T06:28:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.783+0000 7fcee2000640 1 --2- 172.21.15.87:0/1438649721 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcee40d0eb0 0x7fcee40b3490 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcedc000f90 tx=0x7fcedc019cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.783+0000 7fb3a0a00640 1 -- 172.21.15.87:0/2855810577 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c008db0 con 0x7fb388007370 2024-05-27T06:28:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.783+0000 7fcedaa00640 1 -- 172.21.15.87:0/1438649721 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc0bf070 con 0x7fcee40d0eb0 2024-05-27T06:28:04.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.783+0000 7fcedaa00640 1 -- 172.21.15.87:0/1438649721 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcedc003ba0 con 0x7fcee40d0eb0 2024-05-27T06:28:04.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.783+0000 7fcedaa00640 1 -- 172.21.15.87:0/1438649721 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc0110d0 con 0x7fcee40d0eb0 2024-05-27T06:28:04.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.783+0000 7fcee3e00640 1 -- 172.21.15.87:0/1438649721 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcee4161dd0 con 0x7fcee40d0eb0 2024-05-27T06:28:04.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.783+0000 7fcee3e00640 1 -- 172.21.15.87:0/1438649721 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcee4162390 con 0x7fcee40d0eb0 2024-05-27T06:28:04.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.783+0000 7fb3a3200640 1 -- 172.21.15.87:0/2855810577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb388007370 msgr2=0x7fb38800dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.783+0000 7fb3a3200640 1 --2- 172.21.15.87:0/2855810577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb388007370 0x7fb38800dbe0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb39c001700 tx=0x7fb39c01cf80 comp rx=0 tx=0).stop 2024-05-27T06:28:04.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.783+0000 7fb74fe00640 1 -- 172.21.15.87:0/3231260379 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7440b0070 con 0x7fb748006ce0 2024-05-27T06:28:04.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.783+0000 7fb74fe00640 1 -- 172.21.15.87:0/3231260379 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7440ab600 con 0x7fb748006ce0 2024-05-27T06:28:04.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.783+0000 7fb74fe00640 1 -- 172.21.15.87:0/3231260379 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7440b0070 con 0x7fb748006ce0 2024-05-27T06:28:04.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.783+0000 7fb3a2800640 1 -- 172.21.15.87:0/2855810577 reap_dead start 2024-05-27T06:28:04.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.783+0000 7fb3a3200640 1 -- 172.21.15.87:0/2855810577 shutdown_connections 2024-05-27T06:28:04.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.783+0000 7fb3a3200640 1 -- 172.21.15.87:0/2855810577 >> 172.21.15.87:0/2855810577 conn(0x7fb3a40d1370 msgr2=0x7fb3a40d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:04.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.783+0000 7f8299400640 1 Processor -- start 2024-05-27T06:28:04.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.787+0000 7f8299400640 1 -- start start 2024-05-27T06:28:04.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.787+0000 7fcecfe00640 1 -- 172.21.15.87:0/1438649721 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fceb80052a0 con 0x7fcee40d0eb0 2024-05-27T06:28:04.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.787+0000 7fb3a3200640 1 -- 172.21.15.87:0/2855810577 shutdown_connections 2024-05-27T06:28:04.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.787+0000 7fb3a3200640 1 -- 172.21.15.87:0/2855810577 wait complete. 2024-05-27T06:28:04.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.787+0000 7fb756a00640 1 -- 172.21.15.87:0/3231260379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb748006ce0 msgr2=0x7fb7480dfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.787+0000 7fb756a00640 1 --2- 172.21.15.87:0/3231260379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb748006ce0 0x7fb7480dfc50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb7440097c0 tx=0x7fb74401c4c0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.787+0000 7fb756a00640 1 -- 172.21.15.87:0/3231260379 shutdown_connections 2024-05-27T06:28:04.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.787+0000 7fb756a00640 1 --2- 172.21.15.87:0/3231260379 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb748050b50 0x7fb748038b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.787+0000 7fb756a00640 1 --2- 172.21.15.87:0/3231260379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb748006ce0 0x7fb7480dfc50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.787+0000 7fb756a00640 1 -- 172.21.15.87:0/3231260379 >> 172.21.15.87:0/3231260379 conn(0x7fb74800aa80 msgr2=0x7fb74800ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:04.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.787+0000 7fb756a00640 1 -- 172.21.15.87:0/3231260379 shutdown_connections 2024-05-27T06:28:04.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.787+0000 7fb756a00640 1 -- 172.21.15.87:0/3231260379 wait complete. 2024-05-27T06:28:04.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.787+0000 7f8299400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f829406f500 0x7f8294163c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.787+0000 7f8299400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82940cde70 0x7f829415c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.787+0000 7f8292800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f829406f500 0x7f8294163c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.787+0000 7f8292800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f829406f500 0x7f8294163c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.87:47166/0 (socket says 172.21.15.87:47166) 2024-05-27T06:28:04.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.787+0000 7f8292800640 1 -- 172.21.15.87:0/3217932412 learned_addr learned my addr 172.21.15.87:0/3217932412 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:04.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.787+0000 7f8299400640 1 --2- 172.21.15.87:0/3217932412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f829415cb60 0x7f82941672d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.787+0000 7f8291e00640 1 --2- 172.21.15.87:0/3217932412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82940cde70 0x7f829415c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.787+0000 7f8293200640 1 --2- 172.21.15.87:0/3217932412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f829415cb60 0x7f82941672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.787+0000 7f8299400640 1 -- 172.21.15.87:0/3217932412 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8294171270 con 0x7f829415cb60 2024-05-27T06:28:04.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.787+0000 7f8299400640 1 -- 172.21.15.87:0/3217932412 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f82940b4890 con 0x7f82940cde70 2024-05-27T06:28:04.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.787+0000 7f8299400640 1 -- 172.21.15.87:0/3217932412 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f82941713f0 con 0x7f829406f500 2024-05-27T06:28:04.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.787+0000 7fcedaa00640 1 -- 172.21.15.87:0/1438649721 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fcedc0b8680 con 0x7fcee40d0eb0 2024-05-27T06:28:04.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.791+0000 7fb3a3200640 1 Processor -- start 2024-05-27T06:28:04.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.791+0000 7fb3a3200640 1 -- start start 2024-05-27T06:28:04.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.791+0000 7f8292800640 1 -- 172.21.15.87:0/3217932412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82940cde70 msgr2=0x7f829415c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.791+0000 7f8292800640 1 --2- 172.21.15.87:0/3217932412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82940cde70 0x7f829415c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.791+0000 7f8292800640 1 -- 172.21.15.87:0/3217932412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f829415cb60 msgr2=0x7f82941672d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.791+0000 7f8292800640 1 --2- 172.21.15.87:0/3217932412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f829415cb60 0x7f82941672d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.791+0000 7f8292800640 1 -- 172.21.15.87:0/3217932412 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82940b65a0 con 0x7f829406f500 2024-05-27T06:28:04.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.791+0000 7f8292800640 1 --2- 172.21.15.87:0/3217932412 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f829406f500 0x7f8294163c40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f828400c490 tx=0x7f828400c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:04.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.791+0000 7fcedaa00640 1 --2- 172.21.15.87:0/1438649721 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fcec406f430 0x7fcec4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.791+0000 7fcedaa00640 1 -- 172.21.15.87:0/1438649721 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcedc12a700 con 0x7fcee40d0eb0 2024-05-27T06:28:04.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.791+0000 7fcee2a00640 1 --2- 172.21.15.87:0/1438649721 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fcec406f430 0x7fcec4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.791+0000 7fb756a00640 1 Processor -- start 2024-05-27T06:28:04.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.791+0000 7fb756a00640 1 -- start start 2024-05-27T06:28:04.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.791+0000 7f828aa00640 1 -- 172.21.15.87:0/3217932412 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284017070 con 0x7f829406f500 2024-05-27T06:28:04.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.791+0000 7f828aa00640 1 -- 172.21.15.87:0/3217932412 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8284003600 con 0x7f829406f500 2024-05-27T06:28:04.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.791+0000 7fb3a3200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb388007370 0x7fb3a409dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.791+0000 7fb3a3200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3a40b06d0 0x7fb3a40b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.791+0000 7fb3a3200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3a41fde50 0x7fb3a41fe260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.791+0000 7fb3a3200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a4070ab0 con 0x7fb3a41fde50 2024-05-27T06:28:04.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.791+0000 7fb3a3200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a40cc5a0 con 0x7fb3a40b06d0 2024-05-27T06:28:04.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.791+0000 7fb3a3200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb3a4070c30 con 0x7fb388007370 2024-05-27T06:28:04.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.791+0000 7f8299400640 1 -- 172.21.15.87:0/3217932412 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82940b6880 con 0x7f829406f500 2024-05-27T06:28:04.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.791+0000 7f8299400640 1 -- 172.21.15.87:0/3217932412 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f82940b6e40 con 0x7f829406f500 2024-05-27T06:28:04.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.791+0000 7fcee2a00640 1 --2- 172.21.15.87:0/1438649721 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fcec406f430 0x7fcec4071940 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fced4009850 tx=0x7fced4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:04.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7f828aa00640 1 -- 172.21.15.87:0/3217932412 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82840039f0 con 0x7f829406f500 2024-05-27T06:28:04.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7fb3a1400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3a40b06d0 0x7fb3a40b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7fb3a1400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3a40b06d0 0x7fb3a40b0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:37872/0 (socket says 172.21.15.87:37872) 2024-05-27T06:28:04.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7fb3a1400640 1 -- 172.21.15.87:0/1922540708 learned_addr learned my addr 172.21.15.87:0/1922540708 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:04.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7fb3a1e00640 1 --2- 172.21.15.87:0/1922540708 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb388007370 0x7fb3a409dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7fcedaa00640 1 -- 172.21.15.87:0/1438649721 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fcedc016ba0 con 0x7fcee40d0eb0 2024-05-27T06:28:04.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7fb3a2800640 1 --2- 172.21.15.87:0/1922540708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3a41fde50 0x7fb3a41fe260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7fb756a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb748006ce0 0x7fb74804c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7fb756a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7480e41e0 0x7fb74804b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7fb756a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7480c8980 0x7fb7480c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7fb756a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb748039420 con 0x7fb7480c8980 2024-05-27T06:28:04.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7fb756a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb7480392a0 con 0x7fb748006ce0 2024-05-27T06:28:04.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7fb756a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb7480395a0 con 0x7fb7480e41e0 2024-05-27T06:28:04.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7fb755600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb748006ce0 0x7fb74804c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7fb755600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb748006ce0 0x7fb74804c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:37886/0 (socket says 172.21.15.87:37886) 2024-05-27T06:28:04.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7fb755600640 1 -- 172.21.15.87:0/1557994246 learned_addr learned my addr 172.21.15.87:0/1557994246 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:04.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7f8299400640 1 -- 172.21.15.87:0/3217932412 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f826c0052a0 con 0x7f829406f500 2024-05-27T06:28:04.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7fb3a1400640 1 -- 172.21.15.87:0/1922540708 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb388007370 msgr2=0x7fb3a409dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7fb3a1400640 1 --2- 172.21.15.87:0/1922540708 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb388007370 0x7fb3a409dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7fb3a1400640 1 -- 172.21.15.87:0/1922540708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3a41fde50 msgr2=0x7fb3a41fe260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7fb3a1400640 1 --2- 172.21.15.87:0/1922540708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3a41fde50 0x7fb3a41fe260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7fb754c00640 1 --2- 172.21.15.87:0/1557994246 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7480e41e0 0x7fb74804b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7fb3a1400640 1 -- 172.21.15.87:0/1922540708 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a41fe7a0 con 0x7fb3a40b06d0 2024-05-27T06:28:04.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7fb756000640 1 --2- 172.21.15.87:0/1557994246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7480c8980 0x7fb7480c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7fb755600640 1 -- 172.21.15.87:0/1557994246 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7480e41e0 msgr2=0x7fb74804b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7fb755600640 1 --2- 172.21.15.87:0/1557994246 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7480e41e0 0x7fb74804b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7fb755600640 1 -- 172.21.15.87:0/1557994246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7480c8980 msgr2=0x7fb7480c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7fb755600640 1 --2- 172.21.15.87:0/1557994246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7480c8980 0x7fb7480c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7fb755600640 1 -- 172.21.15.87:0/1557994246 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb74804b6b0 con 0x7fb748006ce0 2024-05-27T06:28:04.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.795+0000 7f828aa00640 1 -- 172.21.15.87:0/3217932412 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f828401a070 con 0x7f829406f500 2024-05-27T06:28:04.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.799+0000 7fb755600640 1 --2- 172.21.15.87:0/1557994246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb748006ce0 0x7fb74804c5d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb744000c10 tx=0x7fb74401ad00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:04.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.799+0000 7fb74d600640 1 -- 172.21.15.87:0/1557994246 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7440b0070 con 0x7fb748006ce0 2024-05-27T06:28:04.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.799+0000 7fb756a00640 1 -- 172.21.15.87:0/1557994246 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7480c78e0 con 0x7fb748006ce0 2024-05-27T06:28:04.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.799+0000 7fb756a00640 1 -- 172.21.15.87:0/1557994246 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7480c7ea0 con 0x7fb748006ce0 2024-05-27T06:28:04.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.799+0000 7f828aa00640 1 --2- 172.21.15.87:0/3217932412 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f827406f450 0x7f8274071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.799+0000 7fb74d600640 1 -- 172.21.15.87:0/1557994246 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7440bd070 con 0x7fb748006ce0 2024-05-27T06:28:04.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.799+0000 7fb74d600640 1 -- 172.21.15.87:0/1557994246 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7440b7860 con 0x7fb748006ce0 2024-05-27T06:28:04.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.799+0000 7f828aa00640 1 -- 172.21.15.87:0/3217932412 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f828408e800 con 0x7f829406f500 2024-05-27T06:28:04.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.799+0000 7f8291e00640 1 --2- 172.21.15.87:0/3217932412 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f827406f450 0x7f8274071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.799+0000 7fb3a1400640 1 --2- 172.21.15.87:0/1922540708 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3a40b06d0 0x7fb3a40b0ae0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb39000b670 tx=0x7fb39000bb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:04.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.799+0000 7fb39a000640 1 -- 172.21.15.87:0/1922540708 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb390018070 con 0x7fb3a40b06d0 2024-05-27T06:28:04.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.799+0000 7fb39a000640 1 -- 172.21.15.87:0/1922540708 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb390010830 con 0x7fb3a40b06d0 2024-05-27T06:28:04.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.799+0000 7fb39a000640 1 -- 172.21.15.87:0/1922540708 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb390010c00 con 0x7fb3a40b06d0 2024-05-27T06:28:04.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.799+0000 7fb3a3200640 1 -- 172.21.15.87:0/1922540708 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a40b1fa0 con 0x7fb3a40b06d0 2024-05-27T06:28:04.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.799+0000 7fb3a3200640 1 -- 172.21.15.87:0/1922540708 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a40b1700 con 0x7fb3a40b06d0 2024-05-27T06:28:04.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.799+0000 7f8291e00640 1 --2- 172.21.15.87:0/3217932412 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f827406f450 0x7f8274071960 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8280006fd0 tx=0x7f8280008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:04.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.803+0000 7fb756a00640 1 -- 172.21.15.87:0/1557994246 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb72c0052a0 con 0x7fb748006ce0 2024-05-27T06:28:04.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.803+0000 7fb74d600640 1 -- 172.21.15.87:0/1557994246 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb7440b7a00 con 0x7fb748006ce0 2024-05-27T06:28:04.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.803+0000 7fb74d600640 1 --2- 172.21.15.87:0/1557994246 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb73006f450 0x7fb730071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.803+0000 7fb74d600640 1 -- 172.21.15.87:0/1557994246 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb744129820 con 0x7fb748006ce0 2024-05-27T06:28:04.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.803+0000 7fb754c00640 1 --2- 172.21.15.87:0/1557994246 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb73006f450 0x7fb730071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.803+0000 7f828aa00640 1 -- 172.21.15.87:0/3217932412 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f828405add0 con 0x7f829406f500 2024-05-27T06:28:04.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.803+0000 7fb39a000640 1 -- 172.21.15.87:0/1922540708 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb39001b070 con 0x7fb3a40b06d0 2024-05-27T06:28:04.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.807+0000 7fb754c00640 1 --2- 172.21.15.87:0/1557994246 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb73006f450 0x7fb730071960 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb73c000f70 tx=0x7fb73c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:04.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.807+0000 7fb3a3200640 1 -- 172.21.15.87:0/1922540708 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3a40508e0 con 0x7fb3a40b06d0 2024-05-27T06:28:04.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.807+0000 7fb39a000640 1 --2- 172.21.15.87:0/1922540708 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb38406f500 0x7fb384071a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:04.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.807+0000 7fb39a000640 1 -- 172.21.15.87:0/1922540708 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb39008f7f0 con 0x7fb3a40b06d0 2024-05-27T06:28:04.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.807+0000 7fb3a1e00640 1 --2- 172.21.15.87:0/1922540708 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb38406f500 0x7fb384071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:04.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.807+0000 7fb74d600640 1 -- 172.21.15.87:0/1557994246 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb7440160b0 con 0x7fb748006ce0 2024-05-27T06:28:04.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.807+0000 7fb3a1e00640 1 --2- 172.21.15.87:0/1922540708 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb38406f500 0x7fb384071a10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb394003670 tx=0x7fb394009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:04.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.811+0000 7fb39a000640 1 -- 172.21.15.87:0/1922540708 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb3a41fe7a0 con 0x7fb3a40b06d0 2024-05-27T06:28:04.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.987+0000 7f501d600640 1 -- 172.21.15.87:0/926619054 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f502809dcc0 con 0x7f50280ae9b0 2024-05-27T06:28:04.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.987+0000 7f501fe00640 1 -- 172.21.15.87:0/926619054 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5018001090 con 0x7f50280ae9b0 2024-05-27T06:28:04.988 INFO:teuthology.orchestra.run.smithi087.stdout:55834574859 2024-05-27T06:28:04.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.991+0000 7f501d600640 1 -- 172.21.15.87:0/926619054 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f500806f430 msgr2=0x7f5008071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.991+0000 7f501d600640 1 --2- 172.21.15.87:0/926619054 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f500806f430 0x7f5008071940 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5020009fd0 tx=0x7f502000c040 comp rx=0 tx=0).stop 2024-05-27T06:28:04.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.991+0000 7f501d600640 1 -- 172.21.15.87:0/926619054 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50280ae9b0 msgr2=0x7f502809ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:04.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.991+0000 7f501d600640 1 --2- 172.21.15.87:0/926619054 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50280ae9b0 0x7f502809ed30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f501800c3f0 tx=0x7f501800c8b0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.991+0000 7f501d600640 1 -- 172.21.15.87:0/926619054 shutdown_connections 2024-05-27T06:28:04.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.991+0000 7f501d600640 1 --2- 172.21.15.87:0/926619054 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f500806f430 0x7f5008071940 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.991+0000 7f501d600640 1 --2- 172.21.15.87:0/926619054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50280ce210 0x7f50280d05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.991+0000 7f501d600640 1 --2- 172.21.15.87:0/926619054 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50280b31f0 0x7f50281ef6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.991+0000 7f501d600640 1 --2- 172.21.15.87:0/926619054 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50280ae9b0 0x7f502809ed30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:04.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.991+0000 7f501d600640 1 -- 172.21.15.87:0/926619054 >> 172.21.15.87:0/926619054 conn(0x7f50280729f0 msgr2=0x7f502815a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:04.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.995+0000 7f501d600640 1 -- 172.21.15.87:0/926619054 shutdown_connections 2024-05-27T06:28:04.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:04.995+0000 7f501d600640 1 -- 172.21.15.87:0/926619054 wait complete. 2024-05-27T06:28:05.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.5 2024-05-27T06:28:05.022 DEBUG:teuthology.parallel:result is None 2024-05-27T06:28:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.063+0000 7fea9ba00640 1 -- 172.21.15.87:0/3168168280 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fea9406aa30 con 0x7fea9415e6b0 2024-05-27T06:28:05.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.063+0000 7fea90c00640 1 -- 172.21.15.87:0/3168168280 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fea8c010070 con 0x7fea9415e6b0 2024-05-27T06:28:05.062 INFO:teuthology.orchestra.run.smithi087.stdout:55834574859 2024-05-27T06:28:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.067+0000 7fea9ba00640 1 -- 172.21.15.87:0/3168168280 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fea7406f430 msgr2=0x7fea74071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.067+0000 7fea9ba00640 1 --2- 172.21.15.87:0/3168168280 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fea7406f430 0x7fea74071940 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fea880ae000 tx=0x7fea880a7000 comp rx=0 tx=0).stop 2024-05-27T06:28:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.067+0000 7fea9ba00640 1 -- 172.21.15.87:0/3168168280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea9415e6b0 msgr2=0x7fea9409a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.067+0000 7fea9ba00640 1 --2- 172.21.15.87:0/3168168280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea9415e6b0 0x7fea9409a7f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fea8c007d10 tx=0x7fea8c00d4a0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.067+0000 7fea9ba00640 1 -- 172.21.15.87:0/3168168280 shutdown_connections 2024-05-27T06:28:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.067+0000 7fea9ba00640 1 --2- 172.21.15.87:0/3168168280 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fea7406f430 0x7fea74071940 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.067+0000 7fea9ba00640 1 --2- 172.21.15.87:0/3168168280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea9415e6b0 0x7fea9409a7f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.067+0000 7fea9ba00640 1 --2- 172.21.15.87:0/3168168280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea9415ded0 0x7fea9409a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.067+0000 7fea9ba00640 1 --2- 172.21.15.87:0/3168168280 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea9406c720 0x7fea9409e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.067+0000 7fea9ba00640 1 -- 172.21.15.87:0/3168168280 >> 172.21.15.87:0/3168168280 conn(0x7fea94072ca0 msgr2=0x7fea94150470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.067+0000 7fea9ba00640 1 -- 172.21.15.87:0/3168168280 shutdown_connections 2024-05-27T06:28:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.067+0000 7fea9ba00640 1 -- 172.21.15.87:0/3168168280 wait complete. 2024-05-27T06:28:05.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.071+0000 7f1005c00640 1 -- 172.21.15.87:0/2723717684 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0fdc005860 con 0x7f0ff8057620 2024-05-27T06:28:05.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.071+0000 7f0fefe00640 1 -- 172.21.15.87:0/2723717684 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0ff405c650 con 0x7f0ff8057620 2024-05-27T06:28:05.069 INFO:teuthology.orchestra.run.smithi087.stdout:55834574859 2024-05-27T06:28:05.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.075+0000 7f1005c00640 1 -- 172.21.15.87:0/2723717684 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0fe406f4d0 msgr2=0x7f0fe40719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.075+0000 7f1005c00640 1 --2- 172.21.15.87:0/2723717684 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0fe406f4d0 0x7f0fe40719e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00099b0 tx=0x7f0ff0009190 comp rx=0 tx=0).stop 2024-05-27T06:28:05.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.075+0000 7f1005c00640 1 -- 172.21.15.87:0/2723717684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ff8057620 msgr2=0x7f0ff80ca130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.075+0000 7f1005c00640 1 --2- 172.21.15.87:0/2723717684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ff8057620 0x7f0ff80ca130 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400c760 tx=0x7f0ff400cc20 comp rx=0 tx=0).stop 2024-05-27T06:28:05.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.075+0000 7f1005c00640 1 -- 172.21.15.87:0/2723717684 shutdown_connections 2024-05-27T06:28:05.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.075+0000 7f1005c00640 1 --2- 172.21.15.87:0/2723717684 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0fe406f4d0 0x7f0fe40719e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.075+0000 7f1005c00640 1 --2- 172.21.15.87:0/2723717684 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ff80582e0 0x7f0ff80d8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.075+0000 7f1005c00640 1 --2- 172.21.15.87:0/2723717684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ff8057620 0x7f0ff80ca130 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.075+0000 7f1005c00640 1 --2- 172.21.15.87:0/2723717684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ff803e430 0x7f0ff8052d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.075+0000 7f1005c00640 1 -- 172.21.15.87:0/2723717684 >> 172.21.15.87:0/2723717684 conn(0x7f0ff803ac60 msgr2=0x7f0ff80e43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:05.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.075+0000 7f1005c00640 1 -- 172.21.15.87:0/2723717684 shutdown_connections 2024-05-27T06:28:05.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.075+0000 7f1005c00640 1 -- 172.21.15.87:0/2723717684 wait complete. 2024-05-27T06:28:05.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.075+0000 7f58b9000640 1 -- 172.21.15.87:0/4203988752 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f588c005860 con 0x7f58b4164060 2024-05-27T06:28:05.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.079+0000 7f58ab400640 1 -- 172.21.15.87:0/4203988752 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f58a4060c40 con 0x7f58b4164060 2024-05-27T06:28:05.074 INFO:teuthology.orchestra.run.smithi087.stdout:55834574859 2024-05-27T06:28:05.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.079+0000 7f58b9000640 1 -- 172.21.15.87:0/4203988752 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f589406f400 msgr2=0x7f5894071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.079+0000 7f58b9000640 1 --2- 172.21.15.87:0/4203988752 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f589406f400 0x7f5894071910 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f58b406ca50 tx=0x7f58a0008040 comp rx=0 tx=0).stop 2024-05-27T06:28:05.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.079+0000 7f58b9000640 1 -- 172.21.15.87:0/4203988752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58b4164060 msgr2=0x7f58b409a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.079+0000 7f58b9000640 1 --2- 172.21.15.87:0/4203988752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58b4164060 0x7f58b409a250 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f58a400d620 tx=0x7f58a400dae0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.083+0000 7f58b9000640 1 -- 172.21.15.87:0/4203988752 shutdown_connections 2024-05-27T06:28:05.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.083+0000 7f58b9000640 1 --2- 172.21.15.87:0/4203988752 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f589406f400 0x7f5894071910 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.083+0000 7f58b9000640 1 --2- 172.21.15.87:0/4203988752 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58b40b7510 0x7f58b41659c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.083+0000 7f58b9000640 1 --2- 172.21.15.87:0/4203988752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58b4164060 0x7f58b409a250 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.083+0000 7f58b9000640 1 --2- 172.21.15.87:0/4203988752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58b406ea20 0x7f58b415fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.083+0000 7f58b9000640 1 -- 172.21.15.87:0/4203988752 >> 172.21.15.87:0/4203988752 conn(0x7f58b40d1370 msgr2=0x7f58b40af920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:05.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.083+0000 7f58b9000640 1 -- 172.21.15.87:0/4203988752 shutdown_connections 2024-05-27T06:28:05.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.083+0000 7f58b9000640 1 -- 172.21.15.87:0/4203988752 wait complete. 2024-05-27T06:28:05.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.095+0000 7f8299400640 1 -- 172.21.15.87:0/3217932412 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f826c005590 con 0x7f829406f500 2024-05-27T06:28:05.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.095+0000 7f828aa00640 1 -- 172.21.15.87:0/3217932412 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f828405f0d0 con 0x7f829406f500 2024-05-27T06:28:05.092 INFO:teuthology.orchestra.run.smithi087.stdout:55834574859 2024-05-27T06:28:05.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.1 2024-05-27T06:28:05.094 DEBUG:teuthology.parallel:result is None 2024-05-27T06:28:05.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.099+0000 7f8299400640 1 -- 172.21.15.87:0/3217932412 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f827406f450 msgr2=0x7f8274071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.099+0000 7f8299400640 1 --2- 172.21.15.87:0/3217932412 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f827406f450 0x7f8274071960 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8280006fd0 tx=0x7f8280008040 comp rx=0 tx=0).stop 2024-05-27T06:28:05.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.099+0000 7f8299400640 1 -- 172.21.15.87:0/3217932412 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f829406f500 msgr2=0x7f8294163c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.099+0000 7f8299400640 1 --2- 172.21.15.87:0/3217932412 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f829406f500 0x7f8294163c40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f828400c490 tx=0x7f828400c950 comp rx=0 tx=0).stop 2024-05-27T06:28:05.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.099+0000 7f8299400640 1 -- 172.21.15.87:0/3217932412 shutdown_connections 2024-05-27T06:28:05.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.099+0000 7f8299400640 1 --2- 172.21.15.87:0/3217932412 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f827406f450 0x7f8274071960 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.099+0000 7f8299400640 1 --2- 172.21.15.87:0/3217932412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f829415cb60 0x7f82941672d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.099+0000 7f8299400640 1 --2- 172.21.15.87:0/3217932412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82940cde70 0x7f829415c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.099+0000 7f8299400640 1 --2- 172.21.15.87:0/3217932412 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f829406f500 0x7f8294163c40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.099+0000 7f8299400640 1 -- 172.21.15.87:0/3217932412 >> 172.21.15.87:0/3217932412 conn(0x7f82940cffa0 msgr2=0x7f8294164d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:05.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.099+0000 7f8299400640 1 -- 172.21.15.87:0/3217932412 shutdown_connections 2024-05-27T06:28:05.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.099+0000 7f8299400640 1 -- 172.21.15.87:0/3217932412 wait complete. 2024-05-27T06:28:05.105 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.0 2024-05-27T06:28:05.105 DEBUG:teuthology.parallel:result is None 2024-05-27T06:28:05.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.6 2024-05-27T06:28:05.115 DEBUG:teuthology.parallel:result is None 2024-05-27T06:28:05.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.4 2024-05-27T06:28:05.117 DEBUG:teuthology.parallel:result is None 2024-05-27T06:28:05.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.127+0000 7fcecfe00640 1 -- 172.21.15.87:0/1438649721 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fceb8005860 con 0x7fcee40d0eb0 2024-05-27T06:28:05.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.127+0000 7fcedaa00640 1 -- 172.21.15.87:0/1438649721 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcedc0f7420 con 0x7fcee40d0eb0 2024-05-27T06:28:05.124 INFO:teuthology.orchestra.run.smithi087.stdout:55834574860 2024-05-27T06:28:05.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.131+0000 7fcecfe00640 1 -- 172.21.15.87:0/1438649721 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fcec406f430 msgr2=0x7fcec4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.131+0000 7fcecfe00640 1 --2- 172.21.15.87:0/1438649721 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fcec406f430 0x7fcec4071940 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fced4009850 tx=0x7fced4008040 comp rx=0 tx=0).stop 2024-05-27T06:28:05.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.131+0000 7fcecfe00640 1 -- 172.21.15.87:0/1438649721 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcee40d0eb0 msgr2=0x7fcee40b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.131+0000 7fcecfe00640 1 --2- 172.21.15.87:0/1438649721 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcee40d0eb0 0x7fcee40b3490 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcedc000f90 tx=0x7fcedc019cc0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.131+0000 7fcecfe00640 1 -- 172.21.15.87:0/1438649721 shutdown_connections 2024-05-27T06:28:05.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.131+0000 7fcecfe00640 1 --2- 172.21.15.87:0/1438649721 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fcec406f430 0x7fcec4071940 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.131+0000 7fcecfe00640 1 --2- 172.21.15.87:0/1438649721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcee409eb10 0x7fcee40ae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.131+0000 7fcecfe00640 1 --2- 172.21.15.87:0/1438649721 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcee40d0eb0 0x7fcee40b3490 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.131+0000 7fcecfe00640 1 --2- 172.21.15.87:0/1438649721 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcee40cdbf0 0x7fcee4147810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.131+0000 7fcecfe00640 1 -- 172.21.15.87:0/1438649721 >> 172.21.15.87:0/1438649721 conn(0x7fcee40b42c0 msgr2=0x7fcee40af6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:05.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.131+0000 7fcecfe00640 1 -- 172.21.15.87:0/1438649721 shutdown_connections 2024-05-27T06:28:05.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.131+0000 7fcecfe00640 1 -- 172.21.15.87:0/1438649721 wait complete. 2024-05-27T06:28:05.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.143+0000 7fb756a00640 1 -- 172.21.15.87:0/1557994246 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb72c005590 con 0x7fb748006ce0 2024-05-27T06:28:05.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.143+0000 7fb74d600640 1 -- 172.21.15.87:0/1557994246 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb7440f5f40 con 0x7fb748006ce0 2024-05-27T06:28:05.140 INFO:teuthology.orchestra.run.smithi087.stdout:55834574858 2024-05-27T06:28:05.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.147+0000 7fb756a00640 1 -- 172.21.15.87:0/1557994246 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb73006f450 msgr2=0x7fb730071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.147+0000 7fb756a00640 1 --2- 172.21.15.87:0/1557994246 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb73006f450 0x7fb730071960 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb73c000f70 tx=0x7fb73c009040 comp rx=0 tx=0).stop 2024-05-27T06:28:05.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.147+0000 7fb756a00640 1 -- 172.21.15.87:0/1557994246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb748006ce0 msgr2=0x7fb74804c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.147+0000 7fb756a00640 1 --2- 172.21.15.87:0/1557994246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb748006ce0 0x7fb74804c5d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb744000c10 tx=0x7fb74401ad00 comp rx=0 tx=0).stop 2024-05-27T06:28:05.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.147+0000 7fb756a00640 1 -- 172.21.15.87:0/1557994246 shutdown_connections 2024-05-27T06:28:05.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.147+0000 7fb756a00640 1 --2- 172.21.15.87:0/1557994246 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb73006f450 0x7fb730071960 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.147+0000 7fb756a00640 1 --2- 172.21.15.87:0/1557994246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7480c8980 0x7fb7480c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.147+0000 7fb756a00640 1 --2- 172.21.15.87:0/1557994246 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7480e41e0 0x7fb74804b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.147+0000 7fb756a00640 1 --2- 172.21.15.87:0/1557994246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb748006ce0 0x7fb74804c5d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.147+0000 7fb756a00640 1 -- 172.21.15.87:0/1557994246 >> 172.21.15.87:0/1557994246 conn(0x7fb74800aa80 msgr2=0x7fb7480e9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:05.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.147+0000 7fb756a00640 1 -- 172.21.15.87:0/1557994246 shutdown_connections 2024-05-27T06:28:05.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.147+0000 7fb756a00640 1 -- 172.21.15.87:0/1557994246 wait complete. 2024-05-27T06:28:05.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.3 2024-05-27T06:28:05.147 DEBUG:teuthology.parallel:result is None 2024-05-27T06:28:05.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.151+0000 7fb3a3200640 1 -- 172.21.15.87:0/1922540708 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fb3a4074160 con 0x7fb3a40b06d0 2024-05-27T06:28:05.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.151+0000 7fb39a000640 1 -- 172.21.15.87:0/1922540708 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb39005c410 con 0x7fb3a40b06d0 2024-05-27T06:28:05.148 INFO:teuthology.orchestra.run.smithi087.stdout:55834574859 2024-05-27T06:28:05.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.155+0000 7fb3a3200640 1 -- 172.21.15.87:0/1922540708 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb38406f500 msgr2=0x7fb384071a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.155+0000 7fb3a3200640 1 --2- 172.21.15.87:0/1922540708 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb38406f500 0x7fb384071a10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb394003670 tx=0x7fb394009040 comp rx=0 tx=0).stop 2024-05-27T06:28:05.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.155+0000 7fb3a3200640 1 -- 172.21.15.87:0/1922540708 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3a40b06d0 msgr2=0x7fb3a40b0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.155+0000 7fb3a3200640 1 --2- 172.21.15.87:0/1922540708 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3a40b06d0 0x7fb3a40b0ae0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb39000b670 tx=0x7fb39000bb30 comp rx=0 tx=0).stop 2024-05-27T06:28:05.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.155+0000 7fb3a3200640 1 -- 172.21.15.87:0/1922540708 shutdown_connections 2024-05-27T06:28:05.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.155+0000 7fb3a3200640 1 --2- 172.21.15.87:0/1922540708 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb38406f500 0x7fb384071a10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.155+0000 7fb3a3200640 1 --2- 172.21.15.87:0/1922540708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3a41fde50 0x7fb3a41fe260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.155+0000 7fb3a3200640 1 --2- 172.21.15.87:0/1922540708 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3a40b06d0 0x7fb3a40b0ae0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.155+0000 7fb3a3200640 1 --2- 172.21.15.87:0/1922540708 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb388007370 0x7fb3a409dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.155+0000 7fb3a3200640 1 -- 172.21.15.87:0/1922540708 >> 172.21.15.87:0/1922540708 conn(0x7fb3a40d1370 msgr2=0x7fb3a415b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:05.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.155+0000 7fb3a3200640 1 -- 172.21.15.87:0/1922540708 shutdown_connections 2024-05-27T06:28:05.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.155+0000 7fb3a3200640 1 -- 172.21.15.87:0/1922540708 wait complete. 2024-05-27T06:28:05.166 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2024-05-27T06:28:05.166 DEBUG:teuthology.parallel:result is None 2024-05-27T06:28:05.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.7 2024-05-27T06:28:05.171 DEBUG:teuthology.parallel:result is None 2024-05-27T06:28:05.171 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-27T06:28:05.171 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T06:28:05.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.367+0000 7f9e98600640 1 Processor -- start 2024-05-27T06:28:05.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.367+0000 7f9e98600640 1 -- start start 2024-05-27T06:28:05.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.367+0000 7f9e98600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9e90168f90 0x7f9e9016b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:05.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.367+0000 7f9e98600640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e900ce7a0 con 0x7f9e901605d0 2024-05-27T06:28:05.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.367+0000 7f9e98600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e900cea80 con 0x7f9e9006e8b0 2024-05-27T06:28:05.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.367+0000 7f9e98600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f9e900ced60 con 0x7f9e90168f90 2024-05-27T06:28:05.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.367+0000 7f9e95c00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f9e901605d0 0x7f9e901609e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:53770/0 (socket says 172.21.15.87:53770) 2024-05-27T06:28:05.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.367+0000 7f9e95c00640 1 -- 172.21.15.87:0/2096809540 learned_addr learned my addr 172.21.15.87:0/2096809540 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:05.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.367+0000 7f9e96600640 1 --2- 172.21.15.87:0/2096809540 >> v2:172.21.15.149:3300/0 conn(0x7f9e90168f90 0x7f9e9016b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:05.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.371+0000 7f9e8fe00640 1 -- 172.21.15.87:0/2096809540 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1092444947 0 0) 0x7f9e900ce7a0 con 0x7f9e901605d0 2024-05-27T06:28:05.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.371+0000 7f9e8fe00640 1 -- 172.21.15.87:0/2096809540 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e78003530 con 0x7f9e901605d0 2024-05-27T06:28:05.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.371+0000 7f9e96600640 1 -- 172.21.15.87:0/2096809540 >> v1:172.21.15.149:6789/0 conn(0x7f9e9006e8b0 legacy=0x7f9e9006ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.371+0000 7f9e8fe00640 1 -- 172.21.15.87:0/2096809540 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2270434501 0 0) 0x7f9e900cea80 con 0x7f9e9006e8b0 2024-05-27T06:28:05.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.371+0000 7f9e96600640 1 -- 172.21.15.87:0/2096809540 >> v1:172.21.15.87:6789/0 conn(0x7f9e901605d0 legacy=0x7f9e901609e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.371+0000 7f9e96600640 1 -- 172.21.15.87:0/2096809540 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e900cf040 con 0x7f9e90168f90 2024-05-27T06:28:05.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.371+0000 7f9e96600640 1 --2- 172.21.15.87:0/2096809540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e90168f90 0x7f9e9016b3b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9e88009d90 tx=0x7f9e8801d3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f4f3524d5180fef server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:05.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.371+0000 7f9e8fe00640 1 -- 172.21.15.87:0/2096809540 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e880b2070 con 0x7f9e90168f90 2024-05-27T06:28:05.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.371+0000 7f9e8fe00640 1 -- 172.21.15.87:0/2096809540 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e880a5940 con 0x7f9e90168f90 2024-05-27T06:28:05.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.371+0000 7f9e8fe00640 1 -- 172.21.15.87:0/2096809540 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e880a5cf0 con 0x7f9e90168f90 2024-05-27T06:28:05.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.375+0000 7f9e98600640 1 -- 172.21.15.87:0/2096809540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e90168f90 msgr2=0x7f9e9016b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.375+0000 7f9e98600640 1 --2- 172.21.15.87:0/2096809540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e90168f90 0x7f9e9016b3b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9e88009d90 tx=0x7f9e8801d3d0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.375+0000 7f9e98600640 1 -- 172.21.15.87:0/2096809540 shutdown_connections 2024-05-27T06:28:05.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.375+0000 7f9e98600640 1 --2- 172.21.15.87:0/2096809540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e90168f90 0x7f9e9016b3b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.375+0000 7f9e98600640 1 -- 172.21.15.87:0/2096809540 >> 172.21.15.87:0/2096809540 conn(0x7f9e900d3590 msgr2=0x7f9e900d39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:05.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.375+0000 7f9e98600640 1 -- 172.21.15.87:0/2096809540 shutdown_connections 2024-05-27T06:28:05.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.375+0000 7f9e98600640 1 -- 172.21.15.87:0/2096809540 wait complete. 2024-05-27T06:28:05.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.375+0000 7f9e98600640 1 Processor -- start 2024-05-27T06:28:05.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.375+0000 7f9e98600640 1 -- start start 2024-05-27T06:28:05.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.379+0000 7f9e98600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e9006e8b0 0x7f9e90156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:05.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.379+0000 7f9e98600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e901605d0 0x7f9e901f9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:05.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.379+0000 7f9e98600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e90168f90 0x7f9e9015f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:05.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.379+0000 7f9e98600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9016e6a0 con 0x7f9e901605d0 2024-05-27T06:28:05.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.379+0000 7f9e98600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9016e520 con 0x7f9e90168f90 2024-05-27T06:28:05.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.379+0000 7f9e98600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9e9016e820 con 0x7f9e9006e8b0 2024-05-27T06:28:05.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.379+0000 7f9e95200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e901605d0 0x7f9e901f9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:05.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.379+0000 7f9e95200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e901605d0 0x7f9e901f9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55354/0 (socket says 172.21.15.87:55354) 2024-05-27T06:28:05.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.379+0000 7f9e95200640 1 -- 172.21.15.87:0/494888090 learned_addr learned my addr 172.21.15.87:0/494888090 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:05.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.379+0000 7f9e95c00640 1 --2- 172.21.15.87:0/494888090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e9006e8b0 0x7f9e90156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:05.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.379+0000 7f9e96600640 1 --2- 172.21.15.87:0/494888090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e90168f90 0x7f9e9015f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:05.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.379+0000 7f9e95200640 1 -- 172.21.15.87:0/494888090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e9006e8b0 msgr2=0x7f9e90156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.379+0000 7f9e95200640 1 --2- 172.21.15.87:0/494888090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e9006e8b0 0x7f9e90156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.379+0000 7f9e95200640 1 -- 172.21.15.87:0/494888090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e90168f90 msgr2=0x7f9e9015f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.379+0000 7f9e95200640 1 --2- 172.21.15.87:0/494888090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e90168f90 0x7f9e9015f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.379+0000 7f9e95200640 1 -- 172.21.15.87:0/494888090 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e900b2d30 con 0x7f9e901605d0 2024-05-27T06:28:05.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.379+0000 7f9e95200640 1 --2- 172.21.15.87:0/494888090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e901605d0 0x7f9e901f9e60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00c3a0 tx=0x7f9e7c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:05.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.379+0000 7f9e8d600640 1 -- 172.21.15.87:0/494888090 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c017070 con 0x7f9e901605d0 2024-05-27T06:28:05.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.379+0000 7f9e8d600640 1 -- 172.21.15.87:0/494888090 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e7c003600 con 0x7f9e901605d0 2024-05-27T06:28:05.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.379+0000 7f9e98600640 1 -- 172.21.15.87:0/494888090 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e900b8ac0 con 0x7f9e901605d0 2024-05-27T06:28:05.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.379+0000 7f9e8d600640 1 -- 172.21.15.87:0/494888090 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c0039f0 con 0x7f9e901605d0 2024-05-27T06:28:05.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.379+0000 7f9e98600640 1 -- 172.21.15.87:0/494888090 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e9015eba0 con 0x7f9e901605d0 2024-05-27T06:28:05.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.379+0000 7f9e98600640 1 -- 172.21.15.87:0/494888090 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e9006aa30 con 0x7f9e901605d0 2024-05-27T06:28:05.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.379+0000 7f9e8d600640 1 -- 172.21.15.87:0/494888090 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9e7c01a070 con 0x7f9e901605d0 2024-05-27T06:28:05.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.383+0000 7f9e8d600640 1 --2- 172.21.15.87:0/494888090 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9e7006f400 0x7f9e70071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:05.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.383+0000 7f9e8d600640 1 -- 172.21.15.87:0/494888090 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9e7c08e860 con 0x7f9e901605d0 2024-05-27T06:28:05.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.383+0000 7f9e95c00640 1 --2- 172.21.15.87:0/494888090 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9e7006f400 0x7f9e70071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:05.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.383+0000 7f9e95c00640 1 --2- 172.21.15.87:0/494888090 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9e7006f400 0x7f9e70071910 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9e84007a70 tx=0x7f9e840079c0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:05.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.387+0000 7f9e8d600640 1 -- 172.21.15.87:0/494888090 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f9e7c05ae40 con 0x7f9e901605d0 2024-05-27T06:28:05.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.539+0000 7f9e98600640 1 -- 172.21.15.87:0/494888090 --> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9e9015cd70 con 0x7f9e7006f400 2024-05-27T06:28:05.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.547+0000 7f9e8d600640 1 -- 172.21.15.87:0/494888090 <== mgr.4111 v2:172.21.15.87:6832/2724754260 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332520 (secure 0 0 0) 0x7f9e84001460 con 0x7f9e7006f400 2024-05-27T06:28:05.549 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:05.550 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-27T06:28:05.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.551+0000 7f9e98600640 1 -- 172.21.15.87:0/494888090 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9e7006f400 msgr2=0x7f9e70071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.551+0000 7f9e98600640 1 --2- 172.21.15.87:0/494888090 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9e7006f400 0x7f9e70071910 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9e84007a70 tx=0x7f9e840079c0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.551+0000 7f9e98600640 1 -- 172.21.15.87:0/494888090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e901605d0 msgr2=0x7f9e901f9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.551+0000 7f9e98600640 1 --2- 172.21.15.87:0/494888090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e901605d0 0x7f9e901f9e60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00c3a0 tx=0x7f9e7c00c860 comp rx=0 tx=0).stop 2024-05-27T06:28:05.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.555+0000 7f9e98600640 1 -- 172.21.15.87:0/494888090 shutdown_connections 2024-05-27T06:28:05.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.555+0000 7f9e98600640 1 --2- 172.21.15.87:0/494888090 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9e7006f400 0x7f9e70071910 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.555+0000 7f9e98600640 1 --2- 172.21.15.87:0/494888090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e90168f90 0x7f9e9015f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.555+0000 7f9e98600640 1 --2- 172.21.15.87:0/494888090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e901605d0 0x7f9e901f9e60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.555+0000 7f9e98600640 1 --2- 172.21.15.87:0/494888090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e9006e8b0 0x7f9e90156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.555+0000 7f9e98600640 1 -- 172.21.15.87:0/494888090 >> 172.21.15.87:0/494888090 conn(0x7f9e900d3590 msgr2=0x7f9e901609e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:05.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.555+0000 7f9e98600640 1 -- 172.21.15.87:0/494888090 shutdown_connections 2024-05-27T06:28:05.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.555+0000 7f9e98600640 1 -- 172.21.15.87:0/494888090 wait complete. 2024-05-27T06:28:05.569 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-05-27T06:28:04.572352+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219372,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755348,"statfs":{"total":773094113280,"available":772869476352,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006833"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.699021+0000","last_change":"2024-05-27T06:27:37.599201+0000","last_active":"2024-05-27T06:27:44.699021+0000","last_peered":"2024-05-27T06:27:44.699021+0000","last_clean":"2024-05-27T06:27:44.699021+0000","last_became_active":"2024-05-27T06:27:37.598882+0000","last_became_peered":"2024-05-27T06:27:37.598882+0000","last_unstale":"2024-05-27T06:27:44.699021+0000","last_undegraded":"2024-05-27T06:27:44.699021+0000","last_fullsized":"2024-05-27T06:27:44.699021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:13:32.135455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.137061+0000","last_change":"2024-05-27T06:27:38.587525+0000","last_active":"2024-05-27T06:27:45.137061+0000","last_peered":"2024-05-27T06:27:45.137061+0000","last_clean":"2024-05-27T06:27:45.137061+0000","last_became_active":"2024-05-27T06:27:38.586949+0000","last_became_peered":"2024-05-27T06:27:38.586949+0000","last_unstale":"2024-05-27T06:27:45.137061+0000","last_undegraded":"2024-05-27T06:27:45.137061+0000","last_fullsized":"2024-05-27T06:27:45.137061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:24:46.797590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136334+0000","last_change":"2024-05-27T06:27:42.674258+0000","last_active":"2024-05-27T06:27:45.136334+0000","last_peered":"2024-05-27T06:27:45.136334+0000","last_clean":"2024-05-27T06:27:45.136334+0000","last_became_active":"2024-05-27T06:27:42.673626+0000","last_became_peered":"2024-05-27T06:27:42.673626+0000","last_unstale":"2024-05-27T06:27:45.136334+0000","last_undegraded":"2024-05-27T06:27:45.136334+0000","last_fullsized":"2024-05-27T06:27:45.136334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:29:26.664564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.137215+0000","last_change":"2024-05-27T06:27:37.598836+0000","last_active":"2024-05-27T06:27:45.137215+0000","last_peered":"2024-05-27T06:27:45.137215+0000","last_clean":"2024-05-27T06:27:45.137215+0000","last_became_active":"2024-05-27T06:27:37.598483+0000","last_became_peered":"2024-05-27T06:27:37.598483+0000","last_unstale":"2024-05-27T06:27:45.137215+0000","last_undegraded":"2024-05-27T06:27:45.137215+0000","last_fullsized":"2024-05-27T06:27:45.137215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:06:32.803214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698842+0000","last_change":"2024-05-27T06:27:38.590652+0000","last_active":"2024-05-27T06:27:44.698842+0000","last_peered":"2024-05-27T06:27:44.698842+0000","last_clean":"2024-05-27T06:27:44.698842+0000","last_became_active":"2024-05-27T06:27:38.590399+0000","last_became_peered":"2024-05-27T06:27:38.590399+0000","last_unstale":"2024-05-27T06:27:44.698842+0000","last_undegraded":"2024-05-27T06:27:44.698842+0000","last_fullsized":"2024-05-27T06:27:44.698842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:11:57.311912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641217+0000","last_change":"2024-05-27T06:27:42.678002+0000","last_active":"2024-05-27T06:27:43.641217+0000","last_peered":"2024-05-27T06:27:43.641217+0000","last_clean":"2024-05-27T06:27:43.641217+0000","last_became_active":"2024-05-27T06:27:42.672687+0000","last_became_peered":"2024-05-27T06:27:42.672687+0000","last_unstale":"2024-05-27T06:27:43.641217+0000","last_undegraded":"2024-05-27T06:27:43.641217+0000","last_fullsized":"2024-05-27T06:27:43.641217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:24:50.868712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560389+0000","last_change":"2024-05-27T06:27:37.593814+0000","last_active":"2024-05-27T06:27:45.560389+0000","last_peered":"2024-05-27T06:27:45.560389+0000","last_clean":"2024-05-27T06:27:45.560389+0000","last_became_active":"2024-05-27T06:27:37.593466+0000","last_became_peered":"2024-05-27T06:27:37.593466+0000","last_unstale":"2024-05-27T06:27:45.560389+0000","last_undegraded":"2024-05-27T06:27:45.560389+0000","last_fullsized":"2024-05-27T06:27:45.560389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:26:32.568342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562028+0000","last_change":"2024-05-27T06:27:38.601653+0000","last_active":"2024-05-27T06:27:45.562028+0000","last_peered":"2024-05-27T06:27:45.562028+0000","last_clean":"2024-05-27T06:27:45.562028+0000","last_became_active":"2024-05-27T06:27:38.601248+0000","last_became_peered":"2024-05-27T06:27:38.601248+0000","last_unstale":"2024-05-27T06:27:45.562028+0000","last_undegraded":"2024-05-27T06:27:45.562028+0000","last_fullsized":"2024-05-27T06:27:45.562028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:53.536742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641377+0000","last_change":"2024-05-27T06:27:42.676302+0000","last_active":"2024-05-27T06:27:43.641377+0000","last_peered":"2024-05-27T06:27:43.641377+0000","last_clean":"2024-05-27T06:27:43.641377+0000","last_became_active":"2024-05-27T06:27:42.673036+0000","last_became_peered":"2024-05-27T06:27:42.673036+0000","last_unstale":"2024-05-27T06:27:43.641377+0000","last_undegraded":"2024-05-27T06:27:43.641377+0000","last_fullsized":"2024-05-27T06:27:43.641377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:25:34.504656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560872+0000","last_change":"2024-05-27T06:27:37.599394+0000","last_active":"2024-05-27T06:27:45.560872+0000","last_peered":"2024-05-27T06:27:45.560872+0000","last_clean":"2024-05-27T06:27:45.560872+0000","last_became_active":"2024-05-27T06:27:37.598995+0000","last_became_peered":"2024-05-27T06:27:37.598995+0000","last_unstale":"2024-05-27T06:27:45.560872+0000","last_undegraded":"2024-05-27T06:27:45.560872+0000","last_fullsized":"2024-05-27T06:27:45.560872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:05:47.256329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562108+0000","last_change":"2024-05-27T06:27:38.595082+0000","last_active":"2024-05-27T06:27:45.562108+0000","last_peered":"2024-05-27T06:27:45.562108+0000","last_clean":"2024-05-27T06:27:45.562108+0000","last_became_active":"2024-05-27T06:27:38.594761+0000","last_became_peered":"2024-05-27T06:27:38.594761+0000","last_unstale":"2024-05-27T06:27:45.562108+0000","last_undegraded":"2024-05-27T06:27:45.562108+0000","last_fullsized":"2024-05-27T06:27:45.562108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:35.349266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641123+0000","last_change":"2024-05-27T06:27:42.657602+0000","last_active":"2024-05-27T06:27:43.641123+0000","last_peered":"2024-05-27T06:27:43.641123+0000","last_clean":"2024-05-27T06:27:43.641123+0000","last_became_active":"2024-05-27T06:27:42.657080+0000","last_became_peered":"2024-05-27T06:27:42.657080+0000","last_unstale":"2024-05-27T06:27:43.641123+0000","last_undegraded":"2024-05-27T06:27:43.641123+0000","last_fullsized":"2024-05-27T06:27:43.641123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:25:32.361553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561325+0000","last_change":"2024-05-27T06:27:38.588664+0000","last_active":"2024-05-27T06:27:45.561325+0000","last_peered":"2024-05-27T06:27:45.561325+0000","last_clean":"2024-05-27T06:27:45.561325+0000","last_became_active":"2024-05-27T06:27:38.588190+0000","last_became_peered":"2024-05-27T06:27:38.588190+0000","last_unstale":"2024-05-27T06:27:45.561325+0000","last_undegraded":"2024-05-27T06:27:45.561325+0000","last_fullsized":"2024-05-27T06:27:45.561325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:36:07.073192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561221+0000","last_change":"2024-05-27T06:27:37.593763+0000","last_active":"2024-05-27T06:27:45.561221+0000","last_peered":"2024-05-27T06:27:45.561221+0000","last_clean":"2024-05-27T06:27:45.561221+0000","last_became_active":"2024-05-27T06:27:37.593401+0000","last_became_peered":"2024-05-27T06:27:37.593401+0000","last_unstale":"2024-05-27T06:27:45.561221+0000","last_undegraded":"2024-05-27T06:27:45.561221+0000","last_fullsized":"2024-05-27T06:27:45.561221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:10.389223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.642016+0000","last_change":"2024-05-27T06:27:42.673785+0000","last_active":"2024-05-27T06:27:43.642016+0000","last_peered":"2024-05-27T06:27:43.642016+0000","last_clean":"2024-05-27T06:27:43.642016+0000","last_became_active":"2024-05-27T06:27:42.673292+0000","last_became_peered":"2024-05-27T06:27:42.673292+0000","last_unstale":"2024-05-27T06:27:43.642016+0000","last_undegraded":"2024-05-27T06:27:43.642016+0000","last_fullsized":"2024-05-27T06:27:43.642016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:30.051452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136563+0000","last_change":"2024-05-27T06:27:38.618042+0000","last_active":"2024-05-27T06:27:45.136563+0000","last_peered":"2024-05-27T06:27:45.136563+0000","last_clean":"2024-05-27T06:27:45.136563+0000","last_became_active":"2024-05-27T06:27:38.617706+0000","last_became_peered":"2024-05-27T06:27:38.617706+0000","last_unstale":"2024-05-27T06:27:45.136563+0000","last_undegraded":"2024-05-27T06:27:45.136563+0000","last_fullsized":"2024-05-27T06:27:45.136563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:25:28.290431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995400+0000","last_change":"2024-05-27T06:27:37.597113+0000","last_active":"2024-05-27T06:27:44.995400+0000","last_peered":"2024-05-27T06:27:44.995400+0000","last_clean":"2024-05-27T06:27:44.995400+0000","last_became_active":"2024-05-27T06:27:37.596735+0000","last_became_peered":"2024-05-27T06:27:37.596735+0000","last_unstale":"2024-05-27T06:27:44.995400+0000","last_undegraded":"2024-05-27T06:27:44.995400+0000","last_fullsized":"2024-05-27T06:27:44.995400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:39:09.133451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641559+0000","last_change":"2024-05-27T06:27:42.685192+0000","last_active":"2024-05-27T06:27:43.641559+0000","last_peered":"2024-05-27T06:27:43.641559+0000","last_clean":"2024-05-27T06:27:43.641559+0000","last_became_active":"2024-05-27T06:27:42.684722+0000","last_became_peered":"2024-05-27T06:27:42.684722+0000","last_unstale":"2024-05-27T06:27:43.641559+0000","last_undegraded":"2024-05-27T06:27:43.641559+0000","last_fullsized":"2024-05-27T06:27:43.641559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:29:09.440505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136801+0000","last_change":"2024-05-27T06:27:38.617808+0000","last_active":"2024-05-27T06:27:45.136801+0000","last_peered":"2024-05-27T06:27:45.136801+0000","last_clean":"2024-05-27T06:27:45.136801+0000","last_became_active":"2024-05-27T06:27:38.617484+0000","last_became_peered":"2024-05-27T06:27:38.617484+0000","last_unstale":"2024-05-27T06:27:45.136801+0000","last_undegraded":"2024-05-27T06:27:45.136801+0000","last_fullsized":"2024-05-27T06:27:45.136801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:43:18.651541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.994806+0000","last_change":"2024-05-27T06:27:37.600205+0000","last_active":"2024-05-27T06:27:44.994806+0000","last_peered":"2024-05-27T06:27:44.994806+0000","last_clean":"2024-05-27T06:27:44.994806+0000","last_became_active":"2024-05-27T06:27:37.599877+0000","last_became_peered":"2024-05-27T06:27:37.599877+0000","last_unstale":"2024-05-27T06:27:44.994806+0000","last_undegraded":"2024-05-27T06:27:44.994806+0000","last_fullsized":"2024-05-27T06:27:44.994806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:49:54.332511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995252+0000","last_change":"2024-05-27T06:27:42.673409+0000","last_active":"2024-05-27T06:27:44.995252+0000","last_peered":"2024-05-27T06:27:44.995252+0000","last_clean":"2024-05-27T06:27:44.995252+0000","last_became_active":"2024-05-27T06:27:42.672637+0000","last_became_peered":"2024-05-27T06:27:42.672637+0000","last_unstale":"2024-05-27T06:27:44.995252+0000","last_undegraded":"2024-05-27T06:27:44.995252+0000","last_fullsized":"2024-05-27T06:27:44.995252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:25.641088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641351+0000","last_change":"2024-05-27T06:27:38.587029+0000","last_active":"2024-05-27T06:27:43.641351+0000","last_peered":"2024-05-27T06:27:43.641351+0000","last_clean":"2024-05-27T06:27:43.641351+0000","last_became_active":"2024-05-27T06:27:38.586798+0000","last_became_peered":"2024-05-27T06:27:38.586798+0000","last_unstale":"2024-05-27T06:27:43.641351+0000","last_undegraded":"2024-05-27T06:27:43.641351+0000","last_fullsized":"2024-05-27T06:27:43.641351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:28.542049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561027+0000","last_change":"2024-05-27T06:27:37.585479+0000","last_active":"2024-05-27T06:27:45.561027+0000","last_peered":"2024-05-27T06:27:45.561027+0000","last_clean":"2024-05-27T06:27:45.561027+0000","last_became_active":"2024-05-27T06:27:37.585196+0000","last_became_peered":"2024-05-27T06:27:37.585196+0000","last_unstale":"2024-05-27T06:27:45.561027+0000","last_undegraded":"2024-05-27T06:27:45.561027+0000","last_fullsized":"2024-05-27T06:27:45.561027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:39:09.133451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641758+0000","last_change":"2024-05-27T06:27:42.673356+0000","last_active":"2024-05-27T06:27:43.641758+0000","last_peered":"2024-05-27T06:27:43.641758+0000","last_clean":"2024-05-27T06:27:43.641758+0000","last_became_active":"2024-05-27T06:27:42.672313+0000","last_became_peered":"2024-05-27T06:27:42.672313+0000","last_unstale":"2024-05-27T06:27:43.641758+0000","last_undegraded":"2024-05-27T06:27:43.641758+0000","last_fullsized":"2024-05-27T06:27:43.641758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:13:33.049711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.699037+0000","last_change":"2024-05-27T06:27:38.594812+0000","last_active":"2024-05-27T06:27:44.699037+0000","last_peered":"2024-05-27T06:27:44.699037+0000","last_clean":"2024-05-27T06:27:44.699037+0000","last_became_active":"2024-05-27T06:27:38.594510+0000","last_became_peered":"2024-05-27T06:27:38.594510+0000","last_unstale":"2024-05-27T06:27:44.699037+0000","last_undegraded":"2024-05-27T06:27:44.699037+0000","last_fullsized":"2024-05-27T06:27:44.699037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:47.314366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560621+0000","last_change":"2024-05-27T06:27:37.593100+0000","last_active":"2024-05-27T06:27:45.560621+0000","last_peered":"2024-05-27T06:27:45.560621+0000","last_clean":"2024-05-27T06:27:45.560621+0000","last_became_active":"2024-05-27T06:27:37.592805+0000","last_became_peered":"2024-05-27T06:27:37.592805+0000","last_unstale":"2024-05-27T06:27:45.560621+0000","last_undegraded":"2024-05-27T06:27:45.560621+0000","last_fullsized":"2024-05-27T06:27:45.560621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:27.532558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641244+0000","last_change":"2024-05-27T06:27:42.674749+0000","last_active":"2024-05-27T06:27:43.641244+0000","last_peered":"2024-05-27T06:27:43.641244+0000","last_clean":"2024-05-27T06:27:43.641244+0000","last_became_active":"2024-05-27T06:27:42.674306+0000","last_became_peered":"2024-05-27T06:27:42.674306+0000","last_unstale":"2024-05-27T06:27:43.641244+0000","last_undegraded":"2024-05-27T06:27:43.641244+0000","last_fullsized":"2024-05-27T06:27:43.641244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:36:05.667548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.137291+0000","last_change":"2024-05-27T06:27:38.600218+0000","last_active":"2024-05-27T06:27:45.137291+0000","last_peered":"2024-05-27T06:27:45.137291+0000","last_clean":"2024-05-27T06:27:45.137291+0000","last_became_active":"2024-05-27T06:27:38.599796+0000","last_became_peered":"2024-05-27T06:27:38.599796+0000","last_unstale":"2024-05-27T06:27:45.137291+0000","last_undegraded":"2024-05-27T06:27:45.137291+0000","last_fullsized":"2024-05-27T06:27:45.137291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:25:30.433535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995470+0000","last_change":"2024-05-27T06:27:37.594420+0000","last_active":"2024-05-27T06:27:44.995470+0000","last_peered":"2024-05-27T06:27:44.995470+0000","last_clean":"2024-05-27T06:27:44.995470+0000","last_became_active":"2024-05-27T06:27:37.593946+0000","last_became_peered":"2024-05-27T06:27:37.593946+0000","last_unstale":"2024-05-27T06:27:44.995470+0000","last_undegraded":"2024-05-27T06:27:44.995470+0000","last_fullsized":"2024-05-27T06:27:44.995470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:26:32.568342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136310+0000","last_change":"2024-05-27T06:27:42.685574+0000","last_active":"2024-05-27T06:27:45.136310+0000","last_peered":"2024-05-27T06:27:45.136310+0000","last_clean":"2024-05-27T06:27:45.136310+0000","last_became_active":"2024-05-27T06:27:42.685158+0000","last_became_peered":"2024-05-27T06:27:42.685158+0000","last_unstale":"2024-05-27T06:27:45.136310+0000","last_undegraded":"2024-05-27T06:27:45.136310+0000","last_fullsized":"2024-05-27T06:27:45.136310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:21:58.228721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995447+0000","last_change":"2024-05-27T06:27:38.609767+0000","last_active":"2024-05-27T06:27:44.995447+0000","last_peered":"2024-05-27T06:27:44.995447+0000","last_clean":"2024-05-27T06:27:44.995447+0000","last_became_active":"2024-05-27T06:27:38.603315+0000","last_became_peered":"2024-05-27T06:27:38.603315+0000","last_unstale":"2024-05-27T06:27:44.995447+0000","last_undegraded":"2024-05-27T06:27:44.995447+0000","last_fullsized":"2024-05-27T06:27:44.995447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:47.314366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560615+0000","last_change":"2024-05-27T06:27:37.599180+0000","last_active":"2024-05-27T06:27:45.560615+0000","last_peered":"2024-05-27T06:27:45.560615+0000","last_clean":"2024-05-27T06:27:45.560615+0000","last_became_active":"2024-05-27T06:27:37.598944+0000","last_became_peered":"2024-05-27T06:27:37.598944+0000","last_unstale":"2024-05-27T06:27:45.560615+0000","last_undegraded":"2024-05-27T06:27:45.560615+0000","last_fullsized":"2024-05-27T06:27:45.560615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:49:54.332511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698527+0000","last_change":"2024-05-27T06:27:42.676516+0000","last_active":"2024-05-27T06:27:44.698527+0000","last_peered":"2024-05-27T06:27:44.698527+0000","last_clean":"2024-05-27T06:27:44.698527+0000","last_became_active":"2024-05-27T06:27:42.674971+0000","last_became_peered":"2024-05-27T06:27:42.674971+0000","last_unstale":"2024-05-27T06:27:44.698527+0000","last_undegraded":"2024-05-27T06:27:44.698527+0000","last_fullsized":"2024-05-27T06:27:44.698527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:31:27.862446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562261+0000","last_change":"2024-05-27T06:27:38.596128+0000","last_active":"2024-05-27T06:27:45.562261+0000","last_peered":"2024-05-27T06:27:45.562261+0000","last_clean":"2024-05-27T06:27:45.562261+0000","last_became_active":"2024-05-27T06:27:38.595919+0000","last_became_peered":"2024-05-27T06:27:38.595919+0000","last_unstale":"2024-05-27T06:27:45.562261+0000","last_undegraded":"2024-05-27T06:27:45.562261+0000","last_fullsized":"2024-05-27T06:27:45.562261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:31:23.791324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995552+0000","last_change":"2024-05-27T06:27:37.593456+0000","last_active":"2024-05-27T06:27:44.995552+0000","last_peered":"2024-05-27T06:27:44.995552+0000","last_clean":"2024-05-27T06:27:44.995552+0000","last_became_active":"2024-05-27T06:27:37.592873+0000","last_became_peered":"2024-05-27T06:27:37.592873+0000","last_unstale":"2024-05-27T06:27:44.995552+0000","last_undegraded":"2024-05-27T06:27:44.995552+0000","last_fullsized":"2024-05-27T06:27:44.995552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:05:47.256329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.994952+0000","last_change":"2024-05-27T06:27:42.678385+0000","last_active":"2024-05-27T06:27:44.994952+0000","last_peered":"2024-05-27T06:27:44.994952+0000","last_clean":"2024-05-27T06:27:44.994952+0000","last_became_active":"2024-05-27T06:27:42.677822+0000","last_became_peered":"2024-05-27T06:27:42.677822+0000","last_unstale":"2024-05-27T06:27:44.994952+0000","last_undegraded":"2024-05-27T06:27:44.994952+0000","last_fullsized":"2024-05-27T06:27:44.994952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:31:27.862446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641909+0000","last_change":"2024-05-27T06:27:38.579066+0000","last_active":"2024-05-27T06:27:43.641909+0000","last_peered":"2024-05-27T06:27:43.641909+0000","last_clean":"2024-05-27T06:27:43.641909+0000","last_became_active":"2024-05-27T06:27:38.577426+0000","last_became_peered":"2024-05-27T06:27:38.577426+0000","last_unstale":"2024-05-27T06:27:43.641909+0000","last_undegraded":"2024-05-27T06:27:43.641909+0000","last_fullsized":"2024-05-27T06:27:43.641909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:11.398713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561828+0000","last_change":"2024-05-27T06:27:37.601204+0000","last_active":"2024-05-27T06:27:45.561828+0000","last_peered":"2024-05-27T06:27:45.561828+0000","last_clean":"2024-05-27T06:27:45.561828+0000","last_became_active":"2024-05-27T06:27:37.599178+0000","last_became_peered":"2024-05-27T06:27:37.599178+0000","last_unstale":"2024-05-27T06:27:45.561828+0000","last_undegraded":"2024-05-27T06:27:45.561828+0000","last_fullsized":"2024-05-27T06:27:45.561828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:10.389223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995594+0000","last_change":"2024-05-27T06:27:42.672415+0000","last_active":"2024-05-27T06:27:44.995594+0000","last_peered":"2024-05-27T06:27:44.995594+0000","last_clean":"2024-05-27T06:27:44.995594+0000","last_became_active":"2024-05-27T06:27:42.671247+0000","last_became_peered":"2024-05-27T06:27:42.671247+0000","last_unstale":"2024-05-27T06:27:44.995594+0000","last_undegraded":"2024-05-27T06:27:44.995594+0000","last_fullsized":"2024-05-27T06:27:44.995594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:21:58.228721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.994829+0000","last_change":"2024-05-27T06:27:38.601418+0000","last_active":"2024-05-27T06:27:44.994829+0000","last_peered":"2024-05-27T06:27:44.994829+0000","last_clean":"2024-05-27T06:27:44.994829+0000","last_became_active":"2024-05-27T06:27:38.600709+0000","last_became_peered":"2024-05-27T06:27:38.600709+0000","last_unstale":"2024-05-27T06:27:44.994829+0000","last_undegraded":"2024-05-27T06:27:44.994829+0000","last_fullsized":"2024-05-27T06:27:44.994829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:10:49.565828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.640446+0000","last_change":"2024-05-27T06:27:37.597493+0000","last_active":"2024-05-27T06:27:43.640446+0000","last_peered":"2024-05-27T06:27:43.640446+0000","last_clean":"2024-05-27T06:27:43.640446+0000","last_became_active":"2024-05-27T06:27:37.597007+0000","last_became_peered":"2024-05-27T06:27:37.597007+0000","last_unstale":"2024-05-27T06:27:43.640446+0000","last_undegraded":"2024-05-27T06:27:43.640446+0000","last_fullsized":"2024-05-27T06:27:43.640446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:39:09.133451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995343+0000","last_change":"2024-05-27T06:27:42.672189+0000","last_active":"2024-05-27T06:27:44.995343+0000","last_peered":"2024-05-27T06:27:44.995343+0000","last_clean":"2024-05-27T06:27:44.995343+0000","last_became_active":"2024-05-27T06:27:42.671679+0000","last_became_peered":"2024-05-27T06:27:42.671679+0000","last_unstale":"2024-05-27T06:27:44.995343+0000","last_undegraded":"2024-05-27T06:27:44.995343+0000","last_fullsized":"2024-05-27T06:27:44.995343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:56:11.868706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698082+0000","last_change":"2024-05-27T06:27:38.579100+0000","last_active":"2024-05-27T06:27:44.698082+0000","last_peered":"2024-05-27T06:27:44.698082+0000","last_clean":"2024-05-27T06:27:44.698082+0000","last_became_active":"2024-05-27T06:27:38.578133+0000","last_became_peered":"2024-05-27T06:27:38.578133+0000","last_unstale":"2024-05-27T06:27:44.698082+0000","last_undegraded":"2024-05-27T06:27:44.698082+0000","last_fullsized":"2024-05-27T06:27:44.698082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:52:56.162405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561032+0000","last_change":"2024-05-27T06:27:37.589413+0000","last_active":"2024-05-27T06:27:45.561032+0000","last_peered":"2024-05-27T06:27:45.561032+0000","last_clean":"2024-05-27T06:27:45.561032+0000","last_became_active":"2024-05-27T06:27:37.589095+0000","last_became_peered":"2024-05-27T06:27:37.589095+0000","last_unstale":"2024-05-27T06:27:45.561032+0000","last_undegraded":"2024-05-27T06:27:45.561032+0000","last_fullsized":"2024-05-27T06:27:45.561032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:27.532558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698947+0000","last_change":"2024-05-27T06:27:42.672540+0000","last_active":"2024-05-27T06:27:44.698947+0000","last_peered":"2024-05-27T06:27:44.698947+0000","last_clean":"2024-05-27T06:27:44.698947+0000","last_became_active":"2024-05-27T06:27:42.672001+0000","last_became_peered":"2024-05-27T06:27:42.672001+0000","last_unstale":"2024-05-27T06:27:44.698947+0000","last_undegraded":"2024-05-27T06:27:44.698947+0000","last_fullsized":"2024-05-27T06:27:44.698947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:56:11.868706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136536+0000","last_change":"2024-05-27T06:27:38.592046+0000","last_active":"2024-05-27T06:27:45.136536+0000","last_peered":"2024-05-27T06:27:45.136536+0000","last_clean":"2024-05-27T06:27:45.136536+0000","last_became_active":"2024-05-27T06:27:38.591693+0000","last_became_peered":"2024-05-27T06:27:38.591693+0000","last_unstale":"2024-05-27T06:27:45.136536+0000","last_undegraded":"2024-05-27T06:27:45.136536+0000","last_fullsized":"2024-05-27T06:27:45.136536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:10:49.565828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561713+0000","last_change":"2024-05-27T06:27:37.588339+0000","last_active":"2024-05-27T06:27:45.561713+0000","last_peered":"2024-05-27T06:27:45.561713+0000","last_clean":"2024-05-27T06:27:45.561713+0000","last_became_active":"2024-05-27T06:27:37.587997+0000","last_became_peered":"2024-05-27T06:27:37.587997+0000","last_unstale":"2024-05-27T06:27:45.561713+0000","last_undegraded":"2024-05-27T06:27:45.561713+0000","last_fullsized":"2024-05-27T06:27:45.561713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:05:47.256329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561179+0000","last_change":"2024-05-27T06:27:28.692457+0000","last_active":"2024-05-27T06:27:45.561179+0000","last_peered":"2024-05-27T06:27:45.561179+0000","last_clean":"2024-05-27T06:27:45.561179+0000","last_became_active":"2024-05-27T06:27:28.691290+0000","last_became_peered":"2024-05-27T06:27:28.691290+0000","last_unstale":"2024-05-27T06:27:45.561179+0000","last_undegraded":"2024-05-27T06:27:45.561179+0000","last_fullsized":"2024-05-27T06:27:45.561179+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_clean_scrub_stamp":"2024-05-27T06:27:26.991915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:45.563728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559963+0000","last_change":"2024-05-27T06:27:42.675952+0000","last_active":"2024-05-27T06:27:45.559963+0000","last_peered":"2024-05-27T06:27:45.559963+0000","last_clean":"2024-05-27T06:27:45.559963+0000","last_became_active":"2024-05-27T06:27:42.675456+0000","last_became_peered":"2024-05-27T06:27:42.675456+0000","last_unstale":"2024-05-27T06:27:45.559963+0000","last_undegraded":"2024-05-27T06:27:45.559963+0000","last_fullsized":"2024-05-27T06:27:45.559963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:30.051452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560151+0000","last_change":"2024-05-27T06:27:38.594241+0000","last_active":"2024-05-27T06:27:45.560151+0000","last_peered":"2024-05-27T06:27:45.560151+0000","last_clean":"2024-05-27T06:27:45.560151+0000","last_became_active":"2024-05-27T06:27:38.593947+0000","last_became_peered":"2024-05-27T06:27:38.593947+0000","last_unstale":"2024-05-27T06:27:45.560151+0000","last_undegraded":"2024-05-27T06:27:45.560151+0000","last_fullsized":"2024-05-27T06:27:45.560151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:53.536742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641007+0000","last_change":"2024-05-27T06:27:37.591342+0000","last_active":"2024-05-27T06:27:43.641007+0000","last_peered":"2024-05-27T06:27:43.641007+0000","last_clean":"2024-05-27T06:27:43.641007+0000","last_became_active":"2024-05-27T06:27:37.591027+0000","last_became_peered":"2024-05-27T06:27:37.591027+0000","last_unstale":"2024-05-27T06:27:43.641007+0000","last_undegraded":"2024-05-27T06:27:43.641007+0000","last_fullsized":"2024-05-27T06:27:43.641007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:27.532558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559661+0000","last_change":"2024-05-27T06:27:42.681211+0000","last_active":"2024-05-27T06:27:45.559661+0000","last_peered":"2024-05-27T06:27:45.559661+0000","last_clean":"2024-05-27T06:27:45.559661+0000","last_became_active":"2024-05-27T06:27:42.680695+0000","last_became_peered":"2024-05-27T06:27:42.680695+0000","last_unstale":"2024-05-27T06:27:45.559661+0000","last_undegraded":"2024-05-27T06:27:45.559661+0000","last_fullsized":"2024-05-27T06:27:45.559661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:57.607864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562099+0000","last_change":"2024-05-27T06:27:38.596719+0000","last_active":"2024-05-27T06:27:45.562099+0000","last_peered":"2024-05-27T06:27:45.562099+0000","last_clean":"2024-05-27T06:27:45.562099+0000","last_became_active":"2024-05-27T06:27:38.596458+0000","last_became_peered":"2024-05-27T06:27:38.596458+0000","last_unstale":"2024-05-27T06:27:45.562099+0000","last_undegraded":"2024-05-27T06:27:45.562099+0000","last_fullsized":"2024-05-27T06:27:45.562099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:25.980330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995382+0000","last_change":"2024-05-27T06:27:37.587248+0000","last_active":"2024-05-27T06:27:44.995382+0000","last_peered":"2024-05-27T06:27:44.995382+0000","last_clean":"2024-05-27T06:27:44.995382+0000","last_became_active":"2024-05-27T06:27:37.586914+0000","last_became_peered":"2024-05-27T06:27:37.586914+0000","last_unstale":"2024-05-27T06:27:44.995382+0000","last_undegraded":"2024-05-27T06:27:44.995382+0000","last_fullsized":"2024-05-27T06:27:44.995382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:10.389223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698571+0000","last_change":"2024-05-27T06:27:42.674862+0000","last_active":"2024-05-27T06:27:44.698571+0000","last_peered":"2024-05-27T06:27:44.698571+0000","last_clean":"2024-05-27T06:27:44.698571+0000","last_became_active":"2024-05-27T06:27:42.674435+0000","last_became_peered":"2024-05-27T06:27:42.674435+0000","last_unstale":"2024-05-27T06:27:44.698571+0000","last_undegraded":"2024-05-27T06:27:44.698571+0000","last_fullsized":"2024-05-27T06:27:44.698571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:25.641088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561573+0000","last_change":"2024-05-27T06:27:38.593263+0000","last_active":"2024-05-27T06:27:45.561573+0000","last_peered":"2024-05-27T06:27:45.561573+0000","last_clean":"2024-05-27T06:27:45.561573+0000","last_became_active":"2024-05-27T06:27:38.592852+0000","last_became_peered":"2024-05-27T06:27:38.592852+0000","last_unstale":"2024-05-27T06:27:45.561573+0000","last_undegraded":"2024-05-27T06:27:45.561573+0000","last_fullsized":"2024-05-27T06:27:45.561573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:21.569967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641310+0000","last_change":"2024-05-27T06:27:37.599453+0000","last_active":"2024-05-27T06:27:43.641310+0000","last_peered":"2024-05-27T06:27:43.641310+0000","last_clean":"2024-05-27T06:27:43.641310+0000","last_became_active":"2024-05-27T06:27:37.599122+0000","last_became_peered":"2024-05-27T06:27:37.599122+0000","last_unstale":"2024-05-27T06:27:43.641310+0000","last_undegraded":"2024-05-27T06:27:43.641310+0000","last_fullsized":"2024-05-27T06:27:43.641310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:10.389223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559414+0000","last_change":"2024-05-27T06:27:42.667965+0000","last_active":"2024-05-27T06:27:45.559414+0000","last_peered":"2024-05-27T06:27:45.559414+0000","last_clean":"2024-05-27T06:27:45.559414+0000","last_became_active":"2024-05-27T06:27:42.667525+0000","last_became_peered":"2024-05-27T06:27:42.667525+0000","last_unstale":"2024-05-27T06:27:45.559414+0000","last_undegraded":"2024-05-27T06:27:45.559414+0000","last_fullsized":"2024-05-27T06:27:45.559414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:39:45.712130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561139+0000","last_change":"2024-05-27T06:27:38.593273+0000","last_active":"2024-05-27T06:27:45.561139+0000","last_peered":"2024-05-27T06:27:45.561139+0000","last_clean":"2024-05-27T06:27:45.561139+0000","last_became_active":"2024-05-27T06:27:38.592904+0000","last_became_peered":"2024-05-27T06:27:38.592904+0000","last_unstale":"2024-05-27T06:27:45.561139+0000","last_undegraded":"2024-05-27T06:27:45.561139+0000","last_fullsized":"2024-05-27T06:27:45.561139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:13:28.978589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.642001+0000","last_change":"2024-05-27T06:27:37.588652+0000","last_active":"2024-05-27T06:27:43.642001+0000","last_peered":"2024-05-27T06:27:43.642001+0000","last_clean":"2024-05-27T06:27:43.642001+0000","last_became_active":"2024-05-27T06:27:37.587893+0000","last_became_peered":"2024-05-27T06:27:37.587893+0000","last_unstale":"2024-05-27T06:27:43.642001+0000","last_undegraded":"2024-05-27T06:27:43.642001+0000","last_fullsized":"2024-05-27T06:27:43.642001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:29:42.916475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641001+0000","last_change":"2024-05-27T06:27:42.673669+0000","last_active":"2024-05-27T06:27:43.641001+0000","last_peered":"2024-05-27T06:27:43.641001+0000","last_clean":"2024-05-27T06:27:43.641001+0000","last_became_active":"2024-05-27T06:27:42.672239+0000","last_became_peered":"2024-05-27T06:27:42.672239+0000","last_unstale":"2024-05-27T06:27:43.641001+0000","last_undegraded":"2024-05-27T06:27:43.641001+0000","last_fullsized":"2024-05-27T06:27:43.641001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:12:01.383034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560187+0000","last_change":"2024-05-27T06:27:38.592051+0000","last_active":"2024-05-27T06:27:45.560187+0000","last_peered":"2024-05-27T06:27:45.560187+0000","last_clean":"2024-05-27T06:27:45.560187+0000","last_became_active":"2024-05-27T06:27:38.591691+0000","last_became_peered":"2024-05-27T06:27:38.591691+0000","last_unstale":"2024-05-27T06:27:45.560187+0000","last_undegraded":"2024-05-27T06:27:45.560187+0000","last_fullsized":"2024-05-27T06:27:45.560187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:24:46.797590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.640005+0000","last_change":"2024-05-27T06:27:37.581720+0000","last_active":"2024-05-27T06:27:43.640005+0000","last_peered":"2024-05-27T06:27:43.640005+0000","last_clean":"2024-05-27T06:27:43.640005+0000","last_became_active":"2024-05-27T06:27:37.581315+0000","last_became_peered":"2024-05-27T06:27:37.581315+0000","last_unstale":"2024-05-27T06:27:43.640005+0000","last_undegraded":"2024-05-27T06:27:43.640005+0000","last_fullsized":"2024-05-27T06:27:43.640005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:52:20.552058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698884+0000","last_change":"2024-05-27T06:27:42.663374+0000","last_active":"2024-05-27T06:27:44.698884+0000","last_peered":"2024-05-27T06:27:44.698884+0000","last_clean":"2024-05-27T06:27:44.698884+0000","last_became_active":"2024-05-27T06:27:42.662889+0000","last_became_peered":"2024-05-27T06:27:42.662889+0000","last_unstale":"2024-05-27T06:27:44.698884+0000","last_undegraded":"2024-05-27T06:27:44.698884+0000","last_fullsized":"2024-05-27T06:27:44.698884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:54:35.677824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559633+0000","last_change":"2024-05-27T06:27:38.583434+0000","last_active":"2024-05-27T06:27:45.559633+0000","last_peered":"2024-05-27T06:27:45.559633+0000","last_clean":"2024-05-27T06:27:45.559633+0000","last_became_active":"2024-05-27T06:27:38.582843+0000","last_became_peered":"2024-05-27T06:27:38.582843+0000","last_unstale":"2024-05-27T06:27:45.559633+0000","last_undegraded":"2024-05-27T06:27:45.559633+0000","last_fullsized":"2024-05-27T06:27:45.559633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:41:11.973047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559966+0000","last_change":"2024-05-27T06:27:37.589051+0000","last_active":"2024-05-27T06:27:45.559966+0000","last_peered":"2024-05-27T06:27:45.559966+0000","last_clean":"2024-05-27T06:27:45.559966+0000","last_became_active":"2024-05-27T06:27:37.588633+0000","last_became_peered":"2024-05-27T06:27:37.588633+0000","last_unstale":"2024-05-27T06:27:45.559966+0000","last_undegraded":"2024-05-27T06:27:45.559966+0000","last_fullsized":"2024-05-27T06:27:45.559966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:05:47.256329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.137194+0000","last_change":"2024-05-27T06:27:42.686386+0000","last_active":"2024-05-27T06:27:45.137194+0000","last_peered":"2024-05-27T06:27:45.137194+0000","last_clean":"2024-05-27T06:27:45.137194+0000","last_became_active":"2024-05-27T06:27:42.685755+0000","last_became_peered":"2024-05-27T06:27:42.685755+0000","last_unstale":"2024-05-27T06:27:45.137194+0000","last_undegraded":"2024-05-27T06:27:45.137194+0000","last_fullsized":"2024-05-27T06:27:45.137194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:37:17.435617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561197+0000","last_change":"2024-05-27T06:27:38.593634+0000","last_active":"2024-05-27T06:27:45.561197+0000","last_peered":"2024-05-27T06:27:45.561197+0000","last_clean":"2024-05-27T06:27:45.561197+0000","last_became_active":"2024-05-27T06:27:38.593201+0000","last_became_peered":"2024-05-27T06:27:38.593201+0000","last_unstale":"2024-05-27T06:27:45.561197+0000","last_undegraded":"2024-05-27T06:27:45.561197+0000","last_fullsized":"2024-05-27T06:27:45.561197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:25:30.433535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561742+0000","last_change":"2024-05-27T06:27:37.596337+0000","last_active":"2024-05-27T06:27:45.561742+0000","last_peered":"2024-05-27T06:27:45.561742+0000","last_clean":"2024-05-27T06:27:45.561742+0000","last_became_active":"2024-05-27T06:27:37.596071+0000","last_became_peered":"2024-05-27T06:27:37.596071+0000","last_unstale":"2024-05-27T06:27:45.561742+0000","last_undegraded":"2024-05-27T06:27:45.561742+0000","last_fullsized":"2024-05-27T06:27:45.561742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:27.532558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136738+0000","last_change":"2024-05-27T06:27:42.686370+0000","last_active":"2024-05-27T06:27:45.136738+0000","last_peered":"2024-05-27T06:27:45.136738+0000","last_clean":"2024-05-27T06:27:45.136738+0000","last_became_active":"2024-05-27T06:27:42.685792+0000","last_became_peered":"2024-05-27T06:27:42.685792+0000","last_unstale":"2024-05-27T06:27:45.136738+0000","last_undegraded":"2024-05-27T06:27:45.136738+0000","last_fullsized":"2024-05-27T06:27:45.136738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:28:22.687108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698347+0000","last_change":"2024-05-27T06:27:38.594222+0000","last_active":"2024-05-27T06:27:44.698347+0000","last_peered":"2024-05-27T06:27:44.698347+0000","last_clean":"2024-05-27T06:27:44.698347+0000","last_became_active":"2024-05-27T06:27:38.593632+0000","last_became_peered":"2024-05-27T06:27:38.593632+0000","last_unstale":"2024-05-27T06:27:44.698347+0000","last_undegraded":"2024-05-27T06:27:44.698347+0000","last_fullsized":"2024-05-27T06:27:44.698347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:00:49.009171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698666+0000","last_change":"2024-05-27T06:27:37.589344+0000","last_active":"2024-05-27T06:27:44.698666+0000","last_peered":"2024-05-27T06:27:44.698666+0000","last_clean":"2024-05-27T06:27:44.698666+0000","last_became_active":"2024-05-27T06:27:37.588387+0000","last_became_peered":"2024-05-27T06:27:37.588387+0000","last_unstale":"2024-05-27T06:27:44.698666+0000","last_undegraded":"2024-05-27T06:27:44.698666+0000","last_fullsized":"2024-05-27T06:27:44.698666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:32:06.800381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562338+0000","last_change":"2024-05-27T06:27:42.673810+0000","last_active":"2024-05-27T06:27:45.562338+0000","last_peered":"2024-05-27T06:27:45.562338+0000","last_clean":"2024-05-27T06:27:45.562338+0000","last_became_active":"2024-05-27T06:27:42.673431+0000","last_became_peered":"2024-05-27T06:27:42.673431+0000","last_unstale":"2024-05-27T06:27:45.562338+0000","last_undegraded":"2024-05-27T06:27:45.562338+0000","last_fullsized":"2024-05-27T06:27:45.562338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:00:08.939251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560009+0000","last_change":"2024-05-27T06:27:38.599269+0000","last_active":"2024-05-27T06:27:45.560009+0000","last_peered":"2024-05-27T06:27:45.560009+0000","last_clean":"2024-05-27T06:27:45.560009+0000","last_became_active":"2024-05-27T06:27:38.598937+0000","last_became_peered":"2024-05-27T06:27:38.598937+0000","last_unstale":"2024-05-27T06:27:45.560009+0000","last_undegraded":"2024-05-27T06:27:45.560009+0000","last_fullsized":"2024-05-27T06:27:45.560009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:29:05.369384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:49.604485+0000","last_change":"2024-05-27T06:27:37.601137+0000","last_active":"2024-05-27T06:27:49.604485+0000","last_peered":"2024-05-27T06:27:49.604485+0000","last_clean":"2024-05-27T06:27:49.604485+0000","last_became_active":"2024-05-27T06:27:37.597839+0000","last_became_peered":"2024-05-27T06:27:37.597839+0000","last_unstale":"2024-05-27T06:27:49.604485+0000","last_undegraded":"2024-05-27T06:27:49.604485+0000","last_fullsized":"2024-05-27T06:27:49.604485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:10.389223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995265+0000","last_change":"2024-05-27T06:27:42.677071+0000","last_active":"2024-05-27T06:27:44.995265+0000","last_peered":"2024-05-27T06:27:44.995265+0000","last_clean":"2024-05-27T06:27:44.995265+0000","last_became_active":"2024-05-27T06:27:42.676468+0000","last_became_peered":"2024-05-27T06:27:42.676468+0000","last_unstale":"2024-05-27T06:27:44.995265+0000","last_undegraded":"2024-05-27T06:27:44.995265+0000","last_fullsized":"2024-05-27T06:27:44.995265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:54:35.677824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641784+0000","last_change":"2024-05-27T06:27:38.595005+0000","last_active":"2024-05-27T06:27:43.641784+0000","last_peered":"2024-05-27T06:27:43.641784+0000","last_clean":"2024-05-27T06:27:43.641784+0000","last_became_active":"2024-05-27T06:27:38.594686+0000","last_became_peered":"2024-05-27T06:27:38.594686+0000","last_unstale":"2024-05-27T06:27:43.641784+0000","last_undegraded":"2024-05-27T06:27:43.641784+0000","last_fullsized":"2024-05-27T06:27:43.641784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:26:33.577833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995173+0000","last_change":"2024-05-27T06:27:37.602334+0000","last_active":"2024-05-27T06:27:44.995173+0000","last_peered":"2024-05-27T06:27:44.995173+0000","last_clean":"2024-05-27T06:27:44.995173+0000","last_became_active":"2024-05-27T06:27:37.601956+0000","last_became_peered":"2024-05-27T06:27:37.601956+0000","last_unstale":"2024-05-27T06:27:44.995173+0000","last_undegraded":"2024-05-27T06:27:44.995173+0000","last_fullsized":"2024-05-27T06:27:44.995173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:27.532558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641965+0000","last_change":"2024-05-27T06:27:42.675917+0000","last_active":"2024-05-27T06:27:43.641965+0000","last_peered":"2024-05-27T06:27:43.641965+0000","last_clean":"2024-05-27T06:27:43.641965+0000","last_became_active":"2024-05-27T06:27:42.672667+0000","last_became_peered":"2024-05-27T06:27:42.672667+0000","last_unstale":"2024-05-27T06:27:43.641965+0000","last_undegraded":"2024-05-27T06:27:43.641965+0000","last_fullsized":"2024-05-27T06:27:43.641965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:57.607864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698963+0000","last_change":"2024-05-27T06:27:38.593445+0000","last_active":"2024-05-27T06:27:44.698963+0000","last_peered":"2024-05-27T06:27:44.698963+0000","last_clean":"2024-05-27T06:27:44.698963+0000","last_became_active":"2024-05-27T06:27:38.593177+0000","last_became_peered":"2024-05-27T06:27:38.593177+0000","last_unstale":"2024-05-27T06:27:44.698963+0000","last_undegraded":"2024-05-27T06:27:44.698963+0000","last_fullsized":"2024-05-27T06:27:44.698963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:25:28.290431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562220+0000","last_change":"2024-05-27T06:27:37.591786+0000","last_active":"2024-05-27T06:27:45.562220+0000","last_peered":"2024-05-27T06:27:45.562220+0000","last_clean":"2024-05-27T06:27:45.562220+0000","last_became_active":"2024-05-27T06:27:37.591376+0000","last_became_peered":"2024-05-27T06:27:37.591376+0000","last_unstale":"2024-05-27T06:27:45.562220+0000","last_undegraded":"2024-05-27T06:27:45.562220+0000","last_fullsized":"2024-05-27T06:27:45.562220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:26:32.568342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136705+0000","last_change":"2024-05-27T06:27:42.685562+0000","last_active":"2024-05-27T06:27:45.136705+0000","last_peered":"2024-05-27T06:27:45.136705+0000","last_clean":"2024-05-27T06:27:45.136705+0000","last_became_active":"2024-05-27T06:27:42.685102+0000","last_became_peered":"2024-05-27T06:27:42.685102+0000","last_unstale":"2024-05-27T06:27:45.136705+0000","last_undegraded":"2024-05-27T06:27:45.136705+0000","last_fullsized":"2024-05-27T06:27:45.136705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:00:08.939251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562310+0000","last_change":"2024-05-27T06:27:38.595953+0000","last_active":"2024-05-27T06:27:45.562310+0000","last_peered":"2024-05-27T06:27:45.562310+0000","last_clean":"2024-05-27T06:27:45.562310+0000","last_became_active":"2024-05-27T06:27:38.595628+0000","last_became_peered":"2024-05-27T06:27:38.595628+0000","last_unstale":"2024-05-27T06:27:45.562310+0000","last_undegraded":"2024-05-27T06:27:45.562310+0000","last_fullsized":"2024-05-27T06:27:45.562310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:36:01.596426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560492+0000","last_change":"2024-05-27T06:27:37.600029+0000","last_active":"2024-05-27T06:27:45.560492+0000","last_peered":"2024-05-27T06:27:45.560492+0000","last_clean":"2024-05-27T06:27:45.560492+0000","last_became_active":"2024-05-27T06:27:37.599416+0000","last_became_peered":"2024-05-27T06:27:37.599416+0000","last_unstale":"2024-05-27T06:27:45.560492+0000","last_undegraded":"2024-05-27T06:27:45.560492+0000","last_fullsized":"2024-05-27T06:27:45.560492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:52:20.552058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136431+0000","last_change":"2024-05-27T06:27:42.668152+0000","last_active":"2024-05-27T06:27:45.136431+0000","last_peered":"2024-05-27T06:27:45.136431+0000","last_clean":"2024-05-27T06:27:45.136431+0000","last_became_active":"2024-05-27T06:27:42.667699+0000","last_became_peered":"2024-05-27T06:27:42.667699+0000","last_unstale":"2024-05-27T06:27:45.136431+0000","last_undegraded":"2024-05-27T06:27:45.136431+0000","last_fullsized":"2024-05-27T06:27:45.136431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:39:45.712130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698461+0000","last_change":"2024-05-27T06:27:42.674408+0000","last_active":"2024-05-27T06:27:44.698461+0000","last_peered":"2024-05-27T06:27:44.698461+0000","last_clean":"2024-05-27T06:27:44.698461+0000","last_became_active":"2024-05-27T06:27:42.673922+0000","last_became_peered":"2024-05-27T06:27:42.673922+0000","last_unstale":"2024-05-27T06:27:44.698461+0000","last_undegraded":"2024-05-27T06:27:44.698461+0000","last_fullsized":"2024-05-27T06:27:44.698461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:39.420388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.994666+0000","last_change":"2024-05-27T06:27:38.612241+0000","last_active":"2024-05-27T06:27:44.994666+0000","last_peered":"2024-05-27T06:27:44.994666+0000","last_clean":"2024-05-27T06:27:44.994666+0000","last_became_active":"2024-05-27T06:27:38.611812+0000","last_became_peered":"2024-05-27T06:27:38.611812+0000","last_unstale":"2024-05-27T06:27:44.994666+0000","last_undegraded":"2024-05-27T06:27:44.994666+0000","last_fullsized":"2024-05-27T06:27:44.994666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:43:18.651541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560424+0000","last_change":"2024-05-27T06:27:37.588619+0000","last_active":"2024-05-27T06:27:45.560424+0000","last_peered":"2024-05-27T06:27:45.560424+0000","last_clean":"2024-05-27T06:27:45.560424+0000","last_became_active":"2024-05-27T06:27:37.588234+0000","last_became_peered":"2024-05-27T06:27:37.588234+0000","last_unstale":"2024-05-27T06:27:45.560424+0000","last_undegraded":"2024-05-27T06:27:45.560424+0000","last_fullsized":"2024-05-27T06:27:45.560424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:39:09.133451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560396+0000","last_change":"2024-05-27T06:27:42.675463+0000","last_active":"2024-05-27T06:27:45.560396+0000","last_peered":"2024-05-27T06:27:45.560396+0000","last_clean":"2024-05-27T06:27:45.560396+0000","last_became_active":"2024-05-27T06:27:42.674944+0000","last_became_peered":"2024-05-27T06:27:42.674944+0000","last_unstale":"2024-05-27T06:27:45.560396+0000","last_undegraded":"2024-05-27T06:27:45.560396+0000","last_fullsized":"2024-05-27T06:27:45.560396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:39.420388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136773+0000","last_change":"2024-05-27T06:27:38.602470+0000","last_active":"2024-05-27T06:27:45.136773+0000","last_peered":"2024-05-27T06:27:45.136773+0000","last_clean":"2024-05-27T06:27:45.136773+0000","last_became_active":"2024-05-27T06:27:38.602168+0000","last_became_peered":"2024-05-27T06:27:38.602168+0000","last_unstale":"2024-05-27T06:27:45.136773+0000","last_undegraded":"2024-05-27T06:27:45.136773+0000","last_fullsized":"2024-05-27T06:27:45.136773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:41:11.973047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136564+0000","last_change":"2024-05-27T06:27:37.594520+0000","last_active":"2024-05-27T06:27:45.136564+0000","last_peered":"2024-05-27T06:27:45.136564+0000","last_clean":"2024-05-27T06:27:45.136564+0000","last_became_active":"2024-05-27T06:27:37.594241+0000","last_became_peered":"2024-05-27T06:27:37.594241+0000","last_unstale":"2024-05-27T06:27:45.136564+0000","last_undegraded":"2024-05-27T06:27:45.136564+0000","last_fullsized":"2024-05-27T06:27:45.136564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:32:06.800381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559944+0000","last_change":"2024-05-27T06:27:37.584323+0000","last_active":"2024-05-27T06:27:45.559944+0000","last_peered":"2024-05-27T06:27:45.559944+0000","last_clean":"2024-05-27T06:27:45.559944+0000","last_became_active":"2024-05-27T06:27:37.583455+0000","last_became_peered":"2024-05-27T06:27:37.583455+0000","last_unstale":"2024-05-27T06:27:45.559944+0000","last_undegraded":"2024-05-27T06:27:45.559944+0000","last_fullsized":"2024-05-27T06:27:45.559944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:39:09.133451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698607+0000","last_change":"2024-05-27T06:27:38.574453+0000","last_active":"2024-05-27T06:27:44.698607+0000","last_peered":"2024-05-27T06:27:44.698607+0000","last_clean":"2024-05-27T06:27:44.698607+0000","last_became_active":"2024-05-27T06:27:38.574187+0000","last_became_peered":"2024-05-27T06:27:38.574187+0000","last_unstale":"2024-05-27T06:27:44.698607+0000","last_undegraded":"2024-05-27T06:27:44.698607+0000","last_fullsized":"2024-05-27T06:27:44.698607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:10:49.565828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.640927+0000","last_change":"2024-05-27T06:27:42.685818+0000","last_active":"2024-05-27T06:27:43.640927+0000","last_peered":"2024-05-27T06:27:43.640927+0000","last_clean":"2024-05-27T06:27:43.640927+0000","last_became_active":"2024-05-27T06:27:42.685168+0000","last_became_peered":"2024-05-27T06:27:42.685168+0000","last_unstale":"2024-05-27T06:27:43.640927+0000","last_undegraded":"2024-05-27T06:27:43.640927+0000","last_fullsized":"2024-05-27T06:27:43.640927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:53:00.233527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136653+0000","last_change":"2024-05-27T06:27:37.593851+0000","last_active":"2024-05-27T06:27:45.136653+0000","last_peered":"2024-05-27T06:27:45.136653+0000","last_clean":"2024-05-27T06:27:45.136653+0000","last_became_active":"2024-05-27T06:27:37.593555+0000","last_became_peered":"2024-05-27T06:27:37.593555+0000","last_unstale":"2024-05-27T06:27:45.136653+0000","last_undegraded":"2024-05-27T06:27:45.136653+0000","last_fullsized":"2024-05-27T06:27:45.136653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:13:32.135455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641290+0000","last_change":"2024-05-27T06:27:38.581691+0000","last_active":"2024-05-27T06:27:43.641290+0000","last_peered":"2024-05-27T06:27:43.641290+0000","last_clean":"2024-05-27T06:27:43.641290+0000","last_became_active":"2024-05-27T06:27:38.581340+0000","last_became_peered":"2024-05-27T06:27:38.581340+0000","last_unstale":"2024-05-27T06:27:43.641290+0000","last_undegraded":"2024-05-27T06:27:43.641290+0000","last_fullsized":"2024-05-27T06:27:43.641290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:49:55.342001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.137183+0000","last_change":"2024-05-27T06:27:42.685248+0000","last_active":"2024-05-27T06:27:45.137183+0000","last_peered":"2024-05-27T06:27:45.137183+0000","last_clean":"2024-05-27T06:27:45.137183+0000","last_became_active":"2024-05-27T06:27:42.684742+0000","last_became_peered":"2024-05-27T06:27:42.684742+0000","last_unstale":"2024-05-27T06:27:45.137183+0000","last_undegraded":"2024-05-27T06:27:45.137183+0000","last_fullsized":"2024-05-27T06:27:45.137183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:02:03.498823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559395+0000","last_change":"2024-05-27T06:27:38.583155+0000","last_active":"2024-05-27T06:27:45.559395+0000","last_peered":"2024-05-27T06:27:45.559395+0000","last_clean":"2024-05-27T06:27:45.559395+0000","last_became_active":"2024-05-27T06:27:38.582419+0000","last_became_peered":"2024-05-27T06:27:38.582419+0000","last_unstale":"2024-05-27T06:27:45.559395+0000","last_undegraded":"2024-05-27T06:27:45.559395+0000","last_fullsized":"2024-05-27T06:27:45.559395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:11:57.311912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.640034+0000","last_change":"2024-05-27T06:27:38.590551+0000","last_active":"2024-05-27T06:27:43.640034+0000","last_peered":"2024-05-27T06:27:43.640034+0000","last_clean":"2024-05-27T06:27:43.640034+0000","last_became_active":"2024-05-27T06:27:38.590245+0000","last_became_peered":"2024-05-27T06:27:38.590245+0000","last_unstale":"2024-05-27T06:27:43.640034+0000","last_undegraded":"2024-05-27T06:27:43.640034+0000","last_fullsized":"2024-05-27T06:27:43.640034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:49:55.342001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561694+0000","last_change":"2024-05-27T06:27:38.597109+0000","last_active":"2024-05-27T06:27:45.561694+0000","last_peered":"2024-05-27T06:27:45.561694+0000","last_clean":"2024-05-27T06:27:45.561694+0000","last_became_active":"2024-05-27T06:27:38.596436+0000","last_became_peered":"2024-05-27T06:27:38.596436+0000","last_unstale":"2024-05-27T06:27:45.561694+0000","last_undegraded":"2024-05-27T06:27:45.561694+0000","last_fullsized":"2024-05-27T06:27:45.561694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:29:05.369384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698590+0000","last_change":"2024-05-27T06:27:38.592354+0000","last_active":"2024-05-27T06:27:44.698590+0000","last_peered":"2024-05-27T06:27:44.698590+0000","last_clean":"2024-05-27T06:27:44.698590+0000","last_became_active":"2024-05-27T06:27:38.591629+0000","last_became_peered":"2024-05-27T06:27:38.591629+0000","last_unstale":"2024-05-27T06:27:44.698590+0000","last_undegraded":"2024-05-27T06:27:44.698590+0000","last_fullsized":"2024-05-27T06:27:44.698590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:43:18.651541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136957+0000","last_change":"2024-05-27T06:27:38.600703+0000","last_active":"2024-05-27T06:27:45.136957+0000","last_peered":"2024-05-27T06:27:45.136957+0000","last_clean":"2024-05-27T06:27:45.136957+0000","last_became_active":"2024-05-27T06:27:38.598995+0000","last_became_peered":"2024-05-27T06:27:38.598995+0000","last_unstale":"2024-05-27T06:27:45.136957+0000","last_undegraded":"2024-05-27T06:27:45.136957+0000","last_fullsized":"2024-05-27T06:27:45.136957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:47.314366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.994968+0000","last_change":"2024-05-27T06:27:38.591611+0000","last_active":"2024-05-27T06:27:44.994968+0000","last_peered":"2024-05-27T06:27:44.994968+0000","last_clean":"2024-05-27T06:27:44.994968+0000","last_became_active":"2024-05-27T06:27:38.591257+0000","last_became_peered":"2024-05-27T06:27:38.591257+0000","last_unstale":"2024-05-27T06:27:44.994968+0000","last_undegraded":"2024-05-27T06:27:44.994968+0000","last_fullsized":"2024-05-27T06:27:44.994968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:11:57.311912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560497+0000","last_change":"2024-05-27T06:27:38.601653+0000","last_active":"2024-05-27T06:27:45.560497+0000","last_peered":"2024-05-27T06:27:45.560497+0000","last_clean":"2024-05-27T06:27:45.560497+0000","last_became_active":"2024-05-27T06:27:38.601350+0000","last_became_peered":"2024-05-27T06:27:38.601350+0000","last_unstale":"2024-05-27T06:27:45.560497+0000","last_undegraded":"2024-05-27T06:27:45.560497+0000","last_fullsized":"2024-05-27T06:27:45.560497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:47.314366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.137255+0000","last_change":"2024-05-27T06:27:38.595137+0000","last_active":"2024-05-27T06:27:45.137255+0000","last_peered":"2024-05-27T06:27:45.137255+0000","last_clean":"2024-05-27T06:27:45.137255+0000","last_became_active":"2024-05-27T06:27:38.594672+0000","last_became_peered":"2024-05-27T06:27:38.594672+0000","last_unstale":"2024-05-27T06:27:45.137255+0000","last_undegraded":"2024-05-27T06:27:45.137255+0000","last_fullsized":"2024-05-27T06:27:45.137255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:36:01.596426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560306+0000","last_change":"2024-05-27T06:27:38.604733+0000","last_active":"2024-05-27T06:27:45.560306+0000","last_peered":"2024-05-27T06:27:45.560306+0000","last_clean":"2024-05-27T06:27:45.560306+0000","last_became_active":"2024-05-27T06:27:38.604412+0000","last_became_peered":"2024-05-27T06:27:38.604412+0000","last_unstale":"2024-05-27T06:27:45.560306+0000","last_undegraded":"2024-05-27T06:27:45.560306+0000","last_fullsized":"2024-05-27T06:27:45.560306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:25:28.290431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136468+0000","last_change":"2024-05-27T06:27:38.594417+0000","last_active":"2024-05-27T06:27:45.136468+0000","last_peered":"2024-05-27T06:27:45.136468+0000","last_clean":"2024-05-27T06:27:45.136468+0000","last_became_active":"2024-05-27T06:27:38.594093+0000","last_became_peered":"2024-05-27T06:27:38.594093+0000","last_unstale":"2024-05-27T06:27:45.136468+0000","last_undegraded":"2024-05-27T06:27:45.136468+0000","last_fullsized":"2024-05-27T06:27:45.136468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:36:07.073192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561566+0000","last_change":"2024-05-27T06:27:38.595842+0000","last_active":"2024-05-27T06:27:45.561566+0000","last_peered":"2024-05-27T06:27:45.561566+0000","last_clean":"2024-05-27T06:27:45.561566+0000","last_became_active":"2024-05-27T06:27:38.595187+0000","last_became_peered":"2024-05-27T06:27:38.595187+0000","last_unstale":"2024-05-27T06:27:45.561566+0000","last_undegraded":"2024-05-27T06:27:45.561566+0000","last_fullsized":"2024-05-27T06:27:45.561566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:25:30.433535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698434+0000","last_change":"2024-05-27T06:27:38.596103+0000","last_active":"2024-05-27T06:27:44.698434+0000","last_peered":"2024-05-27T06:27:44.698434+0000","last_clean":"2024-05-27T06:27:44.698434+0000","last_became_active":"2024-05-27T06:27:38.595235+0000","last_became_peered":"2024-05-27T06:27:38.595235+0000","last_unstale":"2024-05-27T06:27:44.698434+0000","last_undegraded":"2024-05-27T06:27:44.698434+0000","last_fullsized":"2024-05-27T06:27:44.698434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:41:11.973047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561763+0000","last_change":"2024-05-27T06:27:38.589402+0000","last_active":"2024-05-27T06:27:45.561763+0000","last_peered":"2024-05-27T06:27:45.561763+0000","last_clean":"2024-05-27T06:27:45.561763+0000","last_became_active":"2024-05-27T06:27:38.588485+0000","last_became_peered":"2024-05-27T06:27:38.588485+0000","last_unstale":"2024-05-27T06:27:45.561763+0000","last_undegraded":"2024-05-27T06:27:45.561763+0000","last_fullsized":"2024-05-27T06:27:45.561763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:25:28.290431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560506+0000","last_change":"2024-05-27T06:27:38.604825+0000","last_active":"2024-05-27T06:27:45.560506+0000","last_peered":"2024-05-27T06:27:45.560506+0000","last_clean":"2024-05-27T06:27:45.560506+0000","last_became_active":"2024-05-27T06:27:38.604493+0000","last_became_peered":"2024-05-27T06:27:38.604493+0000","last_unstale":"2024-05-27T06:27:45.560506+0000","last_undegraded":"2024-05-27T06:27:45.560506+0000","last_fullsized":"2024-05-27T06:27:45.560506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:35.349266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641191+0000","last_change":"2024-05-27T06:27:38.589333+0000","last_active":"2024-05-27T06:27:43.641191+0000","last_peered":"2024-05-27T06:27:43.641191+0000","last_clean":"2024-05-27T06:27:43.641191+0000","last_became_active":"2024-05-27T06:27:38.588557+0000","last_became_peered":"2024-05-27T06:27:38.588557+0000","last_unstale":"2024-05-27T06:27:43.641191+0000","last_undegraded":"2024-05-27T06:27:43.641191+0000","last_fullsized":"2024-05-27T06:27:43.641191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:04:46.051655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562481+0000","last_change":"2024-05-27T06:27:38.595781+0000","last_active":"2024-05-27T06:27:45.562481+0000","last_peered":"2024-05-27T06:27:45.562481+0000","last_clean":"2024-05-27T06:27:45.562481+0000","last_became_active":"2024-05-27T06:27:38.595427+0000","last_became_peered":"2024-05-27T06:27:38.595427+0000","last_unstale":"2024-05-27T06:27:45.562481+0000","last_undegraded":"2024-05-27T06:27:45.562481+0000","last_fullsized":"2024-05-27T06:27:45.562481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:21.569967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560183+0000","last_change":"2024-05-27T06:27:38.603388+0000","last_active":"2024-05-27T06:27:45.560183+0000","last_peered":"2024-05-27T06:27:45.560183+0000","last_clean":"2024-05-27T06:27:45.560183+0000","last_became_active":"2024-05-27T06:27:38.602534+0000","last_became_peered":"2024-05-27T06:27:38.602534+0000","last_unstale":"2024-05-27T06:27:45.560183+0000","last_undegraded":"2024-05-27T06:27:45.560183+0000","last_fullsized":"2024-05-27T06:27:45.560183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:11:57.311912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.994752+0000","last_change":"2024-05-27T06:27:38.597804+0000","last_active":"2024-05-27T06:27:44.994752+0000","last_peered":"2024-05-27T06:27:44.994752+0000","last_clean":"2024-05-27T06:27:44.994752+0000","last_became_active":"2024-05-27T06:27:38.597501+0000","last_became_peered":"2024-05-27T06:27:38.597501+0000","last_unstale":"2024-05-27T06:27:44.994752+0000","last_undegraded":"2024-05-27T06:27:44.994752+0000","last_fullsized":"2024-05-27T06:27:44.994752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:36:07.073192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698683+0000","last_change":"2024-05-27T06:27:38.595971+0000","last_active":"2024-05-27T06:27:44.698683+0000","last_peered":"2024-05-27T06:27:44.698683+0000","last_clean":"2024-05-27T06:27:44.698683+0000","last_became_active":"2024-05-27T06:27:38.595550+0000","last_became_peered":"2024-05-27T06:27:38.595550+0000","last_unstale":"2024-05-27T06:27:44.698683+0000","last_undegraded":"2024-05-27T06:27:44.698683+0000","last_fullsized":"2024-05-27T06:27:44.698683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:44:31.285463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136539+0000","last_change":"2024-05-27T06:27:38.587249+0000","last_active":"2024-05-27T06:27:45.136539+0000","last_peered":"2024-05-27T06:27:45.136539+0000","last_clean":"2024-05-27T06:27:45.136539+0000","last_became_active":"2024-05-27T06:27:38.586880+0000","last_became_peered":"2024-05-27T06:27:38.586880+0000","last_unstale":"2024-05-27T06:27:45.136539+0000","last_undegraded":"2024-05-27T06:27:45.136539+0000","last_fullsized":"2024-05-27T06:27:45.136539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:11:57.311912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641615+0000","last_change":"2024-05-27T06:27:38.588337+0000","last_active":"2024-05-27T06:27:43.641615+0000","last_peered":"2024-05-27T06:27:43.641615+0000","last_clean":"2024-05-27T06:27:43.641615+0000","last_became_active":"2024-05-27T06:27:38.587989+0000","last_became_peered":"2024-05-27T06:27:38.587989+0000","last_unstale":"2024-05-27T06:27:43.641615+0000","last_undegraded":"2024-05-27T06:27:43.641615+0000","last_fullsized":"2024-05-27T06:27:43.641615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:05:48.265820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560707+0000","last_change":"2024-05-27T06:27:38.589920+0000","last_active":"2024-05-27T06:27:45.560707+0000","last_peered":"2024-05-27T06:27:45.560707+0000","last_clean":"2024-05-27T06:27:45.560707+0000","last_became_active":"2024-05-27T06:27:38.588894+0000","last_became_peered":"2024-05-27T06:27:38.588894+0000","last_unstale":"2024-05-27T06:27:45.560707+0000","last_undegraded":"2024-05-27T06:27:45.560707+0000","last_fullsized":"2024-05-27T06:27:45.560707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:43:18.651541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560366+0000","last_change":"2024-05-27T06:27:38.589163+0000","last_active":"2024-05-27T06:27:45.560366+0000","last_peered":"2024-05-27T06:27:45.560366+0000","last_clean":"2024-05-27T06:27:45.560366+0000","last_became_active":"2024-05-27T06:27:38.588860+0000","last_became_peered":"2024-05-27T06:27:38.588860+0000","last_unstale":"2024-05-27T06:27:45.560366+0000","last_undegraded":"2024-05-27T06:27:45.560366+0000","last_fullsized":"2024-05-27T06:27:45.560366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:10:49.565828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561563+0000","last_change":"2024-05-27T06:27:38.592099+0000","last_active":"2024-05-27T06:27:45.561563+0000","last_peered":"2024-05-27T06:27:45.561563+0000","last_clean":"2024-05-27T06:27:45.561563+0000","last_became_active":"2024-05-27T06:27:38.591794+0000","last_became_peered":"2024-05-27T06:27:38.591794+0000","last_unstale":"2024-05-27T06:27:45.561563+0000","last_undegraded":"2024-05-27T06:27:45.561563+0000","last_fullsized":"2024-05-27T06:27:45.561563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:31:23.791324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136320+0000","last_change":"2024-05-27T06:27:38.591399+0000","last_active":"2024-05-27T06:27:45.136320+0000","last_peered":"2024-05-27T06:27:45.136320+0000","last_clean":"2024-05-27T06:27:45.136320+0000","last_became_active":"2024-05-27T06:27:38.591132+0000","last_became_peered":"2024-05-27T06:27:38.591132+0000","last_unstale":"2024-05-27T06:27:45.136320+0000","last_undegraded":"2024-05-27T06:27:45.136320+0000","last_fullsized":"2024-05-27T06:27:45.136320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:00:49.009171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560131+0000","last_change":"2024-05-27T06:27:38.606361+0000","last_active":"2024-05-27T06:27:45.560131+0000","last_peered":"2024-05-27T06:27:45.560131+0000","last_clean":"2024-05-27T06:27:45.560131+0000","last_became_active":"2024-05-27T06:27:38.605036+0000","last_became_peered":"2024-05-27T06:27:38.605036+0000","last_unstale":"2024-05-27T06:27:45.560131+0000","last_undegraded":"2024-05-27T06:27:45.560131+0000","last_fullsized":"2024-05-27T06:27:45.560131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:54:31.606702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561440+0000","last_change":"2024-05-27T06:27:38.594793+0000","last_active":"2024-05-27T06:27:45.561440+0000","last_peered":"2024-05-27T06:27:45.561440+0000","last_clean":"2024-05-27T06:27:45.561440+0000","last_became_active":"2024-05-27T06:27:38.594350+0000","last_became_peered":"2024-05-27T06:27:38.594350+0000","last_unstale":"2024-05-27T06:27:45.561440+0000","last_undegraded":"2024-05-27T06:27:45.561440+0000","last_fullsized":"2024-05-27T06:27:45.561440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:24:46.797590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560917+0000","last_change":"2024-05-27T06:27:38.600252+0000","last_active":"2024-05-27T06:27:45.560917+0000","last_peered":"2024-05-27T06:27:45.560917+0000","last_clean":"2024-05-27T06:27:45.560917+0000","last_became_active":"2024-05-27T06:27:38.599892+0000","last_became_peered":"2024-05-27T06:27:38.599892+0000","last_unstale":"2024-05-27T06:27:45.560917+0000","last_undegraded":"2024-05-27T06:27:45.560917+0000","last_fullsized":"2024-05-27T06:27:45.560917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:36:01.596426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561945+0000","last_change":"2024-05-27T06:27:38.595466+0000","last_active":"2024-05-27T06:27:45.561945+0000","last_peered":"2024-05-27T06:27:45.561945+0000","last_clean":"2024-05-27T06:27:45.561945+0000","last_became_active":"2024-05-27T06:27:38.593979+0000","last_became_peered":"2024-05-27T06:27:38.593979+0000","last_unstale":"2024-05-27T06:27:45.561945+0000","last_undegraded":"2024-05-27T06:27:45.561945+0000","last_fullsized":"2024-05-27T06:27:45.561945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:13:28.978589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698434+0000","last_change":"2024-05-27T06:27:38.581825+0000","last_active":"2024-05-27T06:27:44.698434+0000","last_peered":"2024-05-27T06:27:44.698434+0000","last_clean":"2024-05-27T06:27:44.698434+0000","last_became_active":"2024-05-27T06:27:38.580897+0000","last_became_peered":"2024-05-27T06:27:38.580897+0000","last_unstale":"2024-05-27T06:27:44.698434+0000","last_undegraded":"2024-05-27T06:27:44.698434+0000","last_fullsized":"2024-05-27T06:27:44.698434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:36:07.073192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995182+0000","last_change":"2024-05-27T06:27:38.596385+0000","last_active":"2024-05-27T06:27:44.995182+0000","last_peered":"2024-05-27T06:27:44.995182+0000","last_clean":"2024-05-27T06:27:44.995182+0000","last_became_active":"2024-05-27T06:27:38.595730+0000","last_became_peered":"2024-05-27T06:27:38.595730+0000","last_unstale":"2024-05-27T06:27:44.995182+0000","last_undegraded":"2024-05-27T06:27:44.995182+0000","last_fullsized":"2024-05-27T06:27:44.995182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:25:28.290431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561441+0000","last_change":"2024-05-27T06:27:38.591344+0000","last_active":"2024-05-27T06:27:45.561441+0000","last_peered":"2024-05-27T06:27:45.561441+0000","last_clean":"2024-05-27T06:27:45.561441+0000","last_became_active":"2024-05-27T06:27:38.591001+0000","last_became_peered":"2024-05-27T06:27:38.591001+0000","last_unstale":"2024-05-27T06:27:45.561441+0000","last_undegraded":"2024-05-27T06:27:45.561441+0000","last_fullsized":"2024-05-27T06:27:45.561441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:25.980330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T06:28:05.576 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T06:28:05.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.763+0000 7f3f89e00640 1 Processor -- start 2024-05-27T06:28:05.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.763+0000 7f3f89e00640 1 -- start start 2024-05-27T06:28:05.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.767+0000 7f3f89e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3f840b03c0 0x7f3f840cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:05.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.767+0000 7f3f89e00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f840d10f0 con 0x7f3f840af350 2024-05-27T06:28:05.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.767+0000 7f3f89e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f84160b90 con 0x7f3f840b07d0 2024-05-27T06:28:05.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.767+0000 7f3f89e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f3f8406d610 con 0x7f3f840b03c0 2024-05-27T06:28:05.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.767+0000 7f3f83400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f3f840af350 0x7f3f84160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:53774/0 (socket says 172.21.15.87:53774) 2024-05-27T06:28:05.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.767+0000 7f3f83400640 1 -- 172.21.15.87:0/1634480023 learned_addr learned my addr 172.21.15.87:0/1634480023 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:05.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.767+0000 7f3f82a00640 1 --2- 172.21.15.87:0/1634480023 >> v2:172.21.15.149:3300/0 conn(0x7f3f840b03c0 0x7f3f840cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:05.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.767+0000 7f3f82000640 1 -- 172.21.15.87:0/1634480023 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3903841132 0 0) 0x7f3f7c001120 con 0x7f3f840af350 2024-05-27T06:28:05.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.767+0000 7f3f82000640 1 -- 172.21.15.87:0/1634480023 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f68003450 con 0x7f3f840af350 2024-05-27T06:28:05.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.767+0000 7f3f82a00640 1 -- 172.21.15.87:0/1634480023 >> v1:172.21.15.149:6789/0 conn(0x7f3f840b07d0 legacy=0x7f3f8415fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.767+0000 7f3f82000640 1 -- 172.21.15.87:0/1634480023 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2049647306 0 0) 0x7f3f84160b90 con 0x7f3f840b07d0 2024-05-27T06:28:05.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.767+0000 7f3f82a00640 1 -- 172.21.15.87:0/1634480023 >> v1:172.21.15.87:6789/0 conn(0x7f3f840af350 legacy=0x7f3f84160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.767+0000 7f3f82a00640 1 -- 172.21.15.87:0/1634480023 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8406c720 con 0x7f3f840b03c0 2024-05-27T06:28:05.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.771+0000 7f3f82a00640 1 --2- 172.21.15.87:0/1634480023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f840b03c0 0x7f3f840cdd30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3f74009d90 tx=0x7f3f7401c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fc0b86f4c18ce24 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:05.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.771+0000 7f3f82000640 1 -- 172.21.15.87:0/1634480023 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f740b2070 con 0x7f3f840b03c0 2024-05-27T06:28:05.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.771+0000 7f3f82000640 1 -- 172.21.15.87:0/1634480023 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f740a5890 con 0x7f3f840b03c0 2024-05-27T06:28:05.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.771+0000 7f3f82000640 1 -- 172.21.15.87:0/1634480023 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f740a5c60 con 0x7f3f840b03c0 2024-05-27T06:28:05.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.771+0000 7f3f89e00640 1 -- 172.21.15.87:0/1634480023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f840b03c0 msgr2=0x7f3f840cdd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.771+0000 7f3f89e00640 1 --2- 172.21.15.87:0/1634480023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f840b03c0 0x7f3f840cdd30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3f74009d90 tx=0x7f3f7401c940 comp rx=0 tx=0).stop 2024-05-27T06:28:05.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.771+0000 7f3f89e00640 1 -- 172.21.15.87:0/1634480023 shutdown_connections 2024-05-27T06:28:05.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.771+0000 7f3f89e00640 1 --2- 172.21.15.87:0/1634480023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f840b03c0 0x7f3f840cdd30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.771+0000 7f3f89e00640 1 -- 172.21.15.87:0/1634480023 >> 172.21.15.87:0/1634480023 conn(0x7f3f840b46b0 msgr2=0x7f3f840b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:05.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.771+0000 7f3f89e00640 1 -- 172.21.15.87:0/1634480023 shutdown_connections 2024-05-27T06:28:05.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.771+0000 7f3f89e00640 1 -- 172.21.15.87:0/1634480023 wait complete. 2024-05-27T06:28:05.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.771+0000 7f3f89e00640 1 Processor -- start 2024-05-27T06:28:05.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.771+0000 7f3f89e00640 1 -- start start 2024-05-27T06:28:05.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.775+0000 7f3f89e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f840af350 0x7f3f8415f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:05.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.775+0000 7f3f89e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f840b03c0 0x7f3f8409a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:05.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.775+0000 7f3f89e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f840b07d0 0x7f3f84155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:05.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.775+0000 7f3f89e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8415c620 con 0x7f3f840b07d0 2024-05-27T06:28:05.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.775+0000 7f3f89e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8406d2a0 con 0x7f3f840b03c0 2024-05-27T06:28:05.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.775+0000 7f3f89e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3f8416a120 con 0x7f3f840af350 2024-05-27T06:28:05.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.775+0000 7f3f83400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f840b07d0 0x7f3f84155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:05.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.775+0000 7f3f83400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f840b07d0 0x7f3f84155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55360/0 (socket says 172.21.15.87:55360) 2024-05-27T06:28:05.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.775+0000 7f3f83400640 1 -- 172.21.15.87:0/563683079 learned_addr learned my addr 172.21.15.87:0/563683079 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:05.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.775+0000 7f3f82a00640 1 --2- 172.21.15.87:0/563683079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f840af350 0x7f3f8415f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:05.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.775+0000 7f3f7a000640 1 --2- 172.21.15.87:0/563683079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f840b03c0 0x7f3f8409a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:05.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.775+0000 7f3f83400640 1 -- 172.21.15.87:0/563683079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f840af350 msgr2=0x7f3f8415f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.775+0000 7f3f83400640 1 --2- 172.21.15.87:0/563683079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f840af350 0x7f3f8415f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.775+0000 7f3f83400640 1 -- 172.21.15.87:0/563683079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f840b03c0 msgr2=0x7f3f8409a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.775+0000 7f3f83400640 1 --2- 172.21.15.87:0/563683079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f840b03c0 0x7f3f8409a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.775+0000 7f3f83400640 1 -- 172.21.15.87:0/563683079 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f840c98d0 con 0x7f3f840b07d0 2024-05-27T06:28:05.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.775+0000 7f3f83400640 1 --2- 172.21.15.87:0/563683079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f840b07d0 0x7f3f84155370 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00c3c0 tx=0x7f3f7c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:05.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.775+0000 7f3f7be00640 1 -- 172.21.15.87:0/563683079 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c017070 con 0x7f3f840b07d0 2024-05-27T06:28:05.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.775+0000 7f3f7be00640 1 -- 172.21.15.87:0/563683079 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f7c005cf0 con 0x7f3f840b07d0 2024-05-27T06:28:05.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.775+0000 7f3f7be00640 1 -- 172.21.15.87:0/563683079 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c0072d0 con 0x7f3f840b07d0 2024-05-27T06:28:05.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.775+0000 7f3f89e00640 1 -- 172.21.15.87:0/563683079 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f840c9bb0 con 0x7f3f840b07d0 2024-05-27T06:28:05.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.775+0000 7f3f89e00640 1 -- 172.21.15.87:0/563683079 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f840ca170 con 0x7f3f840b07d0 2024-05-27T06:28:05.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.775+0000 7f3f89e00640 1 -- 172.21.15.87:0/563683079 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f8406aa30 con 0x7f3f840b07d0 2024-05-27T06:28:05.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.779+0000 7f3f7be00640 1 -- 172.21.15.87:0/563683079 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3f7c01a070 con 0x7f3f840b07d0 2024-05-27T06:28:05.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.779+0000 7f3f7be00640 1 --2- 172.21.15.87:0/563683079 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3f6006f400 0x7f3f60071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:05.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.779+0000 7f3f7be00640 1 -- 172.21.15.87:0/563683079 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3f7c08e810 con 0x7f3f840b07d0 2024-05-27T06:28:05.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.779+0000 7f3f82a00640 1 --2- 172.21.15.87:0/563683079 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3f6006f400 0x7f3f60071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:05.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.779+0000 7f3f82a00640 1 --2- 172.21.15.87:0/563683079 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3f6006f400 0x7f3f60071910 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3f740af000 tx=0x7f3f740a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:05.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.783+0000 7f3f7be00640 1 -- 172.21.15.87:0/563683079 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f3f840d10f0 con 0x7f3f840b07d0 2024-05-27T06:28:05.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.939+0000 7f3f89e00640 1 -- 172.21.15.87:0/563683079 --> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3f8406db70 con 0x7f3f6006f400 2024-05-27T06:28:05.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.947+0000 7f3f7be00640 1 -- 172.21.15.87:0/563683079 <== mgr.4111 v2:172.21.15.87:6832/2724754260 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332520 (secure 0 0 0) 0x7f3f8406db70 con 0x7f3f6006f400 2024-05-27T06:28:05.946 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:05.948 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-27T06:28:05.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.951+0000 7f3f89e00640 1 -- 172.21.15.87:0/563683079 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3f6006f400 msgr2=0x7f3f60071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.951+0000 7f3f89e00640 1 --2- 172.21.15.87:0/563683079 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3f6006f400 0x7f3f60071910 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3f740af000 tx=0x7f3f740a7070 comp rx=0 tx=0).stop 2024-05-27T06:28:05.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.951+0000 7f3f89e00640 1 -- 172.21.15.87:0/563683079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f840b07d0 msgr2=0x7f3f84155370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:05.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.951+0000 7f3f89e00640 1 --2- 172.21.15.87:0/563683079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f840b07d0 0x7f3f84155370 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00c3c0 tx=0x7f3f7c001e80 comp rx=0 tx=0).stop 2024-05-27T06:28:05.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.951+0000 7f3f89e00640 1 -- 172.21.15.87:0/563683079 shutdown_connections 2024-05-27T06:28:05.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.951+0000 7f3f89e00640 1 --2- 172.21.15.87:0/563683079 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3f6006f400 0x7f3f60071910 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.951+0000 7f3f89e00640 1 --2- 172.21.15.87:0/563683079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f840b07d0 0x7f3f84155370 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.951+0000 7f3f89e00640 1 --2- 172.21.15.87:0/563683079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f840b03c0 0x7f3f8409a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.951+0000 7f3f89e00640 1 --2- 172.21.15.87:0/563683079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f840af350 0x7f3f8415f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:05.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.951+0000 7f3f89e00640 1 -- 172.21.15.87:0/563683079 >> 172.21.15.87:0/563683079 conn(0x7f3f840b46b0 msgr2=0x7f3f840ae190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:05.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.951+0000 7f3f89e00640 1 -- 172.21.15.87:0/563683079 shutdown_connections 2024-05-27T06:28:05.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:05.951+0000 7f3f89e00640 1 -- 172.21.15.87:0/563683079 wait complete. 2024-05-27T06:28:05.966 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-05-27T06:28:04.572352+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219372,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755348,"statfs":{"total":773094113280,"available":772869476352,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006833"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.699021+0000","last_change":"2024-05-27T06:27:37.599201+0000","last_active":"2024-05-27T06:27:44.699021+0000","last_peered":"2024-05-27T06:27:44.699021+0000","last_clean":"2024-05-27T06:27:44.699021+0000","last_became_active":"2024-05-27T06:27:37.598882+0000","last_became_peered":"2024-05-27T06:27:37.598882+0000","last_unstale":"2024-05-27T06:27:44.699021+0000","last_undegraded":"2024-05-27T06:27:44.699021+0000","last_fullsized":"2024-05-27T06:27:44.699021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:13:32.135455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.137061+0000","last_change":"2024-05-27T06:27:38.587525+0000","last_active":"2024-05-27T06:27:45.137061+0000","last_peered":"2024-05-27T06:27:45.137061+0000","last_clean":"2024-05-27T06:27:45.137061+0000","last_became_active":"2024-05-27T06:27:38.586949+0000","last_became_peered":"2024-05-27T06:27:38.586949+0000","last_unstale":"2024-05-27T06:27:45.137061+0000","last_undegraded":"2024-05-27T06:27:45.137061+0000","last_fullsized":"2024-05-27T06:27:45.137061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:24:46.797590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136334+0000","last_change":"2024-05-27T06:27:42.674258+0000","last_active":"2024-05-27T06:27:45.136334+0000","last_peered":"2024-05-27T06:27:45.136334+0000","last_clean":"2024-05-27T06:27:45.136334+0000","last_became_active":"2024-05-27T06:27:42.673626+0000","last_became_peered":"2024-05-27T06:27:42.673626+0000","last_unstale":"2024-05-27T06:27:45.136334+0000","last_undegraded":"2024-05-27T06:27:45.136334+0000","last_fullsized":"2024-05-27T06:27:45.136334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:29:26.664564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.137215+0000","last_change":"2024-05-27T06:27:37.598836+0000","last_active":"2024-05-27T06:27:45.137215+0000","last_peered":"2024-05-27T06:27:45.137215+0000","last_clean":"2024-05-27T06:27:45.137215+0000","last_became_active":"2024-05-27T06:27:37.598483+0000","last_became_peered":"2024-05-27T06:27:37.598483+0000","last_unstale":"2024-05-27T06:27:45.137215+0000","last_undegraded":"2024-05-27T06:27:45.137215+0000","last_fullsized":"2024-05-27T06:27:45.137215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:06:32.803214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698842+0000","last_change":"2024-05-27T06:27:38.590652+0000","last_active":"2024-05-27T06:27:44.698842+0000","last_peered":"2024-05-27T06:27:44.698842+0000","last_clean":"2024-05-27T06:27:44.698842+0000","last_became_active":"2024-05-27T06:27:38.590399+0000","last_became_peered":"2024-05-27T06:27:38.590399+0000","last_unstale":"2024-05-27T06:27:44.698842+0000","last_undegraded":"2024-05-27T06:27:44.698842+0000","last_fullsized":"2024-05-27T06:27:44.698842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:11:57.311912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641217+0000","last_change":"2024-05-27T06:27:42.678002+0000","last_active":"2024-05-27T06:27:43.641217+0000","last_peered":"2024-05-27T06:27:43.641217+0000","last_clean":"2024-05-27T06:27:43.641217+0000","last_became_active":"2024-05-27T06:27:42.672687+0000","last_became_peered":"2024-05-27T06:27:42.672687+0000","last_unstale":"2024-05-27T06:27:43.641217+0000","last_undegraded":"2024-05-27T06:27:43.641217+0000","last_fullsized":"2024-05-27T06:27:43.641217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:24:50.868712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560389+0000","last_change":"2024-05-27T06:27:37.593814+0000","last_active":"2024-05-27T06:27:45.560389+0000","last_peered":"2024-05-27T06:27:45.560389+0000","last_clean":"2024-05-27T06:27:45.560389+0000","last_became_active":"2024-05-27T06:27:37.593466+0000","last_became_peered":"2024-05-27T06:27:37.593466+0000","last_unstale":"2024-05-27T06:27:45.560389+0000","last_undegraded":"2024-05-27T06:27:45.560389+0000","last_fullsized":"2024-05-27T06:27:45.560389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:26:32.568342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562028+0000","last_change":"2024-05-27T06:27:38.601653+0000","last_active":"2024-05-27T06:27:45.562028+0000","last_peered":"2024-05-27T06:27:45.562028+0000","last_clean":"2024-05-27T06:27:45.562028+0000","last_became_active":"2024-05-27T06:27:38.601248+0000","last_became_peered":"2024-05-27T06:27:38.601248+0000","last_unstale":"2024-05-27T06:27:45.562028+0000","last_undegraded":"2024-05-27T06:27:45.562028+0000","last_fullsized":"2024-05-27T06:27:45.562028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:53.536742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641377+0000","last_change":"2024-05-27T06:27:42.676302+0000","last_active":"2024-05-27T06:27:43.641377+0000","last_peered":"2024-05-27T06:27:43.641377+0000","last_clean":"2024-05-27T06:27:43.641377+0000","last_became_active":"2024-05-27T06:27:42.673036+0000","last_became_peered":"2024-05-27T06:27:42.673036+0000","last_unstale":"2024-05-27T06:27:43.641377+0000","last_undegraded":"2024-05-27T06:27:43.641377+0000","last_fullsized":"2024-05-27T06:27:43.641377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:25:34.504656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560872+0000","last_change":"2024-05-27T06:27:37.599394+0000","last_active":"2024-05-27T06:27:45.560872+0000","last_peered":"2024-05-27T06:27:45.560872+0000","last_clean":"2024-05-27T06:27:45.560872+0000","last_became_active":"2024-05-27T06:27:37.598995+0000","last_became_peered":"2024-05-27T06:27:37.598995+0000","last_unstale":"2024-05-27T06:27:45.560872+0000","last_undegraded":"2024-05-27T06:27:45.560872+0000","last_fullsized":"2024-05-27T06:27:45.560872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:05:47.256329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562108+0000","last_change":"2024-05-27T06:27:38.595082+0000","last_active":"2024-05-27T06:27:45.562108+0000","last_peered":"2024-05-27T06:27:45.562108+0000","last_clean":"2024-05-27T06:27:45.562108+0000","last_became_active":"2024-05-27T06:27:38.594761+0000","last_became_peered":"2024-05-27T06:27:38.594761+0000","last_unstale":"2024-05-27T06:27:45.562108+0000","last_undegraded":"2024-05-27T06:27:45.562108+0000","last_fullsized":"2024-05-27T06:27:45.562108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:35.349266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641123+0000","last_change":"2024-05-27T06:27:42.657602+0000","last_active":"2024-05-27T06:27:43.641123+0000","last_peered":"2024-05-27T06:27:43.641123+0000","last_clean":"2024-05-27T06:27:43.641123+0000","last_became_active":"2024-05-27T06:27:42.657080+0000","last_became_peered":"2024-05-27T06:27:42.657080+0000","last_unstale":"2024-05-27T06:27:43.641123+0000","last_undegraded":"2024-05-27T06:27:43.641123+0000","last_fullsized":"2024-05-27T06:27:43.641123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:25:32.361553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561325+0000","last_change":"2024-05-27T06:27:38.588664+0000","last_active":"2024-05-27T06:27:45.561325+0000","last_peered":"2024-05-27T06:27:45.561325+0000","last_clean":"2024-05-27T06:27:45.561325+0000","last_became_active":"2024-05-27T06:27:38.588190+0000","last_became_peered":"2024-05-27T06:27:38.588190+0000","last_unstale":"2024-05-27T06:27:45.561325+0000","last_undegraded":"2024-05-27T06:27:45.561325+0000","last_fullsized":"2024-05-27T06:27:45.561325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:36:07.073192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561221+0000","last_change":"2024-05-27T06:27:37.593763+0000","last_active":"2024-05-27T06:27:45.561221+0000","last_peered":"2024-05-27T06:27:45.561221+0000","last_clean":"2024-05-27T06:27:45.561221+0000","last_became_active":"2024-05-27T06:27:37.593401+0000","last_became_peered":"2024-05-27T06:27:37.593401+0000","last_unstale":"2024-05-27T06:27:45.561221+0000","last_undegraded":"2024-05-27T06:27:45.561221+0000","last_fullsized":"2024-05-27T06:27:45.561221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:10.389223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.642016+0000","last_change":"2024-05-27T06:27:42.673785+0000","last_active":"2024-05-27T06:27:43.642016+0000","last_peered":"2024-05-27T06:27:43.642016+0000","last_clean":"2024-05-27T06:27:43.642016+0000","last_became_active":"2024-05-27T06:27:42.673292+0000","last_became_peered":"2024-05-27T06:27:42.673292+0000","last_unstale":"2024-05-27T06:27:43.642016+0000","last_undegraded":"2024-05-27T06:27:43.642016+0000","last_fullsized":"2024-05-27T06:27:43.642016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:30.051452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136563+0000","last_change":"2024-05-27T06:27:38.618042+0000","last_active":"2024-05-27T06:27:45.136563+0000","last_peered":"2024-05-27T06:27:45.136563+0000","last_clean":"2024-05-27T06:27:45.136563+0000","last_became_active":"2024-05-27T06:27:38.617706+0000","last_became_peered":"2024-05-27T06:27:38.617706+0000","last_unstale":"2024-05-27T06:27:45.136563+0000","last_undegraded":"2024-05-27T06:27:45.136563+0000","last_fullsized":"2024-05-27T06:27:45.136563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:25:28.290431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995400+0000","last_change":"2024-05-27T06:27:37.597113+0000","last_active":"2024-05-27T06:27:44.995400+0000","last_peered":"2024-05-27T06:27:44.995400+0000","last_clean":"2024-05-27T06:27:44.995400+0000","last_became_active":"2024-05-27T06:27:37.596735+0000","last_became_peered":"2024-05-27T06:27:37.596735+0000","last_unstale":"2024-05-27T06:27:44.995400+0000","last_undegraded":"2024-05-27T06:27:44.995400+0000","last_fullsized":"2024-05-27T06:27:44.995400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:39:09.133451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641559+0000","last_change":"2024-05-27T06:27:42.685192+0000","last_active":"2024-05-27T06:27:43.641559+0000","last_peered":"2024-05-27T06:27:43.641559+0000","last_clean":"2024-05-27T06:27:43.641559+0000","last_became_active":"2024-05-27T06:27:42.684722+0000","last_became_peered":"2024-05-27T06:27:42.684722+0000","last_unstale":"2024-05-27T06:27:43.641559+0000","last_undegraded":"2024-05-27T06:27:43.641559+0000","last_fullsized":"2024-05-27T06:27:43.641559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:29:09.440505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136801+0000","last_change":"2024-05-27T06:27:38.617808+0000","last_active":"2024-05-27T06:27:45.136801+0000","last_peered":"2024-05-27T06:27:45.136801+0000","last_clean":"2024-05-27T06:27:45.136801+0000","last_became_active":"2024-05-27T06:27:38.617484+0000","last_became_peered":"2024-05-27T06:27:38.617484+0000","last_unstale":"2024-05-27T06:27:45.136801+0000","last_undegraded":"2024-05-27T06:27:45.136801+0000","last_fullsized":"2024-05-27T06:27:45.136801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:43:18.651541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.994806+0000","last_change":"2024-05-27T06:27:37.600205+0000","last_active":"2024-05-27T06:27:44.994806+0000","last_peered":"2024-05-27T06:27:44.994806+0000","last_clean":"2024-05-27T06:27:44.994806+0000","last_became_active":"2024-05-27T06:27:37.599877+0000","last_became_peered":"2024-05-27T06:27:37.599877+0000","last_unstale":"2024-05-27T06:27:44.994806+0000","last_undegraded":"2024-05-27T06:27:44.994806+0000","last_fullsized":"2024-05-27T06:27:44.994806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:49:54.332511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995252+0000","last_change":"2024-05-27T06:27:42.673409+0000","last_active":"2024-05-27T06:27:44.995252+0000","last_peered":"2024-05-27T06:27:44.995252+0000","last_clean":"2024-05-27T06:27:44.995252+0000","last_became_active":"2024-05-27T06:27:42.672637+0000","last_became_peered":"2024-05-27T06:27:42.672637+0000","last_unstale":"2024-05-27T06:27:44.995252+0000","last_undegraded":"2024-05-27T06:27:44.995252+0000","last_fullsized":"2024-05-27T06:27:44.995252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:25.641088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641351+0000","last_change":"2024-05-27T06:27:38.587029+0000","last_active":"2024-05-27T06:27:43.641351+0000","last_peered":"2024-05-27T06:27:43.641351+0000","last_clean":"2024-05-27T06:27:43.641351+0000","last_became_active":"2024-05-27T06:27:38.586798+0000","last_became_peered":"2024-05-27T06:27:38.586798+0000","last_unstale":"2024-05-27T06:27:43.641351+0000","last_undegraded":"2024-05-27T06:27:43.641351+0000","last_fullsized":"2024-05-27T06:27:43.641351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:28.542049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561027+0000","last_change":"2024-05-27T06:27:37.585479+0000","last_active":"2024-05-27T06:27:45.561027+0000","last_peered":"2024-05-27T06:27:45.561027+0000","last_clean":"2024-05-27T06:27:45.561027+0000","last_became_active":"2024-05-27T06:27:37.585196+0000","last_became_peered":"2024-05-27T06:27:37.585196+0000","last_unstale":"2024-05-27T06:27:45.561027+0000","last_undegraded":"2024-05-27T06:27:45.561027+0000","last_fullsized":"2024-05-27T06:27:45.561027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:39:09.133451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641758+0000","last_change":"2024-05-27T06:27:42.673356+0000","last_active":"2024-05-27T06:27:43.641758+0000","last_peered":"2024-05-27T06:27:43.641758+0000","last_clean":"2024-05-27T06:27:43.641758+0000","last_became_active":"2024-05-27T06:27:42.672313+0000","last_became_peered":"2024-05-27T06:27:42.672313+0000","last_unstale":"2024-05-27T06:27:43.641758+0000","last_undegraded":"2024-05-27T06:27:43.641758+0000","last_fullsized":"2024-05-27T06:27:43.641758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:13:33.049711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.699037+0000","last_change":"2024-05-27T06:27:38.594812+0000","last_active":"2024-05-27T06:27:44.699037+0000","last_peered":"2024-05-27T06:27:44.699037+0000","last_clean":"2024-05-27T06:27:44.699037+0000","last_became_active":"2024-05-27T06:27:38.594510+0000","last_became_peered":"2024-05-27T06:27:38.594510+0000","last_unstale":"2024-05-27T06:27:44.699037+0000","last_undegraded":"2024-05-27T06:27:44.699037+0000","last_fullsized":"2024-05-27T06:27:44.699037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:47.314366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560621+0000","last_change":"2024-05-27T06:27:37.593100+0000","last_active":"2024-05-27T06:27:45.560621+0000","last_peered":"2024-05-27T06:27:45.560621+0000","last_clean":"2024-05-27T06:27:45.560621+0000","last_became_active":"2024-05-27T06:27:37.592805+0000","last_became_peered":"2024-05-27T06:27:37.592805+0000","last_unstale":"2024-05-27T06:27:45.560621+0000","last_undegraded":"2024-05-27T06:27:45.560621+0000","last_fullsized":"2024-05-27T06:27:45.560621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:27.532558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641244+0000","last_change":"2024-05-27T06:27:42.674749+0000","last_active":"2024-05-27T06:27:43.641244+0000","last_peered":"2024-05-27T06:27:43.641244+0000","last_clean":"2024-05-27T06:27:43.641244+0000","last_became_active":"2024-05-27T06:27:42.674306+0000","last_became_peered":"2024-05-27T06:27:42.674306+0000","last_unstale":"2024-05-27T06:27:43.641244+0000","last_undegraded":"2024-05-27T06:27:43.641244+0000","last_fullsized":"2024-05-27T06:27:43.641244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:36:05.667548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.137291+0000","last_change":"2024-05-27T06:27:38.600218+0000","last_active":"2024-05-27T06:27:45.137291+0000","last_peered":"2024-05-27T06:27:45.137291+0000","last_clean":"2024-05-27T06:27:45.137291+0000","last_became_active":"2024-05-27T06:27:38.599796+0000","last_became_peered":"2024-05-27T06:27:38.599796+0000","last_unstale":"2024-05-27T06:27:45.137291+0000","last_undegraded":"2024-05-27T06:27:45.137291+0000","last_fullsized":"2024-05-27T06:27:45.137291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:25:30.433535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995470+0000","last_change":"2024-05-27T06:27:37.594420+0000","last_active":"2024-05-27T06:27:44.995470+0000","last_peered":"2024-05-27T06:27:44.995470+0000","last_clean":"2024-05-27T06:27:44.995470+0000","last_became_active":"2024-05-27T06:27:37.593946+0000","last_became_peered":"2024-05-27T06:27:37.593946+0000","last_unstale":"2024-05-27T06:27:44.995470+0000","last_undegraded":"2024-05-27T06:27:44.995470+0000","last_fullsized":"2024-05-27T06:27:44.995470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:26:32.568342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136310+0000","last_change":"2024-05-27T06:27:42.685574+0000","last_active":"2024-05-27T06:27:45.136310+0000","last_peered":"2024-05-27T06:27:45.136310+0000","last_clean":"2024-05-27T06:27:45.136310+0000","last_became_active":"2024-05-27T06:27:42.685158+0000","last_became_peered":"2024-05-27T06:27:42.685158+0000","last_unstale":"2024-05-27T06:27:45.136310+0000","last_undegraded":"2024-05-27T06:27:45.136310+0000","last_fullsized":"2024-05-27T06:27:45.136310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:21:58.228721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995447+0000","last_change":"2024-05-27T06:27:38.609767+0000","last_active":"2024-05-27T06:27:44.995447+0000","last_peered":"2024-05-27T06:27:44.995447+0000","last_clean":"2024-05-27T06:27:44.995447+0000","last_became_active":"2024-05-27T06:27:38.603315+0000","last_became_peered":"2024-05-27T06:27:38.603315+0000","last_unstale":"2024-05-27T06:27:44.995447+0000","last_undegraded":"2024-05-27T06:27:44.995447+0000","last_fullsized":"2024-05-27T06:27:44.995447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:47.314366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560615+0000","last_change":"2024-05-27T06:27:37.599180+0000","last_active":"2024-05-27T06:27:45.560615+0000","last_peered":"2024-05-27T06:27:45.560615+0000","last_clean":"2024-05-27T06:27:45.560615+0000","last_became_active":"2024-05-27T06:27:37.598944+0000","last_became_peered":"2024-05-27T06:27:37.598944+0000","last_unstale":"2024-05-27T06:27:45.560615+0000","last_undegraded":"2024-05-27T06:27:45.560615+0000","last_fullsized":"2024-05-27T06:27:45.560615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:49:54.332511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698527+0000","last_change":"2024-05-27T06:27:42.676516+0000","last_active":"2024-05-27T06:27:44.698527+0000","last_peered":"2024-05-27T06:27:44.698527+0000","last_clean":"2024-05-27T06:27:44.698527+0000","last_became_active":"2024-05-27T06:27:42.674971+0000","last_became_peered":"2024-05-27T06:27:42.674971+0000","last_unstale":"2024-05-27T06:27:44.698527+0000","last_undegraded":"2024-05-27T06:27:44.698527+0000","last_fullsized":"2024-05-27T06:27:44.698527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:31:27.862446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562261+0000","last_change":"2024-05-27T06:27:38.596128+0000","last_active":"2024-05-27T06:27:45.562261+0000","last_peered":"2024-05-27T06:27:45.562261+0000","last_clean":"2024-05-27T06:27:45.562261+0000","last_became_active":"2024-05-27T06:27:38.595919+0000","last_became_peered":"2024-05-27T06:27:38.595919+0000","last_unstale":"2024-05-27T06:27:45.562261+0000","last_undegraded":"2024-05-27T06:27:45.562261+0000","last_fullsized":"2024-05-27T06:27:45.562261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:31:23.791324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995552+0000","last_change":"2024-05-27T06:27:37.593456+0000","last_active":"2024-05-27T06:27:44.995552+0000","last_peered":"2024-05-27T06:27:44.995552+0000","last_clean":"2024-05-27T06:27:44.995552+0000","last_became_active":"2024-05-27T06:27:37.592873+0000","last_became_peered":"2024-05-27T06:27:37.592873+0000","last_unstale":"2024-05-27T06:27:44.995552+0000","last_undegraded":"2024-05-27T06:27:44.995552+0000","last_fullsized":"2024-05-27T06:27:44.995552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:05:47.256329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.994952+0000","last_change":"2024-05-27T06:27:42.678385+0000","last_active":"2024-05-27T06:27:44.994952+0000","last_peered":"2024-05-27T06:27:44.994952+0000","last_clean":"2024-05-27T06:27:44.994952+0000","last_became_active":"2024-05-27T06:27:42.677822+0000","last_became_peered":"2024-05-27T06:27:42.677822+0000","last_unstale":"2024-05-27T06:27:44.994952+0000","last_undegraded":"2024-05-27T06:27:44.994952+0000","last_fullsized":"2024-05-27T06:27:44.994952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:31:27.862446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641909+0000","last_change":"2024-05-27T06:27:38.579066+0000","last_active":"2024-05-27T06:27:43.641909+0000","last_peered":"2024-05-27T06:27:43.641909+0000","last_clean":"2024-05-27T06:27:43.641909+0000","last_became_active":"2024-05-27T06:27:38.577426+0000","last_became_peered":"2024-05-27T06:27:38.577426+0000","last_unstale":"2024-05-27T06:27:43.641909+0000","last_undegraded":"2024-05-27T06:27:43.641909+0000","last_fullsized":"2024-05-27T06:27:43.641909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:11.398713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561828+0000","last_change":"2024-05-27T06:27:37.601204+0000","last_active":"2024-05-27T06:27:45.561828+0000","last_peered":"2024-05-27T06:27:45.561828+0000","last_clean":"2024-05-27T06:27:45.561828+0000","last_became_active":"2024-05-27T06:27:37.599178+0000","last_became_peered":"2024-05-27T06:27:37.599178+0000","last_unstale":"2024-05-27T06:27:45.561828+0000","last_undegraded":"2024-05-27T06:27:45.561828+0000","last_fullsized":"2024-05-27T06:27:45.561828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:10.389223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995594+0000","last_change":"2024-05-27T06:27:42.672415+0000","last_active":"2024-05-27T06:27:44.995594+0000","last_peered":"2024-05-27T06:27:44.995594+0000","last_clean":"2024-05-27T06:27:44.995594+0000","last_became_active":"2024-05-27T06:27:42.671247+0000","last_became_peered":"2024-05-27T06:27:42.671247+0000","last_unstale":"2024-05-27T06:27:44.995594+0000","last_undegraded":"2024-05-27T06:27:44.995594+0000","last_fullsized":"2024-05-27T06:27:44.995594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:21:58.228721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.994829+0000","last_change":"2024-05-27T06:27:38.601418+0000","last_active":"2024-05-27T06:27:44.994829+0000","last_peered":"2024-05-27T06:27:44.994829+0000","last_clean":"2024-05-27T06:27:44.994829+0000","last_became_active":"2024-05-27T06:27:38.600709+0000","last_became_peered":"2024-05-27T06:27:38.600709+0000","last_unstale":"2024-05-27T06:27:44.994829+0000","last_undegraded":"2024-05-27T06:27:44.994829+0000","last_fullsized":"2024-05-27T06:27:44.994829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:10:49.565828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.640446+0000","last_change":"2024-05-27T06:27:37.597493+0000","last_active":"2024-05-27T06:27:43.640446+0000","last_peered":"2024-05-27T06:27:43.640446+0000","last_clean":"2024-05-27T06:27:43.640446+0000","last_became_active":"2024-05-27T06:27:37.597007+0000","last_became_peered":"2024-05-27T06:27:37.597007+0000","last_unstale":"2024-05-27T06:27:43.640446+0000","last_undegraded":"2024-05-27T06:27:43.640446+0000","last_fullsized":"2024-05-27T06:27:43.640446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:39:09.133451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995343+0000","last_change":"2024-05-27T06:27:42.672189+0000","last_active":"2024-05-27T06:27:44.995343+0000","last_peered":"2024-05-27T06:27:44.995343+0000","last_clean":"2024-05-27T06:27:44.995343+0000","last_became_active":"2024-05-27T06:27:42.671679+0000","last_became_peered":"2024-05-27T06:27:42.671679+0000","last_unstale":"2024-05-27T06:27:44.995343+0000","last_undegraded":"2024-05-27T06:27:44.995343+0000","last_fullsized":"2024-05-27T06:27:44.995343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:56:11.868706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698082+0000","last_change":"2024-05-27T06:27:38.579100+0000","last_active":"2024-05-27T06:27:44.698082+0000","last_peered":"2024-05-27T06:27:44.698082+0000","last_clean":"2024-05-27T06:27:44.698082+0000","last_became_active":"2024-05-27T06:27:38.578133+0000","last_became_peered":"2024-05-27T06:27:38.578133+0000","last_unstale":"2024-05-27T06:27:44.698082+0000","last_undegraded":"2024-05-27T06:27:44.698082+0000","last_fullsized":"2024-05-27T06:27:44.698082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:52:56.162405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561032+0000","last_change":"2024-05-27T06:27:37.589413+0000","last_active":"2024-05-27T06:27:45.561032+0000","last_peered":"2024-05-27T06:27:45.561032+0000","last_clean":"2024-05-27T06:27:45.561032+0000","last_became_active":"2024-05-27T06:27:37.589095+0000","last_became_peered":"2024-05-27T06:27:37.589095+0000","last_unstale":"2024-05-27T06:27:45.561032+0000","last_undegraded":"2024-05-27T06:27:45.561032+0000","last_fullsized":"2024-05-27T06:27:45.561032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:27.532558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698947+0000","last_change":"2024-05-27T06:27:42.672540+0000","last_active":"2024-05-27T06:27:44.698947+0000","last_peered":"2024-05-27T06:27:44.698947+0000","last_clean":"2024-05-27T06:27:44.698947+0000","last_became_active":"2024-05-27T06:27:42.672001+0000","last_became_peered":"2024-05-27T06:27:42.672001+0000","last_unstale":"2024-05-27T06:27:44.698947+0000","last_undegraded":"2024-05-27T06:27:44.698947+0000","last_fullsized":"2024-05-27T06:27:44.698947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:56:11.868706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136536+0000","last_change":"2024-05-27T06:27:38.592046+0000","last_active":"2024-05-27T06:27:45.136536+0000","last_peered":"2024-05-27T06:27:45.136536+0000","last_clean":"2024-05-27T06:27:45.136536+0000","last_became_active":"2024-05-27T06:27:38.591693+0000","last_became_peered":"2024-05-27T06:27:38.591693+0000","last_unstale":"2024-05-27T06:27:45.136536+0000","last_undegraded":"2024-05-27T06:27:45.136536+0000","last_fullsized":"2024-05-27T06:27:45.136536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:10:49.565828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561713+0000","last_change":"2024-05-27T06:27:37.588339+0000","last_active":"2024-05-27T06:27:45.561713+0000","last_peered":"2024-05-27T06:27:45.561713+0000","last_clean":"2024-05-27T06:27:45.561713+0000","last_became_active":"2024-05-27T06:27:37.587997+0000","last_became_peered":"2024-05-27T06:27:37.587997+0000","last_unstale":"2024-05-27T06:27:45.561713+0000","last_undegraded":"2024-05-27T06:27:45.561713+0000","last_fullsized":"2024-05-27T06:27:45.561713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:05:47.256329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561179+0000","last_change":"2024-05-27T06:27:28.692457+0000","last_active":"2024-05-27T06:27:45.561179+0000","last_peered":"2024-05-27T06:27:45.561179+0000","last_clean":"2024-05-27T06:27:45.561179+0000","last_became_active":"2024-05-27T06:27:28.691290+0000","last_became_peered":"2024-05-27T06:27:28.691290+0000","last_unstale":"2024-05-27T06:27:45.561179+0000","last_undegraded":"2024-05-27T06:27:45.561179+0000","last_fullsized":"2024-05-27T06:27:45.561179+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_clean_scrub_stamp":"2024-05-27T06:27:26.991915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:45.563728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559963+0000","last_change":"2024-05-27T06:27:42.675952+0000","last_active":"2024-05-27T06:27:45.559963+0000","last_peered":"2024-05-27T06:27:45.559963+0000","last_clean":"2024-05-27T06:27:45.559963+0000","last_became_active":"2024-05-27T06:27:42.675456+0000","last_became_peered":"2024-05-27T06:27:42.675456+0000","last_unstale":"2024-05-27T06:27:45.559963+0000","last_undegraded":"2024-05-27T06:27:45.559963+0000","last_fullsized":"2024-05-27T06:27:45.559963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:30.051452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560151+0000","last_change":"2024-05-27T06:27:38.594241+0000","last_active":"2024-05-27T06:27:45.560151+0000","last_peered":"2024-05-27T06:27:45.560151+0000","last_clean":"2024-05-27T06:27:45.560151+0000","last_became_active":"2024-05-27T06:27:38.593947+0000","last_became_peered":"2024-05-27T06:27:38.593947+0000","last_unstale":"2024-05-27T06:27:45.560151+0000","last_undegraded":"2024-05-27T06:27:45.560151+0000","last_fullsized":"2024-05-27T06:27:45.560151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:53.536742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641007+0000","last_change":"2024-05-27T06:27:37.591342+0000","last_active":"2024-05-27T06:27:43.641007+0000","last_peered":"2024-05-27T06:27:43.641007+0000","last_clean":"2024-05-27T06:27:43.641007+0000","last_became_active":"2024-05-27T06:27:37.591027+0000","last_became_peered":"2024-05-27T06:27:37.591027+0000","last_unstale":"2024-05-27T06:27:43.641007+0000","last_undegraded":"2024-05-27T06:27:43.641007+0000","last_fullsized":"2024-05-27T06:27:43.641007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:27.532558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559661+0000","last_change":"2024-05-27T06:27:42.681211+0000","last_active":"2024-05-27T06:27:45.559661+0000","last_peered":"2024-05-27T06:27:45.559661+0000","last_clean":"2024-05-27T06:27:45.559661+0000","last_became_active":"2024-05-27T06:27:42.680695+0000","last_became_peered":"2024-05-27T06:27:42.680695+0000","last_unstale":"2024-05-27T06:27:45.559661+0000","last_undegraded":"2024-05-27T06:27:45.559661+0000","last_fullsized":"2024-05-27T06:27:45.559661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:57.607864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562099+0000","last_change":"2024-05-27T06:27:38.596719+0000","last_active":"2024-05-27T06:27:45.562099+0000","last_peered":"2024-05-27T06:27:45.562099+0000","last_clean":"2024-05-27T06:27:45.562099+0000","last_became_active":"2024-05-27T06:27:38.596458+0000","last_became_peered":"2024-05-27T06:27:38.596458+0000","last_unstale":"2024-05-27T06:27:45.562099+0000","last_undegraded":"2024-05-27T06:27:45.562099+0000","last_fullsized":"2024-05-27T06:27:45.562099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:25.980330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995382+0000","last_change":"2024-05-27T06:27:37.587248+0000","last_active":"2024-05-27T06:27:44.995382+0000","last_peered":"2024-05-27T06:27:44.995382+0000","last_clean":"2024-05-27T06:27:44.995382+0000","last_became_active":"2024-05-27T06:27:37.586914+0000","last_became_peered":"2024-05-27T06:27:37.586914+0000","last_unstale":"2024-05-27T06:27:44.995382+0000","last_undegraded":"2024-05-27T06:27:44.995382+0000","last_fullsized":"2024-05-27T06:27:44.995382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:10.389223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698571+0000","last_change":"2024-05-27T06:27:42.674862+0000","last_active":"2024-05-27T06:27:44.698571+0000","last_peered":"2024-05-27T06:27:44.698571+0000","last_clean":"2024-05-27T06:27:44.698571+0000","last_became_active":"2024-05-27T06:27:42.674435+0000","last_became_peered":"2024-05-27T06:27:42.674435+0000","last_unstale":"2024-05-27T06:27:44.698571+0000","last_undegraded":"2024-05-27T06:27:44.698571+0000","last_fullsized":"2024-05-27T06:27:44.698571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:25.641088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561573+0000","last_change":"2024-05-27T06:27:38.593263+0000","last_active":"2024-05-27T06:27:45.561573+0000","last_peered":"2024-05-27T06:27:45.561573+0000","last_clean":"2024-05-27T06:27:45.561573+0000","last_became_active":"2024-05-27T06:27:38.592852+0000","last_became_peered":"2024-05-27T06:27:38.592852+0000","last_unstale":"2024-05-27T06:27:45.561573+0000","last_undegraded":"2024-05-27T06:27:45.561573+0000","last_fullsized":"2024-05-27T06:27:45.561573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:21.569967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641310+0000","last_change":"2024-05-27T06:27:37.599453+0000","last_active":"2024-05-27T06:27:43.641310+0000","last_peered":"2024-05-27T06:27:43.641310+0000","last_clean":"2024-05-27T06:27:43.641310+0000","last_became_active":"2024-05-27T06:27:37.599122+0000","last_became_peered":"2024-05-27T06:27:37.599122+0000","last_unstale":"2024-05-27T06:27:43.641310+0000","last_undegraded":"2024-05-27T06:27:43.641310+0000","last_fullsized":"2024-05-27T06:27:43.641310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:10.389223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559414+0000","last_change":"2024-05-27T06:27:42.667965+0000","last_active":"2024-05-27T06:27:45.559414+0000","last_peered":"2024-05-27T06:27:45.559414+0000","last_clean":"2024-05-27T06:27:45.559414+0000","last_became_active":"2024-05-27T06:27:42.667525+0000","last_became_peered":"2024-05-27T06:27:42.667525+0000","last_unstale":"2024-05-27T06:27:45.559414+0000","last_undegraded":"2024-05-27T06:27:45.559414+0000","last_fullsized":"2024-05-27T06:27:45.559414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:39:45.712130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561139+0000","last_change":"2024-05-27T06:27:38.593273+0000","last_active":"2024-05-27T06:27:45.561139+0000","last_peered":"2024-05-27T06:27:45.561139+0000","last_clean":"2024-05-27T06:27:45.561139+0000","last_became_active":"2024-05-27T06:27:38.592904+0000","last_became_peered":"2024-05-27T06:27:38.592904+0000","last_unstale":"2024-05-27T06:27:45.561139+0000","last_undegraded":"2024-05-27T06:27:45.561139+0000","last_fullsized":"2024-05-27T06:27:45.561139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:13:28.978589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.642001+0000","last_change":"2024-05-27T06:27:37.588652+0000","last_active":"2024-05-27T06:27:43.642001+0000","last_peered":"2024-05-27T06:27:43.642001+0000","last_clean":"2024-05-27T06:27:43.642001+0000","last_became_active":"2024-05-27T06:27:37.587893+0000","last_became_peered":"2024-05-27T06:27:37.587893+0000","last_unstale":"2024-05-27T06:27:43.642001+0000","last_undegraded":"2024-05-27T06:27:43.642001+0000","last_fullsized":"2024-05-27T06:27:43.642001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:29:42.916475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641001+0000","last_change":"2024-05-27T06:27:42.673669+0000","last_active":"2024-05-27T06:27:43.641001+0000","last_peered":"2024-05-27T06:27:43.641001+0000","last_clean":"2024-05-27T06:27:43.641001+0000","last_became_active":"2024-05-27T06:27:42.672239+0000","last_became_peered":"2024-05-27T06:27:42.672239+0000","last_unstale":"2024-05-27T06:27:43.641001+0000","last_undegraded":"2024-05-27T06:27:43.641001+0000","last_fullsized":"2024-05-27T06:27:43.641001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:12:01.383034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560187+0000","last_change":"2024-05-27T06:27:38.592051+0000","last_active":"2024-05-27T06:27:45.560187+0000","last_peered":"2024-05-27T06:27:45.560187+0000","last_clean":"2024-05-27T06:27:45.560187+0000","last_became_active":"2024-05-27T06:27:38.591691+0000","last_became_peered":"2024-05-27T06:27:38.591691+0000","last_unstale":"2024-05-27T06:27:45.560187+0000","last_undegraded":"2024-05-27T06:27:45.560187+0000","last_fullsized":"2024-05-27T06:27:45.560187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:24:46.797590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.640005+0000","last_change":"2024-05-27T06:27:37.581720+0000","last_active":"2024-05-27T06:27:43.640005+0000","last_peered":"2024-05-27T06:27:43.640005+0000","last_clean":"2024-05-27T06:27:43.640005+0000","last_became_active":"2024-05-27T06:27:37.581315+0000","last_became_peered":"2024-05-27T06:27:37.581315+0000","last_unstale":"2024-05-27T06:27:43.640005+0000","last_undegraded":"2024-05-27T06:27:43.640005+0000","last_fullsized":"2024-05-27T06:27:43.640005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:52:20.552058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698884+0000","last_change":"2024-05-27T06:27:42.663374+0000","last_active":"2024-05-27T06:27:44.698884+0000","last_peered":"2024-05-27T06:27:44.698884+0000","last_clean":"2024-05-27T06:27:44.698884+0000","last_became_active":"2024-05-27T06:27:42.662889+0000","last_became_peered":"2024-05-27T06:27:42.662889+0000","last_unstale":"2024-05-27T06:27:44.698884+0000","last_undegraded":"2024-05-27T06:27:44.698884+0000","last_fullsized":"2024-05-27T06:27:44.698884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:54:35.677824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559633+0000","last_change":"2024-05-27T06:27:38.583434+0000","last_active":"2024-05-27T06:27:45.559633+0000","last_peered":"2024-05-27T06:27:45.559633+0000","last_clean":"2024-05-27T06:27:45.559633+0000","last_became_active":"2024-05-27T06:27:38.582843+0000","last_became_peered":"2024-05-27T06:27:38.582843+0000","last_unstale":"2024-05-27T06:27:45.559633+0000","last_undegraded":"2024-05-27T06:27:45.559633+0000","last_fullsized":"2024-05-27T06:27:45.559633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:41:11.973047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559966+0000","last_change":"2024-05-27T06:27:37.589051+0000","last_active":"2024-05-27T06:27:45.559966+0000","last_peered":"2024-05-27T06:27:45.559966+0000","last_clean":"2024-05-27T06:27:45.559966+0000","last_became_active":"2024-05-27T06:27:37.588633+0000","last_became_peered":"2024-05-27T06:27:37.588633+0000","last_unstale":"2024-05-27T06:27:45.559966+0000","last_undegraded":"2024-05-27T06:27:45.559966+0000","last_fullsized":"2024-05-27T06:27:45.559966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:05:47.256329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.137194+0000","last_change":"2024-05-27T06:27:42.686386+0000","last_active":"2024-05-27T06:27:45.137194+0000","last_peered":"2024-05-27T06:27:45.137194+0000","last_clean":"2024-05-27T06:27:45.137194+0000","last_became_active":"2024-05-27T06:27:42.685755+0000","last_became_peered":"2024-05-27T06:27:42.685755+0000","last_unstale":"2024-05-27T06:27:45.137194+0000","last_undegraded":"2024-05-27T06:27:45.137194+0000","last_fullsized":"2024-05-27T06:27:45.137194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:37:17.435617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561197+0000","last_change":"2024-05-27T06:27:38.593634+0000","last_active":"2024-05-27T06:27:45.561197+0000","last_peered":"2024-05-27T06:27:45.561197+0000","last_clean":"2024-05-27T06:27:45.561197+0000","last_became_active":"2024-05-27T06:27:38.593201+0000","last_became_peered":"2024-05-27T06:27:38.593201+0000","last_unstale":"2024-05-27T06:27:45.561197+0000","last_undegraded":"2024-05-27T06:27:45.561197+0000","last_fullsized":"2024-05-27T06:27:45.561197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:25:30.433535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561742+0000","last_change":"2024-05-27T06:27:37.596337+0000","last_active":"2024-05-27T06:27:45.561742+0000","last_peered":"2024-05-27T06:27:45.561742+0000","last_clean":"2024-05-27T06:27:45.561742+0000","last_became_active":"2024-05-27T06:27:37.596071+0000","last_became_peered":"2024-05-27T06:27:37.596071+0000","last_unstale":"2024-05-27T06:27:45.561742+0000","last_undegraded":"2024-05-27T06:27:45.561742+0000","last_fullsized":"2024-05-27T06:27:45.561742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:27.532558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136738+0000","last_change":"2024-05-27T06:27:42.686370+0000","last_active":"2024-05-27T06:27:45.136738+0000","last_peered":"2024-05-27T06:27:45.136738+0000","last_clean":"2024-05-27T06:27:45.136738+0000","last_became_active":"2024-05-27T06:27:42.685792+0000","last_became_peered":"2024-05-27T06:27:42.685792+0000","last_unstale":"2024-05-27T06:27:45.136738+0000","last_undegraded":"2024-05-27T06:27:45.136738+0000","last_fullsized":"2024-05-27T06:27:45.136738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:28:22.687108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698347+0000","last_change":"2024-05-27T06:27:38.594222+0000","last_active":"2024-05-27T06:27:44.698347+0000","last_peered":"2024-05-27T06:27:44.698347+0000","last_clean":"2024-05-27T06:27:44.698347+0000","last_became_active":"2024-05-27T06:27:38.593632+0000","last_became_peered":"2024-05-27T06:27:38.593632+0000","last_unstale":"2024-05-27T06:27:44.698347+0000","last_undegraded":"2024-05-27T06:27:44.698347+0000","last_fullsized":"2024-05-27T06:27:44.698347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:00:49.009171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698666+0000","last_change":"2024-05-27T06:27:37.589344+0000","last_active":"2024-05-27T06:27:44.698666+0000","last_peered":"2024-05-27T06:27:44.698666+0000","last_clean":"2024-05-27T06:27:44.698666+0000","last_became_active":"2024-05-27T06:27:37.588387+0000","last_became_peered":"2024-05-27T06:27:37.588387+0000","last_unstale":"2024-05-27T06:27:44.698666+0000","last_undegraded":"2024-05-27T06:27:44.698666+0000","last_fullsized":"2024-05-27T06:27:44.698666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:32:06.800381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562338+0000","last_change":"2024-05-27T06:27:42.673810+0000","last_active":"2024-05-27T06:27:45.562338+0000","last_peered":"2024-05-27T06:27:45.562338+0000","last_clean":"2024-05-27T06:27:45.562338+0000","last_became_active":"2024-05-27T06:27:42.673431+0000","last_became_peered":"2024-05-27T06:27:42.673431+0000","last_unstale":"2024-05-27T06:27:45.562338+0000","last_undegraded":"2024-05-27T06:27:45.562338+0000","last_fullsized":"2024-05-27T06:27:45.562338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:00:08.939251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560009+0000","last_change":"2024-05-27T06:27:38.599269+0000","last_active":"2024-05-27T06:27:45.560009+0000","last_peered":"2024-05-27T06:27:45.560009+0000","last_clean":"2024-05-27T06:27:45.560009+0000","last_became_active":"2024-05-27T06:27:38.598937+0000","last_became_peered":"2024-05-27T06:27:38.598937+0000","last_unstale":"2024-05-27T06:27:45.560009+0000","last_undegraded":"2024-05-27T06:27:45.560009+0000","last_fullsized":"2024-05-27T06:27:45.560009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:29:05.369384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:49.604485+0000","last_change":"2024-05-27T06:27:37.601137+0000","last_active":"2024-05-27T06:27:49.604485+0000","last_peered":"2024-05-27T06:27:49.604485+0000","last_clean":"2024-05-27T06:27:49.604485+0000","last_became_active":"2024-05-27T06:27:37.597839+0000","last_became_peered":"2024-05-27T06:27:37.597839+0000","last_unstale":"2024-05-27T06:27:49.604485+0000","last_undegraded":"2024-05-27T06:27:49.604485+0000","last_fullsized":"2024-05-27T06:27:49.604485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:10.389223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995265+0000","last_change":"2024-05-27T06:27:42.677071+0000","last_active":"2024-05-27T06:27:44.995265+0000","last_peered":"2024-05-27T06:27:44.995265+0000","last_clean":"2024-05-27T06:27:44.995265+0000","last_became_active":"2024-05-27T06:27:42.676468+0000","last_became_peered":"2024-05-27T06:27:42.676468+0000","last_unstale":"2024-05-27T06:27:44.995265+0000","last_undegraded":"2024-05-27T06:27:44.995265+0000","last_fullsized":"2024-05-27T06:27:44.995265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:54:35.677824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641784+0000","last_change":"2024-05-27T06:27:38.595005+0000","last_active":"2024-05-27T06:27:43.641784+0000","last_peered":"2024-05-27T06:27:43.641784+0000","last_clean":"2024-05-27T06:27:43.641784+0000","last_became_active":"2024-05-27T06:27:38.594686+0000","last_became_peered":"2024-05-27T06:27:38.594686+0000","last_unstale":"2024-05-27T06:27:43.641784+0000","last_undegraded":"2024-05-27T06:27:43.641784+0000","last_fullsized":"2024-05-27T06:27:43.641784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:26:33.577833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995173+0000","last_change":"2024-05-27T06:27:37.602334+0000","last_active":"2024-05-27T06:27:44.995173+0000","last_peered":"2024-05-27T06:27:44.995173+0000","last_clean":"2024-05-27T06:27:44.995173+0000","last_became_active":"2024-05-27T06:27:37.601956+0000","last_became_peered":"2024-05-27T06:27:37.601956+0000","last_unstale":"2024-05-27T06:27:44.995173+0000","last_undegraded":"2024-05-27T06:27:44.995173+0000","last_fullsized":"2024-05-27T06:27:44.995173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:02:27.532558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641965+0000","last_change":"2024-05-27T06:27:42.675917+0000","last_active":"2024-05-27T06:27:43.641965+0000","last_peered":"2024-05-27T06:27:43.641965+0000","last_clean":"2024-05-27T06:27:43.641965+0000","last_became_active":"2024-05-27T06:27:42.672667+0000","last_became_peered":"2024-05-27T06:27:42.672667+0000","last_unstale":"2024-05-27T06:27:43.641965+0000","last_undegraded":"2024-05-27T06:27:43.641965+0000","last_fullsized":"2024-05-27T06:27:43.641965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:57.607864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698963+0000","last_change":"2024-05-27T06:27:38.593445+0000","last_active":"2024-05-27T06:27:44.698963+0000","last_peered":"2024-05-27T06:27:44.698963+0000","last_clean":"2024-05-27T06:27:44.698963+0000","last_became_active":"2024-05-27T06:27:38.593177+0000","last_became_peered":"2024-05-27T06:27:38.593177+0000","last_unstale":"2024-05-27T06:27:44.698963+0000","last_undegraded":"2024-05-27T06:27:44.698963+0000","last_fullsized":"2024-05-27T06:27:44.698963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:25:28.290431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562220+0000","last_change":"2024-05-27T06:27:37.591786+0000","last_active":"2024-05-27T06:27:45.562220+0000","last_peered":"2024-05-27T06:27:45.562220+0000","last_clean":"2024-05-27T06:27:45.562220+0000","last_became_active":"2024-05-27T06:27:37.591376+0000","last_became_peered":"2024-05-27T06:27:37.591376+0000","last_unstale":"2024-05-27T06:27:45.562220+0000","last_undegraded":"2024-05-27T06:27:45.562220+0000","last_fullsized":"2024-05-27T06:27:45.562220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:26:32.568342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136705+0000","last_change":"2024-05-27T06:27:42.685562+0000","last_active":"2024-05-27T06:27:45.136705+0000","last_peered":"2024-05-27T06:27:45.136705+0000","last_clean":"2024-05-27T06:27:45.136705+0000","last_became_active":"2024-05-27T06:27:42.685102+0000","last_became_peered":"2024-05-27T06:27:42.685102+0000","last_unstale":"2024-05-27T06:27:45.136705+0000","last_undegraded":"2024-05-27T06:27:45.136705+0000","last_fullsized":"2024-05-27T06:27:45.136705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:00:08.939251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562310+0000","last_change":"2024-05-27T06:27:38.595953+0000","last_active":"2024-05-27T06:27:45.562310+0000","last_peered":"2024-05-27T06:27:45.562310+0000","last_clean":"2024-05-27T06:27:45.562310+0000","last_became_active":"2024-05-27T06:27:38.595628+0000","last_became_peered":"2024-05-27T06:27:38.595628+0000","last_unstale":"2024-05-27T06:27:45.562310+0000","last_undegraded":"2024-05-27T06:27:45.562310+0000","last_fullsized":"2024-05-27T06:27:45.562310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:36:01.596426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560492+0000","last_change":"2024-05-27T06:27:37.600029+0000","last_active":"2024-05-27T06:27:45.560492+0000","last_peered":"2024-05-27T06:27:45.560492+0000","last_clean":"2024-05-27T06:27:45.560492+0000","last_became_active":"2024-05-27T06:27:37.599416+0000","last_became_peered":"2024-05-27T06:27:37.599416+0000","last_unstale":"2024-05-27T06:27:45.560492+0000","last_undegraded":"2024-05-27T06:27:45.560492+0000","last_fullsized":"2024-05-27T06:27:45.560492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:52:20.552058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136431+0000","last_change":"2024-05-27T06:27:42.668152+0000","last_active":"2024-05-27T06:27:45.136431+0000","last_peered":"2024-05-27T06:27:45.136431+0000","last_clean":"2024-05-27T06:27:45.136431+0000","last_became_active":"2024-05-27T06:27:42.667699+0000","last_became_peered":"2024-05-27T06:27:42.667699+0000","last_unstale":"2024-05-27T06:27:45.136431+0000","last_undegraded":"2024-05-27T06:27:45.136431+0000","last_fullsized":"2024-05-27T06:27:45.136431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:39:45.712130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698461+0000","last_change":"2024-05-27T06:27:42.674408+0000","last_active":"2024-05-27T06:27:44.698461+0000","last_peered":"2024-05-27T06:27:44.698461+0000","last_clean":"2024-05-27T06:27:44.698461+0000","last_became_active":"2024-05-27T06:27:42.673922+0000","last_became_peered":"2024-05-27T06:27:42.673922+0000","last_unstale":"2024-05-27T06:27:44.698461+0000","last_undegraded":"2024-05-27T06:27:44.698461+0000","last_fullsized":"2024-05-27T06:27:44.698461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:39.420388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.994666+0000","last_change":"2024-05-27T06:27:38.612241+0000","last_active":"2024-05-27T06:27:44.994666+0000","last_peered":"2024-05-27T06:27:44.994666+0000","last_clean":"2024-05-27T06:27:44.994666+0000","last_became_active":"2024-05-27T06:27:38.611812+0000","last_became_peered":"2024-05-27T06:27:38.611812+0000","last_unstale":"2024-05-27T06:27:44.994666+0000","last_undegraded":"2024-05-27T06:27:44.994666+0000","last_fullsized":"2024-05-27T06:27:44.994666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:43:18.651541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560424+0000","last_change":"2024-05-27T06:27:37.588619+0000","last_active":"2024-05-27T06:27:45.560424+0000","last_peered":"2024-05-27T06:27:45.560424+0000","last_clean":"2024-05-27T06:27:45.560424+0000","last_became_active":"2024-05-27T06:27:37.588234+0000","last_became_peered":"2024-05-27T06:27:37.588234+0000","last_unstale":"2024-05-27T06:27:45.560424+0000","last_undegraded":"2024-05-27T06:27:45.560424+0000","last_fullsized":"2024-05-27T06:27:45.560424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:39:09.133451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560396+0000","last_change":"2024-05-27T06:27:42.675463+0000","last_active":"2024-05-27T06:27:45.560396+0000","last_peered":"2024-05-27T06:27:45.560396+0000","last_clean":"2024-05-27T06:27:45.560396+0000","last_became_active":"2024-05-27T06:27:42.674944+0000","last_became_peered":"2024-05-27T06:27:42.674944+0000","last_unstale":"2024-05-27T06:27:45.560396+0000","last_undegraded":"2024-05-27T06:27:45.560396+0000","last_fullsized":"2024-05-27T06:27:45.560396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:39.420388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136773+0000","last_change":"2024-05-27T06:27:38.602470+0000","last_active":"2024-05-27T06:27:45.136773+0000","last_peered":"2024-05-27T06:27:45.136773+0000","last_clean":"2024-05-27T06:27:45.136773+0000","last_became_active":"2024-05-27T06:27:38.602168+0000","last_became_peered":"2024-05-27T06:27:38.602168+0000","last_unstale":"2024-05-27T06:27:45.136773+0000","last_undegraded":"2024-05-27T06:27:45.136773+0000","last_fullsized":"2024-05-27T06:27:45.136773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:41:11.973047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136564+0000","last_change":"2024-05-27T06:27:37.594520+0000","last_active":"2024-05-27T06:27:45.136564+0000","last_peered":"2024-05-27T06:27:45.136564+0000","last_clean":"2024-05-27T06:27:45.136564+0000","last_became_active":"2024-05-27T06:27:37.594241+0000","last_became_peered":"2024-05-27T06:27:37.594241+0000","last_unstale":"2024-05-27T06:27:45.136564+0000","last_undegraded":"2024-05-27T06:27:45.136564+0000","last_fullsized":"2024-05-27T06:27:45.136564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:32:06.800381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559944+0000","last_change":"2024-05-27T06:27:37.584323+0000","last_active":"2024-05-27T06:27:45.559944+0000","last_peered":"2024-05-27T06:27:45.559944+0000","last_clean":"2024-05-27T06:27:45.559944+0000","last_became_active":"2024-05-27T06:27:37.583455+0000","last_became_peered":"2024-05-27T06:27:37.583455+0000","last_unstale":"2024-05-27T06:27:45.559944+0000","last_undegraded":"2024-05-27T06:27:45.559944+0000","last_fullsized":"2024-05-27T06:27:45.559944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:39:09.133451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698607+0000","last_change":"2024-05-27T06:27:38.574453+0000","last_active":"2024-05-27T06:27:44.698607+0000","last_peered":"2024-05-27T06:27:44.698607+0000","last_clean":"2024-05-27T06:27:44.698607+0000","last_became_active":"2024-05-27T06:27:38.574187+0000","last_became_peered":"2024-05-27T06:27:38.574187+0000","last_unstale":"2024-05-27T06:27:44.698607+0000","last_undegraded":"2024-05-27T06:27:44.698607+0000","last_fullsized":"2024-05-27T06:27:44.698607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:10:49.565828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.640927+0000","last_change":"2024-05-27T06:27:42.685818+0000","last_active":"2024-05-27T06:27:43.640927+0000","last_peered":"2024-05-27T06:27:43.640927+0000","last_clean":"2024-05-27T06:27:43.640927+0000","last_became_active":"2024-05-27T06:27:42.685168+0000","last_became_peered":"2024-05-27T06:27:42.685168+0000","last_unstale":"2024-05-27T06:27:43.640927+0000","last_undegraded":"2024-05-27T06:27:43.640927+0000","last_fullsized":"2024-05-27T06:27:43.640927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:53:00.233527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136653+0000","last_change":"2024-05-27T06:27:37.593851+0000","last_active":"2024-05-27T06:27:45.136653+0000","last_peered":"2024-05-27T06:27:45.136653+0000","last_clean":"2024-05-27T06:27:45.136653+0000","last_became_active":"2024-05-27T06:27:37.593555+0000","last_became_peered":"2024-05-27T06:27:37.593555+0000","last_unstale":"2024-05-27T06:27:45.136653+0000","last_undegraded":"2024-05-27T06:27:45.136653+0000","last_fullsized":"2024-05-27T06:27:45.136653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:36.545798+0000","last_clean_scrub_stamp":"2024-05-27T06:27:36.545798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:13:32.135455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641290+0000","last_change":"2024-05-27T06:27:38.581691+0000","last_active":"2024-05-27T06:27:43.641290+0000","last_peered":"2024-05-27T06:27:43.641290+0000","last_clean":"2024-05-27T06:27:43.641290+0000","last_became_active":"2024-05-27T06:27:38.581340+0000","last_became_peered":"2024-05-27T06:27:38.581340+0000","last_unstale":"2024-05-27T06:27:43.641290+0000","last_undegraded":"2024-05-27T06:27:43.641290+0000","last_fullsized":"2024-05-27T06:27:43.641290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:49:55.342001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.137183+0000","last_change":"2024-05-27T06:27:42.685248+0000","last_active":"2024-05-27T06:27:45.137183+0000","last_peered":"2024-05-27T06:27:45.137183+0000","last_clean":"2024-05-27T06:27:45.137183+0000","last_became_active":"2024-05-27T06:27:42.684742+0000","last_became_peered":"2024-05-27T06:27:42.684742+0000","last_unstale":"2024-05-27T06:27:45.137183+0000","last_undegraded":"2024-05-27T06:27:45.137183+0000","last_fullsized":"2024-05-27T06:27:45.137183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:41.626410+0000","last_clean_scrub_stamp":"2024-05-27T06:27:41.626410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:02:03.498823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.559395+0000","last_change":"2024-05-27T06:27:38.583155+0000","last_active":"2024-05-27T06:27:45.559395+0000","last_peered":"2024-05-27T06:27:45.559395+0000","last_clean":"2024-05-27T06:27:45.559395+0000","last_became_active":"2024-05-27T06:27:38.582419+0000","last_became_peered":"2024-05-27T06:27:38.582419+0000","last_unstale":"2024-05-27T06:27:45.559395+0000","last_undegraded":"2024-05-27T06:27:45.559395+0000","last_fullsized":"2024-05-27T06:27:45.559395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:11:57.311912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.640034+0000","last_change":"2024-05-27T06:27:38.590551+0000","last_active":"2024-05-27T06:27:43.640034+0000","last_peered":"2024-05-27T06:27:43.640034+0000","last_clean":"2024-05-27T06:27:43.640034+0000","last_became_active":"2024-05-27T06:27:38.590245+0000","last_became_peered":"2024-05-27T06:27:38.590245+0000","last_unstale":"2024-05-27T06:27:43.640034+0000","last_undegraded":"2024-05-27T06:27:43.640034+0000","last_fullsized":"2024-05-27T06:27:43.640034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:49:55.342001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561694+0000","last_change":"2024-05-27T06:27:38.597109+0000","last_active":"2024-05-27T06:27:45.561694+0000","last_peered":"2024-05-27T06:27:45.561694+0000","last_clean":"2024-05-27T06:27:45.561694+0000","last_became_active":"2024-05-27T06:27:38.596436+0000","last_became_peered":"2024-05-27T06:27:38.596436+0000","last_unstale":"2024-05-27T06:27:45.561694+0000","last_undegraded":"2024-05-27T06:27:45.561694+0000","last_fullsized":"2024-05-27T06:27:45.561694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:29:05.369384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698590+0000","last_change":"2024-05-27T06:27:38.592354+0000","last_active":"2024-05-27T06:27:44.698590+0000","last_peered":"2024-05-27T06:27:44.698590+0000","last_clean":"2024-05-27T06:27:44.698590+0000","last_became_active":"2024-05-27T06:27:38.591629+0000","last_became_peered":"2024-05-27T06:27:38.591629+0000","last_unstale":"2024-05-27T06:27:44.698590+0000","last_undegraded":"2024-05-27T06:27:44.698590+0000","last_fullsized":"2024-05-27T06:27:44.698590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:43:18.651541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136957+0000","last_change":"2024-05-27T06:27:38.600703+0000","last_active":"2024-05-27T06:27:45.136957+0000","last_peered":"2024-05-27T06:27:45.136957+0000","last_clean":"2024-05-27T06:27:45.136957+0000","last_became_active":"2024-05-27T06:27:38.598995+0000","last_became_peered":"2024-05-27T06:27:38.598995+0000","last_unstale":"2024-05-27T06:27:45.136957+0000","last_undegraded":"2024-05-27T06:27:45.136957+0000","last_fullsized":"2024-05-27T06:27:45.136957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:47.314366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.994968+0000","last_change":"2024-05-27T06:27:38.591611+0000","last_active":"2024-05-27T06:27:44.994968+0000","last_peered":"2024-05-27T06:27:44.994968+0000","last_clean":"2024-05-27T06:27:44.994968+0000","last_became_active":"2024-05-27T06:27:38.591257+0000","last_became_peered":"2024-05-27T06:27:38.591257+0000","last_unstale":"2024-05-27T06:27:44.994968+0000","last_undegraded":"2024-05-27T06:27:44.994968+0000","last_fullsized":"2024-05-27T06:27:44.994968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:11:57.311912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560497+0000","last_change":"2024-05-27T06:27:38.601653+0000","last_active":"2024-05-27T06:27:45.560497+0000","last_peered":"2024-05-27T06:27:45.560497+0000","last_clean":"2024-05-27T06:27:45.560497+0000","last_became_active":"2024-05-27T06:27:38.601350+0000","last_became_peered":"2024-05-27T06:27:38.601350+0000","last_unstale":"2024-05-27T06:27:45.560497+0000","last_undegraded":"2024-05-27T06:27:45.560497+0000","last_fullsized":"2024-05-27T06:27:45.560497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:26:47.314366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.137255+0000","last_change":"2024-05-27T06:27:38.595137+0000","last_active":"2024-05-27T06:27:45.137255+0000","last_peered":"2024-05-27T06:27:45.137255+0000","last_clean":"2024-05-27T06:27:45.137255+0000","last_became_active":"2024-05-27T06:27:38.594672+0000","last_became_peered":"2024-05-27T06:27:38.594672+0000","last_unstale":"2024-05-27T06:27:45.137255+0000","last_undegraded":"2024-05-27T06:27:45.137255+0000","last_fullsized":"2024-05-27T06:27:45.137255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:36:01.596426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560306+0000","last_change":"2024-05-27T06:27:38.604733+0000","last_active":"2024-05-27T06:27:45.560306+0000","last_peered":"2024-05-27T06:27:45.560306+0000","last_clean":"2024-05-27T06:27:45.560306+0000","last_became_active":"2024-05-27T06:27:38.604412+0000","last_became_peered":"2024-05-27T06:27:38.604412+0000","last_unstale":"2024-05-27T06:27:45.560306+0000","last_undegraded":"2024-05-27T06:27:45.560306+0000","last_fullsized":"2024-05-27T06:27:45.560306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:25:28.290431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136468+0000","last_change":"2024-05-27T06:27:38.594417+0000","last_active":"2024-05-27T06:27:45.136468+0000","last_peered":"2024-05-27T06:27:45.136468+0000","last_clean":"2024-05-27T06:27:45.136468+0000","last_became_active":"2024-05-27T06:27:38.594093+0000","last_became_peered":"2024-05-27T06:27:38.594093+0000","last_unstale":"2024-05-27T06:27:45.136468+0000","last_undegraded":"2024-05-27T06:27:45.136468+0000","last_fullsized":"2024-05-27T06:27:45.136468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:36:07.073192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561566+0000","last_change":"2024-05-27T06:27:38.595842+0000","last_active":"2024-05-27T06:27:45.561566+0000","last_peered":"2024-05-27T06:27:45.561566+0000","last_clean":"2024-05-27T06:27:45.561566+0000","last_became_active":"2024-05-27T06:27:38.595187+0000","last_became_peered":"2024-05-27T06:27:38.595187+0000","last_unstale":"2024-05-27T06:27:45.561566+0000","last_undegraded":"2024-05-27T06:27:45.561566+0000","last_fullsized":"2024-05-27T06:27:45.561566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:25:30.433535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698434+0000","last_change":"2024-05-27T06:27:38.596103+0000","last_active":"2024-05-27T06:27:44.698434+0000","last_peered":"2024-05-27T06:27:44.698434+0000","last_clean":"2024-05-27T06:27:44.698434+0000","last_became_active":"2024-05-27T06:27:38.595235+0000","last_became_peered":"2024-05-27T06:27:38.595235+0000","last_unstale":"2024-05-27T06:27:44.698434+0000","last_undegraded":"2024-05-27T06:27:44.698434+0000","last_fullsized":"2024-05-27T06:27:44.698434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:41:11.973047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561763+0000","last_change":"2024-05-27T06:27:38.589402+0000","last_active":"2024-05-27T06:27:45.561763+0000","last_peered":"2024-05-27T06:27:45.561763+0000","last_clean":"2024-05-27T06:27:45.561763+0000","last_became_active":"2024-05-27T06:27:38.588485+0000","last_became_peered":"2024-05-27T06:27:38.588485+0000","last_unstale":"2024-05-27T06:27:45.561763+0000","last_undegraded":"2024-05-27T06:27:45.561763+0000","last_fullsized":"2024-05-27T06:27:45.561763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:25:28.290431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560506+0000","last_change":"2024-05-27T06:27:38.604825+0000","last_active":"2024-05-27T06:27:45.560506+0000","last_peered":"2024-05-27T06:27:45.560506+0000","last_clean":"2024-05-27T06:27:45.560506+0000","last_became_active":"2024-05-27T06:27:38.604493+0000","last_became_peered":"2024-05-27T06:27:38.604493+0000","last_unstale":"2024-05-27T06:27:45.560506+0000","last_undegraded":"2024-05-27T06:27:45.560506+0000","last_fullsized":"2024-05-27T06:27:45.560506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:35.349266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641191+0000","last_change":"2024-05-27T06:27:38.589333+0000","last_active":"2024-05-27T06:27:43.641191+0000","last_peered":"2024-05-27T06:27:43.641191+0000","last_clean":"2024-05-27T06:27:43.641191+0000","last_became_active":"2024-05-27T06:27:38.588557+0000","last_became_peered":"2024-05-27T06:27:38.588557+0000","last_unstale":"2024-05-27T06:27:43.641191+0000","last_undegraded":"2024-05-27T06:27:43.641191+0000","last_fullsized":"2024-05-27T06:27:43.641191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:04:46.051655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.562481+0000","last_change":"2024-05-27T06:27:38.595781+0000","last_active":"2024-05-27T06:27:45.562481+0000","last_peered":"2024-05-27T06:27:45.562481+0000","last_clean":"2024-05-27T06:27:45.562481+0000","last_became_active":"2024-05-27T06:27:38.595427+0000","last_became_peered":"2024-05-27T06:27:38.595427+0000","last_unstale":"2024-05-27T06:27:45.562481+0000","last_undegraded":"2024-05-27T06:27:45.562481+0000","last_fullsized":"2024-05-27T06:27:45.562481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:21.569967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560183+0000","last_change":"2024-05-27T06:27:38.603388+0000","last_active":"2024-05-27T06:27:45.560183+0000","last_peered":"2024-05-27T06:27:45.560183+0000","last_clean":"2024-05-27T06:27:45.560183+0000","last_became_active":"2024-05-27T06:27:38.602534+0000","last_became_peered":"2024-05-27T06:27:38.602534+0000","last_unstale":"2024-05-27T06:27:45.560183+0000","last_undegraded":"2024-05-27T06:27:45.560183+0000","last_fullsized":"2024-05-27T06:27:45.560183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:11:57.311912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.994752+0000","last_change":"2024-05-27T06:27:38.597804+0000","last_active":"2024-05-27T06:27:44.994752+0000","last_peered":"2024-05-27T06:27:44.994752+0000","last_clean":"2024-05-27T06:27:44.994752+0000","last_became_active":"2024-05-27T06:27:38.597501+0000","last_became_peered":"2024-05-27T06:27:38.597501+0000","last_unstale":"2024-05-27T06:27:44.994752+0000","last_undegraded":"2024-05-27T06:27:44.994752+0000","last_fullsized":"2024-05-27T06:27:44.994752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:36:07.073192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698683+0000","last_change":"2024-05-27T06:27:38.595971+0000","last_active":"2024-05-27T06:27:44.698683+0000","last_peered":"2024-05-27T06:27:44.698683+0000","last_clean":"2024-05-27T06:27:44.698683+0000","last_became_active":"2024-05-27T06:27:38.595550+0000","last_became_peered":"2024-05-27T06:27:38.595550+0000","last_unstale":"2024-05-27T06:27:44.698683+0000","last_undegraded":"2024-05-27T06:27:44.698683+0000","last_fullsized":"2024-05-27T06:27:44.698683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:44:31.285463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136539+0000","last_change":"2024-05-27T06:27:38.587249+0000","last_active":"2024-05-27T06:27:45.136539+0000","last_peered":"2024-05-27T06:27:45.136539+0000","last_clean":"2024-05-27T06:27:45.136539+0000","last_became_active":"2024-05-27T06:27:38.586880+0000","last_became_peered":"2024-05-27T06:27:38.586880+0000","last_unstale":"2024-05-27T06:27:45.136539+0000","last_undegraded":"2024-05-27T06:27:45.136539+0000","last_fullsized":"2024-05-27T06:27:45.136539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:11:57.311912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:43.641615+0000","last_change":"2024-05-27T06:27:38.588337+0000","last_active":"2024-05-27T06:27:43.641615+0000","last_peered":"2024-05-27T06:27:43.641615+0000","last_clean":"2024-05-27T06:27:43.641615+0000","last_became_active":"2024-05-27T06:27:38.587989+0000","last_became_peered":"2024-05-27T06:27:38.587989+0000","last_unstale":"2024-05-27T06:27:43.641615+0000","last_undegraded":"2024-05-27T06:27:43.641615+0000","last_fullsized":"2024-05-27T06:27:43.641615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:05:48.265820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560707+0000","last_change":"2024-05-27T06:27:38.589920+0000","last_active":"2024-05-27T06:27:45.560707+0000","last_peered":"2024-05-27T06:27:45.560707+0000","last_clean":"2024-05-27T06:27:45.560707+0000","last_became_active":"2024-05-27T06:27:38.588894+0000","last_became_peered":"2024-05-27T06:27:38.588894+0000","last_unstale":"2024-05-27T06:27:45.560707+0000","last_undegraded":"2024-05-27T06:27:45.560707+0000","last_fullsized":"2024-05-27T06:27:45.560707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:43:18.651541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560366+0000","last_change":"2024-05-27T06:27:38.589163+0000","last_active":"2024-05-27T06:27:45.560366+0000","last_peered":"2024-05-27T06:27:45.560366+0000","last_clean":"2024-05-27T06:27:45.560366+0000","last_became_active":"2024-05-27T06:27:38.588860+0000","last_became_peered":"2024-05-27T06:27:38.588860+0000","last_unstale":"2024-05-27T06:27:45.560366+0000","last_undegraded":"2024-05-27T06:27:45.560366+0000","last_fullsized":"2024-05-27T06:27:45.560366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:10:49.565828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561563+0000","last_change":"2024-05-27T06:27:38.592099+0000","last_active":"2024-05-27T06:27:45.561563+0000","last_peered":"2024-05-27T06:27:45.561563+0000","last_clean":"2024-05-27T06:27:45.561563+0000","last_became_active":"2024-05-27T06:27:38.591794+0000","last_became_peered":"2024-05-27T06:27:38.591794+0000","last_unstale":"2024-05-27T06:27:45.561563+0000","last_undegraded":"2024-05-27T06:27:45.561563+0000","last_fullsized":"2024-05-27T06:27:45.561563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:31:23.791324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.136320+0000","last_change":"2024-05-27T06:27:38.591399+0000","last_active":"2024-05-27T06:27:45.136320+0000","last_peered":"2024-05-27T06:27:45.136320+0000","last_clean":"2024-05-27T06:27:45.136320+0000","last_became_active":"2024-05-27T06:27:38.591132+0000","last_became_peered":"2024-05-27T06:27:38.591132+0000","last_unstale":"2024-05-27T06:27:45.136320+0000","last_undegraded":"2024-05-27T06:27:45.136320+0000","last_fullsized":"2024-05-27T06:27:45.136320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:00:49.009171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560131+0000","last_change":"2024-05-27T06:27:38.606361+0000","last_active":"2024-05-27T06:27:45.560131+0000","last_peered":"2024-05-27T06:27:45.560131+0000","last_clean":"2024-05-27T06:27:45.560131+0000","last_became_active":"2024-05-27T06:27:38.605036+0000","last_became_peered":"2024-05-27T06:27:38.605036+0000","last_unstale":"2024-05-27T06:27:45.560131+0000","last_undegraded":"2024-05-27T06:27:45.560131+0000","last_fullsized":"2024-05-27T06:27:45.560131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:54:31.606702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561440+0000","last_change":"2024-05-27T06:27:38.594793+0000","last_active":"2024-05-27T06:27:45.561440+0000","last_peered":"2024-05-27T06:27:45.561440+0000","last_clean":"2024-05-27T06:27:45.561440+0000","last_became_active":"2024-05-27T06:27:38.594350+0000","last_became_peered":"2024-05-27T06:27:38.594350+0000","last_unstale":"2024-05-27T06:27:45.561440+0000","last_undegraded":"2024-05-27T06:27:45.561440+0000","last_fullsized":"2024-05-27T06:27:45.561440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:24:46.797590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.560917+0000","last_change":"2024-05-27T06:27:38.600252+0000","last_active":"2024-05-27T06:27:45.560917+0000","last_peered":"2024-05-27T06:27:45.560917+0000","last_clean":"2024-05-27T06:27:45.560917+0000","last_became_active":"2024-05-27T06:27:38.599892+0000","last_became_peered":"2024-05-27T06:27:38.599892+0000","last_unstale":"2024-05-27T06:27:45.560917+0000","last_undegraded":"2024-05-27T06:27:45.560917+0000","last_fullsized":"2024-05-27T06:27:45.560917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:36:01.596426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561945+0000","last_change":"2024-05-27T06:27:38.595466+0000","last_active":"2024-05-27T06:27:45.561945+0000","last_peered":"2024-05-27T06:27:45.561945+0000","last_clean":"2024-05-27T06:27:45.561945+0000","last_became_active":"2024-05-27T06:27:38.593979+0000","last_became_peered":"2024-05-27T06:27:38.593979+0000","last_unstale":"2024-05-27T06:27:45.561945+0000","last_undegraded":"2024-05-27T06:27:45.561945+0000","last_fullsized":"2024-05-27T06:27:45.561945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:13:28.978589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.698434+0000","last_change":"2024-05-27T06:27:38.581825+0000","last_active":"2024-05-27T06:27:44.698434+0000","last_peered":"2024-05-27T06:27:44.698434+0000","last_clean":"2024-05-27T06:27:44.698434+0000","last_became_active":"2024-05-27T06:27:38.580897+0000","last_became_peered":"2024-05-27T06:27:38.580897+0000","last_unstale":"2024-05-27T06:27:44.698434+0000","last_undegraded":"2024-05-27T06:27:44.698434+0000","last_fullsized":"2024-05-27T06:27:44.698434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:36:07.073192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:44.995182+0000","last_change":"2024-05-27T06:27:38.596385+0000","last_active":"2024-05-27T06:27:44.995182+0000","last_peered":"2024-05-27T06:27:44.995182+0000","last_clean":"2024-05-27T06:27:44.995182+0000","last_became_active":"2024-05-27T06:27:38.595730+0000","last_became_peered":"2024-05-27T06:27:38.595730+0000","last_unstale":"2024-05-27T06:27:44.995182+0000","last_undegraded":"2024-05-27T06:27:44.995182+0000","last_fullsized":"2024-05-27T06:27:44.995182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:25:28.290431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-27T06:27:45.561441+0000","last_change":"2024-05-27T06:27:38.591344+0000","last_active":"2024-05-27T06:27:45.561441+0000","last_peered":"2024-05-27T06:27:45.561441+0000","last_clean":"2024-05-27T06:27:45.561441+0000","last_became_active":"2024-05-27T06:27:38.591001+0000","last_became_peered":"2024-05-27T06:27:38.591001+0000","last_unstale":"2024-05-27T06:27:45.561441+0000","last_undegraded":"2024-05-27T06:27:45.561441+0000","last_fullsized":"2024-05-27T06:27:45.561441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:37.555289+0000","last_clean_scrub_stamp":"2024-05-27T06:27:37.555289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:25.980330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T06:28:05.972 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-27T06:28:05.972 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-27T06:28:05.972 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-27T06:28:05.972 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-27T06:28:06.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.159+0000 7f19f4400640 1 Processor -- start 2024-05-27T06:28:06.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.159+0000 7f19f4400640 1 -- start start 2024-05-27T06:28:06.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.163+0000 7f19f4400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f19ec0b4d10 0x7f19ec0aee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:06.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.163+0000 7f19f4400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19ec0b5120 0x7f19ec0af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:06.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.163+0000 7f19f4400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f19ec070410 0x7f19ec070820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:06.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.163+0000 7f19f4400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f19ec070d60 con 0x7f19ec070410 2024-05-27T06:28:06.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.163+0000 7f19f4400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f19ec06f370 con 0x7f19ec0b4d10 2024-05-27T06:28:06.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.163+0000 7f19f4400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f19ec06f650 con 0x7f19ec0b5120 2024-05-27T06:28:06.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.163+0000 7f19f2400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f19ec070410 0x7f19ec070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:06.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.163+0000 7f19f2400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f19ec070410 0x7f19ec070820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55362/0 (socket says 172.21.15.87:55362) 2024-05-27T06:28:06.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.163+0000 7f19f2400640 1 -- 172.21.15.87:0/2264633493 learned_addr learned my addr 172.21.15.87:0/2264633493 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:06.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.163+0000 7f19f1000640 1 --2- 172.21.15.87:0/2264633493 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19ec0b5120 0x7f19ec0af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:06.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.163+0000 7f19f1a00640 1 --2- 172.21.15.87:0/2264633493 >> v2:172.21.15.149:3300/0 conn(0x7f19ec0b4d10 0x7f19ec0aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:06.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.163+0000 7f19f2400640 1 -- 172.21.15.87:0/2264633493 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19ec0b5120 msgr2=0x7f19ec0af3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:06.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.163+0000 7f19f2400640 1 --2- 172.21.15.87:0/2264633493 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19ec0b5120 0x7f19ec0af3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:06.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.163+0000 7f19f2400640 1 -- 172.21.15.87:0/2264633493 >> v2:172.21.15.149:3300/0 conn(0x7f19ec0b4d10 msgr2=0x7f19ec0aee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:06.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.163+0000 7f19f2400640 1 --2- 172.21.15.87:0/2264633493 >> v2:172.21.15.149:3300/0 conn(0x7f19ec0b4d10 0x7f19ec0aee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:06.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.163+0000 7f19f2400640 1 -- 172.21.15.87:0/2264633493 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19ec06f930 con 0x7f19ec070410 2024-05-27T06:28:06.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.167+0000 7f19f2400640 1 --2- 172.21.15.87:0/2264633493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19ec070410 0x7f19ec070820 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f19ec0725b0 tx=0x7f19e401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49aafa45c9bc017 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:06.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.167+0000 7f19ebe00640 1 -- 172.21.15.87:0/2264633493 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e40a5760 con 0x7f19ec070410 2024-05-27T06:28:06.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.167+0000 7f19ebe00640 1 -- 172.21.15.87:0/2264633493 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19e40a5900 con 0x7f19ec070410 2024-05-27T06:28:06.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.167+0000 7f19ebe00640 1 -- 172.21.15.87:0/2264633493 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e40a5cd0 con 0x7f19ec070410 2024-05-27T06:28:06.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.167+0000 7f19f4400640 1 -- 172.21.15.87:0/2264633493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19ec070410 msgr2=0x7f19ec070820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:06.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.167+0000 7f19f4400640 1 --2- 172.21.15.87:0/2264633493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19ec070410 0x7f19ec070820 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f19ec0725b0 tx=0x7f19e401c9f0 comp rx=0 tx=0).stop 2024-05-27T06:28:06.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.167+0000 7f19f4400640 1 -- 172.21.15.87:0/2264633493 shutdown_connections 2024-05-27T06:28:06.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.167+0000 7f19f4400640 1 --2- 172.21.15.87:0/2264633493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19ec070410 0x7f19ec070820 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:06.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.167+0000 7f19f4400640 1 --2- 172.21.15.87:0/2264633493 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19ec0b5120 0x7f19ec0af3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:06.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.167+0000 7f19f4400640 1 --2- 172.21.15.87:0/2264633493 >> v2:172.21.15.149:3300/0 conn(0x7f19ec0b4d10 0x7f19ec0aee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:06.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.167+0000 7f19f4400640 1 -- 172.21.15.87:0/2264633493 >> 172.21.15.87:0/2264633493 conn(0x7f19ec0d1e70 msgr2=0x7f19ec0d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:06.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.167+0000 7f19f4400640 1 -- 172.21.15.87:0/2264633493 shutdown_connections 2024-05-27T06:28:06.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.167+0000 7f19f4400640 1 -- 172.21.15.87:0/2264633493 wait complete. 2024-05-27T06:28:06.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.171+0000 7f19f4400640 1 Processor -- start 2024-05-27T06:28:06.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.171+0000 7f19f4400640 1 -- start start 2024-05-27T06:28:06.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.171+0000 7f19f4400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19ec070410 0x7f19ec162ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:06.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.171+0000 7f19f4400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19ec0b4d10 0x7f19ec15c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:06.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.171+0000 7f19f4400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19ec0b5120 0x7f19ec15c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:06.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.171+0000 7f19f4400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f19ec06cce0 con 0x7f19ec0b4d10 2024-05-27T06:28:06.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.171+0000 7f19f4400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f19ec06cb60 con 0x7f19ec0b5120 2024-05-27T06:28:06.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.171+0000 7f19f4400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f19ec06ce60 con 0x7f19ec070410 2024-05-27T06:28:06.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.171+0000 7f19f1000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19ec0b4d10 0x7f19ec15c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:06.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.171+0000 7f19f1000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19ec0b4d10 0x7f19ec15c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55366/0 (socket says 172.21.15.87:55366) 2024-05-27T06:28:06.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.171+0000 7f19f1000640 1 -- 172.21.15.87:0/1761516379 learned_addr learned my addr 172.21.15.87:0/1761516379 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:06.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.171+0000 7f19f1000640 1 -- 172.21.15.87:0/1761516379 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19ec070410 msgr2=0x7f19ec162ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:06.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.171+0000 7f19f1a00640 1 --2- 172.21.15.87:0/1761516379 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19ec070410 0x7f19ec162ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:06.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.171+0000 7f19f1000640 1 --2- 172.21.15.87:0/1761516379 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19ec070410 0x7f19ec162ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:06.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.171+0000 7f19f1000640 1 -- 172.21.15.87:0/1761516379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19ec0b5120 msgr2=0x7f19ec15c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:06.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.171+0000 7f19f1000640 1 --2- 172.21.15.87:0/1761516379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19ec0b5120 0x7f19ec15c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:06.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.171+0000 7f19f1000640 1 -- 172.21.15.87:0/1761516379 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19ec161320 con 0x7f19ec0b4d10 2024-05-27T06:28:06.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.171+0000 7f19f1000640 1 --2- 172.21.15.87:0/1761516379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19ec0b4d10 0x7f19ec15c430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f19d800e870 tx=0x7f19d800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:06.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.171+0000 7f19e9600640 1 -- 172.21.15.87:0/1761516379 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d8017070 con 0x7f19ec0b4d10 2024-05-27T06:28:06.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.171+0000 7f19e9600640 1 -- 172.21.15.87:0/1761516379 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19d800c940 con 0x7f19ec0b4d10 2024-05-27T06:28:06.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.171+0000 7f19f4400640 1 -- 172.21.15.87:0/1761516379 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19ec152450 con 0x7f19ec0b4d10 2024-05-27T06:28:06.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.171+0000 7f19e9600640 1 -- 172.21.15.87:0/1761516379 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d800ccf0 con 0x7f19ec0b4d10 2024-05-27T06:28:06.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.171+0000 7f19f4400640 1 -- 172.21.15.87:0/1761516379 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19ec152a10 con 0x7f19ec0b4d10 2024-05-27T06:28:06.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.175+0000 7f19f4400640 1 -- 172.21.15.87:0/1761516379 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19ec160530 con 0x7f19ec0b4d10 2024-05-27T06:28:06.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.175+0000 7f19e9600640 1 -- 172.21.15.87:0/1761516379 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f19d801a070 con 0x7f19ec0b4d10 2024-05-27T06:28:06.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.175+0000 7f19e9600640 1 --2- 172.21.15.87:0/1761516379 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f19cc06f400 0x7f19cc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:06.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.175+0000 7f19e9600640 1 -- 172.21.15.87:0/1761516379 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f19d808f950 con 0x7f19ec0b4d10 2024-05-27T06:28:06.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.175+0000 7f19f1a00640 1 --2- 172.21.15.87:0/1761516379 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f19cc06f400 0x7f19cc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:06.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.175+0000 7f19f1a00640 1 --2- 172.21.15.87:0/1761516379 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f19cc06f400 0x7f19cc071910 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009910 tx=0x7f19e0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:06.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.179+0000 7f19e9600640 1 -- 172.21.15.87:0/1761516379 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f19d805c460 con 0x7f19ec0b4d10 2024-05-27T06:28:06.325 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T06:28:06.328 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T06:28:06.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.371+0000 7f19f4400640 1 -- 172.21.15.87:0/1761516379 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f19ec06aa30 con 0x7f19ec0b4d10 2024-05-27T06:28:06.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.371+0000 7f19e9600640 1 -- 172.21.15.87:0/1761516379 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f19d805bd60 con 0x7f19ec0b4d10 2024-05-27T06:28:06.366 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:06.366 INFO:teuthology.orchestra.run.smithi087.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-27T06:28:06.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.371+0000 7f19f4400640 1 -- 172.21.15.87:0/1761516379 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f19cc06f400 msgr2=0x7f19cc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:06.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.371+0000 7f19f4400640 1 --2- 172.21.15.87:0/1761516379 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f19cc06f400 0x7f19cc071910 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009910 tx=0x7f19e0008040 comp rx=0 tx=0).stop 2024-05-27T06:28:06.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.371+0000 7f19f4400640 1 -- 172.21.15.87:0/1761516379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19ec0b4d10 msgr2=0x7f19ec15c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:06.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.371+0000 7f19f4400640 1 --2- 172.21.15.87:0/1761516379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19ec0b4d10 0x7f19ec15c430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f19d800e870 tx=0x7f19d800ec70 comp rx=0 tx=0).stop 2024-05-27T06:28:06.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.371+0000 7f19f4400640 1 -- 172.21.15.87:0/1761516379 shutdown_connections 2024-05-27T06:28:06.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.371+0000 7f19f4400640 1 --2- 172.21.15.87:0/1761516379 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f19cc06f400 0x7f19cc071910 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:06.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.371+0000 7f19f4400640 1 --2- 172.21.15.87:0/1761516379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19ec0b5120 0x7f19ec15c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:06.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.371+0000 7f19f4400640 1 --2- 172.21.15.87:0/1761516379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19ec0b4d10 0x7f19ec15c430 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:06.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.371+0000 7f19f4400640 1 --2- 172.21.15.87:0/1761516379 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19ec070410 0x7f19ec162ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:06.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.371+0000 7f19f4400640 1 -- 172.21.15.87:0/1761516379 >> 172.21.15.87:0/1761516379 conn(0x7f19ec0d1e70 msgr2=0x7f19ec0aee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:06.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.371+0000 7f19f4400640 1 -- 172.21.15.87:0/1761516379 shutdown_connections 2024-05-27T06:28:06.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.371+0000 7f19f4400640 1 -- 172.21.15.87:0/1761516379 wait complete. 2024-05-27T06:28:06.388 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-27T06:28:06.388 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T06:28:06.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.579+0000 7efdd5800640 1 Processor -- start 2024-05-27T06:28:06.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.579+0000 7efdd5800640 1 -- start start 2024-05-27T06:28:06.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.579+0000 7efdd5800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efdd01617b0 0x7efdd006d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:06.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.579+0000 7efdd5800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efdd006db40 0x7efdd00d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:06.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.579+0000 7efdd5800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdd0161bc0 con 0x7efdd00cffa0 2024-05-27T06:28:06.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.579+0000 7efdd5800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7efdd00d03b0 con 0x7efdd01617b0 2024-05-27T06:28:06.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.579+0000 7efdd5800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efdd01626e0 con 0x7efdd006db40 2024-05-27T06:28:06.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.579+0000 7efdce000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efdd01617b0 0x7efdd006d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:06.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.579+0000 7efdce000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efdd01617b0 0x7efdd006d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55382/0 (socket says 172.21.15.87:55382) 2024-05-27T06:28:06.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.579+0000 7efdce000640 1 -- 172.21.15.87:0/1742849110 learned_addr learned my addr 172.21.15.87:0/1742849110 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:06.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.579+0000 7efdcf400640 1 --2- 172.21.15.87:0/1742849110 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efdd006db40 0x7efdd00d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:06.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.579+0000 7efdce000640 1 -- 172.21.15.87:0/1742849110 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efdd006db40 msgr2=0x7efdd00d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:06.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.579+0000 7efdce000640 1 --2- 172.21.15.87:0/1742849110 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efdd006db40 0x7efdd00d17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:06.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.579+0000 7efdce000640 1 -- 172.21.15.87:0/1742849110 >> v1:172.21.15.149:6789/0 conn(0x7efdd00cffa0 legacy=0x7efdd0144800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:06.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.579+0000 7efdce000640 1 -- 172.21.15.87:0/1742849110 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd006df50 con 0x7efdd01617b0 2024-05-27T06:28:06.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.583+0000 7efdce000640 1 --2- 172.21.15.87:0/1742849110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdd01617b0 0x7efdd006d600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efdbc009870 tx=0x7efdbc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f172826766b67 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:06.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.583+0000 7efdcd600640 1 -- 172.21.15.87:0/1742849110 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdbc0b1070 con 0x7efdd01617b0 2024-05-27T06:28:06.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.583+0000 7efdcd600640 1 -- 172.21.15.87:0/1742849110 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdbc0ac620 con 0x7efdd01617b0 2024-05-27T06:28:06.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.583+0000 7efdcd600640 1 -- 172.21.15.87:0/1742849110 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdbc0ac9f0 con 0x7efdd01617b0 2024-05-27T06:28:06.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.583+0000 7efdd5800640 1 -- 172.21.15.87:0/1742849110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdd01617b0 msgr2=0x7efdd006d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:06.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.583+0000 7efdd5800640 1 --2- 172.21.15.87:0/1742849110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdd01617b0 0x7efdd006d600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efdbc009870 tx=0x7efdbc01c4d0 comp rx=0 tx=0).stop 2024-05-27T06:28:06.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.583+0000 7efdd5800640 1 -- 172.21.15.87:0/1742849110 shutdown_connections 2024-05-27T06:28:06.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.583+0000 7efdd5800640 1 --2- 172.21.15.87:0/1742849110 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efdd006db40 0x7efdd00d17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:06.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.583+0000 7efdd5800640 1 --2- 172.21.15.87:0/1742849110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdd01617b0 0x7efdd006d600 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:06.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.583+0000 7efdd5800640 1 -- 172.21.15.87:0/1742849110 >> 172.21.15.87:0/1742849110 conn(0x7efdd00700d0 msgr2=0x7efdd00704e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:06.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.583+0000 7efdd5800640 1 -- 172.21.15.87:0/1742849110 shutdown_connections 2024-05-27T06:28:06.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.583+0000 7efdd5800640 1 -- 172.21.15.87:0/1742849110 wait complete. 2024-05-27T06:28:06.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.587+0000 7efdd5800640 1 Processor -- start 2024-05-27T06:28:06.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.587+0000 7efdd5800640 1 -- start start 2024-05-27T06:28:06.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.587+0000 7efdd5800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efdd006db40 0x7efdd01f8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:06.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.587+0000 7efdd5800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdd00cffa0 0x7efdd015a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:06.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.587+0000 7efdd5800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdd01617b0 0x7efdd015c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:06.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.587+0000 7efdd5800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efdd0147620 con 0x7efdd00cffa0 2024-05-27T06:28:06.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.587+0000 7efdd5800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efdd0144f10 con 0x7efdd01617b0 2024-05-27T06:28:06.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.587+0000 7efdd5800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efdd00d2110 con 0x7efdd006db40 2024-05-27T06:28:06.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.587+0000 7efdce000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdd00cffa0 0x7efdd015a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:06.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.587+0000 7efdce000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdd00cffa0 0x7efdd015a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55392/0 (socket says 172.21.15.87:55392) 2024-05-27T06:28:06.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.587+0000 7efdce000640 1 -- 172.21.15.87:0/4219369597 learned_addr learned my addr 172.21.15.87:0/4219369597 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:06.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.587+0000 7efdcf400640 1 --2- 172.21.15.87:0/4219369597 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdd01617b0 0x7efdd015c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:06.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.591+0000 7efdcea00640 1 --2- 172.21.15.87:0/4219369597 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efdd006db40 0x7efdd01f8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:06.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.591+0000 7efdce000640 1 -- 172.21.15.87:0/4219369597 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efdd006db40 msgr2=0x7efdd01f8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:06.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.591+0000 7efdce000640 1 --2- 172.21.15.87:0/4219369597 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efdd006db40 0x7efdd01f8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:06.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.591+0000 7efdce000640 1 -- 172.21.15.87:0/4219369597 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdd01617b0 msgr2=0x7efdd015c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:06.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.591+0000 7efdce000640 1 --2- 172.21.15.87:0/4219369597 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdd01617b0 0x7efdd015c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:06.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.591+0000 7efdce000640 1 -- 172.21.15.87:0/4219369597 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd0143420 con 0x7efdd00cffa0 2024-05-27T06:28:06.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.591+0000 7efdce000640 1 --2- 172.21.15.87:0/4219369597 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdd00cffa0 0x7efdd015a0a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efdbc0af040 tx=0x7efdbc019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:06.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.591+0000 7efdc6a00640 1 -- 172.21.15.87:0/4219369597 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdbc0b1040 con 0x7efdd00cffa0 2024-05-27T06:28:06.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.591+0000 7efdc6a00640 1 -- 172.21.15.87:0/4219369597 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdbc0ac420 con 0x7efdd00cffa0 2024-05-27T06:28:06.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.591+0000 7efdd5800640 1 -- 172.21.15.87:0/4219369597 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd0143700 con 0x7efdd00cffa0 2024-05-27T06:28:06.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.591+0000 7efdc6a00640 1 -- 172.21.15.87:0/4219369597 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdbc0b5680 con 0x7efdd00cffa0 2024-05-27T06:28:06.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.591+0000 7efdd5800640 1 -- 172.21.15.87:0/4219369597 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd0143cc0 con 0x7efdd00cffa0 2024-05-27T06:28:06.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.591+0000 7efdd5800640 1 -- 172.21.15.87:0/4219369597 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdd0160e10 con 0x7efdd00cffa0 2024-05-27T06:28:06.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.591+0000 7efdc6a00640 1 -- 172.21.15.87:0/4219369597 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7efdbc0bc020 con 0x7efdd00cffa0 2024-05-27T06:28:06.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.595+0000 7efdc6a00640 1 --2- 172.21.15.87:0/4219369597 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efdb006f400 0x7efdb0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:06.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.595+0000 7efdc6a00640 1 -- 172.21.15.87:0/4219369597 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7efdbc128a00 con 0x7efdd00cffa0 2024-05-27T06:28:06.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.595+0000 7efdcea00640 1 --2- 172.21.15.87:0/4219369597 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efdb006f400 0x7efdb0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:06.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.595+0000 7efdcea00640 1 --2- 172.21.15.87:0/4219369597 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efdb006f400 0x7efdb0071910 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efdc0001650 tx=0x7efdc0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:06.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.599+0000 7efdc6a00640 1 -- 172.21.15.87:0/4219369597 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7efdbc0c3020 con 0x7efdd00cffa0 2024-05-27T06:28:06.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.799+0000 7efdd5800640 1 -- 172.21.15.87:0/4219369597 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efdd006aa30 con 0x7efdd00cffa0 2024-05-27T06:28:06.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.799+0000 7efdc6a00640 1 -- 172.21.15.87:0/4219369597 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7efdbc016150 con 0x7efdd00cffa0 2024-05-27T06:28:06.795 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:06.795 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1075024068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1075024068},{"type":"v1","addr":"172.21.15.87:6835","nonce":1075024068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/437385084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":437385084},{"type":"v1","addr":"172.21.15.149:6833","nonce":437385084}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/852280291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":852280291},{"type":"v1","addr":"172.21.15.149:6835","nonce":852280291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T06:27:37.964959+0000","modified":"2024-05-27T06:27:59.081534+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/1799934036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1799934036},{"type":"v1","addr":"172.21.15.87:6837","nonce":1799934036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-27T06:28:06.796 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 9 2024-05-27T06:28:06.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.799+0000 7efdd5800640 1 -- 172.21.15.87:0/4219369597 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efdb006f400 msgr2=0x7efdb0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:06.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.799+0000 7efdd5800640 1 --2- 172.21.15.87:0/4219369597 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efdb006f400 0x7efdb0071910 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efdc0001650 tx=0x7efdc0009040 comp rx=0 tx=0).stop 2024-05-27T06:28:06.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.799+0000 7efdd5800640 1 -- 172.21.15.87:0/4219369597 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdd00cffa0 msgr2=0x7efdd015a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:06.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.799+0000 7efdd5800640 1 --2- 172.21.15.87:0/4219369597 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdd00cffa0 0x7efdd015a0a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efdbc0af040 tx=0x7efdbc019270 comp rx=0 tx=0).stop 2024-05-27T06:28:06.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.799+0000 7efdd5800640 1 -- 172.21.15.87:0/4219369597 shutdown_connections 2024-05-27T06:28:06.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.799+0000 7efdd5800640 1 --2- 172.21.15.87:0/4219369597 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efdb006f400 0x7efdb0071910 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:06.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.799+0000 7efdd5800640 1 --2- 172.21.15.87:0/4219369597 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdd01617b0 0x7efdd015c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:06.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.799+0000 7efdd5800640 1 --2- 172.21.15.87:0/4219369597 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdd00cffa0 0x7efdd015a0a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:06.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.799+0000 7efdd5800640 1 --2- 172.21.15.87:0/4219369597 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efdd006db40 0x7efdd01f8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:06.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.799+0000 7efdd5800640 1 -- 172.21.15.87:0/4219369597 >> 172.21.15.87:0/4219369597 conn(0x7efdd00700d0 msgr2=0x7efdd0073b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:06.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.799+0000 7efdd5800640 1 -- 172.21.15.87:0/4219369597 shutdown_connections 2024-05-27T06:28:06.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.803+0000 7efdd5800640 1 -- 172.21.15.87:0/4219369597 wait complete. 2024-05-27T06:28:06.817 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T06:28:06.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.967+0000 7f29d9200640 1 Processor -- start 2024-05-27T06:28:06.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.967+0000 7f29d9200640 1 -- start start 2024-05-27T06:28:06.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.971+0000 7f29d9200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f29d40ce440 0x7f29d40ae340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:06.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.971+0000 7f29d9200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f29d40b07d0 0x7f29d40ae880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:06.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.971+0000 7f29d9200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29d40d10f0 con 0x7f29d40b03c0 2024-05-27T06:28:06.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.971+0000 7f29d9200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f29d406d610 con 0x7f29d40b07d0 2024-05-27T06:28:06.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.971+0000 7f29d9200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f29d406c720 con 0x7f29d40ce440 2024-05-27T06:28:06.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.971+0000 7f29d2800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f29d40b07d0 0x7f29d40ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:06.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.971+0000 7f29d1e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f29d40b03c0 0x7f29d40cdd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:53776/0 (socket says 172.21.15.87:53776) 2024-05-27T06:28:06.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.971+0000 7f29d1e00640 1 -- 172.21.15.87:0/3208697180 learned_addr learned my addr 172.21.15.87:0/3208697180 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:06.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.971+0000 7f29c9400640 1 --2- 172.21.15.87:0/3208697180 >> v2:172.21.15.149:3300/0 conn(0x7f29d40ce440 0x7f29d40ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:06.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.971+0000 7f29d2800640 1 -- 172.21.15.87:0/3208697180 >> v2:172.21.15.149:3300/0 conn(0x7f29d40ce440 msgr2=0x7f29d40ae340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:06.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.971+0000 7f29d2800640 1 --2- 172.21.15.87:0/3208697180 >> v2:172.21.15.149:3300/0 conn(0x7f29d40ce440 0x7f29d40ae340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:06.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.971+0000 7f29d2800640 1 -- 172.21.15.87:0/3208697180 >> v1:172.21.15.87:6789/0 conn(0x7f29d40b03c0 legacy=0x7f29d40cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:06.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.971+0000 7f29d2800640 1 -- 172.21.15.87:0/3208697180 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d406ca00 con 0x7f29d40b07d0 2024-05-27T06:28:06.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.971+0000 7f29c9400640 1 --2- 172.21.15.87:0/3208697180 >> v2:172.21.15.149:3300/0 conn(0x7f29d40ce440 0x7f29d40ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:06.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.975+0000 7f29d2800640 1 --2- 172.21.15.87:0/3208697180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29d40b07d0 0x7f29d40ae880 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f29d40d2440 tx=0x7f29cc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3efafe19249543c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:06.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.975+0000 7f29d1400640 1 -- 172.21.15.87:0/3208697180 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc0b0070 con 0x7f29d40b07d0 2024-05-27T06:28:06.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.975+0000 7f29d1400640 1 -- 172.21.15.87:0/3208697180 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29cc0ab600 con 0x7f29d40b07d0 2024-05-27T06:28:06.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.975+0000 7f29d1400640 1 -- 172.21.15.87:0/3208697180 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc0ab9d0 con 0x7f29d40b07d0 2024-05-27T06:28:06.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.975+0000 7f29d9200640 1 -- 172.21.15.87:0/3208697180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29d40b07d0 msgr2=0x7f29d40ae880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:06.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.975+0000 7f29d9200640 1 --2- 172.21.15.87:0/3208697180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29d40b07d0 0x7f29d40ae880 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f29d40d2440 tx=0x7f29cc01c450 comp rx=0 tx=0).stop 2024-05-27T06:28:06.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.975+0000 7f29d9200640 1 -- 172.21.15.87:0/3208697180 shutdown_connections 2024-05-27T06:28:06.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.975+0000 7f29d9200640 1 --2- 172.21.15.87:0/3208697180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29d40b07d0 0x7f29d40ae880 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:06.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.975+0000 7f29d9200640 1 --2- 172.21.15.87:0/3208697180 >> v2:172.21.15.149:3300/0 conn(0x7f29d40ce440 0x7f29d40ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:06.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.975+0000 7f29d9200640 1 -- 172.21.15.87:0/3208697180 >> 172.21.15.87:0/3208697180 conn(0x7f29d40b46b0 msgr2=0x7f29d40b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:06.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.975+0000 7f29d9200640 1 -- 172.21.15.87:0/3208697180 shutdown_connections 2024-05-27T06:28:06.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.975+0000 7f29d9200640 1 -- 172.21.15.87:0/3208697180 wait complete. 2024-05-27T06:28:06.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.975+0000 7f29d9200640 1 Processor -- start 2024-05-27T06:28:06.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.975+0000 7f29d9200640 1 -- start start 2024-05-27T06:28:06.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.979+0000 7f29d9200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29d40b03c0 0x7f29d41556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:06.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.979+0000 7f29d9200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29d40b07d0 0x7f29d40743b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:06.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.979+0000 7f29d9200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29d41562a0 0x7f29d40748f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:06.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.979+0000 7f29d9200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f29d40aedc0 con 0x7f29d40b07d0 2024-05-27T06:28:06.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.979+0000 7f29d9200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f29d415c620 con 0x7f29d41562a0 2024-05-27T06:28:06.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.979+0000 7f29d9200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f29d40aef40 con 0x7f29d40b03c0 2024-05-27T06:28:06.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.979+0000 7f29c9400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29d40b07d0 0x7f29d40743b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:06.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.979+0000 7f29c9400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29d40b07d0 0x7f29d40743b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55396/0 (socket says 172.21.15.87:55396) 2024-05-27T06:28:06.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.979+0000 7f29c9400640 1 -- 172.21.15.87:0/3613175950 learned_addr learned my addr 172.21.15.87:0/3613175950 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:06.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.979+0000 7f29d2800640 1 --2- 172.21.15.87:0/3613175950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29d41562a0 0x7f29d40748f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:06.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.979+0000 7f29d1e00640 1 --2- 172.21.15.87:0/3613175950 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29d40b03c0 0x7f29d41556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:06.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.979+0000 7f29c9400640 1 -- 172.21.15.87:0/3613175950 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29d40b03c0 msgr2=0x7f29d41556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:06.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.979+0000 7f29c9400640 1 --2- 172.21.15.87:0/3613175950 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29d40b03c0 0x7f29d41556c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:06.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.979+0000 7f29c9400640 1 -- 172.21.15.87:0/3613175950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29d41562a0 msgr2=0x7f29d40748f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:06.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.979+0000 7f29c9400640 1 --2- 172.21.15.87:0/3613175950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29d41562a0 0x7f29d40748f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:06.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.979+0000 7f29c9400640 1 -- 172.21.15.87:0/3613175950 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d406f3e0 con 0x7f29d40b07d0 2024-05-27T06:28:06.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.979+0000 7f29c9400640 1 --2- 172.21.15.87:0/3613175950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29d40b07d0 0x7f29d40743b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f29bc00c7f0 tx=0x7f29bc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:06.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.979+0000 7f29caa00640 1 -- 172.21.15.87:0/3613175950 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29bc015070 con 0x7f29d40b07d0 2024-05-27T06:28:06.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.979+0000 7f29caa00640 1 -- 172.21.15.87:0/3613175950 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29bc0077c0 con 0x7f29d40b07d0 2024-05-27T06:28:06.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.979+0000 7f29d9200640 1 -- 172.21.15.87:0/3613175950 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29d415e870 con 0x7f29d40b07d0 2024-05-27T06:28:06.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.979+0000 7f29caa00640 1 -- 172.21.15.87:0/3613175950 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29bc007bb0 con 0x7f29d40b07d0 2024-05-27T06:28:06.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.979+0000 7f29d9200640 1 -- 172.21.15.87:0/3613175950 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29d415ee30 con 0x7f29d40b07d0 2024-05-27T06:28:06.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.979+0000 7f29d9200640 1 -- 172.21.15.87:0/3613175950 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29d406aa30 con 0x7f29d40b07d0 2024-05-27T06:28:06.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.983+0000 7f29caa00640 1 -- 172.21.15.87:0/3613175950 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f29bc018070 con 0x7f29d40b07d0 2024-05-27T06:28:06.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.983+0000 7f29caa00640 1 --2- 172.21.15.87:0/3613175950 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f29b006f400 0x7f29b0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:06.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.983+0000 7f29caa00640 1 -- 172.21.15.87:0/3613175950 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f29bc08f560 con 0x7f29d40b07d0 2024-05-27T06:28:06.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.983+0000 7f29d1e00640 1 --2- 172.21.15.87:0/3613175950 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f29b006f400 0x7f29b0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:06.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.983+0000 7f29d1e00640 1 --2- 172.21.15.87:0/3613175950 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f29b006f400 0x7f29b0071910 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f29c40012f0 tx=0x7f29c4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:06.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:06.987+0000 7f29caa00640 1 -- 172.21.15.87:0/3613175950 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f29bc05c070 con 0x7f29d40b07d0 2024-05-27T06:28:07.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.175+0000 7f29d9200640 1 -- 172.21.15.87:0/3613175950 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29d406db70 con 0x7f29d40b07d0 2024-05-27T06:28:07.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.179+0000 7f29caa00640 1 -- 172.21.15.87:0/3613175950 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7f29bc05b970 con 0x7f29d40b07d0 2024-05-27T06:28:07.174 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:07.174 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1075024068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1075024068},{"type":"v1","addr":"172.21.15.87:6835","nonce":1075024068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/437385084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":437385084},{"type":"v1","addr":"172.21.15.149:6833","nonce":437385084}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/852280291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":852280291},{"type":"v1","addr":"172.21.15.149:6835","nonce":852280291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T06:27:37.964959+0000","modified":"2024-05-27T06:27:59.081534+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/1799934036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1799934036},{"type":"v1","addr":"172.21.15.87:6837","nonce":1799934036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-27T06:28:07.175 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 9 2024-05-27T06:28:07.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.179+0000 7f29d9200640 1 -- 172.21.15.87:0/3613175950 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f29b006f400 msgr2=0x7f29b0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:07.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.179+0000 7f29d9200640 1 --2- 172.21.15.87:0/3613175950 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f29b006f400 0x7f29b0071910 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f29c40012f0 tx=0x7f29c4009040 comp rx=0 tx=0).stop 2024-05-27T06:28:07.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.179+0000 7f29d9200640 1 -- 172.21.15.87:0/3613175950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29d40b07d0 msgr2=0x7f29d40743b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:07.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.179+0000 7f29d9200640 1 --2- 172.21.15.87:0/3613175950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29d40b07d0 0x7f29d40743b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f29bc00c7f0 tx=0x7f29bc00ccb0 comp rx=0 tx=0).stop 2024-05-27T06:28:07.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.179+0000 7f29d9200640 1 -- 172.21.15.87:0/3613175950 shutdown_connections 2024-05-27T06:28:07.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.179+0000 7f29d9200640 1 --2- 172.21.15.87:0/3613175950 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f29b006f400 0x7f29b0071910 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:07.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.179+0000 7f29d9200640 1 --2- 172.21.15.87:0/3613175950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29d41562a0 0x7f29d40748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:07.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.179+0000 7f29d9200640 1 --2- 172.21.15.87:0/3613175950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29d40b07d0 0x7f29d40743b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:07.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.179+0000 7f29d9200640 1 --2- 172.21.15.87:0/3613175950 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29d40b03c0 0x7f29d41556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:07.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.179+0000 7f29d9200640 1 -- 172.21.15.87:0/3613175950 >> 172.21.15.87:0/3613175950 conn(0x7f29d40b46b0 msgr2=0x7f29d4165e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:07.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.179+0000 7f29d9200640 1 -- 172.21.15.87:0/3613175950 shutdown_connections 2024-05-27T06:28:07.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.179+0000 7f29d9200640 1 -- 172.21.15.87:0/3613175950 wait complete. 2024-05-27T06:28:07.196 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T06:28:07.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.343+0000 7f2de8a00640 1 Processor -- start 2024-05-27T06:28:07.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.343+0000 7f2de8a00640 1 -- start start 2024-05-27T06:28:07.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.347+0000 7f2de8a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2de40cdcc0 0x7f2de415fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:07.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.347+0000 7f2de8a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2de40b8870 0x7f2de40b8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:07.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.347+0000 7f2de8a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2de41639d0 0x7f2de4163de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:07.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.347+0000 7f2de8a00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f2de40ce4c0 con 0x7f2de40cdcc0 2024-05-27T06:28:07.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.347+0000 7f2de8a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f2de40d21c0 con 0x7f2de40b8870 2024-05-27T06:28:07.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.347+0000 7f2de8a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2de40d24a0 con 0x7f2de41639d0 2024-05-27T06:28:07.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.347+0000 7f2de1e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2de40cdcc0 0x7f2de415fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:07.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.347+0000 7f2de1e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2de40cdcc0 0x7f2de415fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55398/0 (socket says 172.21.15.87:55398) 2024-05-27T06:28:07.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.347+0000 7f2de1e00640 1 -- 172.21.15.87:0/1950424020 learned_addr learned my addr 172.21.15.87:0/1950424020 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:07.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.347+0000 7f2de2800640 1 --2- 172.21.15.87:0/1950424020 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2de41639d0 0x7f2de4163de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:07.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.347+0000 7f2ddbe00640 1 --2- 172.21.15.87:0/1950424020 >> v2:172.21.15.149:3300/0 conn(0x7f2de40b8870 0x7f2de40b8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:07.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.347+0000 7f2de1e00640 1 -- 172.21.15.87:0/1950424020 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2de41639d0 msgr2=0x7f2de4163de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:07.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.347+0000 7f2de1e00640 1 --2- 172.21.15.87:0/1950424020 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2de41639d0 0x7f2de4163de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:07.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.347+0000 7f2de1e00640 1 -- 172.21.15.87:0/1950424020 >> v2:172.21.15.149:3300/0 conn(0x7f2de40b8870 msgr2=0x7f2de40b8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:07.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.347+0000 7f2de1e00640 1 --2- 172.21.15.87:0/1950424020 >> v2:172.21.15.149:3300/0 conn(0x7f2de40b8870 0x7f2de40b8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:07.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.347+0000 7f2de1e00640 1 -- 172.21.15.87:0/1950424020 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de40d2780 con 0x7f2de40cdcc0 2024-05-27T06:28:07.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.347+0000 7f2de2800640 1 --2- 172.21.15.87:0/1950424020 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2de41639d0 0x7f2de4163de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:07.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.347+0000 7f2ddbe00640 1 --2- 172.21.15.87:0/1950424020 >> v2:172.21.15.149:3300/0 conn(0x7f2de40b8870 0x7f2de40b8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:07.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.351+0000 7f2de1e00640 1 --2- 172.21.15.87:0/1950424020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2de40cdcc0 0x7f2de415fe50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2de4163910 tx=0x7f2dd401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c6b736b13585a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:07.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.351+0000 7f2de1400640 1 -- 172.21.15.87:0/1950424020 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd40b2070 con 0x7f2de40cdcc0 2024-05-27T06:28:07.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.351+0000 7f2de1400640 1 -- 172.21.15.87:0/1950424020 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd40a9070 con 0x7f2de40cdcc0 2024-05-27T06:28:07.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.351+0000 7f2de1400640 1 -- 172.21.15.87:0/1950424020 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd40ad880 con 0x7f2de40cdcc0 2024-05-27T06:28:07.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.351+0000 7f2de8a00640 1 -- 172.21.15.87:0/1950424020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2de40cdcc0 msgr2=0x7f2de415fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:07.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.351+0000 7f2de8a00640 1 --2- 172.21.15.87:0/1950424020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2de40cdcc0 0x7f2de415fe50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2de4163910 tx=0x7f2dd401c490 comp rx=0 tx=0).stop 2024-05-27T06:28:07.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.351+0000 7f2de8a00640 1 -- 172.21.15.87:0/1950424020 shutdown_connections 2024-05-27T06:28:07.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.351+0000 7f2de8a00640 1 --2- 172.21.15.87:0/1950424020 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2de41639d0 0x7f2de4163de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:07.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.351+0000 7f2de8a00640 1 --2- 172.21.15.87:0/1950424020 >> v2:172.21.15.149:3300/0 conn(0x7f2de40b8870 0x7f2de40b8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:07.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.351+0000 7f2de8a00640 1 --2- 172.21.15.87:0/1950424020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2de40cdcc0 0x7f2de415fe50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:07.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.351+0000 7f2de8a00640 1 -- 172.21.15.87:0/1950424020 >> 172.21.15.87:0/1950424020 conn(0x7f2de40d3670 msgr2=0x7f2de40d3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:07.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.351+0000 7f2de8a00640 1 -- 172.21.15.87:0/1950424020 shutdown_connections 2024-05-27T06:28:07.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.351+0000 7f2de8a00640 1 -- 172.21.15.87:0/1950424020 wait complete. 2024-05-27T06:28:07.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.355+0000 7f2de8a00640 1 Processor -- start 2024-05-27T06:28:07.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.355+0000 7f2de8a00640 1 -- start start 2024-05-27T06:28:07.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.355+0000 7f2de8a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2de40b8870 0x7f2de4156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:07.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.355+0000 7f2de8a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2de40cdcc0 0x7f2de415e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:07.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.355+0000 7f2de8a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2de41639d0 0x7f2de415e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:07.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.355+0000 7f2de8a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2de40b7390 con 0x7f2de41639d0 2024-05-27T06:28:07.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.355+0000 7f2de8a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2de40b7210 con 0x7f2de40b8870 2024-05-27T06:28:07.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.355+0000 7f2de8a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2de40cf1b0 con 0x7f2de40cdcc0 2024-05-27T06:28:07.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.355+0000 7f2de2800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2de41639d0 0x7f2de415e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:07.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.355+0000 7f2de2800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2de41639d0 0x7f2de415e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55412/0 (socket says 172.21.15.87:55412) 2024-05-27T06:28:07.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.355+0000 7f2de2800640 1 -- 172.21.15.87:0/1154962432 learned_addr learned my addr 172.21.15.87:0/1154962432 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:07.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.355+0000 7f2de1e00640 1 --2- 172.21.15.87:0/1154962432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2de40b8870 0x7f2de4156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:07.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.355+0000 7f2ddbe00640 1 --2- 172.21.15.87:0/1154962432 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2de40cdcc0 0x7f2de415e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:07.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.355+0000 7f2de2800640 1 -- 172.21.15.87:0/1154962432 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2de40cdcc0 msgr2=0x7f2de415e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:07.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.355+0000 7f2de2800640 1 --2- 172.21.15.87:0/1154962432 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2de40cdcc0 0x7f2de415e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:07.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.355+0000 7f2de2800640 1 -- 172.21.15.87:0/1154962432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2de40b8870 msgr2=0x7f2de4156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:07.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.355+0000 7f2de2800640 1 --2- 172.21.15.87:0/1154962432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2de40b8870 0x7f2de4156800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:07.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.355+0000 7f2de2800640 1 -- 172.21.15.87:0/1154962432 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de41583b0 con 0x7f2de41639d0 2024-05-27T06:28:07.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.355+0000 7f2de2800640 1 --2- 172.21.15.87:0/1154962432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2de41639d0 0x7f2de415e7e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00cd80 tx=0x7f2ddc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:07.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.355+0000 7f2dda000640 1 -- 172.21.15.87:0/1154962432 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc003ba0 con 0x7f2de41639d0 2024-05-27T06:28:07.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.355+0000 7f2dda000640 1 -- 172.21.15.87:0/1154962432 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ddc003d60 con 0x7f2de41639d0 2024-05-27T06:28:07.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.355+0000 7f2dda000640 1 -- 172.21.15.87:0/1154962432 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc004260 con 0x7f2de41639d0 2024-05-27T06:28:07.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.355+0000 7f2de8a00640 1 -- 172.21.15.87:0/1154962432 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de4158c00 con 0x7f2de41639d0 2024-05-27T06:28:07.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.355+0000 7f2de8a00640 1 -- 172.21.15.87:0/1154962432 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de4158ea0 con 0x7f2de41639d0 2024-05-27T06:28:07.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.359+0000 7f2de8a00640 1 -- 172.21.15.87:0/1154962432 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2de406aa30 con 0x7f2de41639d0 2024-05-27T06:28:07.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.359+0000 7f2dda000640 1 -- 172.21.15.87:0/1154962432 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2ddc004400 con 0x7f2de41639d0 2024-05-27T06:28:07.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.359+0000 7f2dda000640 1 --2- 172.21.15.87:0/1154962432 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2dc006f400 0x7f2dc0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:07.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.359+0000 7f2dda000640 1 -- 172.21.15.87:0/1154962432 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2ddc08ff10 con 0x7f2de41639d0 2024-05-27T06:28:07.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.359+0000 7f2de1e00640 1 --2- 172.21.15.87:0/1154962432 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2dc006f400 0x7f2dc0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:07.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.359+0000 7f2de1e00640 1 --2- 172.21.15.87:0/1154962432 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2dc006f400 0x7f2dc0071910 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40af000 tx=0x7f2dd4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:07.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.363+0000 7f2dda000640 1 -- 172.21.15.87:0/1154962432 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f2ddc014030 con 0x7f2de41639d0 2024-05-27T06:28:07.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.519+0000 7f2de8a00640 1 -- 172.21.15.87:0/1154962432 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2de4163de0 con 0x7f2de41639d0 2024-05-27T06:28:07.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.523+0000 7f2dda000640 1 -- 172.21.15.87:0/1154962432 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7f2ddc05c500 con 0x7f2de41639d0 2024-05-27T06:28:07.518 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:07.518 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:27:43.048854+0000","last_up_change":"2024-05-27T06:27:25.988592+0000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T06:27:26.590191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T06:27:35.840893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T06:27:36.929608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-27T06:27:40.638358+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6801","nonce":3674824716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6803","nonce":3674824716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6807","nonce":3674824716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6805","nonce":3674824716}]},"public_addr":"172.21.15.87:6801/3674824716","cluster_addr":"172.21.15.87:6803/3674824716","heartbeat_back_addr":"172.21.15.87:6807/3674824716","heartbeat_front_addr":"172.21.15.87:6805/3674824716","state":["exists","up"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6809","nonce":2443981288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6811","nonce":2443981288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6815","nonce":2443981288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6813","nonce":2443981288}]},"public_addr":"172.21.15.87:6809/2443981288","cluster_addr":"172.21.15.87:6811/2443981288","heartbeat_back_addr":"172.21.15.87:6815/2443981288","heartbeat_front_addr":"172.21.15.87:6813/2443981288","state":["exists","up"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6819","nonce":1441249238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6823","nonce":1441249238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6831","nonce":1441249238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6825","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6827","nonce":1441249238}]},"public_addr":"172.21.15.87:6819/1441249238","cluster_addr":"172.21.15.87:6823/1441249238","heartbeat_back_addr":"172.21.15.87:6831/1441249238","heartbeat_front_addr":"172.21.15.87:6827/1441249238","state":["exists","up"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6818","nonce":1173805234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6822","nonce":1173805234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6829","nonce":1173805234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6826","nonce":1173805234}]},"public_addr":"172.21.15.87:6818/1173805234","cluster_addr":"172.21.15.87:6822/1173805234","heartbeat_back_addr":"172.21.15.87:6829/1173805234","heartbeat_front_addr":"172.21.15.87:6826/1173805234","state":["exists","up"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6819","nonce":1551871079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6823","nonce":1551871079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6831","nonce":1551871079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6827","nonce":1551871079}]},"public_addr":"172.21.15.149:6819/1551871079","cluster_addr":"172.21.15.149:6823/1551871079","heartbeat_back_addr":"172.21.15.149:6831/1551871079","heartbeat_front_addr":"172.21.15.149:6827/1551871079","state":["exists","up"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6818","nonce":582864816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6822","nonce":582864816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6830","nonce":582864816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6826","nonce":582864816}]},"public_addr":"172.21.15.149:6818/582864816","cluster_addr":"172.21.15.149:6822/582864816","heartbeat_back_addr":"172.21.15.149:6830/582864816","heartbeat_front_addr":"172.21.15.149:6826/582864816","state":["exists","up"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6801","nonce":531351314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6803","nonce":531351314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6807","nonce":531351314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6805","nonce":531351314}]},"public_addr":"172.21.15.149:6801/531351314","cluster_addr":"172.21.15.149:6803/531351314","heartbeat_back_addr":"172.21.15.149:6807/531351314","heartbeat_front_addr":"172.21.15.149:6805/531351314","state":["exists","up"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6809","nonce":1171039913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6811","nonce":1171039913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6815","nonce":1171039913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6813","nonce":1171039913}]},"public_addr":"172.21.15.149:6809/1171039913","cluster_addr":"172.21.15.149:6811/1171039913","heartbeat_back_addr":"172.21.15.149:6815/1171039913","heartbeat_front_addr":"172.21.15.149:6813/1171039913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.589776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.819787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.767566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.683842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.038885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.120319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.687007+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.812832+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:28:07.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.523+0000 7f2de8a00640 1 -- 172.21.15.87:0/1154962432 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2dc006f400 msgr2=0x7f2dc0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:07.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.523+0000 7f2de8a00640 1 --2- 172.21.15.87:0/1154962432 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2dc006f400 0x7f2dc0071910 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40af000 tx=0x7f2dd4008040 comp rx=0 tx=0).stop 2024-05-27T06:28:07.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.523+0000 7f2de8a00640 1 -- 172.21.15.87:0/1154962432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2de41639d0 msgr2=0x7f2de415e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:07.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.523+0000 7f2de8a00640 1 --2- 172.21.15.87:0/1154962432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2de41639d0 0x7f2de415e7e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00cd80 tx=0x7f2ddc00a650 comp rx=0 tx=0).stop 2024-05-27T06:28:07.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.523+0000 7f2de8a00640 1 -- 172.21.15.87:0/1154962432 shutdown_connections 2024-05-27T06:28:07.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.523+0000 7f2de8a00640 1 --2- 172.21.15.87:0/1154962432 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2dc006f400 0x7f2dc0071910 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:07.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.523+0000 7f2de8a00640 1 --2- 172.21.15.87:0/1154962432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2de41639d0 0x7f2de415e7e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:07.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.523+0000 7f2de8a00640 1 --2- 172.21.15.87:0/1154962432 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2de40cdcc0 0x7f2de415e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:07.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.523+0000 7f2de8a00640 1 --2- 172.21.15.87:0/1154962432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2de40b8870 0x7f2de4156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:07.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.523+0000 7f2de8a00640 1 -- 172.21.15.87:0/1154962432 >> 172.21.15.87:0/1154962432 conn(0x7f2de40d3670 msgr2=0x7f2de415c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:07.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.523+0000 7f2de8a00640 1 -- 172.21.15.87:0/1154962432 shutdown_connections 2024-05-27T06:28:07.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.523+0000 7f2de8a00640 1 -- 172.21.15.87:0/1154962432 wait complete. 2024-05-27T06:28:07.540 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T06:28:07.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.691+0000 7f8460600640 1 Processor -- start 2024-05-27T06:28:07.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.691+0000 7f8460600640 1 -- start start 2024-05-27T06:28:07.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.691+0000 7f8460600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f845815cfe0 0x7f845815d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:07.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.691+0000 7f8460600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f84580d1740 0x7f84580d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:07.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.691+0000 7f8460600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f845815d930 con 0x7f84580cbf90 2024-05-27T06:28:07.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.691+0000 7f8460600640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f84580d2090 con 0x7f845815cfe0 2024-05-27T06:28:07.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.691+0000 7f8460600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f845815dbb0 con 0x7f84580d1740 2024-05-27T06:28:07.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.691+0000 7f845d200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f845815cfe0 0x7f845815d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:07.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.691+0000 7f845d200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f845815cfe0 0x7f845815d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55418/0 (socket says 172.21.15.87:55418) 2024-05-27T06:28:07.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.691+0000 7f845d200640 1 -- 172.21.15.87:0/3387966593 learned_addr learned my addr 172.21.15.87:0/3387966593 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:07.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.695+0000 7f845e600640 1 --2- 172.21.15.87:0/3387966593 >> v2:172.21.15.149:3300/0 conn(0x7f84580d1740 0x7f84580d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:07.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.695+0000 7f845d200640 1 -- 172.21.15.87:0/3387966593 >> v2:172.21.15.149:3300/0 conn(0x7f84580d1740 msgr2=0x7f84580d1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:07.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.695+0000 7f845d200640 1 --2- 172.21.15.87:0/3387966593 >> v2:172.21.15.149:3300/0 conn(0x7f84580d1740 0x7f84580d1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:07.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.695+0000 7f845d200640 1 -- 172.21.15.87:0/3387966593 >> v1:172.21.15.149:6789/0 conn(0x7f84580cbf90 legacy=0x7f845806cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:07.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.695+0000 7f845d200640 1 -- 172.21.15.87:0/3387966593 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f845815de90 con 0x7f845815cfe0 2024-05-27T06:28:07.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.695+0000 7f845e600640 1 --2- 172.21.15.87:0/3387966593 >> v2:172.21.15.149:3300/0 conn(0x7f84580d1740 0x7f84580d1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:07.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.695+0000 7f845d200640 1 --2- 172.21.15.87:0/3387966593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f845815cfe0 0x7f845815d3f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f84580cdc20 tx=0x7f844401eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=127dd03eb9eec3d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:07.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.695+0000 7f8457e00640 1 -- 172.21.15.87:0/3387966593 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84440b5070 con 0x7f845815cfe0 2024-05-27T06:28:07.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.695+0000 7f8457e00640 1 -- 172.21.15.87:0/3387966593 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84440a87d0 con 0x7f845815cfe0 2024-05-27T06:28:07.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.695+0000 7f8457e00640 1 -- 172.21.15.87:0/3387966593 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84440a8ba0 con 0x7f845815cfe0 2024-05-27T06:28:07.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.699+0000 7f8460600640 1 -- 172.21.15.87:0/3387966593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f845815cfe0 msgr2=0x7f845815d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:07.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.699+0000 7f8460600640 1 --2- 172.21.15.87:0/3387966593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f845815cfe0 0x7f845815d3f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f84580cdc20 tx=0x7f844401eb10 comp rx=0 tx=0).stop 2024-05-27T06:28:07.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.699+0000 7f8460600640 1 -- 172.21.15.87:0/3387966593 shutdown_connections 2024-05-27T06:28:07.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.699+0000 7f8460600640 1 --2- 172.21.15.87:0/3387966593 >> v2:172.21.15.149:3300/0 conn(0x7f84580d1740 0x7f84580d1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:07.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.699+0000 7f8460600640 1 --2- 172.21.15.87:0/3387966593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f845815cfe0 0x7f845815d3f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:07.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.699+0000 7f8460600640 1 -- 172.21.15.87:0/3387966593 >> 172.21.15.87:0/3387966593 conn(0x7f84580b46b0 msgr2=0x7f84580b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:07.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.699+0000 7f8460600640 1 -- 172.21.15.87:0/3387966593 shutdown_connections 2024-05-27T06:28:07.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.699+0000 7f8460600640 1 -- 172.21.15.87:0/3387966593 wait complete. 2024-05-27T06:28:07.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.699+0000 7f8460600640 1 Processor -- start 2024-05-27T06:28:07.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.699+0000 7f8460600640 1 -- start start 2024-05-27T06:28:07.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.703+0000 7f8460600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f84580cbf90 0x7f845815bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:07.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.703+0000 7f8460600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84580d1740 0x7f84581fa320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:07.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.703+0000 7f8460600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f845815cfe0 0x7f84581fa860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:07.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.703+0000 7f8460600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f845815e170 con 0x7f84580d1740 2024-05-27T06:28:07.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.703+0000 7f8460600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f845806caa0 con 0x7f845815cfe0 2024-05-27T06:28:07.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.703+0000 7f8460600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f84580cc3a0 con 0x7f84580cbf90 2024-05-27T06:28:07.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.703+0000 7f845d200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84580d1740 0x7f84581fa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:07.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.703+0000 7f845d200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84580d1740 0x7f84581fa320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55432/0 (socket says 172.21.15.87:55432) 2024-05-27T06:28:07.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.703+0000 7f845d200640 1 -- 172.21.15.87:0/3818473880 learned_addr learned my addr 172.21.15.87:0/3818473880 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:07.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.703+0000 7f845e600640 1 --2- 172.21.15.87:0/3818473880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f845815cfe0 0x7f84581fa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:07.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.703+0000 7f845dc00640 1 --2- 172.21.15.87:0/3818473880 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f84580cbf90 0x7f845815bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:07.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.703+0000 7f845d200640 1 -- 172.21.15.87:0/3818473880 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f84580cbf90 msgr2=0x7f845815bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:07.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.703+0000 7f845d200640 1 --2- 172.21.15.87:0/3818473880 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f84580cbf90 0x7f845815bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:07.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.703+0000 7f845d200640 1 -- 172.21.15.87:0/3818473880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f845815cfe0 msgr2=0x7f84581fa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:07.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.703+0000 7f845d200640 1 --2- 172.21.15.87:0/3818473880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f845815cfe0 0x7f84581fa860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:07.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.703+0000 7f845d200640 1 -- 172.21.15.87:0/3818473880 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84580aebc0 con 0x7f84580d1740 2024-05-27T06:28:07.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.703+0000 7f845d200640 1 --2- 172.21.15.87:0/3818473880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84580d1740 0x7f84581fa320 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f844401d1c0 tx=0x7f844401b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:07.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.703+0000 7f8455600640 1 -- 172.21.15.87:0/3818473880 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84440b5040 con 0x7f84580d1740 2024-05-27T06:28:07.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.703+0000 7f8455600640 1 -- 172.21.15.87:0/3818473880 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84440be070 con 0x7f84580d1740 2024-05-27T06:28:07.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.703+0000 7f8455600640 1 -- 172.21.15.87:0/3818473880 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84440b0900 con 0x7f84580d1740 2024-05-27T06:28:07.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.703+0000 7f8460600640 1 -- 172.21.15.87:0/3818473880 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84580aeea0 con 0x7f84580d1740 2024-05-27T06:28:07.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.703+0000 7f8460600640 1 -- 172.21.15.87:0/3818473880 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84581528c0 con 0x7f84580d1740 2024-05-27T06:28:07.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.703+0000 7f8460600640 1 -- 172.21.15.87:0/3818473880 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f845806aa30 con 0x7f84580d1740 2024-05-27T06:28:07.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.703+0000 7f8455600640 1 -- 172.21.15.87:0/3818473880 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f84440b0aa0 con 0x7f84580d1740 2024-05-27T06:28:07.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.707+0000 7f8455600640 1 --2- 172.21.15.87:0/3818473880 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f843806f400 0x7f8438071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:07.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.707+0000 7f8455600640 1 -- 172.21.15.87:0/3818473880 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f844412ca70 con 0x7f84580d1740 2024-05-27T06:28:07.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.707+0000 7f845dc00640 1 --2- 172.21.15.87:0/3818473880 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f843806f400 0x7f8438071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:07.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.707+0000 7f845dc00640 1 --2- 172.21.15.87:0/3818473880 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f843806f400 0x7f8438071910 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f844c00b810 tx=0x7f844c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:07.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.711+0000 7f8455600640 1 -- 172.21.15.87:0/3818473880 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f845815d930 con 0x7f84580d1740 2024-05-27T06:28:07.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.903+0000 7f8460600640 1 -- 172.21.15.87:0/3818473880 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f845809abb0 con 0x7f84580d1740 2024-05-27T06:28:07.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.903+0000 7f8455600640 1 -- 172.21.15.87:0/3818473880 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7f845809abb0 con 0x7f84580d1740 2024-05-27T06:28:07.898 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:07.898 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1075024068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1075024068},{"type":"v1","addr":"172.21.15.87:6835","nonce":1075024068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/437385084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":437385084},{"type":"v1","addr":"172.21.15.149:6833","nonce":437385084}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/852280291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":852280291},{"type":"v1","addr":"172.21.15.149:6835","nonce":852280291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T06:27:37.964959+0000","modified":"2024-05-27T06:27:59.081534+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/1799934036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1799934036},{"type":"v1","addr":"172.21.15.87:6837","nonce":1799934036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-27T06:28:07.899 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 9 2024-05-27T06:28:07.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.903+0000 7f8460600640 1 -- 172.21.15.87:0/3818473880 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f843806f400 msgr2=0x7f8438071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:07.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.903+0000 7f8460600640 1 --2- 172.21.15.87:0/3818473880 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f843806f400 0x7f8438071910 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f844c00b810 tx=0x7f844c008040 comp rx=0 tx=0).stop 2024-05-27T06:28:07.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.903+0000 7f8460600640 1 -- 172.21.15.87:0/3818473880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84580d1740 msgr2=0x7f84581fa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:07.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.903+0000 7f8460600640 1 --2- 172.21.15.87:0/3818473880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84580d1740 0x7f84581fa320 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f844401d1c0 tx=0x7f844401b8b0 comp rx=0 tx=0).stop 2024-05-27T06:28:07.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.903+0000 7f8460600640 1 -- 172.21.15.87:0/3818473880 shutdown_connections 2024-05-27T06:28:07.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.903+0000 7f8460600640 1 --2- 172.21.15.87:0/3818473880 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f843806f400 0x7f8438071910 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:07.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.903+0000 7f8460600640 1 --2- 172.21.15.87:0/3818473880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f845815cfe0 0x7f84581fa860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:07.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.903+0000 7f8460600640 1 --2- 172.21.15.87:0/3818473880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84580d1740 0x7f84581fa320 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:07.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.903+0000 7f8460600640 1 --2- 172.21.15.87:0/3818473880 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f84580cbf90 0x7f845815bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:07.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.903+0000 7f8460600640 1 -- 172.21.15.87:0/3818473880 >> 172.21.15.87:0/3818473880 conn(0x7f84580b46b0 msgr2=0x7f8458153800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:07.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.903+0000 7f8460600640 1 -- 172.21.15.87:0/3818473880 shutdown_connections 2024-05-27T06:28:07.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:07.903+0000 7f8460600640 1 -- 172.21.15.87:0/3818473880 wait complete. 2024-05-27T06:28:08.323 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-27T06:27:37.964959+0000', 'modified': '2024-05-27T06:27:59.081534+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.87:6837/1799934036', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6836', 'nonce': 1799934036}, {'type': 'v1', 'addr': '172.21.15.87:6837', 'nonce': 1799934036}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4290, 'qdb_cluster': [4290]} 2024-05-27T06:28:08.323 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-27T06:28:08.323 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-27T06:28:08.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.474+0000 7f2b8a800640 1 Processor -- start 2024-05-27T06:28:08.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.474+0000 7f2b8a800640 1 -- start start 2024-05-27T06:28:08.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.478+0000 7f2b8a800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2b840b4690 0x7f2b840cf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:08.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.478+0000 7f2b8a800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2b840d1ba0 0x7f2b84163a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:08.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.478+0000 7f2b8a800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b840ce2c0 con 0x7f2b840d1fb0 2024-05-27T06:28:08.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.478+0000 7f2b8a800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f2b840b4aa0 con 0x7f2b840b4690 2024-05-27T06:28:08.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.478+0000 7f2b8a800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f2b840ce090 con 0x7f2b840d1ba0 2024-05-27T06:28:08.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.478+0000 7f2b89400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2b840b4690 0x7f2b840cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:08.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.478+0000 7f2b89400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2b840b4690 0x7f2b840cf080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55448/0 (socket says 172.21.15.87:55448) 2024-05-27T06:28:08.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.478+0000 7f2b89400640 1 -- 172.21.15.87:0/900329660 learned_addr learned my addr 172.21.15.87:0/900329660 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:08.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.478+0000 7f2b88a00640 1 --2- 172.21.15.87:0/900329660 >> v2:172.21.15.149:3300/0 conn(0x7f2b840d1ba0 0x7f2b84163a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:08.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.478+0000 7f2b89400640 1 -- 172.21.15.87:0/900329660 >> v2:172.21.15.149:3300/0 conn(0x7f2b840d1ba0 msgr2=0x7f2b84163a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:08.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.478+0000 7f2b89400640 1 --2- 172.21.15.87:0/900329660 >> v2:172.21.15.149:3300/0 conn(0x7f2b840d1ba0 0x7f2b84163a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.478+0000 7f2b89400640 1 -- 172.21.15.87:0/900329660 >> v1:172.21.15.87:6789/0 conn(0x7f2b840d1fb0 legacy=0x7f2b8415d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:08.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.478+0000 7f2b83e00640 1 -- 172.21.15.87:0/900329660 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1379556715 0 0) 0x7f2b840ce2c0 con 0x7f2b840d1fb0 2024-05-27T06:28:08.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.478+0000 7f2b89400640 1 -- 172.21.15.87:0/900329660 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b840ce5a0 con 0x7f2b840b4690 2024-05-27T06:28:08.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.482+0000 7f2b89400640 1 --2- 172.21.15.87:0/900329660 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b840b4690 0x7f2b840cf080 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2b840d1140 tx=0x7f2b7801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b37aa607a48579e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:08.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.482+0000 7f2b83e00640 1 -- 172.21.15.87:0/900329660 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b780b0070 con 0x7f2b840b4690 2024-05-27T06:28:08.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.482+0000 7f2b83e00640 1 -- 172.21.15.87:0/900329660 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b780ab600 con 0x7f2b840b4690 2024-05-27T06:28:08.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.482+0000 7f2b83e00640 1 -- 172.21.15.87:0/900329660 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b780ab9d0 con 0x7f2b840b4690 2024-05-27T06:28:08.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.482+0000 7f2b8a800640 1 -- 172.21.15.87:0/900329660 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b840b4690 msgr2=0x7f2b840cf080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:08.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.482+0000 7f2b8a800640 1 --2- 172.21.15.87:0/900329660 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b840b4690 0x7f2b840cf080 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2b840d1140 tx=0x7f2b7801c520 comp rx=0 tx=0).stop 2024-05-27T06:28:08.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.482+0000 7f2b8a800640 1 -- 172.21.15.87:0/900329660 shutdown_connections 2024-05-27T06:28:08.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.482+0000 7f2b8a800640 1 --2- 172.21.15.87:0/900329660 >> v2:172.21.15.149:3300/0 conn(0x7f2b840d1ba0 0x7f2b84163a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.482+0000 7f2b8a800640 1 --2- 172.21.15.87:0/900329660 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b840b4690 0x7f2b840cf080 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.482+0000 7f2b8a800640 1 -- 172.21.15.87:0/900329660 >> 172.21.15.87:0/900329660 conn(0x7f2b840d35c0 msgr2=0x7f2b840d39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:08.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.482+0000 7f2b8a800640 1 -- 172.21.15.87:0/900329660 shutdown_connections 2024-05-27T06:28:08.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.482+0000 7f2b8a800640 1 -- 172.21.15.87:0/900329660 wait complete. 2024-05-27T06:28:08.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.482+0000 7f2b8a800640 1 Processor -- start 2024-05-27T06:28:08.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.482+0000 7f2b8a800640 1 -- start start 2024-05-27T06:28:08.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.486+0000 7f2b8a800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b840b4690 0x7f2b84158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:08.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.486+0000 7f2b8a800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b840d1ba0 0x7f2b8415b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:08.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.486+0000 7f2b8a800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b840d1fb0 0x7f2b840caf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:08.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.486+0000 7f2b8a800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8406f550 con 0x7f2b840d1ba0 2024-05-27T06:28:08.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.486+0000 7f2b8a800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2b84164390 con 0x7f2b840d1fb0 2024-05-27T06:28:08.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.486+0000 7f2b8a800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2b8406f6d0 con 0x7f2b840b4690 2024-05-27T06:28:08.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.486+0000 7f2b88a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b840d1ba0 0x7f2b8415b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:08.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.486+0000 7f2b88a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b840d1ba0 0x7f2b8415b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55456/0 (socket says 172.21.15.87:55456) 2024-05-27T06:28:08.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.486+0000 7f2b88a00640 1 -- 172.21.15.87:0/1056486562 learned_addr learned my addr 172.21.15.87:0/1056486562 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:08.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.486+0000 7f2b89400640 1 --2- 172.21.15.87:0/1056486562 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b840b4690 0x7f2b84158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:08.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.486+0000 7f2b88a00640 1 -- 172.21.15.87:0/1056486562 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b840b4690 msgr2=0x7f2b84158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:08.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.486+0000 7f2b88a00640 1 --2- 172.21.15.87:0/1056486562 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b840b4690 0x7f2b84158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.486+0000 7f2b89e00640 1 --2- 172.21.15.87:0/1056486562 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b840d1fb0 0x7f2b840caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:08.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.486+0000 7f2b88a00640 1 -- 172.21.15.87:0/1056486562 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b840d1fb0 msgr2=0x7f2b840caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:08.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.486+0000 7f2b88a00640 1 --2- 172.21.15.87:0/1056486562 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b840d1fb0 0x7f2b840caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.486+0000 7f2b88a00640 1 -- 172.21.15.87:0/1056486562 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b841558c0 con 0x7f2b840d1ba0 2024-05-27T06:28:08.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.486+0000 7f2b89400640 1 --2- 172.21.15.87:0/1056486562 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b840b4690 0x7f2b84158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:08.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.486+0000 7f2b89e00640 1 --2- 172.21.15.87:0/1056486562 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b840d1fb0 0x7f2b840caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:08.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.486+0000 7f2b88a00640 1 --2- 172.21.15.87:0/1056486562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b840d1ba0 0x7f2b8415b240 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2b7000d620 tx=0x7f2b7000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:08.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.486+0000 7f2b81600640 1 -- 172.21.15.87:0/1056486562 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7000b620 con 0x7f2b840d1ba0 2024-05-27T06:28:08.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.486+0000 7f2b81600640 1 -- 172.21.15.87:0/1056486562 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b70019070 con 0x7f2b840d1ba0 2024-05-27T06:28:08.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.486+0000 7f2b81600640 1 -- 172.21.15.87:0/1056486562 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7000b9e0 con 0x7f2b840d1ba0 2024-05-27T06:28:08.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.486+0000 7f2b8a800640 1 -- 172.21.15.87:0/1056486562 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b84157f80 con 0x7f2b840d1ba0 2024-05-27T06:28:08.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.486+0000 7f2b8a800640 1 -- 172.21.15.87:0/1056486562 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b8415bca0 con 0x7f2b840d1ba0 2024-05-27T06:28:08.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.490+0000 7f2b81600640 1 -- 172.21.15.87:0/1056486562 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2b7000bb80 con 0x7f2b840d1ba0 2024-05-27T06:28:08.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.490+0000 7f2b81600640 1 --2- 172.21.15.87:0/1056486562 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2b6406f430 0x7f2b64071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:08.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.490+0000 7f2b81600640 1 -- 172.21.15.87:0/1056486562 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2b7008fa30 con 0x7f2b840d1ba0 2024-05-27T06:28:08.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.490+0000 7f2b89400640 1 --2- 172.21.15.87:0/1056486562 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2b6406f430 0x7f2b64071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:08.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.490+0000 7f2b9356f000 1 Processor -- start 2024-05-27T06:28:08.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.490+0000 7f2b9356f000 1 -- start start 2024-05-27T06:28:08.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.490+0000 7f2b89400640 1 --2- 172.21.15.87:0/1056486562 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2b6406f430 0x7f2b64071940 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2b780ad000 tx=0x7f2b78008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:08.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.490+0000 7f2b9356f000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e349dce1f0 0x55e349f17c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:08.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.490+0000 7f2b9356f000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 0x55e349f181a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:08.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.490+0000 7f2b9356f000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e349db0a60 0x55e349f186e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:08.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.490+0000 7f2b9356f000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e349d2a6f0 con 0x55e349dc6f90 2024-05-27T06:28:08.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.490+0000 7f2b9356f000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55e349d1a290 con 0x55e349db0a60 2024-05-27T06:28:08.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.490+0000 7f2b9356f000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55e349d1e2d0 con 0x55e349dce1f0 2024-05-27T06:28:08.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.494+0000 7f2b88a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 0x55e349f181a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:08.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.494+0000 7f2b88a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 0x55e349f181a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55462/0 (socket says 172.21.15.87:55462) 2024-05-27T06:28:08.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.494+0000 7f2b88a00640 1 -- 172.21.15.87:0/817945135 learned_addr learned my addr 172.21.15.87:0/817945135 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:08.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.494+0000 7f2b89400640 1 --2- 172.21.15.87:0/817945135 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e349dce1f0 0x55e349f17c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:08.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.494+0000 7f2b89e00640 1 --2- 172.21.15.87:0/817945135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e349db0a60 0x55e349f186e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:08.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.494+0000 7f2b88a00640 1 -- 172.21.15.87:0/817945135 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e349dce1f0 msgr2=0x55e349f17c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:08.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.494+0000 7f2b88a00640 1 --2- 172.21.15.87:0/817945135 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e349dce1f0 0x55e349f17c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.494+0000 7f2b88a00640 1 -- 172.21.15.87:0/817945135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e349db0a60 msgr2=0x55e349f186e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:08.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.494+0000 7f2b88a00640 1 --2- 172.21.15.87:0/817945135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e349db0a60 0x55e349f186e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.494+0000 7f2b88a00640 1 -- 172.21.15.87:0/817945135 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e349cf8c10 con 0x55e349dc6f90 2024-05-27T06:28:08.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.494+0000 7f2b89e00640 1 --2- 172.21.15.87:0/817945135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e349db0a60 0x55e349f186e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:08.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.494+0000 7f2b88a00640 1 --2- 172.21.15.87:0/817945135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 0x55e349f181a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2b7000b0e0 tx=0x7f2b7005b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe6058c85574e0a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:08.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.494+0000 7f2b75c00640 1 -- 172.21.15.87:0/817945135 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7005c5d0 con 0x55e349dc6f90 2024-05-27T06:28:08.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.494+0000 7f2b75c00640 1 -- 172.21.15.87:0/817945135 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b7005bed0 con 0x55e349dc6f90 2024-05-27T06:28:08.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.494+0000 7f2b75c00640 1 -- 172.21.15.87:0/817945135 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b70011da0 con 0x55e349dc6f90 2024-05-27T06:28:08.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.494+0000 7f2b9356f000 1 -- 172.21.15.87:0/817945135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 msgr2=0x55e349f181a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:08.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.494+0000 7f2b9356f000 1 --2- 172.21.15.87:0/817945135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 0x55e349f181a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2b7000b0e0 tx=0x7f2b7005b820 comp rx=0 tx=0).stop 2024-05-27T06:28:08.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.494+0000 7f2b9356f000 1 -- 172.21.15.87:0/817945135 shutdown_connections 2024-05-27T06:28:08.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.494+0000 7f2b9356f000 1 --2- 172.21.15.87:0/817945135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e349db0a60 0x55e349f186e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.494+0000 7f2b9356f000 1 --2- 172.21.15.87:0/817945135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 0x55e349f181a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.494+0000 7f2b9356f000 1 --2- 172.21.15.87:0/817945135 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e349dce1f0 0x55e349f17c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.494+0000 7f2b9356f000 1 -- 172.21.15.87:0/817945135 >> 172.21.15.87:0/817945135 conn(0x55e349dd4db0 msgr2=0x55e349efac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:08.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.494+0000 7f2b9356f000 1 -- 172.21.15.87:0/817945135 shutdown_connections 2024-05-27T06:28:08.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.494+0000 7f2b9356f000 1 -- 172.21.15.87:0/817945135 wait complete. 2024-05-27T06:28:08.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.494+0000 7f2b9356f000 1 -- start start 2024-05-27T06:28:08.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.494+0000 7f2b9356f000 1 Processor -- start 2024-05-27T06:28:08.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b9356f000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e349db0a60 0x55e349ed62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:08.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b9356f000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 0x55e349ed9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:08.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b9356f000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e349dce1f0 0x55e349ed9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:08.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b9356f000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e349cb27d0 con 0x55e349dc6f90 2024-05-27T06:28:08.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b9356f000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55e349d22900 con 0x55e349dce1f0 2024-05-27T06:28:08.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b9356f000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55e349cc71a0 con 0x55e349db0a60 2024-05-27T06:28:08.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b9356f000 10 client.0 _ll_register_callbacks cb 0x55e349eb9560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T06:28:08.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b88a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 0x55e349ed9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:08.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b88a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 0x55e349ed9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55476/0 (socket says 172.21.15.87:55476) 2024-05-27T06:28:08.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b88a00640 1 -- 172.21.15.87:0/1580339708 learned_addr learned my addr 172.21.15.87:0/1580339708 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:08.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b89e00640 1 --2- 172.21.15.87:0/1580339708 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e349dce1f0 0x55e349ed9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:08.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b89400640 1 --2- 172.21.15.87:0/1580339708 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e349db0a60 0x55e349ed62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:08.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b88a00640 1 -- 172.21.15.87:0/1580339708 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e349db0a60 msgr2=0x55e349ed62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:08.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b88a00640 1 --2- 172.21.15.87:0/1580339708 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e349db0a60 0x55e349ed62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b88a00640 1 -- 172.21.15.87:0/1580339708 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e349dce1f0 msgr2=0x55e349ed9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:08.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b88a00640 1 --2- 172.21.15.87:0/1580339708 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e349dce1f0 0x55e349ed9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b88a00640 1 -- 172.21.15.87:0/1580339708 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e349d629d0 con 0x55e349dc6f90 2024-05-27T06:28:08.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b88a00640 1 --2- 172.21.15.87:0/1580339708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 0x55e349ed9640 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2b7001d000 tx=0x7f2b70014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f8c7073dc5778e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:08.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b6a000640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-27T06:28:08.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b6a000640 1 -- 172.21.15.87:0/1580339708 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7005c5d0 con 0x55e349dc6f90 2024-05-27T06:28:08.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b6a000640 1 -- 172.21.15.87:0/1580339708 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2b7005b130 con 0x55e349dc6f90 2024-05-27T06:28:08.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b9356f000 1 -- 172.21.15.87:0/1580339708 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b7005bed0 con 0x55e349dc6f90 2024-05-27T06:28:08.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b6a000640 1 -- 172.21.15.87:0/1580339708 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f2b70060280 con 0x55e349dc6f90 2024-05-27T06:28:08.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b9356f000 10 client.4683 fetch_fsmap learned FSMap version 9 2024-05-27T06:28:08.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b9356f000 1 -- 172.21.15.87:0/1580339708 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55e349cf5530 con 0x55e349dc6f90 2024-05-27T06:28:08.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b6a000640 1 -- 172.21.15.87:0/1580339708 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b7005bed0 con 0x55e349dc6f90 2024-05-27T06:28:08.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b6a000640 1 -- 172.21.15.87:0/1580339708 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7f2b70013070 con 0x55e349dc6f90 2024-05-27T06:28:08.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b9356f000 10 client.4683 fetch_fsmap finished waiting for FSMap version 9 2024-05-27T06:28:08.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b9356f000 10 client.4683 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-27T06:28:08.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b9356f000 20 client.4683 populate_metadata read hostname 'smithi087' 2024-05-27T06:28:08.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b9356f000 1 --2- 172.21.15.87:0/1580339708 >> [v2:172.21.15.87:6836/1799934036,v1:172.21.15.87:6837/1799934036] conn(0x55e3499c27d0 0x55e349f1eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:08.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b9356f000 4 client.4683 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T06:28:08.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b9356f000 1 -- 172.21.15.87:0/1580339708 --> [v2:172.21.15.87:6836/1799934036,v1:172.21.15.87:6837/1799934036] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e349cb5be0 con 0x55e3499c27d0 2024-05-27T06:28:08.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b89400640 1 --2- 172.21.15.87:0/1580339708 >> [v2:172.21.15.87:6836/1799934036,v1:172.21.15.87:6837/1799934036] conn(0x55e3499c27d0 0x55e349f1eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:08.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b6a000640 10 client.4683 ms_handle_connect on v2:172.21.15.87:6836/1799934036 2024-05-27T06:28:08.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.498+0000 7f2b89400640 1 --2- 172.21.15.87:0/1580339708 >> [v2:172.21.15.87:6836/1799934036,v1:172.21.15.87:6837/1799934036] conn(0x55e3499c27d0 0x55e349f1eb70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6d82f5d7abe58dd server_cookie=1d8352f7bb6b439d in_seq=0 out_seq=0 2024-05-27T06:28:08.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.502+0000 7f2b6a000640 1 -- 172.21.15.87:0/1580339708 <== mds.0 v2:172.21.15.87:6836/1799934036 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55e349cb5be0 con 0x55e3499c27d0 2024-05-27T06:28:08.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.502+0000 7f2b6a000640 10 client.4683 handle_command_reply: tid=0 2024-05-27T06:28:08.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.502+0000 7f2b9356f000 1 client.4683 shutdown 2024-05-27T06:28:08.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.502+0000 7f2b9356f000 1 -- 172.21.15.87:0/1580339708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 msgr2=0x55e349ed9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:08.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.502+0000 7f2b9356f000 1 --2- 172.21.15.87:0/1580339708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 0x55e349ed9640 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2b7001d000 tx=0x7f2b70014000 comp rx=0 tx=0).stop 2024-05-27T06:28:08.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.502+0000 7f2b9356f000 1 -- 172.21.15.87:0/1580339708 shutdown_connections 2024-05-27T06:28:08.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.502+0000 7f2b9356f000 1 --2- 172.21.15.87:0/1580339708 >> [v2:172.21.15.87:6836/1799934036,v1:172.21.15.87:6837/1799934036] conn(0x55e3499c27d0 0x55e349f1eb70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.502+0000 7f2b9356f000 1 --2- 172.21.15.87:0/1580339708 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e349dce1f0 0x55e349ed9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.502+0000 7f2b9356f000 1 --2- 172.21.15.87:0/1580339708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 0x55e349ed9640 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.502+0000 7f2b9356f000 1 --2- 172.21.15.87:0/1580339708 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e349db0a60 0x55e349ed62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.502+0000 7f2b6a000640 0 client.4683 ms_handle_reset on v2:172.21.15.87:6836/1799934036 2024-05-27T06:28:08.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.502+0000 7f2b9356f000 1 -- 172.21.15.87:0/1580339708 >> 172.21.15.87:0/1580339708 conn(0x55e349dd4db0 msgr2=0x55e349ecf6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:08.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.502+0000 7f2b9356f000 1 -- 172.21.15.87:0/1580339708 shutdown_connections 2024-05-27T06:28:08.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.502+0000 7f2b9356f000 1 -- 172.21.15.87:0/1580339708 wait complete. 2024-05-27T06:28:08.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.502+0000 7f2b9356f000 20 client.4683 trim_cache size 0 max 16384 2024-05-27T06:28:08.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.518+0000 7f2b9356f000 1 Processor -- start 2024-05-27T06:28:08.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.518+0000 7f2b9356f000 1 -- start start 2024-05-27T06:28:08.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b9356f000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e349db0a60 0x55e349f2ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:08.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b9356f000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 0x55e349f2f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:08.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b9356f000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e349dce1f0 0x55e349f20b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:08.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b9356f000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2b84206570 con 0x55e349dc6f90 2024-05-27T06:28:08.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b9356f000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2b84205900 con 0x55e349dce1f0 2024-05-27T06:28:08.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b9356f000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2b84205f50 con 0x55e349db0a60 2024-05-27T06:28:08.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b88a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 0x55e349f2f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:08.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b88a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 0x55e349f2f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55480/0 (socket says 172.21.15.87:55480) 2024-05-27T06:28:08.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b88a00640 1 -- 172.21.15.87:0/1947477546 learned_addr learned my addr 172.21.15.87:0/1947477546 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:08.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b89400640 1 --2- 172.21.15.87:0/1947477546 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e349db0a60 0x55e349f2ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:08.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b89e00640 1 --2- 172.21.15.87:0/1947477546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e349dce1f0 0x55e349f20b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:08.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b88a00640 1 -- 172.21.15.87:0/1947477546 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e349db0a60 msgr2=0x55e349f2ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:08.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b88a00640 1 --2- 172.21.15.87:0/1947477546 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e349db0a60 0x55e349f2ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b88a00640 1 -- 172.21.15.87:0/1947477546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e349dce1f0 msgr2=0x55e349f20b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:08.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b88a00640 1 --2- 172.21.15.87:0/1947477546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e349dce1f0 0x55e349f20b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b88a00640 1 -- 172.21.15.87:0/1947477546 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e349cbb880 con 0x55e349dc6f90 2024-05-27T06:28:08.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b89e00640 1 --2- 172.21.15.87:0/1947477546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e349dce1f0 0x55e349f20b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:08.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b88a00640 1 --2- 172.21.15.87:0/1947477546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 0x55e349f2f170 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2b70060440 tx=0x7f2b70088000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6144b13cc48edd01 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:08.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b75200640 1 -- 172.21.15.87:0/1947477546 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7005b640 con 0x55e349dc6f90 2024-05-27T06:28:08.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b75200640 1 -- 172.21.15.87:0/1947477546 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b7005c5d0 con 0x55e349dc6f90 2024-05-27T06:28:08.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b75200640 1 -- 172.21.15.87:0/1947477546 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7005b370 con 0x55e349dc6f90 2024-05-27T06:28:08.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b9356f000 1 -- 172.21.15.87:0/1947477546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 msgr2=0x55e349f2f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:08.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b9356f000 1 --2- 172.21.15.87:0/1947477546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 0x55e349f2f170 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2b70060440 tx=0x7f2b70088000 comp rx=0 tx=0).stop 2024-05-27T06:28:08.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b9356f000 1 -- 172.21.15.87:0/1947477546 shutdown_connections 2024-05-27T06:28:08.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b9356f000 1 --2- 172.21.15.87:0/1947477546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e349dce1f0 0x55e349f20b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b9356f000 1 --2- 172.21.15.87:0/1947477546 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 0x55e349f2f170 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b9356f000 1 --2- 172.21.15.87:0/1947477546 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e349db0a60 0x55e349f2ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b9356f000 1 -- 172.21.15.87:0/1947477546 >> 172.21.15.87:0/1947477546 conn(0x55e349dd4db0 msgr2=0x55e349ed9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:08.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b9356f000 1 -- 172.21.15.87:0/1947477546 shutdown_connections 2024-05-27T06:28:08.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b9356f000 1 -- 172.21.15.87:0/1947477546 wait complete. 2024-05-27T06:28:08.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.522+0000 7f2b9356f000 1 -- start start 2024-05-27T06:28:08.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b9356f000 1 Processor -- start 2024-05-27T06:28:08.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b9356f000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e349db0a60 0x55e349f24510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:08.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b9356f000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 0x55e349f478b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:08.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b9356f000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e349dce1f0 0x55e349f47df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:08.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b9356f000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e349d9e590 con 0x55e349dc6f90 2024-05-27T06:28:08.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b9356f000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55e349cdd650 con 0x55e349db0a60 2024-05-27T06:28:08.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b9356f000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55e349d294c0 con 0x55e349dce1f0 2024-05-27T06:28:08.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b9356f000 10 client.0 _ll_register_callbacks cb 0x7f2b780ae070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T06:28:08.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b88a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 0x55e349f478b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:08.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b88a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 0x55e349f478b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55482/0 (socket says 172.21.15.87:55482) 2024-05-27T06:28:08.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b88a00640 1 -- 172.21.15.87:0/524439330 learned_addr learned my addr 172.21.15.87:0/524439330 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:08.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b89400640 1 --2- 172.21.15.87:0/524439330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e349db0a60 0x55e349f24510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:08.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b89e00640 1 --2- 172.21.15.87:0/524439330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e349dce1f0 0x55e349f47df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:08.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b88a00640 1 -- 172.21.15.87:0/524439330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e349dce1f0 msgr2=0x55e349f47df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:08.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b88a00640 1 --2- 172.21.15.87:0/524439330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e349dce1f0 0x55e349f47df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b88a00640 1 -- 172.21.15.87:0/524439330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e349db0a60 msgr2=0x55e349f24510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:08.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b88a00640 1 --2- 172.21.15.87:0/524439330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e349db0a60 0x55e349f24510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b88a00640 1 -- 172.21.15.87:0/524439330 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e349cd1ea0 con 0x55e349dc6f90 2024-05-27T06:28:08.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b88a00640 1 --2- 172.21.15.87:0/524439330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 0x55e349f478b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2b7005c780 tx=0x7f2b7000bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d605b724ca87392 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:08.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b6a000640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-27T06:28:08.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b6a000640 1 -- 172.21.15.87:0/524439330 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7005b640 con 0x55e349dc6f90 2024-05-27T06:28:08.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b6a000640 1 -- 172.21.15.87:0/524439330 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2b7005aba0 con 0x55e349dc6f90 2024-05-27T06:28:08.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b9356f000 1 -- 172.21.15.87:0/524439330 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b7005c5d0 con 0x55e349dc6f90 2024-05-27T06:28:08.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b6a000640 1 -- 172.21.15.87:0/524439330 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f2b7005bed0 con 0x55e349dc6f90 2024-05-27T06:28:08.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b9356f000 10 client.4689 fetch_fsmap learned FSMap version 9 2024-05-27T06:28:08.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b9356f000 1 -- 172.21.15.87:0/524439330 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55e349d9ea20 con 0x55e349dc6f90 2024-05-27T06:28:08.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b6a000640 1 -- 172.21.15.87:0/524439330 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b7005c5d0 con 0x55e349dc6f90 2024-05-27T06:28:08.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b6a000640 1 -- 172.21.15.87:0/524439330 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7f2b70075070 con 0x55e349dc6f90 2024-05-27T06:28:08.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b9356f000 10 client.4689 fetch_fsmap finished waiting for FSMap version 9 2024-05-27T06:28:08.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b9356f000 10 client.4689 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-27T06:28:08.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b9356f000 20 client.4689 populate_metadata read hostname 'smithi087' 2024-05-27T06:28:08.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b9356f000 1 --2- 172.21.15.87:0/524439330 >> [v2:172.21.15.87:6836/1799934036,v1:172.21.15.87:6837/1799934036] conn(0x55e3499b0830 0x55e349f8aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:08.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b9356f000 4 client.4689 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-27T06:28:08.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b9356f000 1 -- 172.21.15.87:0/524439330 --> [v2:172.21.15.87:6836/1799934036,v1:172.21.15.87:6837/1799934036] -- command(tid 0: {"prefix": "status"}) -- 0x55e349cb9de0 con 0x55e3499b0830 2024-05-27T06:28:08.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.526+0000 7f2b89400640 1 --2- 172.21.15.87:0/524439330 >> [v2:172.21.15.87:6836/1799934036,v1:172.21.15.87:6837/1799934036] conn(0x55e3499b0830 0x55e349f8aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:08.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b89400640 1 --2- 172.21.15.87:0/524439330 >> [v2:172.21.15.87:6836/1799934036,v1:172.21.15.87:6837/1799934036] conn(0x55e3499b0830 0x55e349f8aef0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6feecd4c0e16f707 server_cookie=d600a2732f537be4 in_seq=0 out_seq=0 2024-05-27T06:28:08.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b6a000640 10 client.4689 ms_handle_connect on v2:172.21.15.87:6836/1799934036 2024-05-27T06:28:08.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b6a000640 1 -- 172.21.15.87:0/524439330 <== mds.0 v2:172.21.15.87:6836/1799934036 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55e349cb9de0 con 0x55e3499b0830 2024-05-27T06:28:08.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b6a000640 10 client.4689 handle_command_reply: tid=0 2024-05-27T06:28:08.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b9356f000 1 client.4689 shutdown 2024-05-27T06:28:08.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b9356f000 1 -- 172.21.15.87:0/524439330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 msgr2=0x55e349f478b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:08.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b9356f000 1 --2- 172.21.15.87:0/524439330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 0x55e349f478b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2b7005c780 tx=0x7f2b7000bef0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b9356f000 1 -- 172.21.15.87:0/524439330 shutdown_connections 2024-05-27T06:28:08.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b9356f000 1 --2- 172.21.15.87:0/524439330 >> [v2:172.21.15.87:6836/1799934036,v1:172.21.15.87:6837/1799934036] conn(0x55e3499b0830 0x55e349f8aef0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b9356f000 1 --2- 172.21.15.87:0/524439330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55e349dce1f0 0x55e349f47df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b9356f000 1 --2- 172.21.15.87:0/524439330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e349dc6f90 0x55e349f478b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b9356f000 1 --2- 172.21.15.87:0/524439330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e349db0a60 0x55e349f24510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b6a000640 0 client.4689 ms_handle_reset on v2:172.21.15.87:6836/1799934036 2024-05-27T06:28:08.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b9356f000 1 -- 172.21.15.87:0/524439330 >> 172.21.15.87:0/524439330 conn(0x55e349dd4db0 msgr2=0x55e349f2dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:08.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b9356f000 1 -- 172.21.15.87:0/524439330 shutdown_connections 2024-05-27T06:28:08.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b9356f000 1 -- 172.21.15.87:0/524439330 wait complete. 2024-05-27T06:28:08.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b9356f000 20 client.4689 trim_cache size 0 max 16384 2024-05-27T06:28:08.530 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-27T06:28:08.530 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_fsid": "0412686d-4f35-45cc-b082-ef9741c1aff5", 2024-05-27T06:28:08.530 INFO:teuthology.orchestra.run.smithi087.stdout: "whoami": 0, 2024-05-27T06:28:08.530 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 4290, 2024-05-27T06:28:08.531 INFO:teuthology.orchestra.run.smithi087.stdout: "want_state": "up:active", 2024-05-27T06:28:08.531 INFO:teuthology.orchestra.run.smithi087.stdout: "state": "up:active", 2024-05-27T06:28:08.531 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs", 2024-05-27T06:28:08.531 INFO:teuthology.orchestra.run.smithi087.stdout: "rank_uptime": 29.965230763000001, 2024-05-27T06:28:08.531 INFO:teuthology.orchestra.run.smithi087.stdout: "mdsmap_epoch": 9, 2024-05-27T06:28:08.531 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch": 24, 2024-05-27T06:28:08.531 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch_barrier": 24, 2024-05-27T06:28:08.531 INFO:teuthology.orchestra.run.smithi087.stdout: "uptime": 35.951525722 2024-05-27T06:28:08.531 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-27T06:28:08.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b8a800640 1 -- 172.21.15.87:0/1056486562 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2b6406f430 msgr2=0x7f2b64071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:08.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b8a800640 1 --2- 172.21.15.87:0/1056486562 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2b6406f430 0x7f2b64071940 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2b780ad000 tx=0x7f2b78008040 comp rx=0 tx=0).stop 2024-05-27T06:28:08.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b8a800640 1 -- 172.21.15.87:0/1056486562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b840d1ba0 msgr2=0x7f2b8415b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:08.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b8a800640 1 --2- 172.21.15.87:0/1056486562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b840d1ba0 0x7f2b8415b240 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2b7000d620 tx=0x7f2b7000dae0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b8a800640 1 -- 172.21.15.87:0/1056486562 shutdown_connections 2024-05-27T06:28:08.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b8a800640 1 --2- 172.21.15.87:0/1056486562 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2b6406f430 0x7f2b64071940 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b8a800640 1 --2- 172.21.15.87:0/1056486562 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b840d1fb0 0x7f2b840caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b8a800640 1 --2- 172.21.15.87:0/1056486562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b840d1ba0 0x7f2b8415b240 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b8a800640 1 --2- 172.21.15.87:0/1056486562 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2b840b4690 0x7f2b84158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:08.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b8a800640 1 -- 172.21.15.87:0/1056486562 >> 172.21.15.87:0/1056486562 conn(0x7f2b840d35c0 msgr2=0x7f2b84161560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:08.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b8a800640 1 -- 172.21.15.87:0/1056486562 shutdown_connections 2024-05-27T06:28:08.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:08.530+0000 7f2b8a800640 1 -- 172.21.15.87:0/1056486562 wait complete. 2024-05-27T06:28:08.547 INFO:teuthology.run_tasks:Running task sequential... 2024-05-27T06:28:08.556 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-27T06:28:08.557 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-27T06:28:08.557 INFO:teuthology.task.print:Enabling mgr modules 2024-05-27T06:28:08.557 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-27T06:28:08.581 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-27T06:28:08.581 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-05-27T06:28:08.581 INFO:tasks.ceph_fuse:client.0 config is {} 2024-05-27T06:28:08.581 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-27T06:28:08.581 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-27T06:28:08.581 INFO:tasks.ceph_fuse:client.2 config is {} 2024-05-27T06:28:08.581 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-27T06:28:08.581 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-27T06:28:08.581 INFO:tasks.ceph_fuse:client.1 config is {} 2024-05-27T06:28:08.582 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-27T06:28:08.582 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-27T06:28:08.582 INFO:tasks.ceph_fuse:client.3 config is {} 2024-05-27T06:28:08.582 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-27T06:28:08.582 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-27T06:28:08.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:08.582 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-05-27T06:28:08.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:08.593 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2024-05-27T06:28:08.660 INFO:teuthology.orchestra.run.smithi149.stderr:Cannot find device "ceph-brx" 2024-05-27T06:28:08.662 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T06:28:08.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:08.662 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-05-27T06:28:08.671 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-05-27T06:28:08.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:08.672 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-27T06:28:08.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:08.734 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2024-05-27T06:28:08.944 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-27T06:28:08.944 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-27T06:28:09.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.094+0000 7f2345e00640 1 Processor -- start 2024-05-27T06:28:09.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.094+0000 7f2345e00640 1 -- start start 2024-05-27T06:28:09.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.094+0000 7f2345e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f234006e8b0 0x7f234006ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:09.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.094+0000 7f2345e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f234006f200 0x7f23400d1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:09.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.094+0000 7f2345e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23400ce7a0 con 0x7f23401605d0 2024-05-27T06:28:09.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.094+0000 7f2345e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f23400cea80 con 0x7f234006e8b0 2024-05-27T06:28:09.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.094+0000 7f2345e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f23400ced60 con 0x7f234006f200 2024-05-27T06:28:09.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.094+0000 7f233f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f234006f200 0x7f23400d1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:09.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.094+0000 7f2336000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f234006e8b0 0x7f234006ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:09.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.094+0000 7f233f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f234006f200 0x7f23400d1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.87:47334/0 (socket says 172.21.15.87:47334) 2024-05-27T06:28:09.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.094+0000 7f2336000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f234006e8b0 0x7f234006ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:38034/0 (socket says 172.21.15.87:38034) 2024-05-27T06:28:09.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.094+0000 7f233f400640 1 -- 172.21.15.87:0/3540491828 learned_addr learned my addr 172.21.15.87:0/3540491828 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:09.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.094+0000 7f233ea00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f23401605d0 0x7f23401609e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.87:44756/0 (socket says 172.21.15.87:44756) 2024-05-27T06:28:09.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.094+0000 7f233f400640 1 -- 172.21.15.87:0/3540491828 >> v2:172.21.15.149:3300/0 conn(0x7f234006e8b0 msgr2=0x7f234006ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:09.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.094+0000 7f233e000640 1 -- 172.21.15.87:0/3540491828 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1684713407 0 0) 0x7f23400ce7a0 con 0x7f23401605d0 2024-05-27T06:28:09.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.098+0000 7f233f400640 1 --2- 172.21.15.87:0/3540491828 >> v2:172.21.15.149:3300/0 conn(0x7f234006e8b0 0x7f234006ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:09.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.098+0000 7f233f400640 1 -- 172.21.15.87:0/3540491828 >> v1:172.21.15.149:6789/0 conn(0x7f23401605d0 legacy=0x7f23401609e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:09.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.098+0000 7f233f400640 1 -- 172.21.15.87:0/3540491828 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23400cf040 con 0x7f234006f200 2024-05-27T06:28:09.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.098+0000 7f2336000640 1 --2- 172.21.15.87:0/3540491828 >> v2:172.21.15.149:3300/0 conn(0x7f234006e8b0 0x7f234006ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:28:09.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.098+0000 7f233f400640 1 --2- 172.21.15.87:0/3540491828 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f234006f200 0x7f23400d1d50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2338009870 tx=0x7f233801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=814e61787c8d33c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:09.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.098+0000 7f233e000640 1 -- 172.21.15.87:0/3540491828 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23380a7070 con 0x7f234006f200 2024-05-27T06:28:09.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.098+0000 7f233e000640 1 -- 172.21.15.87:0/3540491828 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23380b0070 con 0x7f234006f200 2024-05-27T06:28:09.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.098+0000 7f233e000640 1 -- 172.21.15.87:0/3540491828 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23380ab890 con 0x7f234006f200 2024-05-27T06:28:09.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.098+0000 7f2345e00640 1 -- 172.21.15.87:0/3540491828 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f234006f200 msgr2=0x7f23400d1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:09.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.098+0000 7f2345e00640 1 --2- 172.21.15.87:0/3540491828 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f234006f200 0x7f23400d1d50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2338009870 tx=0x7f233801c560 comp rx=0 tx=0).stop 2024-05-27T06:28:09.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.102+0000 7f2345e00640 1 -- 172.21.15.87:0/3540491828 shutdown_connections 2024-05-27T06:28:09.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.102+0000 7f2345e00640 1 --2- 172.21.15.87:0/3540491828 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f234006f200 0x7f23400d1d50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:09.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.102+0000 7f2345e00640 1 --2- 172.21.15.87:0/3540491828 >> v2:172.21.15.149:3300/0 conn(0x7f234006e8b0 0x7f234006ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:09.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.102+0000 7f2345e00640 1 -- 172.21.15.87:0/3540491828 >> 172.21.15.87:0/3540491828 conn(0x7f23400d3590 msgr2=0x7f23400d39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:09.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.102+0000 7f2345e00640 1 -- 172.21.15.87:0/3540491828 shutdown_connections 2024-05-27T06:28:09.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.102+0000 7f2345e00640 1 -- 172.21.15.87:0/3540491828 wait complete. 2024-05-27T06:28:09.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.102+0000 7f2345e00640 1 Processor -- start 2024-05-27T06:28:09.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.102+0000 7f2345e00640 1 -- start start 2024-05-27T06:28:09.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.102+0000 7f2345e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f234006e8b0 0x7f23400b82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:09.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.102+0000 7f2345e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f234006f200 0x7f2340158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:09.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.102+0000 7f2345e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23401605d0 0x7f2340158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:09.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.106+0000 7f2345e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f23400d2e30 con 0x7f234006f200 2024-05-27T06:28:09.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.106+0000 7f2345e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f23400d2cb0 con 0x7f234006e8b0 2024-05-27T06:28:09.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.106+0000 7f2345e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f234016cfb0 con 0x7f23401605d0 2024-05-27T06:28:09.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.106+0000 7f2336000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f234006f200 0x7f2340158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:09.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.106+0000 7f2336000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f234006f200 0x7f2340158940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55498/0 (socket says 172.21.15.87:55498) 2024-05-27T06:28:09.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.106+0000 7f2336000640 1 -- 172.21.15.87:0/1490888445 learned_addr learned my addr 172.21.15.87:0/1490888445 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:09.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.106+0000 7f233ea00640 1 --2- 172.21.15.87:0/1490888445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f234006e8b0 0x7f23400b82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:09.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.106+0000 7f233f400640 1 --2- 172.21.15.87:0/1490888445 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23401605d0 0x7f2340158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:09.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.106+0000 7f2336000640 1 -- 172.21.15.87:0/1490888445 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23401605d0 msgr2=0x7f2340158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:09.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.106+0000 7f2336000640 1 --2- 172.21.15.87:0/1490888445 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23401605d0 0x7f2340158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:09.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.106+0000 7f2336000640 1 -- 172.21.15.87:0/1490888445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f234006e8b0 msgr2=0x7f23400b82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:09.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.106+0000 7f2336000640 1 --2- 172.21.15.87:0/1490888445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f234006e8b0 0x7f23400b82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:09.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.106+0000 7f2336000640 1 -- 172.21.15.87:0/1490888445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23400b8830 con 0x7f234006f200 2024-05-27T06:28:09.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.106+0000 7f2336000640 1 --2- 172.21.15.87:0/1490888445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f234006f200 0x7f2340158940 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f232800e9e0 tx=0x7f232800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:09.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.106+0000 7f2337e00640 1 -- 172.21.15.87:0/1490888445 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2328017070 con 0x7f234006f200 2024-05-27T06:28:09.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.106+0000 7f2337e00640 1 -- 172.21.15.87:0/1490888445 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f232800c9d0 con 0x7f234006f200 2024-05-27T06:28:09.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.106+0000 7f2337e00640 1 -- 172.21.15.87:0/1490888445 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232800cdc0 con 0x7f234006f200 2024-05-27T06:28:09.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.106+0000 7f2345e00640 1 -- 172.21.15.87:0/1490888445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2340159660 con 0x7f234006f200 2024-05-27T06:28:09.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.106+0000 7f2345e00640 1 -- 172.21.15.87:0/1490888445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23400b6690 con 0x7f234006f200 2024-05-27T06:28:09.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.106+0000 7f2345e00640 1 -- 172.21.15.87:0/1490888445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23400b61b0 con 0x7f234006f200 2024-05-27T06:28:09.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.106+0000 7f2337e00640 1 -- 172.21.15.87:0/1490888445 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f232801a070 con 0x7f234006f200 2024-05-27T06:28:09.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.110+0000 7f2337e00640 1 --2- 172.21.15.87:0/1490888445 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f231c06f430 0x7f231c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:09.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.110+0000 7f2337e00640 1 -- 172.21.15.87:0/1490888445 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f232808f3d0 con 0x7f234006f200 2024-05-27T06:28:09.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.110+0000 7f233ea00640 1 --2- 172.21.15.87:0/1490888445 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f231c06f430 0x7f231c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:09.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.110+0000 7f233ea00640 1 --2- 172.21.15.87:0/1490888445 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f231c06f430 0x7f231c071940 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f23300012f0 tx=0x7f2330001690 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:09.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.114+0000 7f2337e00640 1 -- 172.21.15.87:0/1490888445 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f232805b9b0 con 0x7f234006f200 2024-05-27T06:28:09.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.302+0000 7f2345e00640 1 -- 172.21.15.87:0/1490888445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f23401593f0 con 0x7f234006f200 2024-05-27T06:28:09.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.302+0000 7f2337e00640 1 -- 172.21.15.87:0/1490888445 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f232805fcb0 con 0x7f234006f200 2024-05-27T06:28:09.301 INFO:teuthology.orchestra.run.smithi087.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-27T06:28:09.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.306+0000 7f2345e00640 1 -- 172.21.15.87:0/1490888445 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f231c06f430 msgr2=0x7f231c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:09.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.306+0000 7f2345e00640 1 --2- 172.21.15.87:0/1490888445 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f231c06f430 0x7f231c071940 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f23300012f0 tx=0x7f2330001690 comp rx=0 tx=0).stop 2024-05-27T06:28:09.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.306+0000 7f2345e00640 1 -- 172.21.15.87:0/1490888445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f234006f200 msgr2=0x7f2340158940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:09.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.306+0000 7f2345e00640 1 --2- 172.21.15.87:0/1490888445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f234006f200 0x7f2340158940 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f232800e9e0 tx=0x7f232800eea0 comp rx=0 tx=0).stop 2024-05-27T06:28:09.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.306+0000 7f2345e00640 1 -- 172.21.15.87:0/1490888445 shutdown_connections 2024-05-27T06:28:09.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.306+0000 7f2345e00640 1 --2- 172.21.15.87:0/1490888445 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f231c06f430 0x7f231c071940 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:09.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.306+0000 7f2345e00640 1 --2- 172.21.15.87:0/1490888445 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23401605d0 0x7f2340158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:09.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.306+0000 7f2345e00640 1 --2- 172.21.15.87:0/1490888445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f234006f200 0x7f2340158940 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:09.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.306+0000 7f2345e00640 1 --2- 172.21.15.87:0/1490888445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f234006e8b0 0x7f23400b82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:09.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.306+0000 7f2345e00640 1 -- 172.21.15.87:0/1490888445 >> 172.21.15.87:0/1490888445 conn(0x7f23400d3590 msgr2=0x7f23400b4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:09.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.306+0000 7f2345e00640 1 -- 172.21.15.87:0/1490888445 shutdown_connections 2024-05-27T06:28:09.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09.306+0000 7f2345e00640 1 -- 172.21.15.87:0/1490888445 wait complete. 2024-05-27T06:28:09.322 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-27T06:28:09.322 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-27T06:28:09.322 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-05-27T06:28:09.322 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-27T06:28:09.322 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-27T06:28:09.322 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-27T06:28:09.322 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-27T06:28:09.322 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-27T06:28:09.322 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-27T06:28:09.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:09.323 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-05-27T06:28:09.331 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T06:28:09.331 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T06:28:09.331 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T06:28:09.332 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:09.332 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-05-27T06:28:09.332 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:09.332 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:28:09.332 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:09.332 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-05-27T06:28:09.332 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:28:09.332 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:09.332 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-05-27T06:28:09.332 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:28:09.332 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:09.332 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-27T06:28:09.332 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:09.333 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-27T06:28:09.333 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42452sec preferred_lft 42452sec 2024-05-27T06:28:09.333 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-05-27T06:28:09.333 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:09.333 INFO:teuthology.orchestra.run.smithi087.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-27T06:28:09.333 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 02:42:75:41:48:14 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:09.333 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-27T06:28:09.333 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:09.334 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-27T06:28:09.334 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:28:09.334 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-27T06:28:09.334 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add name ceph-brx type bridge 2024-05-27T06:28:09.334 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr flush dev ceph-brx 2024-05-27T06:28:09.334 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set ceph-brx up 2024-05-27T06:28:09.334 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-27T06:28:09.335 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-27T06:28:09.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:28:09.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:28:09.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:09.487 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-27T06:28:09.506 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-05-27T06:28:09.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:09.508 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-05-27T06:28:09.559 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-05-27T06:28:09.560 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-27T06:28:09.560 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-27T06:28:09.560 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-27T06:28:09.560 INFO:teuthology.orchestra.run.smithi087.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-27T06:28:09.560 INFO:teuthology.orchestra.run.smithi087.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-27T06:28:09.560 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-27T06:28:09.560 INFO:teuthology.orchestra.run.smithi087.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:28:09.560 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:28:09.560 INFO:teuthology.orchestra.run.smithi087.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:28:09.561 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-27T06:28:09.561 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:28:09.561 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-27T06:28:09.561 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-27T06:28:09.561 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-27T06:28:09.561 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-27T06:28:09.561 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-27T06:28:09.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:28:09.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:28:09.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:09.698 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-05-27T06:28:09.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:09.750 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list-id 2024-05-27T06:28:09.806 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:28:09.806 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-27T06:28:09.806 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:28:09.806 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-27T06:28:09.806 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-27T06:28:09.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:28:09.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:28:09.935 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-27T06:28:09.935 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:28:09.935 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-27T06:28:09.935 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-27T06:28:09.935 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-27T06:28:09.935 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-27T06:28:09.935 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-27T06:28:09.936 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-27T06:28:09.936 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-27T06:28:10.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:28:10.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:28:10.115 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:28:10.115 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-27T06:28:10.115 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-05-27T06:28:10.115 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set dev brx.0 master ceph-brx 2024-05-27T06:28:10.115 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-27T06:28:10.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:28:10.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:28:10.198 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-27T06:28:10.198 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T06:28:10.198 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-27T06:28:10.253 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-27T06:28:10.253 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T06:28:10.253 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-27T06:28:10.308 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-05-27T06:28:10.373 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T06:28:10.430 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-05-27T06:28:10.430 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-05-27T06:28:10.430 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-05-27T06:28:10.431 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-05-27T06:28:10.431 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-05-27T06:28:10.431 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-05-27T06:28:10.431 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-05-27T06:28:10.431 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-05-27T06:28:10.431 INFO:teuthology.orchestra.run.smithi087.stdout:/run/lock 2024-05-27T06:28:10.431 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-05-27T06:28:10.431 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-05-27T06:28:10.431 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-05-27T06:28:10.431 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T06:28:10.431 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-05-27T06:28:10.431 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-05-27T06:28:10.431 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-05-27T06:28:10.432 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-05-27T06:28:10.432 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/fs/nfsd 2024-05-27T06:28:10.432 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-05-27T06:28:10.432 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-05-27T06:28:10.432 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysusers.service 2024-05-27T06:28:10.432 INFO:teuthology.orchestra.run.smithi087.stdout:/run/rpc_pipefs 2024-05-27T06:28:10.432 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-05-27T06:28:10.432 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-05-27T06:28:10.432 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2024-05-27T06:28:10.432 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2024-05-27T06:28:10.432 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2024-05-27T06:28:10.432 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2024-05-27T06:28:10.432 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-05-27T06:28:10.432 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:28:10.432 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:28:10.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:10.433 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-05-27T06:28:10.485 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-27T06:28:10.485 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-27T06:28:10.528 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-05-27T06:28:10.548 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T06:28:10.604 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-05-27T06:28:10.604 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-05-27T06:28:10.604 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-05-27T06:28:10.604 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-05-27T06:28:10.604 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-05-27T06:28:10.604 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-05-27T06:28:10.604 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-05-27T06:28:10.604 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-05-27T06:28:10.604 INFO:teuthology.orchestra.run.smithi087.stdout:/run/lock 2024-05-27T06:28:10.604 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-05-27T06:28:10.604 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-05-27T06:28:10.605 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-05-27T06:28:10.605 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T06:28:10.605 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-05-27T06:28:10.605 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-05-27T06:28:10.605 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-05-27T06:28:10.605 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-05-27T06:28:10.605 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/fs/nfsd 2024-05-27T06:28:10.605 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-05-27T06:28:10.605 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-05-27T06:28:10.605 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysusers.service 2024-05-27T06:28:10.605 INFO:teuthology.orchestra.run.smithi087.stdout:/run/rpc_pipefs 2024-05-27T06:28:10.605 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-05-27T06:28:10.605 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-05-27T06:28:10.606 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2024-05-27T06:28:10.606 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2024-05-27T06:28:10.606 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2024-05-27T06:28:10.606 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2024-05-27T06:28:10.606 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-05-27T06:28:10.606 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:28:10.606 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:28:10.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:10.607 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-05-27T06:28:10.637 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:2024-05-27T06:28:10.638+0000 7fbeda647580 -1 init, newargv = 0x7fbec000a430 newargc=15 2024-05-27T06:28:10.637 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[35526]: starting ceph client 2024-05-27T06:28:10.645 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[35526]: starting fuse 2024-05-27T06:28:10.646 INFO:teuthology.orchestra.run.smithi087.stdout:44 2024-05-27T06:28:10.646 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-05-27T06:28:10.646 DEBUG:teuthology.orchestra.run.smithi087:> sudo stdin-killer -- python3 -c ' 2024-05-27T06:28:10.646 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-05-27T06:28:10.647 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-05-27T06:28:10.647 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-05-27T06:28:10.647 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-05-27T06:28:10.647 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:28:10.647 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-05-27T06:28:10.647 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-27T06:28:10.647 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-05-27T06:28:10.647 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-27T06:28:10.647 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:28:10.647 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-05-27T06:28:10.647 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-05-27T06:28:10.647 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-05-27T06:28:10.647 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-05-27T06:28:10.647 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:28:10.648 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-05-27T06:28:10.648 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-27T06:28:10.648 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-27T06:28:10.648 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-27T06:28:10.648 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-05-27T06:28:10.648 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-05-27T06:28:10.648 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-05-27T06:28:10.648 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-27T06:28:10.648 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:28:10.648 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.0")) 2024-05-27T06:28:10.648 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-05-27T06:28:10.774 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.0.35526.asok 2024-05-27T06:28:10.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:28:10.785 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.35526.asok 2024-05-27T06:28:10.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:10.785 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.35526.asok status 2024-05-27T06:28:10.964 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-27T06:28:10.964 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-05-27T06:28:10.964 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "38f9d900c83c63799fbdbe61acc9a11b0d3554a6", 2024-05-27T06:28:10.964 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 19.0.0-3872-g38f9d900 (38f9d900c83c63799fbdbe61acc9a11b0d3554a6) squid (dev)", 2024-05-27T06:28:10.964 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "0", 2024-05-27T06:28:10.964 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-05-27T06:28:10.964 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-27T06:28:10.965 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "35526", 2024-05-27T06:28:10.965 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-05-27T06:28:10.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:10.965 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-05-27T06:28:10.965 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-05-27T06:28:10.965 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 4695, 2024-05-27T06:28:10.965 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-05-27T06:28:10.965 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-05-27T06:28:10.965 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-05-27T06:28:10.965 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 4695 2024-05-27T06:28:10.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:10.966 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-05-27T06:28:10.966 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-05-27T06:28:10.966 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-05-27T06:28:10.966 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3314792356 2024-05-27T06:28:10.966 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:10.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:10.966 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-05-27T06:28:10.966 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-05-27T06:28:10.966 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-05-27T06:28:10.966 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3314792356 2024-05-27T06:28:10.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:10.966 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.4695 192.168.0.1:0/3314792356", 2024-05-27T06:28:10.967 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/3314792356", 2024-05-27T06:28:10.967 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-05-27T06:28:10.967 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 9, 2024-05-27T06:28:10.967 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 24, 2024-05-27T06:28:10.967 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-05-27T06:28:10.967 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-05-27T06:28:10.967 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-05-27T06:28:10.967 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-27T06:28:10.980 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-27T06:28:11.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.130+0000 7fb787a00640 1 Processor -- start 2024-05-27T06:28:11.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.130+0000 7fb787a00640 1 -- start start 2024-05-27T06:28:11.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.130+0000 7fb787a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb7800b2f00 0x7fb7801680f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:11.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.130+0000 7fb787a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7800b3310 0x7fb780168630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:11.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.130+0000 7fb787a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7800ce5c0 con 0x7fb7800cf380 2024-05-27T06:28:11.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.130+0000 7fb787a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fb780164a70 con 0x7fb7800b2f00 2024-05-27T06:28:11.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.130+0000 7fb787a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb7800ce8a0 con 0x7fb7800b3310 2024-05-27T06:28:11.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.134+0000 7fb77fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7800b3310 0x7fb780168630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:11.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.134+0000 7fb785000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb7800b2f00 0x7fb7801680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:11.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.134+0000 7fb785000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb7800b2f00 0x7fb7801680f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:38060/0 (socket says 172.21.15.87:38060) 2024-05-27T06:28:11.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.134+0000 7fb785000640 1 -- 172.21.15.87:0/3218430779 learned_addr learned my addr 172.21.15.87:0/3218430779 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:11.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.134+0000 7fb77fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7800b3310 0x7fb780168630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.87:47358/0 (socket says 172.21.15.87:47358) 2024-05-27T06:28:11.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.134+0000 7fb785000640 1 -- 172.21.15.87:0/3218430779 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7800b3310 msgr2=0x7fb780168630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:11.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.134+0000 7fb785000640 1 --2- 172.21.15.87:0/3218430779 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7800b3310 0x7fb780168630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:11.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.134+0000 7fb785000640 1 -- 172.21.15.87:0/3218430779 >> v1:172.21.15.149:6789/0 conn(0x7fb7800cf380 legacy=0x7fb7800cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:11.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.134+0000 7fb785000640 1 -- 172.21.15.87:0/3218430779 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7800ceb80 con 0x7fb7800b2f00 2024-05-27T06:28:11.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.134+0000 7fb785000640 1 --2- 172.21.15.87:0/3218430779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7800b2f00 0x7fb7801680f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb774009870 tx=0x7fb77401c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b3dcc765f801820 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:11.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.134+0000 7fb77f400640 1 -- 172.21.15.87:0/3218430779 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7740a7070 con 0x7fb7800b2f00 2024-05-27T06:28:11.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.138+0000 7fb77f400640 1 -- 172.21.15.87:0/3218430779 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7740b0070 con 0x7fb7800b2f00 2024-05-27T06:28:11.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.138+0000 7fb77f400640 1 -- 172.21.15.87:0/3218430779 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7740ab890 con 0x7fb7800b2f00 2024-05-27T06:28:11.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.138+0000 7fb787a00640 1 -- 172.21.15.87:0/3218430779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7800b2f00 msgr2=0x7fb7801680f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:11.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.138+0000 7fb787a00640 1 --2- 172.21.15.87:0/3218430779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7800b2f00 0x7fb7801680f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb774009870 tx=0x7fb77401c560 comp rx=0 tx=0).stop 2024-05-27T06:28:11.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.138+0000 7fb787a00640 1 -- 172.21.15.87:0/3218430779 shutdown_connections 2024-05-27T06:28:11.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.138+0000 7fb787a00640 1 --2- 172.21.15.87:0/3218430779 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7800b3310 0x7fb780168630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:11.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.138+0000 7fb787a00640 1 --2- 172.21.15.87:0/3218430779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7800b2f00 0x7fb7801680f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:11.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.138+0000 7fb787a00640 1 -- 172.21.15.87:0/3218430779 >> 172.21.15.87:0/3218430779 conn(0x7fb7800d3590 msgr2=0x7fb7800d39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:11.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.138+0000 7fb787a00640 1 -- 172.21.15.87:0/3218430779 shutdown_connections 2024-05-27T06:28:11.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.138+0000 7fb787a00640 1 -- 172.21.15.87:0/3218430779 wait complete. 2024-05-27T06:28:11.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.138+0000 7fb787a00640 1 Processor -- start 2024-05-27T06:28:11.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.138+0000 7fb787a00640 1 -- start start 2024-05-27T06:28:11.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.142+0000 7fb787a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7800b2f00 0x7fb78014bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:11.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.142+0000 7fb787a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7800b3310 0x7fb78015eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:11.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.142+0000 7fb787a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7800cf380 0x7fb78015e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:11.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.142+0000 7fb787a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb780171430 con 0x7fb7800cf380 2024-05-27T06:28:11.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.142+0000 7fb787a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb7800d3180 con 0x7fb7800b2f00 2024-05-27T06:28:11.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.142+0000 7fb787a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb7801715b0 con 0x7fb7800b3310 2024-05-27T06:28:11.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.142+0000 7fb785a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7800cf380 0x7fb78015e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:11.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.142+0000 7fb785a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7800cf380 0x7fb78015e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55510/0 (socket says 172.21.15.87:55510) 2024-05-27T06:28:11.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.142+0000 7fb785a00640 1 -- 172.21.15.87:0/1420437849 learned_addr learned my addr 172.21.15.87:0/1420437849 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:11.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.142+0000 7fb785000640 1 --2- 172.21.15.87:0/1420437849 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7800b2f00 0x7fb78014bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:11.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.142+0000 7fb77fe00640 1 --2- 172.21.15.87:0/1420437849 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7800b3310 0x7fb78015eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:11.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.142+0000 7fb785a00640 1 -- 172.21.15.87:0/1420437849 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7800b3310 msgr2=0x7fb78015eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:11.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.142+0000 7fb785a00640 1 --2- 172.21.15.87:0/1420437849 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7800b3310 0x7fb78015eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:11.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.142+0000 7fb785a00640 1 -- 172.21.15.87:0/1420437849 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7800b2f00 msgr2=0x7fb78014bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:11.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.142+0000 7fb785a00640 1 --2- 172.21.15.87:0/1420437849 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7800b2f00 0x7fb78014bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:11.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.142+0000 7fb785a00640 1 -- 172.21.15.87:0/1420437849 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78014c4d0 con 0x7fb7800cf380 2024-05-27T06:28:11.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.142+0000 7fb785a00640 1 --2- 172.21.15.87:0/1420437849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7800cf380 0x7fb78015e320 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb77800c710 tx=0x7fb77800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:11.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.142+0000 7fb77cc00640 1 -- 172.21.15.87:0/1420437849 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb778003b80 con 0x7fb7800cf380 2024-05-27T06:28:11.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.142+0000 7fb77cc00640 1 -- 172.21.15.87:0/1420437849 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb778003d20 con 0x7fb7800cf380 2024-05-27T06:28:11.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.142+0000 7fb77cc00640 1 -- 172.21.15.87:0/1420437849 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77800aa90 con 0x7fb7800cf380 2024-05-27T06:28:11.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.142+0000 7fb787a00640 1 -- 172.21.15.87:0/1420437849 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb780149940 con 0x7fb7800cf380 2024-05-27T06:28:11.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.142+0000 7fb787a00640 1 -- 172.21.15.87:0/1420437849 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb780149f00 con 0x7fb7800cf380 2024-05-27T06:28:11.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.142+0000 7fb787a00640 1 -- 172.21.15.87:0/1420437849 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7801496b0 con 0x7fb7800cf380 2024-05-27T06:28:11.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.146+0000 7fb77cc00640 1 -- 172.21.15.87:0/1420437849 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb77800ac30 con 0x7fb7800cf380 2024-05-27T06:28:11.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.146+0000 7fb77cc00640 1 --2- 172.21.15.87:0/1420437849 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb76006f430 0x7fb760071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:11.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.146+0000 7fb77cc00640 1 -- 172.21.15.87:0/1420437849 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb77808f3d0 con 0x7fb7800cf380 2024-05-27T06:28:11.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.146+0000 7fb785000640 1 --2- 172.21.15.87:0/1420437849 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb76006f430 0x7fb760071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:11.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.146+0000 7fb785000640 1 --2- 172.21.15.87:0/1420437849 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb76006f430 0x7fb760071940 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb7740af000 tx=0x7fb7740a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:11.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.150+0000 7fb77cc00640 1 -- 172.21.15.87:0/1420437849 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb78014c4d0 con 0x7fb7800cf380 2024-05-27T06:28:11.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.342+0000 7fb787a00640 1 -- 172.21.15.87:0/1420437849 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb7800d1900 con 0x7fb7800cf380 2024-05-27T06:28:11.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.342+0000 7fb77cc00640 1 -- 172.21.15.87:0/1420437849 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fb77800ce20 con 0x7fb7800cf380 2024-05-27T06:28:11.338 INFO:teuthology.orchestra.run.smithi087.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-27T06:28:11.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.342+0000 7fb787a00640 1 -- 172.21.15.87:0/1420437849 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb76006f430 msgr2=0x7fb760071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:11.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.342+0000 7fb787a00640 1 --2- 172.21.15.87:0/1420437849 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb76006f430 0x7fb760071940 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb7740af000 tx=0x7fb7740a7000 comp rx=0 tx=0).stop 2024-05-27T06:28:11.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.342+0000 7fb787a00640 1 -- 172.21.15.87:0/1420437849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7800cf380 msgr2=0x7fb78015e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:11.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.342+0000 7fb787a00640 1 --2- 172.21.15.87:0/1420437849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7800cf380 0x7fb78015e320 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb77800c710 tx=0x7fb77800cbd0 comp rx=0 tx=0).stop 2024-05-27T06:28:11.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.342+0000 7fb787a00640 1 -- 172.21.15.87:0/1420437849 shutdown_connections 2024-05-27T06:28:11.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.342+0000 7fb787a00640 1 --2- 172.21.15.87:0/1420437849 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb76006f430 0x7fb760071940 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:11.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.342+0000 7fb787a00640 1 --2- 172.21.15.87:0/1420437849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7800cf380 0x7fb78015e320 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:11.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.342+0000 7fb787a00640 1 --2- 172.21.15.87:0/1420437849 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7800b3310 0x7fb78015eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:11.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.342+0000 7fb787a00640 1 --2- 172.21.15.87:0/1420437849 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb7800b2f00 0x7fb78014bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:11.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.342+0000 7fb787a00640 1 -- 172.21.15.87:0/1420437849 >> 172.21.15.87:0/1420437849 conn(0x7fb7800d3590 msgr2=0x7fb780167c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:11.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.342+0000 7fb787a00640 1 -- 172.21.15.87:0/1420437849 shutdown_connections 2024-05-27T06:28:11.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11.342+0000 7fb787a00640 1 -- 172.21.15.87:0/1420437849 wait complete. 2024-05-27T06:28:11.360 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-27T06:28:11.360 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-27T06:28:11.360 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-05-27T06:28:11.360 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-05-27T06:28:11.360 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-27T06:28:11.360 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-27T06:28:11.360 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-27T06:28:11.361 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-27T06:28:11.361 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-05-27T06:28:11.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:11.361 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-05-27T06:28:11.370 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T06:28:11.370 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T06:28:11.370 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T06:28:11.370 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:11.370 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-05-27T06:28:11.370 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:11.370 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:28:11.371 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:11.371 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-05-27T06:28:11.371 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:28:11.371 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:11.371 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-05-27T06:28:11.371 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:28:11.371 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:11.371 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-27T06:28:11.371 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:11.371 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-27T06:28:11.371 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42450sec preferred_lft 42450sec 2024-05-27T06:28:11.371 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-05-27T06:28:11.371 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:11.372 INFO:teuthology.orchestra.run.smithi087.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-27T06:28:11.372 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 02:42:75:41:48:14 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:11.372 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-27T06:28:11.372 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:11.372 INFO:teuthology.orchestra.run.smithi087.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-27T06:28:11.372 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:11.372 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-27T06:28:11.372 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:11.372 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2024-05-27T06:28:11.372 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:11.372 INFO:teuthology.orchestra.run.smithi087.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-27T06:28:11.372 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:28:11.372 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-05-27T06:28:11.372 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:11.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:11.373 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-27T06:28:11.430 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-05-27T06:28:11.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:11.433 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-05-27T06:28:11.485 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-05-27T06:28:11.485 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-27T06:28:11.485 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-27T06:28:11.485 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-27T06:28:11.485 INFO:teuthology.orchestra.run.smithi087.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-27T06:28:11.485 INFO:teuthology.orchestra.run.smithi087.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-27T06:28:11.485 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-27T06:28:11.486 INFO:teuthology.orchestra.run.smithi087.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:28:11.486 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:28:11.486 INFO:teuthology.orchestra.run.smithi087.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:28:11.486 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-27T06:28:11.486 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:28:11.487 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-27T06:28:11.487 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-27T06:28:11.487 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-27T06:28:11.487 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-27T06:28:11.487 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-27T06:28:11.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:28:11.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:28:11.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:11.619 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-05-27T06:28:11.629 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-27T06:28:11.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:11.629 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list-id 2024-05-27T06:28:11.678 INFO:teuthology.orchestra.run.smithi087.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-05-27T06:28:11.678 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:28:11.679 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-27T06:28:11.679 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:28:11.679 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-05-27T06:28:11.679 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-27T06:28:11.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:28:11.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:28:11.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:11.804 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-27T06:28:11.824 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T06:28:11.824 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T06:28:11.824 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T06:28:11.824 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:11.824 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-05-27T06:28:11.824 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:11.825 INFO:teuthology.orchestra.run.smithi087.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-27T06:28:11.825 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 5e:f1:4e:f5:51:89 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-27T06:28:11.825 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-27T06:28:11.825 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:11.825 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::5cf1:4eff:fef5:5189/64 scope link 2024-05-27T06:28:11.825 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:11.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:11.827 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-27T06:28:11.893 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T06:28:11.893 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T06:28:11.893 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T06:28:11.893 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:11.893 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-05-27T06:28:11.893 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:11.893 INFO:teuthology.orchestra.run.smithi087.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-27T06:28:11.893 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 5e:f1:4e:f5:51:89 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-27T06:28:11.893 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-27T06:28:11.893 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:11.893 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::5cf1:4eff:fef5:5189/64 scope link 2024-05-27T06:28:11.893 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:11.895 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-05-27T06:28:11.895 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:28:11.895 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-27T06:28:11.895 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-05-27T06:28:11.895 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-27T06:28:11.895 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-05-27T06:28:11.895 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-05-27T06:28:11.895 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-05-27T06:28:11.896 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-27T06:28:11.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:28:12.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:28:12.072 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:28:12.072 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-27T06:28:12.072 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.1 up 2024-05-27T06:28:12.072 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set dev brx.1 master ceph-brx 2024-05-27T06:28:12.072 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-27T06:28:12.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:28:12.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:28:12.155 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-05-27T06:28:12.155 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T06:28:12.155 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-05-27T06:28:12.209 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-05-27T06:28:12.209 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T06:28:12.209 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-05-27T06:28:12.260 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-05-27T06:28:12.325 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T06:28:12.374 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-05-27T06:28:12.374 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-05-27T06:28:12.374 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-05-27T06:28:12.375 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-05-27T06:28:12.375 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-05-27T06:28:12.375 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-05-27T06:28:12.375 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-05-27T06:28:12.375 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-05-27T06:28:12.375 INFO:teuthology.orchestra.run.smithi087.stdout:/run/lock 2024-05-27T06:28:12.375 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-05-27T06:28:12.375 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-05-27T06:28:12.375 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-05-27T06:28:12.375 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T06:28:12.375 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-05-27T06:28:12.375 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-05-27T06:28:12.376 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-05-27T06:28:12.376 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-05-27T06:28:12.376 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/fs/nfsd 2024-05-27T06:28:12.376 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-05-27T06:28:12.376 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-05-27T06:28:12.376 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysusers.service 2024-05-27T06:28:12.376 INFO:teuthology.orchestra.run.smithi087.stdout:/run/rpc_pipefs 2024-05-27T06:28:12.376 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-05-27T06:28:12.376 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-05-27T06:28:12.376 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2024-05-27T06:28:12.376 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2024-05-27T06:28:12.376 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2024-05-27T06:28:12.377 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2024-05-27T06:28:12.377 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-05-27T06:28:12.377 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:28:12.377 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:28:12.377 INFO:teuthology.orchestra.run.smithi087.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-27T06:28:12.377 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:28:12.377 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:28:12.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:12.378 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-05-27T06:28:12.433 INFO:teuthology.orchestra.run.smithi087.stdout:44 2024-05-27T06:28:12.433 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [44] 2024-05-27T06:28:12.433 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-05-27T06:28:12.480 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-05-27T06:28:12.500 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T06:28:12.550 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-05-27T06:28:12.550 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-05-27T06:28:12.550 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-05-27T06:28:12.551 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-05-27T06:28:12.551 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-05-27T06:28:12.551 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-05-27T06:28:12.551 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-05-27T06:28:12.551 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-05-27T06:28:12.551 INFO:teuthology.orchestra.run.smithi087.stdout:/run/lock 2024-05-27T06:28:12.551 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-05-27T06:28:12.551 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-05-27T06:28:12.551 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-05-27T06:28:12.551 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T06:28:12.551 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-05-27T06:28:12.551 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-05-27T06:28:12.552 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-05-27T06:28:12.552 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-05-27T06:28:12.552 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/fs/nfsd 2024-05-27T06:28:12.552 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-05-27T06:28:12.552 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-05-27T06:28:12.552 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysusers.service 2024-05-27T06:28:12.552 INFO:teuthology.orchestra.run.smithi087.stdout:/run/rpc_pipefs 2024-05-27T06:28:12.552 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-05-27T06:28:12.552 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-05-27T06:28:12.552 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2024-05-27T06:28:12.552 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2024-05-27T06:28:12.552 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2024-05-27T06:28:12.553 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2024-05-27T06:28:12.553 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-05-27T06:28:12.553 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:28:12.553 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:28:12.553 INFO:teuthology.orchestra.run.smithi087.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-27T06:28:12.553 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:28:12.553 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:28:12.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:12.554 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-05-27T06:28:12.586 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi087.stderr:2024-05-27T06:28:12.590+0000 7fc7ccf70580 -1 init, newargv = 0x55c1d1355eb0 newargc=15 2024-05-27T06:28:12.586 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi087.stderr:ceph-fuse[35665]: starting ceph client 2024-05-27T06:28:12.595 INFO:teuthology.orchestra.run.smithi087.stdout:44 2024-05-27T06:28:12.595 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi087.stderr:ceph-fuse[35665]: starting fuse 2024-05-27T06:28:13.697 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-05-27T06:28:13.720 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T06:28:13.775 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-05-27T06:28:13.775 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-05-27T06:28:13.775 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-05-27T06:28:13.775 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-05-27T06:28:13.775 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-05-27T06:28:13.775 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-05-27T06:28:13.775 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-05-27T06:28:13.775 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-05-27T06:28:13.776 INFO:teuthology.orchestra.run.smithi087.stdout:/run/lock 2024-05-27T06:28:13.776 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-05-27T06:28:13.776 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-05-27T06:28:13.776 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-05-27T06:28:13.776 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T06:28:13.776 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-05-27T06:28:13.776 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-05-27T06:28:13.776 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-05-27T06:28:13.776 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-05-27T06:28:13.776 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/fs/nfsd 2024-05-27T06:28:13.776 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-05-27T06:28:13.776 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-05-27T06:28:13.776 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysusers.service 2024-05-27T06:28:13.777 INFO:teuthology.orchestra.run.smithi087.stdout:/run/rpc_pipefs 2024-05-27T06:28:13.777 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-05-27T06:28:13.777 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-05-27T06:28:13.777 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2024-05-27T06:28:13.777 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2024-05-27T06:28:13.777 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2024-05-27T06:28:13.777 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2024-05-27T06:28:13.777 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-05-27T06:28:13.777 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:28:13.777 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:28:13.777 INFO:teuthology.orchestra.run.smithi087.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-27T06:28:13.777 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:28:13.777 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:28:13.777 INFO:teuthology.orchestra.run.smithi087.stdout:/home/ubuntu/cephtest/mnt.2 2024-05-27T06:28:13.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:13.778 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-05-27T06:28:13.829 INFO:teuthology.orchestra.run.smithi087.stdout:44 2024-05-27T06:28:13.829 INFO:teuthology.orchestra.run.smithi087.stdout:45 2024-05-27T06:28:13.829 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44, 45] 2024-05-27T06:28:13.829 DEBUG:teuthology.orchestra.run.smithi087:> sudo stdin-killer -- python3 -c ' 2024-05-27T06:28:13.830 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-05-27T06:28:13.830 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-05-27T06:28:13.830 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-05-27T06:28:13.830 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-05-27T06:28:13.830 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:28:13.830 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-05-27T06:28:13.830 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-05-27T06:28:13.830 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-05-27T06:28:13.830 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-05-27T06:28:13.830 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:28:13.830 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-05-27T06:28:13.830 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-05-27T06:28:13.830 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-05-27T06:28:13.830 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-05-27T06:28:13.831 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:28:13.831 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-05-27T06:28:13.831 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-27T06:28:13.831 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-27T06:28:13.831 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-27T06:28:13.831 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-05-27T06:28:13.831 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-05-27T06:28:13.831 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-05-27T06:28:13.831 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-27T06:28:13.831 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:28:13.831 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.2")) 2024-05-27T06:28:13.831 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-05-27T06:28:13.961 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.2.35665.asok 2024-05-27T06:28:13.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:28:13.973 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.35665.asok 2024-05-27T06:28:13.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:13.973 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.35665.asok status 2024-05-27T06:28:14.151 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-27T06:28:14.151 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-05-27T06:28:14.151 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "38f9d900c83c63799fbdbe61acc9a11b0d3554a6", 2024-05-27T06:28:14.151 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 19.0.0-3872-g38f9d900 (38f9d900c83c63799fbdbe61acc9a11b0d3554a6) squid (dev)", 2024-05-27T06:28:14.151 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "2", 2024-05-27T06:28:14.151 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-05-27T06:28:14.151 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-05-27T06:28:14.151 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "35665", 2024-05-27T06:28:14.151 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-05-27T06:28:14.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-05-27T06:28:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-05-27T06:28:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 4704, 2024-05-27T06:28:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-05-27T06:28:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-05-27T06:28:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-05-27T06:28:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 4704 2024-05-27T06:28:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-05-27T06:28:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-05-27T06:28:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:0", 2024-05-27T06:28:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3666034837 2024-05-27T06:28:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:14.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-05-27T06:28:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-05-27T06:28:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:0", 2024-05-27T06:28:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3666034837 2024-05-27T06:28:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.4704 172.21.15.87:0/3666034837", 2024-05-27T06:28:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "172.21.15.87:0/3666034837", 2024-05-27T06:28:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-05-27T06:28:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 9, 2024-05-27T06:28:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 24, 2024-05-27T06:28:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-05-27T06:28:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-05-27T06:28:14.153 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-05-27T06:28:14.153 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-27T06:28:14.166 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-27T06:28:14.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.314+0000 7fbea7a00640 1 Processor -- start 2024-05-27T06:28:14.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.314+0000 7fbea7a00640 1 -- start start 2024-05-27T06:28:14.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.318+0000 7fbea7a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbea00b03c0 0x7fbea00cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:14.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.318+0000 7fbea7a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbea00b07d0 0x7fbea00ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:14.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.318+0000 7fbea7a00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbea00d10f0 con 0x7fbea015fd70 2024-05-27T06:28:14.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.318+0000 7fbea7a00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fbea006d610 con 0x7fbea00b03c0 2024-05-27T06:28:14.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.318+0000 7fbea7a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbea006c720 con 0x7fbea00b07d0 2024-05-27T06:28:14.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.318+0000 7fbea5000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbea00b03c0 0x7fbea00cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:14.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.318+0000 7fbea5a00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fbea015fd70 0x7fbea0160180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:53792/0 (socket says 172.21.15.87:53792) 2024-05-27T06:28:14.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.318+0000 7fbea5a00640 1 -- 172.21.15.87:0/1230286987 learned_addr learned my addr 172.21.15.87:0/1230286987 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:14.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.318+0000 7fbe9fe00640 1 --2- 172.21.15.87:0/1230286987 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbea00b07d0 0x7fbea00ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:14.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.318+0000 7fbea5000640 1 -- 172.21.15.87:0/1230286987 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbea00b07d0 msgr2=0x7fbea00ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:14.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.318+0000 7fbea5000640 1 --2- 172.21.15.87:0/1230286987 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbea00b07d0 0x7fbea00ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:14.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.318+0000 7fbea5000640 1 -- 172.21.15.87:0/1230286987 >> v1:172.21.15.87:6789/0 conn(0x7fbea015fd70 legacy=0x7fbea0160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:14.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.318+0000 7fbea5000640 1 -- 172.21.15.87:0/1230286987 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea006ca00 con 0x7fbea00b03c0 2024-05-27T06:28:14.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.318+0000 7fbe9f400640 1 -- 172.21.15.87:0/1230286987 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2493481722 0 0) 0x7fbe98001120 con 0x7fbea015fd70 2024-05-27T06:28:14.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.322+0000 7fbea5000640 1 --2- 172.21.15.87:0/1230286987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbea00b03c0 0x7fbea00cdd30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009d90 tx=0x7fbe9001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb8058ece0b3d6d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:14.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.322+0000 7fbe9f400640 1 -- 172.21.15.87:0/1230286987 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe900b2070 con 0x7fbea00b03c0 2024-05-27T06:28:14.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.322+0000 7fbe9f400640 1 -- 172.21.15.87:0/1230286987 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe900a5a00 con 0x7fbea00b03c0 2024-05-27T06:28:14.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.322+0000 7fbe9f400640 1 -- 172.21.15.87:0/1230286987 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe900a5dd0 con 0x7fbea00b03c0 2024-05-27T06:28:14.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.322+0000 7fbea7a00640 1 -- 172.21.15.87:0/1230286987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbea00b03c0 msgr2=0x7fbea00cdd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:14.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.322+0000 7fbea7a00640 1 --2- 172.21.15.87:0/1230286987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbea00b03c0 0x7fbea00cdd30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009d90 tx=0x7fbe9001c940 comp rx=0 tx=0).stop 2024-05-27T06:28:14.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.322+0000 7fbea7a00640 1 -- 172.21.15.87:0/1230286987 shutdown_connections 2024-05-27T06:28:14.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.322+0000 7fbea7a00640 1 --2- 172.21.15.87:0/1230286987 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbea00b07d0 0x7fbea00ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:14.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.322+0000 7fbea7a00640 1 --2- 172.21.15.87:0/1230286987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbea00b03c0 0x7fbea00cdd30 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:14.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.322+0000 7fbea7a00640 1 -- 172.21.15.87:0/1230286987 >> 172.21.15.87:0/1230286987 conn(0x7fbea00b46b0 msgr2=0x7fbea00b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:14.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.322+0000 7fbea7a00640 1 -- 172.21.15.87:0/1230286987 shutdown_connections 2024-05-27T06:28:14.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.322+0000 7fbea7a00640 1 -- 172.21.15.87:0/1230286987 wait complete. 2024-05-27T06:28:14.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.326+0000 7fbea7a00640 1 Processor -- start 2024-05-27T06:28:14.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.326+0000 7fbea7a00640 1 -- start start 2024-05-27T06:28:14.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.326+0000 7fbea7a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbea00b03c0 0x7fbea0099730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:14.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.326+0000 7fbea7a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbea00b07d0 0x7fbea0099f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:14.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.326+0000 7fbea7a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbea015fd70 0x7fbea009a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:14.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.326+0000 7fbea7a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbea00d1740 con 0x7fbea00b03c0 2024-05-27T06:28:14.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.326+0000 7fbea7a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbea015c620 con 0x7fbea00b07d0 2024-05-27T06:28:14.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.326+0000 7fbea7a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbea00d18c0 con 0x7fbea015fd70 2024-05-27T06:28:14.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.326+0000 7fbea5000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbea00b03c0 0x7fbea0099730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:14.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.326+0000 7fbea5000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbea00b03c0 0x7fbea0099730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55522/0 (socket says 172.21.15.87:55522) 2024-05-27T06:28:14.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.326+0000 7fbea5000640 1 -- 172.21.15.87:0/3063310364 learned_addr learned my addr 172.21.15.87:0/3063310364 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:14.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.326+0000 7fbea5000640 1 -- 172.21.15.87:0/3063310364 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbea015fd70 msgr2=0x7fbea009a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:14.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.326+0000 7fbea5000640 1 --2- 172.21.15.87:0/3063310364 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbea015fd70 0x7fbea009a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:14.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.326+0000 7fbea5000640 1 -- 172.21.15.87:0/3063310364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbea00b07d0 msgr2=0x7fbea0099f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:14.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.326+0000 7fbea5000640 1 --2- 172.21.15.87:0/3063310364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbea00b07d0 0x7fbea0099f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:14.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.326+0000 7fbea5000640 1 -- 172.21.15.87:0/3063310364 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea015b2c0 con 0x7fbea00b03c0 2024-05-27T06:28:14.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.326+0000 7fbea5000640 1 --2- 172.21.15.87:0/3063310364 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbea00b03c0 0x7fbea0099730 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbe9001a570 tx=0x7fbe900196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:14.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.326+0000 7fbe9cc00640 1 -- 172.21.15.87:0/3063310364 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe900b2040 con 0x7fbea00b03c0 2024-05-27T06:28:14.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.326+0000 7fbe9cc00640 1 -- 172.21.15.87:0/3063310364 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe900bf070 con 0x7fbea00b03c0 2024-05-27T06:28:14.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.326+0000 7fbea7a00640 1 -- 172.21.15.87:0/3063310364 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbea015aa20 con 0x7fbea00b03c0 2024-05-27T06:28:14.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.326+0000 7fbe9cc00640 1 -- 172.21.15.87:0/3063310364 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe900ad980 con 0x7fbea00b03c0 2024-05-27T06:28:14.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.326+0000 7fbea7a00640 1 -- 172.21.15.87:0/3063310364 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbea015afe0 con 0x7fbea00b03c0 2024-05-27T06:28:14.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.330+0000 7fbea7a00640 1 -- 172.21.15.87:0/3063310364 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbea006aa30 con 0x7fbea00b03c0 2024-05-27T06:28:14.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.330+0000 7fbe9cc00640 1 -- 172.21.15.87:0/3063310364 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbe900adb20 con 0x7fbea00b03c0 2024-05-27T06:28:14.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.330+0000 7fbe9cc00640 1 --2- 172.21.15.87:0/3063310364 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbe8006f430 0x7fbe80071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:14.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.330+0000 7fbe9cc00640 1 -- 172.21.15.87:0/3063310364 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbe9012a810 con 0x7fbea00b03c0 2024-05-27T06:28:14.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.330+0000 7fbe9fe00640 1 --2- 172.21.15.87:0/3063310364 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbe8006f430 0x7fbe80071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:14.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.334+0000 7fbe9fe00640 1 --2- 172.21.15.87:0/3063310364 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbe8006f430 0x7fbe80071940 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbea015a950 tx=0x7fbe8c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:14.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.338+0000 7fbe9cc00640 1 -- 172.21.15.87:0/3063310364 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fbe90016560 con 0x7fbea00b03c0 2024-05-27T06:28:14.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.526+0000 7fbea7a00640 1 -- 172.21.15.87:0/3063310364 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbea00cd8e0 con 0x7fbea00b03c0 2024-05-27T06:28:14.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.530+0000 7fbe9cc00640 1 -- 172.21.15.87:0/3063310364 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fbe90128e20 con 0x7fbea00b03c0 2024-05-27T06:28:14.527 INFO:teuthology.orchestra.run.smithi087.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-27T06:28:14.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.530+0000 7fbea7a00640 1 -- 172.21.15.87:0/3063310364 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbe8006f430 msgr2=0x7fbe80071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:14.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.530+0000 7fbea7a00640 1 --2- 172.21.15.87:0/3063310364 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbe8006f430 0x7fbe80071940 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbea015a950 tx=0x7fbe8c008040 comp rx=0 tx=0).stop 2024-05-27T06:28:14.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.530+0000 7fbea7a00640 1 -- 172.21.15.87:0/3063310364 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbea00b03c0 msgr2=0x7fbea0099730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:14.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.530+0000 7fbea7a00640 1 --2- 172.21.15.87:0/3063310364 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbea00b03c0 0x7fbea0099730 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbe9001a570 tx=0x7fbe900196e0 comp rx=0 tx=0).stop 2024-05-27T06:28:14.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.530+0000 7fbea7a00640 1 -- 172.21.15.87:0/3063310364 shutdown_connections 2024-05-27T06:28:14.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.530+0000 7fbea7a00640 1 --2- 172.21.15.87:0/3063310364 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbe8006f430 0x7fbe80071940 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:14.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.530+0000 7fbea7a00640 1 --2- 172.21.15.87:0/3063310364 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbea015fd70 0x7fbea009a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:14.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.530+0000 7fbea7a00640 1 --2- 172.21.15.87:0/3063310364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbea00b07d0 0x7fbea0099f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:14.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.530+0000 7fbea7a00640 1 --2- 172.21.15.87:0/3063310364 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbea00b03c0 0x7fbea0099730 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:14.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.530+0000 7fbea7a00640 1 -- 172.21.15.87:0/3063310364 >> 172.21.15.87:0/3063310364 conn(0x7fbea00b46b0 msgr2=0x7fbea00686b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:14.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.530+0000 7fbea7a00640 1 -- 172.21.15.87:0/3063310364 shutdown_connections 2024-05-27T06:28:14.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:14.530+0000 7fbea7a00640 1 -- 172.21.15.87:0/3063310364 wait complete. 2024-05-27T06:28:14.548 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-27T06:28:14.548 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-27T06:28:14.549 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-05-27T06:28:14.549 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-27T06:28:14.549 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-27T06:28:14.549 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-27T06:28:14.549 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-27T06:28:14.549 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-27T06:28:14.549 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-27T06:28:14.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:14.550 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-05-27T06:28:14.560 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T06:28:14.560 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T06:28:14.560 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T06:28:14.560 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:14.561 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-05-27T06:28:14.561 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:14.561 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:28:14.561 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:14.561 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-05-27T06:28:14.561 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:28:14.561 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:14.561 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-05-27T06:28:14.561 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:28:14.561 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:14.562 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-27T06:28:14.562 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:14.562 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-27T06:28:14.562 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42443sec preferred_lft 42443sec 2024-05-27T06:28:14.562 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link 2024-05-27T06:28:14.562 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:14.562 INFO:teuthology.orchestra.run.smithi149.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-27T06:28:14.562 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 02:42:61:a8:ae:04 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:14.562 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-27T06:28:14.562 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:14.563 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-27T06:28:14.563 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:28:14.564 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-05-27T06:28:14.564 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add name ceph-brx type bridge 2024-05-27T06:28:14.564 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr flush dev ceph-brx 2024-05-27T06:28:14.564 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set ceph-brx up 2024-05-27T06:28:14.564 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-27T06:28:14.564 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-05-27T06:28:14.656 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:28:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:28:14.721 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:28:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:28:14.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:14.728 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-27T06:28:14.746 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-05-27T06:28:14.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:14.748 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-05-27T06:28:14.824 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-05-27T06:28:14.824 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-27T06:28:14.824 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-27T06:28:14.824 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-27T06:28:14.824 INFO:teuthology.orchestra.run.smithi149.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-27T06:28:14.824 INFO:teuthology.orchestra.run.smithi149.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-27T06:28:14.824 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-27T06:28:14.825 INFO:teuthology.orchestra.run.smithi149.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:28:14.825 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:28:14.825 INFO:teuthology.orchestra.run.smithi149.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:28:14.825 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-27T06:28:14.825 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:28:14.825 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-05-27T06:28:14.825 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-27T06:28:14.825 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-27T06:28:14.825 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-27T06:28:14.825 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-05-27T06:28:14.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:28:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:28:14.954 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:28:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:28:14.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:14.961 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-05-27T06:28:14.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:14.970 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list-id 2024-05-27T06:28:15.020 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:28:15.020 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-05-27T06:28:15.020 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-27T06:28:15.020 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-27T06:28:15.021 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-05-27T06:28:15.109 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:28:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:28:15.140 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:28:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:28:15.147 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-27T06:28:15.147 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:28:15.147 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-05-27T06:28:15.148 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-27T06:28:15.148 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-27T06:28:15.148 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-27T06:28:15.148 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-27T06:28:15.148 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-27T06:28:15.148 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-05-27T06:28:15.194 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:28:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:28:15.307 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:28:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:28:15.314 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:28:15.314 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-05-27T06:28:15.314 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-05-27T06:28:15.314 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set dev brx.0 master ceph-brx 2024-05-27T06:28:15.315 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-05-27T06:28:15.402 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:28:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:28:15.432 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:28:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:28:15.439 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-05-27T06:28:15.439 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T06:28:15.439 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-27T06:28:15.448 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-27T06:28:15.448 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T06:28:15.448 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-27T06:28:15.499 DEBUG:teuthology.orchestra.run.smithi149:> sudo modprobe fuse 2024-05-27T06:28:15.560 DEBUG:teuthology.orchestra.run.smithi149:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T06:28:15.617 INFO:teuthology.orchestra.run.smithi149.stdout:/sys 2024-05-27T06:28:15.617 INFO:teuthology.orchestra.run.smithi149.stdout:/proc 2024-05-27T06:28:15.617 INFO:teuthology.orchestra.run.smithi149.stdout:/dev 2024-05-27T06:28:15.618 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/pts 2024-05-27T06:28:15.618 INFO:teuthology.orchestra.run.smithi149.stdout:/run 2024-05-27T06:28:15.618 INFO:teuthology.orchestra.run.smithi149.stdout:/ 2024-05-27T06:28:15.618 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/security 2024-05-27T06:28:15.618 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/shm 2024-05-27T06:28:15.618 INFO:teuthology.orchestra.run.smithi149.stdout:/run/lock 2024-05-27T06:28:15.618 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup 2024-05-27T06:28:15.618 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/pstore 2024-05-27T06:28:15.618 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/bpf 2024-05-27T06:28:15.618 INFO:teuthology.orchestra.run.smithi149.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T06:28:15.618 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/hugepages 2024-05-27T06:28:15.618 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/mqueue 2024-05-27T06:28:15.618 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/debug 2024-05-27T06:28:15.618 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/tracing 2024-05-27T06:28:15.619 INFO:teuthology.orchestra.run.smithi149.stdout:/proc/fs/nfsd 2024-05-27T06:28:15.619 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/fuse/connections 2024-05-27T06:28:15.619 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/config 2024-05-27T06:28:15.619 INFO:teuthology.orchestra.run.smithi149.stdout:/run/credentials/systemd-sysusers.service 2024-05-27T06:28:15.619 INFO:teuthology.orchestra.run.smithi149.stdout:/run/rpc_pipefs 2024-05-27T06:28:15.619 INFO:teuthology.orchestra.run.smithi149.stdout:/run/user/1000 2024-05-27T06:28:15.619 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph 2024-05-27T06:28:15.619 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-4 2024-05-27T06:28:15.619 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-5 2024-05-27T06:28:15.619 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-6 2024-05-27T06:28:15.619 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-7 2024-05-27T06:28:15.619 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns 2024-05-27T06:28:15.619 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-27T06:28:15.620 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-27T06:28:15.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:15.620 DEBUG:teuthology.orchestra.run.smithi149:> ls /sys/fs/fuse/connections 2024-05-27T06:28:15.676 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-27T06:28:15.676 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-05-27T06:28:15.723 DEBUG:teuthology.orchestra.run.smithi149:> sudo modprobe fuse 2024-05-27T06:28:15.743 DEBUG:teuthology.orchestra.run.smithi149:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T06:28:15.797 INFO:teuthology.orchestra.run.smithi149.stdout:/sys 2024-05-27T06:28:15.798 INFO:teuthology.orchestra.run.smithi149.stdout:/proc 2024-05-27T06:28:15.798 INFO:teuthology.orchestra.run.smithi149.stdout:/dev 2024-05-27T06:28:15.798 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/pts 2024-05-27T06:28:15.798 INFO:teuthology.orchestra.run.smithi149.stdout:/run 2024-05-27T06:28:15.798 INFO:teuthology.orchestra.run.smithi149.stdout:/ 2024-05-27T06:28:15.798 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/security 2024-05-27T06:28:15.798 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/shm 2024-05-27T06:28:15.798 INFO:teuthology.orchestra.run.smithi149.stdout:/run/lock 2024-05-27T06:28:15.798 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup 2024-05-27T06:28:15.798 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/pstore 2024-05-27T06:28:15.798 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/bpf 2024-05-27T06:28:15.798 INFO:teuthology.orchestra.run.smithi149.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T06:28:15.799 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/hugepages 2024-05-27T06:28:15.799 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/mqueue 2024-05-27T06:28:15.799 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/debug 2024-05-27T06:28:15.799 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/tracing 2024-05-27T06:28:15.799 INFO:teuthology.orchestra.run.smithi149.stdout:/proc/fs/nfsd 2024-05-27T06:28:15.799 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/fuse/connections 2024-05-27T06:28:15.799 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/config 2024-05-27T06:28:15.799 INFO:teuthology.orchestra.run.smithi149.stdout:/run/credentials/systemd-sysusers.service 2024-05-27T06:28:15.799 INFO:teuthology.orchestra.run.smithi149.stdout:/run/rpc_pipefs 2024-05-27T06:28:15.799 INFO:teuthology.orchestra.run.smithi149.stdout:/run/user/1000 2024-05-27T06:28:15.799 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph 2024-05-27T06:28:15.799 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-4 2024-05-27T06:28:15.799 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-5 2024-05-27T06:28:15.799 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-6 2024-05-27T06:28:15.800 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-7 2024-05-27T06:28:15.800 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns 2024-05-27T06:28:15.800 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-27T06:28:15.800 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-27T06:28:15.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:15.801 DEBUG:teuthology.orchestra.run.smithi149:> ls /sys/fs/fuse/connections 2024-05-27T06:28:15.830 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi149.stderr:2024-05-27T06:28:15.832+0000 7f5714d4c580 -1 init, newargv = 0x7f5708005c30 newargc=15 2024-05-27T06:28:15.830 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi149.stderr:ceph-fuse[33772]: starting ceph client 2024-05-27T06:28:15.839 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi149.stderr:ceph-fuse[33772]: starting fuse 2024-05-27T06:28:16.939 DEBUG:teuthology.orchestra.run.smithi149:> sudo modprobe fuse 2024-05-27T06:28:16.963 DEBUG:teuthology.orchestra.run.smithi149:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T06:28:17.019 INFO:teuthology.orchestra.run.smithi149.stdout:/sys 2024-05-27T06:28:17.019 INFO:teuthology.orchestra.run.smithi149.stdout:/proc 2024-05-27T06:28:17.019 INFO:teuthology.orchestra.run.smithi149.stdout:/dev 2024-05-27T06:28:17.019 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/pts 2024-05-27T06:28:17.019 INFO:teuthology.orchestra.run.smithi149.stdout:/run 2024-05-27T06:28:17.019 INFO:teuthology.orchestra.run.smithi149.stdout:/ 2024-05-27T06:28:17.019 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/security 2024-05-27T06:28:17.019 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/shm 2024-05-27T06:28:17.020 INFO:teuthology.orchestra.run.smithi149.stdout:/run/lock 2024-05-27T06:28:17.020 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup 2024-05-27T06:28:17.020 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/pstore 2024-05-27T06:28:17.020 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/bpf 2024-05-27T06:28:17.020 INFO:teuthology.orchestra.run.smithi149.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T06:28:17.020 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/hugepages 2024-05-27T06:28:17.020 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/mqueue 2024-05-27T06:28:17.020 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/debug 2024-05-27T06:28:17.020 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/tracing 2024-05-27T06:28:17.020 INFO:teuthology.orchestra.run.smithi149.stdout:/proc/fs/nfsd 2024-05-27T06:28:17.020 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/fuse/connections 2024-05-27T06:28:17.020 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/config 2024-05-27T06:28:17.020 INFO:teuthology.orchestra.run.smithi149.stdout:/run/credentials/systemd-sysusers.service 2024-05-27T06:28:17.020 INFO:teuthology.orchestra.run.smithi149.stdout:/run/rpc_pipefs 2024-05-27T06:28:17.021 INFO:teuthology.orchestra.run.smithi149.stdout:/run/user/1000 2024-05-27T06:28:17.021 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph 2024-05-27T06:28:17.021 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-4 2024-05-27T06:28:17.021 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-5 2024-05-27T06:28:17.021 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-6 2024-05-27T06:28:17.021 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-7 2024-05-27T06:28:17.021 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns 2024-05-27T06:28:17.021 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-27T06:28:17.021 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-27T06:28:17.022 INFO:teuthology.orchestra.run.smithi149.stdout:/home/ubuntu/cephtest/mnt.1 2024-05-27T06:28:17.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:17.023 DEBUG:teuthology.orchestra.run.smithi149:> ls /sys/fs/fuse/connections 2024-05-27T06:28:17.073 INFO:teuthology.orchestra.run.smithi149.stdout:44 2024-05-27T06:28:17.073 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-05-27T06:28:17.073 DEBUG:teuthology.orchestra.run.smithi149:> sudo stdin-killer -- python3 -c ' 2024-05-27T06:28:17.073 DEBUG:teuthology.orchestra.run.smithi149:> import glob 2024-05-27T06:28:17.074 DEBUG:teuthology.orchestra.run.smithi149:> import re 2024-05-27T06:28:17.074 DEBUG:teuthology.orchestra.run.smithi149:> import os 2024-05-27T06:28:17.074 DEBUG:teuthology.orchestra.run.smithi149:> import subprocess 2024-05-27T06:28:17.074 DEBUG:teuthology.orchestra.run.smithi149:> 2024-05-27T06:28:17.074 DEBUG:teuthology.orchestra.run.smithi149:> def _find_admin_socket(client_name): 2024-05-27T06:28:17.074 DEBUG:teuthology.orchestra.run.smithi149:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-05-27T06:28:17.074 DEBUG:teuthology.orchestra.run.smithi149:> files = glob.glob(asok_path) 2024-05-27T06:28:17.074 DEBUG:teuthology.orchestra.run.smithi149:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-05-27T06:28:17.074 DEBUG:teuthology.orchestra.run.smithi149:> 2024-05-27T06:28:17.074 DEBUG:teuthology.orchestra.run.smithi149:> # Given a non-glob path, it better be there 2024-05-27T06:28:17.074 DEBUG:teuthology.orchestra.run.smithi149:> if "*" not in asok_path: 2024-05-27T06:28:17.074 DEBUG:teuthology.orchestra.run.smithi149:> assert(len(files) == 1) 2024-05-27T06:28:17.074 DEBUG:teuthology.orchestra.run.smithi149:> return files[0] 2024-05-27T06:28:17.074 DEBUG:teuthology.orchestra.run.smithi149:> 2024-05-27T06:28:17.075 DEBUG:teuthology.orchestra.run.smithi149:> for f in files: 2024-05-27T06:28:17.075 DEBUG:teuthology.orchestra.run.smithi149:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-27T06:28:17.075 DEBUG:teuthology.orchestra.run.smithi149:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-27T06:28:17.075 DEBUG:teuthology.orchestra.run.smithi149:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-27T06:28:17.075 DEBUG:teuthology.orchestra.run.smithi149:> contents = proc_f.read() 2024-05-27T06:28:17.075 DEBUG:teuthology.orchestra.run.smithi149:> if mountpoint in contents: 2024-05-27T06:28:17.075 DEBUG:teuthology.orchestra.run.smithi149:> return f 2024-05-27T06:28:17.075 DEBUG:teuthology.orchestra.run.smithi149:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-27T06:28:17.075 DEBUG:teuthology.orchestra.run.smithi149:> 2024-05-27T06:28:17.075 DEBUG:teuthology.orchestra.run.smithi149:> print(_find_admin_socket("client.1")) 2024-05-27T06:28:17.075 DEBUG:teuthology.orchestra.run.smithi149:> ' 2024-05-27T06:28:17.206 INFO:teuthology.orchestra.run.smithi149.stdout:/var/run/ceph/ceph-client.1.33772.asok 2024-05-27T06:28:17.210 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:28:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:28:17.219 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.33772.asok 2024-05-27T06:28:17.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:17.219 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.33772.asok status 2024-05-27T06:28:17.398 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-27T06:28:17.399 INFO:teuthology.orchestra.run.smithi149.stdout: "metadata": { 2024-05-27T06:28:17.399 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_sha1": "38f9d900c83c63799fbdbe61acc9a11b0d3554a6", 2024-05-27T06:28:17.399 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_version": "ceph version 19.0.0-3872-g38f9d900 (38f9d900c83c63799fbdbe61acc9a11b0d3554a6) squid (dev)", 2024-05-27T06:28:17.399 INFO:teuthology.orchestra.run.smithi149.stdout: "entity_id": "1", 2024-05-27T06:28:17.399 INFO:teuthology.orchestra.run.smithi149.stdout: "hostname": "smithi149", 2024-05-27T06:28:17.399 INFO:teuthology.orchestra.run.smithi149.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-05-27T06:28:17.399 INFO:teuthology.orchestra.run.smithi149.stdout: "pid": "33772", 2024-05-27T06:28:17.399 INFO:teuthology.orchestra.run.smithi149.stdout: "root": "/" 2024-05-27T06:28:17.399 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-27T06:28:17.399 INFO:teuthology.orchestra.run.smithi149.stdout: "dentry_count": 0, 2024-05-27T06:28:17.399 INFO:teuthology.orchestra.run.smithi149.stdout: "dentry_pinned_count": 0, 2024-05-27T06:28:17.400 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 4684, 2024-05-27T06:28:17.400 INFO:teuthology.orchestra.run.smithi149.stdout: "inst": { 2024-05-27T06:28:17.400 INFO:teuthology.orchestra.run.smithi149.stdout: "name": { 2024-05-27T06:28:17.400 INFO:teuthology.orchestra.run.smithi149.stdout: "type": "client", 2024-05-27T06:28:17.400 INFO:teuthology.orchestra.run.smithi149.stdout: "num": 4684 2024-05-27T06:28:17.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-27T06:28:17.400 INFO:teuthology.orchestra.run.smithi149.stdout: "addr": { 2024-05-27T06:28:17.400 INFO:teuthology.orchestra.run.smithi149.stdout: "type": "v1", 2024-05-27T06:28:17.400 INFO:teuthology.orchestra.run.smithi149.stdout: "addr": "192.168.0.1:0", 2024-05-27T06:28:17.400 INFO:teuthology.orchestra.run.smithi149.stdout: "nonce": 3322812161 2024-05-27T06:28:17.400 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-27T06:28:17.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-27T06:28:17.400 INFO:teuthology.orchestra.run.smithi149.stdout: "addr": { 2024-05-27T06:28:17.400 INFO:teuthology.orchestra.run.smithi149.stdout: "type": "v1", 2024-05-27T06:28:17.401 INFO:teuthology.orchestra.run.smithi149.stdout: "addr": "192.168.0.1:0", 2024-05-27T06:28:17.401 INFO:teuthology.orchestra.run.smithi149.stdout: "nonce": 3322812161 2024-05-27T06:28:17.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-27T06:28:17.401 INFO:teuthology.orchestra.run.smithi149.stdout: "inst_str": "client.4684 192.168.0.1:0/3322812161", 2024-05-27T06:28:17.401 INFO:teuthology.orchestra.run.smithi149.stdout: "addr_str": "192.168.0.1:0/3322812161", 2024-05-27T06:28:17.401 INFO:teuthology.orchestra.run.smithi149.stdout: "inode_count": 1, 2024-05-27T06:28:17.401 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_epoch": 9, 2024-05-27T06:28:17.401 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_epoch": 24, 2024-05-27T06:28:17.401 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_epoch_barrier": 0, 2024-05-27T06:28:17.401 INFO:teuthology.orchestra.run.smithi149.stdout: "blocklisted": false, 2024-05-27T06:28:17.401 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs" 2024-05-27T06:28:17.401 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-27T06:28:17.414 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-27T06:28:17.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.574+0000 7f3aa7000640 1 Processor -- start 2024-05-27T06:28:17.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.574+0000 7f3aa7000640 1 -- start start 2024-05-27T06:28:17.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.578+0000 7f3aa7000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3aa00cbf90 0x7f3aa006cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:17.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.578+0000 7f3aa7000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3aa006d500 0x7f3aa015cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:17.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.578+0000 7f3aa7000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3aa015d930 con 0x7f3aa015d520 2024-05-27T06:28:17.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.578+0000 7f3aa7000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f3aa006d910 con 0x7f3aa006d500 2024-05-27T06:28:17.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.578+0000 7f3aa7000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3aa015dbb0 con 0x7f3aa00cbf90 2024-05-27T06:28:17.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.578+0000 7f3a9fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3aa00cbf90 0x7f3aa006cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:17.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.578+0000 7f3a97400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3aa006d500 0x7f3aa015cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:17.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.578+0000 7f3aa5000640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f3aa015d520 0x7f3aa00d1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.87:57086/0 (socket says 172.21.15.87:57086) 2024-05-27T06:28:17.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.578+0000 7f3aa5000640 1 -- 172.21.15.87:0/1662118568 learned_addr learned my addr 172.21.15.87:0/1662118568 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:17.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.578+0000 7f3a9fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3aa00cbf90 0x7f3aa006cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.87:39564/0 (socket says 172.21.15.87:39564) 2024-05-27T06:28:17.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.578+0000 7f3a9f400640 1 -- 172.21.15.87:0/1662118568 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 942450878 0 0) 0x7f3a980014a0 con 0x7f3aa015d520 2024-05-27T06:28:17.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.578+0000 7f3a9f400640 1 -- 172.21.15.87:0/1662118568 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a84003530 con 0x7f3aa015d520 2024-05-27T06:28:17.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.578+0000 7f3a97400640 1 -- 172.21.15.87:0/1662118568 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3aa00cbf90 msgr2=0x7f3aa006cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:17.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.578+0000 7f3a97400640 1 --2- 172.21.15.87:0/1662118568 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3aa00cbf90 0x7f3aa006cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:17.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.578+0000 7f3a97400640 1 -- 172.21.15.87:0/1662118568 >> v1:172.21.15.149:6789/0 conn(0x7f3aa015d520 legacy=0x7f3aa00d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:17.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.578+0000 7f3a97400640 1 -- 172.21.15.87:0/1662118568 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa015de90 con 0x7f3aa006d500 2024-05-27T06:28:17.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.578+0000 7f3a9fe00640 1 --2- 172.21.15.87:0/1662118568 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3aa00cbf90 0x7f3aa006cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:28:17.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.582+0000 7f3a97400640 1 --2- 172.21.15.87:0/1662118568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3aa006d500 0x7f3aa015cfe0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3a880097c0 tx=0x7f3a8801ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ca397a93de75b97 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:17.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.582+0000 7f3a9f400640 1 -- 172.21.15.87:0/1662118568 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a880b5070 con 0x7f3aa006d500 2024-05-27T06:28:17.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.582+0000 7f3a9f400640 1 -- 172.21.15.87:0/1662118568 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a880a8990 con 0x7f3aa006d500 2024-05-27T06:28:17.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.582+0000 7f3a9f400640 1 -- 172.21.15.87:0/1662118568 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a880a8d40 con 0x7f3aa006d500 2024-05-27T06:28:17.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.582+0000 7f3aa7000640 1 -- 172.21.15.87:0/1662118568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3aa006d500 msgr2=0x7f3aa015cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:17.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.582+0000 7f3aa7000640 1 --2- 172.21.15.87:0/1662118568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3aa006d500 0x7f3aa015cfe0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3a880097c0 tx=0x7f3a8801ec90 comp rx=0 tx=0).stop 2024-05-27T06:28:17.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.582+0000 7f3aa7000640 1 -- 172.21.15.87:0/1662118568 shutdown_connections 2024-05-27T06:28:17.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.582+0000 7f3aa7000640 1 --2- 172.21.15.87:0/1662118568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3aa006d500 0x7f3aa015cfe0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:17.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.582+0000 7f3aa7000640 1 --2- 172.21.15.87:0/1662118568 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3aa00cbf90 0x7f3aa006cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:17.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.582+0000 7f3aa7000640 1 -- 172.21.15.87:0/1662118568 >> 172.21.15.87:0/1662118568 conn(0x7f3aa00b46b0 msgr2=0x7f3aa00b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:17.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.582+0000 7f3aa7000640 1 -- 172.21.15.87:0/1662118568 shutdown_connections 2024-05-27T06:28:17.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.582+0000 7f3aa7000640 1 -- 172.21.15.87:0/1662118568 wait complete. 2024-05-27T06:28:17.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.582+0000 7f3aa7000640 1 Processor -- start 2024-05-27T06:28:17.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.586+0000 7f3aa7000640 1 -- start start 2024-05-27T06:28:17.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.586+0000 7f3aa7000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3aa006d500 0x7f3aa00c5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:17.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.586+0000 7f3aa7000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3aa00cbf90 0x7f3aa01f7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:17.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.586+0000 7f3aa7000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3aa015d520 0x7f3aa01f7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:17.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.586+0000 7f3aa7000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa015e170 con 0x7f3aa015d520 2024-05-27T06:28:17.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.586+0000 7f3aa7000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa006caa0 con 0x7f3aa006d500 2024-05-27T06:28:17.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.586+0000 7f3aa7000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3aa00cc3a0 con 0x7f3aa00cbf90 2024-05-27T06:28:17.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.586+0000 7f3aa5000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3aa015d520 0x7f3aa01f7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:17.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.586+0000 7f3a9fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3aa006d500 0x7f3aa00c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:17.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.586+0000 7f3a9fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3aa006d500 0x7f3aa00c5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:39338/0 (socket says 172.21.15.87:39338) 2024-05-27T06:28:17.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.586+0000 7f3aa5000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3aa015d520 0x7f3aa01f7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34788/0 (socket says 172.21.15.87:34788) 2024-05-27T06:28:17.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.586+0000 7f3a9fe00640 1 -- 172.21.15.87:0/1574797373 learned_addr learned my addr 172.21.15.87:0/1574797373 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:17.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.586+0000 7f3a97400640 1 --2- 172.21.15.87:0/1574797373 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3aa00cbf90 0x7f3aa01f7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:17.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.586+0000 7f3a9fe00640 1 -- 172.21.15.87:0/1574797373 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3aa00cbf90 msgr2=0x7f3aa01f7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:17.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.586+0000 7f3a9fe00640 1 --2- 172.21.15.87:0/1574797373 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3aa00cbf90 0x7f3aa01f7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:17.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.586+0000 7f3a9fe00640 1 -- 172.21.15.87:0/1574797373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3aa015d520 msgr2=0x7f3aa01f7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:17.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.586+0000 7f3a9fe00640 1 --2- 172.21.15.87:0/1574797373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3aa015d520 0x7f3aa01f7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:17.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.586+0000 7f3a9fe00640 1 -- 172.21.15.87:0/1574797373 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa00c6180 con 0x7f3aa006d500 2024-05-27T06:28:17.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.586+0000 7f3aa5000640 1 --2- 172.21.15.87:0/1574797373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3aa015d520 0x7f3aa01f7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:28:17.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.586+0000 7f3a9fe00640 1 --2- 172.21.15.87:0/1574797373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3aa006d500 0x7f3aa00c5880 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3a9000e980 tx=0x7f3a9000ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:17.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.586+0000 7f3a9cc00640 1 -- 172.21.15.87:0/1574797373 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a90017070 con 0x7f3aa006d500 2024-05-27T06:28:17.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.586+0000 7f3a9cc00640 1 -- 172.21.15.87:0/1574797373 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a9000ca00 con 0x7f3aa006d500 2024-05-27T06:28:17.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.586+0000 7f3aa7000640 1 -- 172.21.15.87:0/1574797373 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aa00c6460 con 0x7f3aa006d500 2024-05-27T06:28:17.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.586+0000 7f3a9cc00640 1 -- 172.21.15.87:0/1574797373 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a9000cdd0 con 0x7f3aa006d500 2024-05-27T06:28:17.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.586+0000 7f3aa7000640 1 -- 172.21.15.87:0/1574797373 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aa00c6a20 con 0x7f3aa006d500 2024-05-27T06:28:17.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.590+0000 7f3aa7000640 1 -- 172.21.15.87:0/1574797373 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3aa006aa30 con 0x7f3aa006d500 2024-05-27T06:28:17.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.590+0000 7f3a9cc00640 1 -- 172.21.15.87:0/1574797373 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3a9001a070 con 0x7f3aa006d500 2024-05-27T06:28:17.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.590+0000 7f3a9cc00640 1 --2- 172.21.15.87:0/1574797373 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3a7c06f400 0x7f3a7c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:17.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.590+0000 7f3a9cc00640 1 -- 172.21.15.87:0/1574797373 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3a9008f820 con 0x7f3aa006d500 2024-05-27T06:28:17.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.590+0000 7f3a97400640 1 --2- 172.21.15.87:0/1574797373 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3a7c06f400 0x7f3a7c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:17.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.590+0000 7f3a97400640 1 --2- 172.21.15.87:0/1574797373 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3a7c06f400 0x7f3a7c071910 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3a880b2000 tx=0x7f3a880aa070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:17.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.594+0000 7f3a9cc00640 1 -- 172.21.15.87:0/1574797373 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f3a9005be80 con 0x7f3aa006d500 2024-05-27T06:28:17.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.790+0000 7f3aa7000640 1 -- 172.21.15.87:0/1574797373 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3aa0075e90 con 0x7f3aa006d500 2024-05-27T06:28:17.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.790+0000 7f3a9cc00640 1 -- 172.21.15.87:0/1574797373 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f3a90060180 con 0x7f3aa006d500 2024-05-27T06:28:17.787 INFO:teuthology.orchestra.run.smithi087.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-27T06:28:17.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.794+0000 7f3aa7000640 1 -- 172.21.15.87:0/1574797373 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3a7c06f400 msgr2=0x7f3a7c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:17.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.794+0000 7f3aa7000640 1 --2- 172.21.15.87:0/1574797373 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3a7c06f400 0x7f3a7c071910 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3a880b2000 tx=0x7f3a880aa070 comp rx=0 tx=0).stop 2024-05-27T06:28:17.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.794+0000 7f3aa7000640 1 -- 172.21.15.87:0/1574797373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3aa006d500 msgr2=0x7f3aa00c5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:17.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.794+0000 7f3aa7000640 1 --2- 172.21.15.87:0/1574797373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3aa006d500 0x7f3aa00c5880 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3a9000e980 tx=0x7f3a9000ee40 comp rx=0 tx=0).stop 2024-05-27T06:28:17.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.794+0000 7f3aa7000640 1 -- 172.21.15.87:0/1574797373 shutdown_connections 2024-05-27T06:28:17.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.794+0000 7f3aa7000640 1 --2- 172.21.15.87:0/1574797373 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3a7c06f400 0x7f3a7c071910 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:17.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.794+0000 7f3aa7000640 1 --2- 172.21.15.87:0/1574797373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3aa015d520 0x7f3aa01f7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:17.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.794+0000 7f3aa7000640 1 --2- 172.21.15.87:0/1574797373 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3aa00cbf90 0x7f3aa01f7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:17.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.794+0000 7f3aa7000640 1 --2- 172.21.15.87:0/1574797373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3aa006d500 0x7f3aa00c5880 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:17.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.794+0000 7f3aa7000640 1 -- 172.21.15.87:0/1574797373 >> 172.21.15.87:0/1574797373 conn(0x7f3aa00b46b0 msgr2=0x7f3aa00b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:17.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.794+0000 7f3aa7000640 1 -- 172.21.15.87:0/1574797373 shutdown_connections 2024-05-27T06:28:17.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:17.794+0000 7f3aa7000640 1 -- 172.21.15.87:0/1574797373 wait complete. 2024-05-27T06:28:17.810 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-27T06:28:17.810 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-27T06:28:17.810 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-05-27T06:28:17.810 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-05-27T06:28:17.810 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-27T06:28:17.810 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-27T06:28:17.810 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-27T06:28:17.810 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-27T06:28:17.810 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-05-27T06:28:17.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:17.811 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-05-27T06:28:17.820 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T06:28:17.820 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T06:28:17.820 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T06:28:17.820 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:17.820 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-05-27T06:28:17.820 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:17.820 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:28:17.820 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:17.820 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-05-27T06:28:17.820 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:28:17.820 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:17.820 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-05-27T06:28:17.821 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:28:17.821 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:17.821 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-27T06:28:17.821 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:17.821 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-27T06:28:17.821 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42440sec preferred_lft 42440sec 2024-05-27T06:28:17.821 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link 2024-05-27T06:28:17.821 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:17.821 INFO:teuthology.orchestra.run.smithi149.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-27T06:28:17.821 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 02:42:61:a8:ae:04 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:17.821 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-27T06:28:17.821 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:17.821 INFO:teuthology.orchestra.run.smithi149.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-27T06:28:17.822 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:17.822 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-27T06:28:17.822 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:17.822 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-27T06:28:17.822 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:17.822 INFO:teuthology.orchestra.run.smithi149.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-27T06:28:17.822 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-27T06:28:17.822 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-27T06:28:17.822 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:17.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:17.823 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-27T06:28:17.886 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-05-27T06:28:17.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:17.888 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-05-27T06:28:17.947 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-05-27T06:28:17.948 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-27T06:28:17.948 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-27T06:28:17.948 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-27T06:28:17.948 INFO:teuthology.orchestra.run.smithi149.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-27T06:28:17.948 INFO:teuthology.orchestra.run.smithi149.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-27T06:28:17.948 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-27T06:28:17.948 INFO:teuthology.orchestra.run.smithi149.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:28:17.948 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:28:17.948 INFO:teuthology.orchestra.run.smithi149.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:28:17.948 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-27T06:28:17.949 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:28:17.949 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-05-27T06:28:17.949 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-27T06:28:17.949 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-27T06:28:17.949 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-27T06:28:17.949 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-05-27T06:28:18.040 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:28:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:28:18.082 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:28:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:28:18.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:18.088 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-05-27T06:28:18.097 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-27T06:28:18.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:18.098 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list-id 2024-05-27T06:28:18.152 INFO:teuthology.orchestra.run.smithi149.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-05-27T06:28:18.152 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:28:18.152 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-05-27T06:28:18.152 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-27T06:28:18.152 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-05-27T06:28:18.153 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-05-27T06:28:18.242 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:28:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:28:18.272 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:28:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:28:18.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:18.279 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-27T06:28:18.299 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T06:28:18.299 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T06:28:18.299 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T06:28:18.299 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:18.299 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-05-27T06:28:18.299 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:18.299 INFO:teuthology.orchestra.run.smithi149.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-27T06:28:18.299 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 02:86:12:3e:dc:12 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-27T06:28:18.299 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-27T06:28:18.299 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:18.300 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::86:12ff:fe3e:dc12/64 scope link 2024-05-27T06:28:18.300 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:18.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:18.301 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-27T06:28:18.363 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T06:28:18.363 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T06:28:18.363 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T06:28:18.363 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:18.364 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-05-27T06:28:18.364 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:18.364 INFO:teuthology.orchestra.run.smithi149.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-27T06:28:18.364 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 02:86:12:3e:dc:12 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-27T06:28:18.364 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-27T06:28:18.364 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:18.364 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::86:12ff:fe3e:dc12/64 scope link 2024-05-27T06:28:18.364 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:18.365 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-05-27T06:28:18.365 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:28:18.366 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-05-27T06:28:18.366 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-05-27T06:28:18.366 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-27T06:28:18.366 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-05-27T06:28:18.366 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-05-27T06:28:18.366 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-05-27T06:28:18.366 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-05-27T06:28:18.454 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:28:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:28:18.538 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:28:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:28:18.546 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:28:18.546 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-05-27T06:28:18.546 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.1 up 2024-05-27T06:28:18.546 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set dev brx.1 master ceph-brx 2024-05-27T06:28:18.546 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-05-27T06:28:18.635 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:28:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:28:18.666 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:28:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:28:18.672 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-05-27T06:28:18.673 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T06:28:18.673 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-05-27T06:28:18.681 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-05-27T06:28:18.681 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T06:28:18.681 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-05-27T06:28:18.731 DEBUG:teuthology.orchestra.run.smithi149:> sudo modprobe fuse 2024-05-27T06:28:18.799 DEBUG:teuthology.orchestra.run.smithi149:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T06:28:18.849 INFO:teuthology.orchestra.run.smithi149.stdout:/sys 2024-05-27T06:28:18.850 INFO:teuthology.orchestra.run.smithi149.stdout:/proc 2024-05-27T06:28:18.850 INFO:teuthology.orchestra.run.smithi149.stdout:/dev 2024-05-27T06:28:18.850 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/pts 2024-05-27T06:28:18.850 INFO:teuthology.orchestra.run.smithi149.stdout:/run 2024-05-27T06:28:18.850 INFO:teuthology.orchestra.run.smithi149.stdout:/ 2024-05-27T06:28:18.850 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/security 2024-05-27T06:28:18.850 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/shm 2024-05-27T06:28:18.850 INFO:teuthology.orchestra.run.smithi149.stdout:/run/lock 2024-05-27T06:28:18.850 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup 2024-05-27T06:28:18.851 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/pstore 2024-05-27T06:28:18.851 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/bpf 2024-05-27T06:28:18.851 INFO:teuthology.orchestra.run.smithi149.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T06:28:18.851 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/hugepages 2024-05-27T06:28:18.851 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/mqueue 2024-05-27T06:28:18.851 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/debug 2024-05-27T06:28:18.851 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/tracing 2024-05-27T06:28:18.851 INFO:teuthology.orchestra.run.smithi149.stdout:/proc/fs/nfsd 2024-05-27T06:28:18.852 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/fuse/connections 2024-05-27T06:28:18.852 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/config 2024-05-27T06:28:18.852 INFO:teuthology.orchestra.run.smithi149.stdout:/run/credentials/systemd-sysusers.service 2024-05-27T06:28:18.852 INFO:teuthology.orchestra.run.smithi149.stdout:/run/rpc_pipefs 2024-05-27T06:28:18.852 INFO:teuthology.orchestra.run.smithi149.stdout:/run/user/1000 2024-05-27T06:28:18.852 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph 2024-05-27T06:28:18.852 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-4 2024-05-27T06:28:18.852 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-5 2024-05-27T06:28:18.852 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-6 2024-05-27T06:28:18.853 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-7 2024-05-27T06:28:18.853 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns 2024-05-27T06:28:18.853 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-27T06:28:18.853 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-27T06:28:18.853 INFO:teuthology.orchestra.run.smithi149.stdout:/home/ubuntu/cephtest/mnt.1 2024-05-27T06:28:18.853 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-27T06:28:18.853 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-27T06:28:18.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:18.854 DEBUG:teuthology.orchestra.run.smithi149:> ls /sys/fs/fuse/connections 2024-05-27T06:28:18.908 INFO:teuthology.orchestra.run.smithi149.stdout:44 2024-05-27T06:28:18.908 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [44] 2024-05-27T06:28:18.908 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-05-27T06:28:18.953 DEBUG:teuthology.orchestra.run.smithi149:> sudo modprobe fuse 2024-05-27T06:28:18.975 DEBUG:teuthology.orchestra.run.smithi149:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T06:28:19.030 INFO:teuthology.orchestra.run.smithi149.stdout:/sys 2024-05-27T06:28:19.030 INFO:teuthology.orchestra.run.smithi149.stdout:/proc 2024-05-27T06:28:19.030 INFO:teuthology.orchestra.run.smithi149.stdout:/dev 2024-05-27T06:28:19.030 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/pts 2024-05-27T06:28:19.030 INFO:teuthology.orchestra.run.smithi149.stdout:/run 2024-05-27T06:28:19.031 INFO:teuthology.orchestra.run.smithi149.stdout:/ 2024-05-27T06:28:19.031 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/security 2024-05-27T06:28:19.031 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/shm 2024-05-27T06:28:19.031 INFO:teuthology.orchestra.run.smithi149.stdout:/run/lock 2024-05-27T06:28:19.031 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup 2024-05-27T06:28:19.031 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/pstore 2024-05-27T06:28:19.031 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/bpf 2024-05-27T06:28:19.031 INFO:teuthology.orchestra.run.smithi149.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T06:28:19.031 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/hugepages 2024-05-27T06:28:19.031 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/mqueue 2024-05-27T06:28:19.031 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/debug 2024-05-27T06:28:19.031 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/tracing 2024-05-27T06:28:19.031 INFO:teuthology.orchestra.run.smithi149.stdout:/proc/fs/nfsd 2024-05-27T06:28:19.031 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/fuse/connections 2024-05-27T06:28:19.032 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/config 2024-05-27T06:28:19.032 INFO:teuthology.orchestra.run.smithi149.stdout:/run/credentials/systemd-sysusers.service 2024-05-27T06:28:19.032 INFO:teuthology.orchestra.run.smithi149.stdout:/run/rpc_pipefs 2024-05-27T06:28:19.032 INFO:teuthology.orchestra.run.smithi149.stdout:/run/user/1000 2024-05-27T06:28:19.032 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph 2024-05-27T06:28:19.032 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-4 2024-05-27T06:28:19.032 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-5 2024-05-27T06:28:19.032 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-6 2024-05-27T06:28:19.032 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-7 2024-05-27T06:28:19.032 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns 2024-05-27T06:28:19.032 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-27T06:28:19.032 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-27T06:28:19.032 INFO:teuthology.orchestra.run.smithi149.stdout:/home/ubuntu/cephtest/mnt.1 2024-05-27T06:28:19.032 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-27T06:28:19.032 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-27T06:28:19.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:19.033 DEBUG:teuthology.orchestra.run.smithi149:> ls /sys/fs/fuse/connections 2024-05-27T06:28:19.055 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi149.stderr:2024-05-27T06:28:19.055+0000 7fed2e614580 -1 init, newargv = 0x7fed14001090 newargc=15 2024-05-27T06:28:19.055 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi149.stderr:ceph-fuse[33891]: starting ceph client 2024-05-27T06:28:19.063 INFO:teuthology.orchestra.run.smithi149.stdout:44 2024-05-27T06:28:19.064 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi149.stderr:ceph-fuse[33891]: starting fuse 2024-05-27T06:28:20.165 DEBUG:teuthology.orchestra.run.smithi149:> sudo modprobe fuse 2024-05-27T06:28:20.189 DEBUG:teuthology.orchestra.run.smithi149:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T06:28:20.246 INFO:teuthology.orchestra.run.smithi149.stdout:/sys 2024-05-27T06:28:20.247 INFO:teuthology.orchestra.run.smithi149.stdout:/proc 2024-05-27T06:28:20.247 INFO:teuthology.orchestra.run.smithi149.stdout:/dev 2024-05-27T06:28:20.247 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/pts 2024-05-27T06:28:20.247 INFO:teuthology.orchestra.run.smithi149.stdout:/run 2024-05-27T06:28:20.247 INFO:teuthology.orchestra.run.smithi149.stdout:/ 2024-05-27T06:28:20.247 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/security 2024-05-27T06:28:20.247 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/shm 2024-05-27T06:28:20.247 INFO:teuthology.orchestra.run.smithi149.stdout:/run/lock 2024-05-27T06:28:20.247 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/cgroup 2024-05-27T06:28:20.247 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/pstore 2024-05-27T06:28:20.247 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/bpf 2024-05-27T06:28:20.247 INFO:teuthology.orchestra.run.smithi149.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T06:28:20.247 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/hugepages 2024-05-27T06:28:20.248 INFO:teuthology.orchestra.run.smithi149.stdout:/dev/mqueue 2024-05-27T06:28:20.248 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/debug 2024-05-27T06:28:20.248 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/tracing 2024-05-27T06:28:20.248 INFO:teuthology.orchestra.run.smithi149.stdout:/proc/fs/nfsd 2024-05-27T06:28:20.248 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/fs/fuse/connections 2024-05-27T06:28:20.248 INFO:teuthology.orchestra.run.smithi149.stdout:/sys/kernel/config 2024-05-27T06:28:20.248 INFO:teuthology.orchestra.run.smithi149.stdout:/run/credentials/systemd-sysusers.service 2024-05-27T06:28:20.248 INFO:teuthology.orchestra.run.smithi149.stdout:/run/rpc_pipefs 2024-05-27T06:28:20.248 INFO:teuthology.orchestra.run.smithi149.stdout:/run/user/1000 2024-05-27T06:28:20.248 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph 2024-05-27T06:28:20.248 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-4 2024-05-27T06:28:20.248 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-5 2024-05-27T06:28:20.248 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-6 2024-05-27T06:28:20.248 INFO:teuthology.orchestra.run.smithi149.stdout:/var/lib/ceph/osd/ceph-7 2024-05-27T06:28:20.248 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns 2024-05-27T06:28:20.249 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-27T06:28:20.249 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-27T06:28:20.249 INFO:teuthology.orchestra.run.smithi149.stdout:/home/ubuntu/cephtest/mnt.1 2024-05-27T06:28:20.249 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-27T06:28:20.249 INFO:teuthology.orchestra.run.smithi149.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-27T06:28:20.249 INFO:teuthology.orchestra.run.smithi149.stdout:/home/ubuntu/cephtest/mnt.3 2024-05-27T06:28:20.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:20.250 DEBUG:teuthology.orchestra.run.smithi149:> ls /sys/fs/fuse/connections 2024-05-27T06:28:20.301 INFO:teuthology.orchestra.run.smithi149.stdout:44 2024-05-27T06:28:20.301 INFO:teuthology.orchestra.run.smithi149.stdout:45 2024-05-27T06:28:20.301 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44, 45] 2024-05-27T06:28:20.301 DEBUG:teuthology.orchestra.run.smithi149:> sudo stdin-killer -- python3 -c ' 2024-05-27T06:28:20.301 DEBUG:teuthology.orchestra.run.smithi149:> import glob 2024-05-27T06:28:20.301 DEBUG:teuthology.orchestra.run.smithi149:> import re 2024-05-27T06:28:20.302 DEBUG:teuthology.orchestra.run.smithi149:> import os 2024-05-27T06:28:20.302 DEBUG:teuthology.orchestra.run.smithi149:> import subprocess 2024-05-27T06:28:20.302 DEBUG:teuthology.orchestra.run.smithi149:> 2024-05-27T06:28:20.302 DEBUG:teuthology.orchestra.run.smithi149:> def _find_admin_socket(client_name): 2024-05-27T06:28:20.302 DEBUG:teuthology.orchestra.run.smithi149:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-05-27T06:28:20.302 DEBUG:teuthology.orchestra.run.smithi149:> files = glob.glob(asok_path) 2024-05-27T06:28:20.302 DEBUG:teuthology.orchestra.run.smithi149:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-05-27T06:28:20.302 DEBUG:teuthology.orchestra.run.smithi149:> 2024-05-27T06:28:20.302 DEBUG:teuthology.orchestra.run.smithi149:> # Given a non-glob path, it better be there 2024-05-27T06:28:20.302 DEBUG:teuthology.orchestra.run.smithi149:> if "*" not in asok_path: 2024-05-27T06:28:20.302 DEBUG:teuthology.orchestra.run.smithi149:> assert(len(files) == 1) 2024-05-27T06:28:20.302 DEBUG:teuthology.orchestra.run.smithi149:> return files[0] 2024-05-27T06:28:20.302 DEBUG:teuthology.orchestra.run.smithi149:> 2024-05-27T06:28:20.302 DEBUG:teuthology.orchestra.run.smithi149:> for f in files: 2024-05-27T06:28:20.303 DEBUG:teuthology.orchestra.run.smithi149:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-27T06:28:20.303 DEBUG:teuthology.orchestra.run.smithi149:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-27T06:28:20.303 DEBUG:teuthology.orchestra.run.smithi149:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-27T06:28:20.303 DEBUG:teuthology.orchestra.run.smithi149:> contents = proc_f.read() 2024-05-27T06:28:20.303 DEBUG:teuthology.orchestra.run.smithi149:> if mountpoint in contents: 2024-05-27T06:28:20.303 DEBUG:teuthology.orchestra.run.smithi149:> return f 2024-05-27T06:28:20.303 DEBUG:teuthology.orchestra.run.smithi149:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-27T06:28:20.303 DEBUG:teuthology.orchestra.run.smithi149:> 2024-05-27T06:28:20.303 DEBUG:teuthology.orchestra.run.smithi149:> print(_find_admin_socket("client.3")) 2024-05-27T06:28:20.303 DEBUG:teuthology.orchestra.run.smithi149:> ' 2024-05-27T06:28:20.437 INFO:teuthology.orchestra.run.smithi149.stdout:/var/run/ceph/ceph-client.3.33891.asok 2024-05-27T06:28:20.441 INFO:teuthology.orchestra.run.smithi149.stderr:2024-05-27T06:28:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:28:20.450 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.33891.asok 2024-05-27T06:28:20.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:20.450 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.33891.asok status 2024-05-27T06:28:20.636 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-05-27T06:28:20.637 INFO:teuthology.orchestra.run.smithi149.stdout: "metadata": { 2024-05-27T06:28:20.637 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_sha1": "38f9d900c83c63799fbdbe61acc9a11b0d3554a6", 2024-05-27T06:28:20.637 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_version": "ceph version 19.0.0-3872-g38f9d900 (38f9d900c83c63799fbdbe61acc9a11b0d3554a6) squid (dev)", 2024-05-27T06:28:20.637 INFO:teuthology.orchestra.run.smithi149.stdout: "entity_id": "3", 2024-05-27T06:28:20.637 INFO:teuthology.orchestra.run.smithi149.stdout: "hostname": "smithi149", 2024-05-27T06:28:20.637 INFO:teuthology.orchestra.run.smithi149.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-05-27T06:28:20.637 INFO:teuthology.orchestra.run.smithi149.stdout: "pid": "33891", 2024-05-27T06:28:20.637 INFO:teuthology.orchestra.run.smithi149.stdout: "root": "/" 2024-05-27T06:28:20.637 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-27T06:28:20.637 INFO:teuthology.orchestra.run.smithi149.stdout: "dentry_count": 0, 2024-05-27T06:28:20.637 INFO:teuthology.orchestra.run.smithi149.stdout: "dentry_pinned_count": 0, 2024-05-27T06:28:20.638 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 4702, 2024-05-27T06:28:20.638 INFO:teuthology.orchestra.run.smithi149.stdout: "inst": { 2024-05-27T06:28:20.638 INFO:teuthology.orchestra.run.smithi149.stdout: "name": { 2024-05-27T06:28:20.638 INFO:teuthology.orchestra.run.smithi149.stdout: "type": "client", 2024-05-27T06:28:20.638 INFO:teuthology.orchestra.run.smithi149.stdout: "num": 4702 2024-05-27T06:28:20.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-27T06:28:20.638 INFO:teuthology.orchestra.run.smithi149.stdout: "addr": { 2024-05-27T06:28:20.638 INFO:teuthology.orchestra.run.smithi149.stdout: "type": "v1", 2024-05-27T06:28:20.638 INFO:teuthology.orchestra.run.smithi149.stdout: "addr": "192.168.0.2:0", 2024-05-27T06:28:20.638 INFO:teuthology.orchestra.run.smithi149.stdout: "nonce": 1247735747 2024-05-27T06:28:20.638 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-05-27T06:28:20.638 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-27T06:28:20.638 INFO:teuthology.orchestra.run.smithi149.stdout: "addr": { 2024-05-27T06:28:20.638 INFO:teuthology.orchestra.run.smithi149.stdout: "type": "v1", 2024-05-27T06:28:20.639 INFO:teuthology.orchestra.run.smithi149.stdout: "addr": "192.168.0.2:0", 2024-05-27T06:28:20.639 INFO:teuthology.orchestra.run.smithi149.stdout: "nonce": 1247735747 2024-05-27T06:28:20.639 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-05-27T06:28:20.639 INFO:teuthology.orchestra.run.smithi149.stdout: "inst_str": "client.4702 192.168.0.2:0/1247735747", 2024-05-27T06:28:20.639 INFO:teuthology.orchestra.run.smithi149.stdout: "addr_str": "192.168.0.2:0/1247735747", 2024-05-27T06:28:20.639 INFO:teuthology.orchestra.run.smithi149.stdout: "inode_count": 1, 2024-05-27T06:28:20.639 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_epoch": 9, 2024-05-27T06:28:20.639 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_epoch": 25, 2024-05-27T06:28:20.639 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_epoch_barrier": 0, 2024-05-27T06:28:20.639 INFO:teuthology.orchestra.run.smithi149.stdout: "blocklisted": false, 2024-05-27T06:28:20.639 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs" 2024-05-27T06:28:20.639 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-05-27T06:28:20.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:20.653 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-05-27T06:28:20.653 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-27T06:28:20.664 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-05-27T06:28:20.664 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-27T06:28:20.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:20.664 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-27T06:28:20.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:20.732 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-05-27T06:28:20.732 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.2 2024-05-27T06:28:20.783 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-05-27T06:28:20.783 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-05-27T06:28:20.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:20.783 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-05-27T06:28:20.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:20.847 DEBUG:teuthology.orchestra.run.smithi149:> stat --file-system '--printf=%T 2024-05-27T06:28:20.847 DEBUG:teuthology.orchestra.run.smithi149:> ' -- /home/ubuntu/cephtest/mnt.1 2024-05-27T06:28:20.857 INFO:teuthology.orchestra.run.smithi149.stdout:fuseblk 2024-05-27T06:28:20.857 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-05-27T06:28:20.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:20.857 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-27T06:28:20.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:20.919 DEBUG:teuthology.orchestra.run.smithi149:> stat --file-system '--printf=%T 2024-05-27T06:28:20.919 DEBUG:teuthology.orchestra.run.smithi149:> ' -- /home/ubuntu/cephtest/mnt.3 2024-05-27T06:28:20.973 INFO:teuthology.orchestra.run.smithi149.stdout:fuseblk 2024-05-27T06:28:20.973 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-05-27T06:28:20.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:20.974 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-05-27T06:28:21.039 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-27T06:28:21.083 INFO:tasks.cephfs_test_runner:Starting test: test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) That a client who does not have the capability for setting 2024-05-27T06:28:21.083 INFO:tasks.cephfs_test_runner:test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-05-27T06:28:21.083 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T06:28:21.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.242+0000 7f5a81c00640 1 Processor -- start 2024-05-27T06:28:21.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.242+0000 7f5a81c00640 1 -- start start 2024-05-27T06:28:21.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.246+0000 7f5a81c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5a7c0ce440 0x7f5a7c0ae340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:21.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.246+0000 7f5a81c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5a7c0b07d0 0x7f5a7c0ae880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:21.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.246+0000 7f5a81c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a7c0d10f0 con 0x7f5a7c0b03c0 2024-05-27T06:28:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.246+0000 7f5a81c00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f5a7c06d610 con 0x7f5a7c0ce440 2024-05-27T06:28:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.246+0000 7f5a81c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f5a7c06c720 con 0x7f5a7c0b07d0 2024-05-27T06:28:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.246+0000 7f5a72000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5a7c0ce440 0x7f5a7c0ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.246+0000 7f5a72000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5a7c0ce440 0x7f5a7c0ae340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34800/0 (socket says 172.21.15.87:34800) 2024-05-27T06:28:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.246+0000 7f5a72000640 1 -- 172.21.15.87:0/3453765136 learned_addr learned my addr 172.21.15.87:0/3453765136 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:21.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.246+0000 7f5a7b400640 1 --2- 172.21.15.87:0/3453765136 >> v2:172.21.15.149:3300/0 conn(0x7f5a7c0b07d0 0x7f5a7c0ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:21.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.246+0000 7f5a72000640 1 -- 172.21.15.87:0/3453765136 >> v2:172.21.15.149:3300/0 conn(0x7f5a7c0b07d0 msgr2=0x7f5a7c0ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:21.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.246+0000 7f5a72000640 1 --2- 172.21.15.87:0/3453765136 >> v2:172.21.15.149:3300/0 conn(0x7f5a7c0b07d0 0x7f5a7c0ae880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:21.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.246+0000 7f5a72000640 1 -- 172.21.15.87:0/3453765136 >> v1:172.21.15.149:6789/0 conn(0x7f5a7c0b03c0 legacy=0x7f5a7c0cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:21.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.246+0000 7f5a72000640 1 -- 172.21.15.87:0/3453765136 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7c06ca00 con 0x7f5a7c0ce440 2024-05-27T06:28:21.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.250+0000 7f5a72000640 1 --2- 172.21.15.87:0/3453765136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a7c0ce440 0x7f5a7c0ae340 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c071c90 tx=0x7f5a6401e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea4a42e9bc5f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:21.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.250+0000 7f5a7a000640 1 -- 172.21.15.87:0/3453765136 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a640ad070 con 0x7f5a7c0ce440 2024-05-27T06:28:21.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.250+0000 7f5a7a000640 1 -- 172.21.15.87:0/3453765136 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a64004230 con 0x7f5a7c0ce440 2024-05-27T06:28:21.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.250+0000 7f5a7a000640 1 -- 172.21.15.87:0/3453765136 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a640a77f0 con 0x7f5a7c0ce440 2024-05-27T06:28:21.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.250+0000 7f5a81c00640 1 -- 172.21.15.87:0/3453765136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a7c0ce440 msgr2=0x7f5a7c0ae340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:21.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.250+0000 7f5a81c00640 1 --2- 172.21.15.87:0/3453765136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a7c0ce440 0x7f5a7c0ae340 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c071c90 tx=0x7f5a6401e9a0 comp rx=0 tx=0).stop 2024-05-27T06:28:21.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.250+0000 7f5a81c00640 1 -- 172.21.15.87:0/3453765136 shutdown_connections 2024-05-27T06:28:21.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.250+0000 7f5a81c00640 1 --2- 172.21.15.87:0/3453765136 >> v2:172.21.15.149:3300/0 conn(0x7f5a7c0b07d0 0x7f5a7c0ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:21.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.250+0000 7f5a81c00640 1 --2- 172.21.15.87:0/3453765136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a7c0ce440 0x7f5a7c0ae340 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:21.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.250+0000 7f5a81c00640 1 -- 172.21.15.87:0/3453765136 >> 172.21.15.87:0/3453765136 conn(0x7f5a7c0b46b0 msgr2=0x7f5a7c0b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:21.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.250+0000 7f5a81c00640 1 -- 172.21.15.87:0/3453765136 shutdown_connections 2024-05-27T06:28:21.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.250+0000 7f5a81c00640 1 -- 172.21.15.87:0/3453765136 wait complete. 2024-05-27T06:28:21.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.254+0000 7f5a81c00640 1 Processor -- start 2024-05-27T06:28:21.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.254+0000 7f5a81c00640 1 -- start start 2024-05-27T06:28:21.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.254+0000 7f5a81c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a7c0b03c0 0x7f5a7c09a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:21.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.254+0000 7f5a81c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a7c0b07d0 0x7f5a7c152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:21.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.254+0000 7f5a81c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a7c154dc0 0x7f5a7c1532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:21.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.254+0000 7f5a81c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c0aedc0 con 0x7f5a7c0b03c0 2024-05-27T06:28:21.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.254+0000 7f5a81c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c15c620 con 0x7f5a7c0b07d0 2024-05-27T06:28:21.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.254+0000 7f5a81c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5a7c0aef40 con 0x7f5a7c154dc0 2024-05-27T06:28:21.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.254+0000 7f5a7aa00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a7c0b03c0 0x7f5a7c09a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:21.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.254+0000 7f5a72000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a7c0b07d0 0x7f5a7c152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:21.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.254+0000 7f5a7aa00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a7c0b03c0 0x7f5a7c09a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34806/0 (socket says 172.21.15.87:34806) 2024-05-27T06:28:21.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.254+0000 7f5a7aa00640 1 -- 172.21.15.87:0/132272564 learned_addr learned my addr 172.21.15.87:0/132272564 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:21.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.254+0000 7f5a7b400640 1 --2- 172.21.15.87:0/132272564 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a7c154dc0 0x7f5a7c1532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:21.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.254+0000 7f5a72000640 1 -- 172.21.15.87:0/132272564 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a7c154dc0 msgr2=0x7f5a7c1532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:21.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.254+0000 7f5a72000640 1 --2- 172.21.15.87:0/132272564 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a7c154dc0 0x7f5a7c1532f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:21.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.254+0000 7f5a72000640 1 -- 172.21.15.87:0/132272564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a7c0b03c0 msgr2=0x7f5a7c09a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:21.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.254+0000 7f5a72000640 1 --2- 172.21.15.87:0/132272564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a7c0b03c0 0x7f5a7c09a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:21.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.254+0000 7f5a72000640 1 -- 172.21.15.87:0/132272564 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7c153d20 con 0x7f5a7c0b07d0 2024-05-27T06:28:21.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.254+0000 7f5a7aa00640 1 --2- 172.21.15.87:0/132272564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a7c0b03c0 0x7f5a7c09a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:28:21.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.254+0000 7f5a72000640 1 --2- 172.21.15.87:0/132272564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a7c0b07d0 0x7f5a7c152db0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5a64004000 tx=0x7f5a6401b740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:21.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.254+0000 7f5a73400640 1 -- 172.21.15.87:0/132272564 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a640b7070 con 0x7f5a7c0b07d0 2024-05-27T06:28:21.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.254+0000 7f5a73400640 1 -- 172.21.15.87:0/132272564 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a64003620 con 0x7f5a7c0b07d0 2024-05-27T06:28:21.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.254+0000 7f5a81c00640 1 -- 172.21.15.87:0/132272564 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7c09aea0 con 0x7f5a7c0b07d0 2024-05-27T06:28:21.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.254+0000 7f5a73400640 1 -- 172.21.15.87:0/132272564 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a640ad050 con 0x7f5a7c0b07d0 2024-05-27T06:28:21.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.254+0000 7f5a81c00640 1 -- 172.21.15.87:0/132272564 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a7c0ca7d0 con 0x7f5a7c0b07d0 2024-05-27T06:28:21.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.258+0000 7f5a81c00640 1 -- 172.21.15.87:0/132272564 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a7c06aa30 con 0x7f5a7c0b07d0 2024-05-27T06:28:21.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.258+0000 7f5a73400640 1 -- 172.21.15.87:0/132272564 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5a64003a10 con 0x7f5a7c0b07d0 2024-05-27T06:28:21.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.258+0000 7f5a73400640 1 --2- 172.21.15.87:0/132272564 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5a5806f430 0x7f5a58071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:21.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.258+0000 7f5a73400640 1 -- 172.21.15.87:0/132272564 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f5a64129860 con 0x7f5a7c0b07d0 2024-05-27T06:28:21.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.258+0000 7f5a7aa00640 1 --2- 172.21.15.87:0/132272564 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5a5806f430 0x7f5a58071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:21.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.258+0000 7f5a7aa00640 1 --2- 172.21.15.87:0/132272564 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5a5806f430 0x7f5a58071940 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00f290 tx=0x7f5a6c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:21.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.262+0000 7f5a73400640 1 -- 172.21.15.87:0/132272564 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f5a640c1060 con 0x7f5a7c0b07d0 2024-05-27T06:28:21.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.422+0000 7f5a81c00640 1 -- 172.21.15.87:0/132272564 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5a7c153830 con 0x7f5a7c0b07d0 2024-05-27T06:28:21.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.422+0000 7f5a73400640 1 -- 172.21.15.87:0/132272564 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18938 (secure 0 0 0) 0x7f5a640185c0 con 0x7f5a7c0b07d0 2024-05-27T06:28:21.420 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:21.420 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":26,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:28:19.781895+0000","last_up_change":"2024-05-27T06:27:25.988592+0000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T06:27:26.590191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T06:27:35.840893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T06:27:36.929608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-27T06:27:40.638358+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6801","nonce":3674824716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6803","nonce":3674824716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6807","nonce":3674824716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6805","nonce":3674824716}]},"public_addr":"172.21.15.87:6801/3674824716","cluster_addr":"172.21.15.87:6803/3674824716","heartbeat_back_addr":"172.21.15.87:6807/3674824716","heartbeat_front_addr":"172.21.15.87:6805/3674824716","state":["exists","up"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6809","nonce":2443981288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6811","nonce":2443981288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6815","nonce":2443981288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6813","nonce":2443981288}]},"public_addr":"172.21.15.87:6809/2443981288","cluster_addr":"172.21.15.87:6811/2443981288","heartbeat_back_addr":"172.21.15.87:6815/2443981288","heartbeat_front_addr":"172.21.15.87:6813/2443981288","state":["exists","up"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6819","nonce":1441249238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6823","nonce":1441249238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6831","nonce":1441249238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6825","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6827","nonce":1441249238}]},"public_addr":"172.21.15.87:6819/1441249238","cluster_addr":"172.21.15.87:6823/1441249238","heartbeat_back_addr":"172.21.15.87:6831/1441249238","heartbeat_front_addr":"172.21.15.87:6827/1441249238","state":["exists","up"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6818","nonce":1173805234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6822","nonce":1173805234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6829","nonce":1173805234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6826","nonce":1173805234}]},"public_addr":"172.21.15.87:6818/1173805234","cluster_addr":"172.21.15.87:6822/1173805234","heartbeat_back_addr":"172.21.15.87:6829/1173805234","heartbeat_front_addr":"172.21.15.87:6826/1173805234","state":["exists","up"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6819","nonce":1551871079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6823","nonce":1551871079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6831","nonce":1551871079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6827","nonce":1551871079}]},"public_addr":"172.21.15.149:6819/1551871079","cluster_addr":"172.21.15.149:6823/1551871079","heartbeat_back_addr":"172.21.15.149:6831/1551871079","heartbeat_front_addr":"172.21.15.149:6827/1551871079","state":["exists","up"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6818","nonce":582864816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6822","nonce":582864816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6830","nonce":582864816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6826","nonce":582864816}]},"public_addr":"172.21.15.149:6818/582864816","cluster_addr":"172.21.15.149:6822/582864816","heartbeat_back_addr":"172.21.15.149:6830/582864816","heartbeat_front_addr":"172.21.15.149:6826/582864816","state":["exists","up"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6801","nonce":531351314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6803","nonce":531351314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6807","nonce":531351314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6805","nonce":531351314}]},"public_addr":"172.21.15.149:6801/531351314","cluster_addr":"172.21.15.149:6803/531351314","heartbeat_back_addr":"172.21.15.149:6807/531351314","heartbeat_front_addr":"172.21.15.149:6805/531351314","state":["exists","up"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6809","nonce":1171039913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6811","nonce":1171039913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6815","nonce":1171039913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6813","nonce":1171039913}]},"public_addr":"172.21.15.149:6809/1171039913","cluster_addr":"172.21.15.149:6811/1171039913","heartbeat_back_addr":"172.21.15.149:6815/1171039913","heartbeat_front_addr":"172.21.15.149:6813/1171039913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.589776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.819787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.767566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.683842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.038885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.120319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.687007+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.812832+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:28:21.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.422+0000 7f5a81c00640 1 -- 172.21.15.87:0/132272564 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5a5806f430 msgr2=0x7f5a58071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:21.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.422+0000 7f5a81c00640 1 --2- 172.21.15.87:0/132272564 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5a5806f430 0x7f5a58071940 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00f290 tx=0x7f5a6c009040 comp rx=0 tx=0).stop 2024-05-27T06:28:21.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.422+0000 7f5a81c00640 1 -- 172.21.15.87:0/132272564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a7c0b07d0 msgr2=0x7f5a7c152db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:21.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.422+0000 7f5a81c00640 1 --2- 172.21.15.87:0/132272564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a7c0b07d0 0x7f5a7c152db0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5a64004000 tx=0x7f5a6401b740 comp rx=0 tx=0).stop 2024-05-27T06:28:21.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.422+0000 7f5a81c00640 1 -- 172.21.15.87:0/132272564 shutdown_connections 2024-05-27T06:28:21.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.422+0000 7f5a81c00640 1 --2- 172.21.15.87:0/132272564 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5a5806f430 0x7f5a58071940 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:21.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.422+0000 7f5a81c00640 1 --2- 172.21.15.87:0/132272564 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a7c154dc0 0x7f5a7c1532f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:21.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.422+0000 7f5a81c00640 1 --2- 172.21.15.87:0/132272564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a7c0b07d0 0x7f5a7c152db0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:21.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.422+0000 7f5a81c00640 1 --2- 172.21.15.87:0/132272564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a7c0b03c0 0x7f5a7c09a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:21.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.422+0000 7f5a81c00640 1 -- 172.21.15.87:0/132272564 >> 172.21.15.87:0/132272564 conn(0x7f5a7c0b46b0 msgr2=0x7f5a7c074490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:21.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.422+0000 7f5a81c00640 1 -- 172.21.15.87:0/132272564 shutdown_connections 2024-05-27T06:28:21.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.426+0000 7f5a81c00640 1 -- 172.21.15.87:0/132272564 wait complete. 2024-05-27T06:28:21.442 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T06:27:26.590191+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T06:27:35.840893+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T06:27:36.929608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-27T06:27:40.638358+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-27T06:28:21.442 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T06:28:21.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.594+0000 7f3736200640 1 Processor -- start 2024-05-27T06:28:21.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.594+0000 7f3736200640 1 -- start start 2024-05-27T06:28:21.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.598+0000 7f3736200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f373006c940 0x7f373006cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:21.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.598+0000 7f3736200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37300cf530 con 0x7f37300d1700 2024-05-27T06:28:21.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.598+0000 7f3736200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37300cf810 con 0x7f3730157310 2024-05-27T06:28:21.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.598+0000 7f3736200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f37300d0140 con 0x7f373006c940 2024-05-27T06:28:21.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.598+0000 7f372fe00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f373006c940 0x7f373006cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:21.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.598+0000 7f372ea00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f37300d1700 0x7f37300d1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57534/0 (socket says 172.21.15.87:57534) 2024-05-27T06:28:21.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.598+0000 7f372ea00640 1 -- 172.21.15.87:0/2062559619 learned_addr learned my addr 172.21.15.87:0/2062559619 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:21.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.598+0000 7f372fe00640 1 -- 172.21.15.87:0/2062559619 >> v1:172.21.15.149:6789/0 conn(0x7f3730157310 legacy=0x7f373015dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:21.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.598+0000 7f372fe00640 1 -- 172.21.15.87:0/2062559619 >> v1:172.21.15.87:6789/0 conn(0x7f37300d1700 legacy=0x7f37300d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:21.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.598+0000 7f372fe00640 1 -- 172.21.15.87:0/2062559619 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37300cfaf0 con 0x7f373006c940 2024-05-27T06:28:21.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.598+0000 7f372e000640 1 -- 172.21.15.87:0/2062559619 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1901486850 0 0) 0x7f37300cf530 con 0x7f37300d1700 2024-05-27T06:28:21.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.602+0000 7f372fe00640 1 --2- 172.21.15.87:0/2062559619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f373006c940 0x7f373006cd50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f37300d02c0 tx=0x7f372801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d1e0a750a0aad67 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:21.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.602+0000 7f372e000640 1 -- 172.21.15.87:0/2062559619 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37280b2070 con 0x7f373006c940 2024-05-27T06:28:21.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.602+0000 7f372e000640 1 -- 172.21.15.87:0/2062559619 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37280a5810 con 0x7f373006c940 2024-05-27T06:28:21.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.602+0000 7f372e000640 1 -- 172.21.15.87:0/2062559619 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37280a5be0 con 0x7f373006c940 2024-05-27T06:28:21.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.602+0000 7f3736200640 1 -- 172.21.15.87:0/2062559619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f373006c940 msgr2=0x7f373006cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:21.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.602+0000 7f3736200640 1 --2- 172.21.15.87:0/2062559619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f373006c940 0x7f373006cd50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f37300d02c0 tx=0x7f372801c8c0 comp rx=0 tx=0).stop 2024-05-27T06:28:21.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.602+0000 7f3736200640 1 -- 172.21.15.87:0/2062559619 shutdown_connections 2024-05-27T06:28:21.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.602+0000 7f3736200640 1 --2- 172.21.15.87:0/2062559619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f373006c940 0x7f373006cd50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:21.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.602+0000 7f3736200640 1 -- 172.21.15.87:0/2062559619 >> 172.21.15.87:0/2062559619 conn(0x7f37300b46b0 msgr2=0x7f37300b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:21.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.602+0000 7f3736200640 1 -- 172.21.15.87:0/2062559619 shutdown_connections 2024-05-27T06:28:21.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.602+0000 7f3736200640 1 -- 172.21.15.87:0/2062559619 wait complete. 2024-05-27T06:28:21.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.602+0000 7f3736200640 1 Processor -- start 2024-05-27T06:28:21.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.602+0000 7f3736200640 1 -- start start 2024-05-27T06:28:21.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.606+0000 7f3736200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f373006c940 0x7f373015fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:21.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.606+0000 7f3736200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37300d1700 0x7f37300cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:21.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.606+0000 7f3736200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3730157310 0x7f37300ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:21.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.606+0000 7f3736200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f37300707c0 con 0x7f373006c940 2024-05-27T06:28:21.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.606+0000 7f3736200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3730070640 con 0x7f3730157310 2024-05-27T06:28:21.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.606+0000 7f3736200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f373016b4e0 con 0x7f37300d1700 2024-05-27T06:28:21.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.606+0000 7f372f400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f373006c940 0x7f373015fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:21.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.606+0000 7f372f400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f373006c940 0x7f373015fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34822/0 (socket says 172.21.15.87:34822) 2024-05-27T06:28:21.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.606+0000 7f372f400640 1 -- 172.21.15.87:0/2516255386 learned_addr learned my addr 172.21.15.87:0/2516255386 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:21.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.606+0000 7f372ea00640 1 --2- 172.21.15.87:0/2516255386 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37300d1700 0x7f37300cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:21.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.606+0000 7f372fe00640 1 --2- 172.21.15.87:0/2516255386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3730157310 0x7f37300ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:21.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.606+0000 7f372f400640 1 -- 172.21.15.87:0/2516255386 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37300d1700 msgr2=0x7f37300cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:21.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.606+0000 7f372f400640 1 --2- 172.21.15.87:0/2516255386 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37300d1700 0x7f37300cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:21.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.606+0000 7f372f400640 1 -- 172.21.15.87:0/2516255386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3730157310 msgr2=0x7f37300ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:21.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.606+0000 7f372f400640 1 --2- 172.21.15.87:0/2516255386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3730157310 0x7f37300ce2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:21.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.606+0000 7f372f400640 1 -- 172.21.15.87:0/2516255386 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f373014e0a0 con 0x7f373006c940 2024-05-27T06:28:21.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.606+0000 7f372f400640 1 --2- 172.21.15.87:0/2516255386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f373006c940 0x7f373015fc00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f372000c3c0 tx=0x7f372000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:21.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.606+0000 7f3727400640 1 -- 172.21.15.87:0/2516255386 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3720017070 con 0x7f373006c940 2024-05-27T06:28:21.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.606+0000 7f3727400640 1 -- 172.21.15.87:0/2516255386 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37200052d0 con 0x7f373006c940 2024-05-27T06:28:21.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.606+0000 7f3727400640 1 -- 172.21.15.87:0/2516255386 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3720003820 con 0x7f373006c940 2024-05-27T06:28:21.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.606+0000 7f3736200640 1 -- 172.21.15.87:0/2516255386 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f373014e380 con 0x7f373006c940 2024-05-27T06:28:21.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.606+0000 7f3736200640 1 -- 172.21.15.87:0/2516255386 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f373014e940 con 0x7f373006c940 2024-05-27T06:28:21.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.606+0000 7f3736200640 1 -- 172.21.15.87:0/2516255386 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f373006aa30 con 0x7f373006c940 2024-05-27T06:28:21.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.610+0000 7f3727400640 1 -- 172.21.15.87:0/2516255386 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f372001a070 con 0x7f373006c940 2024-05-27T06:28:21.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.610+0000 7f3727400640 1 --2- 172.21.15.87:0/2516255386 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f371006f400 0x7f3710071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:21.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.610+0000 7f3727400640 1 -- 172.21.15.87:0/2516255386 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f372008e950 con 0x7f373006c940 2024-05-27T06:28:21.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.610+0000 7f372ea00640 1 --2- 172.21.15.87:0/2516255386 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f371006f400 0x7f3710071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:21.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.610+0000 7f372ea00640 1 --2- 172.21.15.87:0/2516255386 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f371006f400 0x7f3710071910 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f371c007bc0 tx=0x7f371c007b10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:21.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.614+0000 7f3727400640 1 -- 172.21.15.87:0/2516255386 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f3720005480 con 0x7f373006c940 2024-05-27T06:28:21.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.770+0000 7f3736200640 1 -- 172.21.15.87:0/2516255386 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f37300ce9c0 con 0x7f373006c940 2024-05-27T06:28:21.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.770+0000 7f3727400640 1 -- 172.21.15.87:0/2516255386 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f372008ce20 con 0x7f373006c940 2024-05-27T06:28:21.769 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-05-27T06:28:21.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.774+0000 7f3736200640 1 -- 172.21.15.87:0/2516255386 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f371006f400 msgr2=0x7f3710071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:21.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.774+0000 7f3736200640 1 --2- 172.21.15.87:0/2516255386 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f371006f400 0x7f3710071910 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f371c007bc0 tx=0x7f371c007b10 comp rx=0 tx=0).stop 2024-05-27T06:28:21.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.774+0000 7f3736200640 1 -- 172.21.15.87:0/2516255386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f373006c940 msgr2=0x7f373015fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:21.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.774+0000 7f3736200640 1 --2- 172.21.15.87:0/2516255386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f373006c940 0x7f373015fc00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f372000c3c0 tx=0x7f372000c880 comp rx=0 tx=0).stop 2024-05-27T06:28:21.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.774+0000 7f3736200640 1 -- 172.21.15.87:0/2516255386 shutdown_connections 2024-05-27T06:28:21.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.774+0000 7f3736200640 1 --2- 172.21.15.87:0/2516255386 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f371006f400 0x7f3710071910 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:21.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.774+0000 7f3736200640 1 --2- 172.21.15.87:0/2516255386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3730157310 0x7f37300ce2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:21.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.774+0000 7f3736200640 1 --2- 172.21.15.87:0/2516255386 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37300d1700 0x7f37300cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:21.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.774+0000 7f3736200640 1 --2- 172.21.15.87:0/2516255386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f373006c940 0x7f373015fc00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:21.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.774+0000 7f3736200640 1 -- 172.21.15.87:0/2516255386 >> 172.21.15.87:0/2516255386 conn(0x7f37300b46b0 msgr2=0x7f3730167f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:21.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.774+0000 7f3736200640 1 -- 172.21.15.87:0/2516255386 shutdown_connections 2024-05-27T06:28:21.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.774+0000 7f3736200640 1 -- 172.21.15.87:0/2516255386 wait complete. 2024-05-27T06:28:21.791 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T06:28:21.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.942+0000 7f5f15400640 1 Processor -- start 2024-05-27T06:28:21.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.942+0000 7f5f15400640 1 -- start start 2024-05-27T06:28:21.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.946+0000 7f5f15400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f100d1e10 0x7f5f10073350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:21.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.946+0000 7f5f15400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5f100cf7c0 0x7f5f100cfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:21.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.946+0000 7f5f15400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f1006d660 con 0x7f5f10072f40 2024-05-27T06:28:21.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.946+0000 7f5f15400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f5f1006d130 con 0x7f5f100cf7c0 2024-05-27T06:28:21.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.946+0000 7f5f15400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5f1006eec0 con 0x7f5f100d1e10 2024-05-27T06:28:21.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.946+0000 7f5f0f200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5f100cf7c0 0x7f5f100cfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:21.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.946+0000 7f5f05e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f100d1e10 0x7f5f10073350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:21.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.946+0000 7f5f0e800640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f5f10072f40 0x7f5f100d1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.87:57110/0 (socket says 172.21.15.87:57110) 2024-05-27T06:28:21.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.946+0000 7f5f0e800640 1 -- 172.21.15.87:0/3639223636 learned_addr learned my addr 172.21.15.87:0/3639223636 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:21.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.946+0000 7f5f0de00640 1 -- 172.21.15.87:0/3639223636 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 859968943 0 0) 0x7f5f1006d660 con 0x7f5f10072f40 2024-05-27T06:28:21.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.946+0000 7f5f0de00640 1 -- 172.21.15.87:0/3639223636 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ef4003530 con 0x7f5f10072f40 2024-05-27T06:28:21.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.946+0000 7f5f0f200640 1 -- 172.21.15.87:0/3639223636 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f100d1e10 msgr2=0x7f5f10073350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:21.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.946+0000 7f5f0f200640 1 --2- 172.21.15.87:0/3639223636 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f100d1e10 0x7f5f10073350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:21.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.946+0000 7f5f0f200640 1 -- 172.21.15.87:0/3639223636 >> v1:172.21.15.149:6789/0 conn(0x7f5f10072f40 legacy=0x7f5f100d1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:21.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.946+0000 7f5f0f200640 1 -- 172.21.15.87:0/3639223636 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f1006d380 con 0x7f5f100cf7c0 2024-05-27T06:28:21.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.946+0000 7f5f05e00640 1 --2- 172.21.15.87:0/3639223636 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f100d1e10 0x7f5f10073350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:28:21.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.950+0000 7f5f0f200640 1 --2- 172.21.15.87:0/3639223636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f100cf7c0 0x7f5f100cfbd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5f080097c0 tx=0x7f5f0801c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f3c6e7a5402fd61 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:21.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.950+0000 7f5f0de00640 1 -- 172.21.15.87:0/3639223636 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f080b2070 con 0x7f5f100cf7c0 2024-05-27T06:28:21.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.950+0000 7f5f0de00640 1 -- 172.21.15.87:0/3639223636 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f080ad680 con 0x7f5f100cf7c0 2024-05-27T06:28:21.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.950+0000 7f5f0de00640 1 -- 172.21.15.87:0/3639223636 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f080ada50 con 0x7f5f100cf7c0 2024-05-27T06:28:21.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.950+0000 7f5f15400640 1 -- 172.21.15.87:0/3639223636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f100cf7c0 msgr2=0x7f5f100cfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:21.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.950+0000 7f5f15400640 1 --2- 172.21.15.87:0/3639223636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f100cf7c0 0x7f5f100cfbd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5f080097c0 tx=0x7f5f0801c3e0 comp rx=0 tx=0).stop 2024-05-27T06:28:21.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.950+0000 7f5f15400640 1 -- 172.21.15.87:0/3639223636 shutdown_connections 2024-05-27T06:28:21.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.950+0000 7f5f15400640 1 --2- 172.21.15.87:0/3639223636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f100cf7c0 0x7f5f100cfbd0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:21.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.950+0000 7f5f15400640 1 --2- 172.21.15.87:0/3639223636 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f100d1e10 0x7f5f10073350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:21.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.950+0000 7f5f15400640 1 -- 172.21.15.87:0/3639223636 >> 172.21.15.87:0/3639223636 conn(0x7f5f100b46b0 msgr2=0x7f5f100b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:21.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.950+0000 7f5f15400640 1 -- 172.21.15.87:0/3639223636 shutdown_connections 2024-05-27T06:28:21.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.950+0000 7f5f15400640 1 -- 172.21.15.87:0/3639223636 wait complete. 2024-05-27T06:28:21.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.950+0000 7f5f15400640 1 Processor -- start 2024-05-27T06:28:21.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.950+0000 7f5f15400640 1 -- start start 2024-05-27T06:28:21.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.954+0000 7f5f15400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f10072f40 0x7f5f100cc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:21.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.954+0000 7f5f15400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f100cf7c0 0x7f5f10156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:21.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.954+0000 7f5f15400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f10156c70 0x7f5f100ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:21.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.954+0000 7f5f15400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5f1015cf60 con 0x7f5f10072f40 2024-05-27T06:28:21.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.954+0000 7f5f15400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5f1015cde0 con 0x7f5f100cf7c0 2024-05-27T06:28:21.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.954+0000 7f5f15400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5f100cd880 con 0x7f5f10156c70 2024-05-27T06:28:21.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.954+0000 7f5f0e800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f10072f40 0x7f5f100cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:21.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.954+0000 7f5f0e800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f10072f40 0x7f5f100cc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34828/0 (socket says 172.21.15.87:34828) 2024-05-27T06:28:21.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.954+0000 7f5f0e800640 1 -- 172.21.15.87:0/1520207499 learned_addr learned my addr 172.21.15.87:0/1520207499 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:21.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.954+0000 7f5f05e00640 1 --2- 172.21.15.87:0/1520207499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f100cf7c0 0x7f5f10156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:21.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.954+0000 7f5f0f200640 1 --2- 172.21.15.87:0/1520207499 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f10156c70 0x7f5f100ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:21.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.954+0000 7f5f0e800640 1 -- 172.21.15.87:0/1520207499 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f10156c70 msgr2=0x7f5f100ae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:21.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.954+0000 7f5f0e800640 1 --2- 172.21.15.87:0/1520207499 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f10156c70 0x7f5f100ae570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:21.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.954+0000 7f5f0e800640 1 -- 172.21.15.87:0/1520207499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f100cf7c0 msgr2=0x7f5f10156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:21.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.954+0000 7f5f0e800640 1 --2- 172.21.15.87:0/1520207499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f100cf7c0 0x7f5f10156730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:21.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.954+0000 7f5f0e800640 1 -- 172.21.15.87:0/1520207499 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f10156510 con 0x7f5f10072f40 2024-05-27T06:28:21.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.954+0000 7f5f0e800640 1 --2- 172.21.15.87:0/1520207499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f10072f40 0x7f5f100cc950 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5f0000cbe0 tx=0x7f5f0000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:21.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.954+0000 7f5f07400640 1 -- 172.21.15.87:0/1520207499 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0000aca0 con 0x7f5f10072f40 2024-05-27T06:28:21.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.954+0000 7f5f07400640 1 -- 172.21.15.87:0/1520207499 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f0000ae40 con 0x7f5f10072f40 2024-05-27T06:28:21.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.954+0000 7f5f07400640 1 -- 172.21.15.87:0/1520207499 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f00012600 con 0x7f5f10072f40 2024-05-27T06:28:21.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.954+0000 7f5f15400640 1 -- 172.21.15.87:0/1520207499 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f10157080 con 0x7f5f10072f40 2024-05-27T06:28:21.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.954+0000 7f5f15400640 1 -- 172.21.15.87:0/1520207499 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f10153c80 con 0x7f5f10072f40 2024-05-27T06:28:21.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.954+0000 7f5f15400640 1 -- 172.21.15.87:0/1520207499 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f1006aa30 con 0x7f5f10072f40 2024-05-27T06:28:21.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.958+0000 7f5f07400640 1 -- 172.21.15.87:0/1520207499 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5f000127a0 con 0x7f5f10072f40 2024-05-27T06:28:21.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.958+0000 7f5f07400640 1 --2- 172.21.15.87:0/1520207499 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5eec06f400 0x7f5eec071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:21.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.958+0000 7f5f07400640 1 -- 172.21.15.87:0/1520207499 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f5f0008fd70 con 0x7f5f10072f40 2024-05-27T06:28:21.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.958+0000 7f5f05e00640 1 --2- 172.21.15.87:0/1520207499 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5eec06f400 0x7f5eec071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:21.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.958+0000 7f5f05e00640 1 --2- 172.21.15.87:0/1520207499 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5eec06f400 0x7f5eec071910 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5f10155440 tx=0x7f5ef8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:21.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:21.962+0000 7f5f07400640 1 -- 172.21.15.87:0/1520207499 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f5f10157080 con 0x7f5f10072f40 2024-05-27T06:28:22.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.118+0000 7f5f15400640 1 -- 172.21.15.87:0/1520207499 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5f10073e50 con 0x7f5f10072f40 2024-05-27T06:28:22.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.118+0000 7f5f07400640 1 -- 172.21.15.87:0/1520207499 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f5f10156510 con 0x7f5f10072f40 2024-05-27T06:28:22.115 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-05-27T06:28:22.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.118+0000 7f5f15400640 1 -- 172.21.15.87:0/1520207499 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5eec06f400 msgr2=0x7f5eec071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:22.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.118+0000 7f5f15400640 1 --2- 172.21.15.87:0/1520207499 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5eec06f400 0x7f5eec071910 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5f10155440 tx=0x7f5ef8008040 comp rx=0 tx=0).stop 2024-05-27T06:28:22.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.118+0000 7f5f15400640 1 -- 172.21.15.87:0/1520207499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f10072f40 msgr2=0x7f5f100cc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:22.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.118+0000 7f5f15400640 1 --2- 172.21.15.87:0/1520207499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f10072f40 0x7f5f100cc950 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5f0000cbe0 tx=0x7f5f0000a060 comp rx=0 tx=0).stop 2024-05-27T06:28:22.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.118+0000 7f5f15400640 1 -- 172.21.15.87:0/1520207499 shutdown_connections 2024-05-27T06:28:22.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.118+0000 7f5f15400640 1 --2- 172.21.15.87:0/1520207499 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5eec06f400 0x7f5eec071910 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.118+0000 7f5f15400640 1 --2- 172.21.15.87:0/1520207499 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f10156c70 0x7f5f100ae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.118+0000 7f5f15400640 1 --2- 172.21.15.87:0/1520207499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f100cf7c0 0x7f5f10156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.118+0000 7f5f15400640 1 --2- 172.21.15.87:0/1520207499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f10072f40 0x7f5f100cc950 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.118+0000 7f5f15400640 1 -- 172.21.15.87:0/1520207499 >> 172.21.15.87:0/1520207499 conn(0x7f5f100b46b0 msgr2=0x7f5f100686b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:22.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.118+0000 7f5f15400640 1 -- 172.21.15.87:0/1520207499 shutdown_connections 2024-05-27T06:28:22.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.118+0000 7f5f15400640 1 -- 172.21.15.87:0/1520207499 wait complete. 2024-05-27T06:28:22.137 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T06:28:22.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.286+0000 7f230e200640 1 Processor -- start 2024-05-27T06:28:22.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.290+0000 7f230e200640 1 -- start start 2024-05-27T06:28:22.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.290+0000 7f230e200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f23081610c0 0x7f23080d02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:22.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.290+0000 7f230e200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f23080d0810 0x7f23080d1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:22.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.290+0000 7f230e200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23080d1130 con 0x7f23080d1c40 2024-05-27T06:28:22.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.290+0000 7f230e200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f23080d0c20 con 0x7f23080d0810 2024-05-27T06:28:22.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.290+0000 7f230e200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f23080d2050 con 0x7f23081610c0 2024-05-27T06:28:22.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.290+0000 7f2306a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f23080d0810 0x7f23080d1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:22.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.290+0000 7f2307e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f23080d1c40 0x7f230806eb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57546/0 (socket says 172.21.15.87:57546) 2024-05-27T06:28:22.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.290+0000 7f2307e00640 1 -- 172.21.15.87:0/704679856 learned_addr learned my addr 172.21.15.87:0/704679856 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:22.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.290+0000 7f2307400640 1 --2- 172.21.15.87:0/704679856 >> v2:172.21.15.149:3300/0 conn(0x7f23081610c0 0x7f23080d02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:22.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.290+0000 7f2306a00640 1 -- 172.21.15.87:0/704679856 >> v2:172.21.15.149:3300/0 conn(0x7f23081610c0 msgr2=0x7f23080d02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:22.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.290+0000 7f2306a00640 1 --2- 172.21.15.87:0/704679856 >> v2:172.21.15.149:3300/0 conn(0x7f23081610c0 0x7f23080d02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.290+0000 7f2306a00640 1 -- 172.21.15.87:0/704679856 >> v1:172.21.15.87:6789/0 conn(0x7f23080d1c40 legacy=0x7f230806eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:22.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.290+0000 7f2306a00640 1 -- 172.21.15.87:0/704679856 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23080d0e50 con 0x7f23080d0810 2024-05-27T06:28:22.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.294+0000 7f2306a00640 1 --2- 172.21.15.87:0/704679856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23080d0810 0x7f23080d1700 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2308071cd0 tx=0x7f22f401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d623833e927057b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:22.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.294+0000 7f2306000640 1 -- 172.21.15.87:0/704679856 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f40ab680 con 0x7f23080d0810 2024-05-27T06:28:22.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.294+0000 7f2306000640 1 -- 172.21.15.87:0/704679856 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22f40b0070 con 0x7f23080d0810 2024-05-27T06:28:22.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.294+0000 7f2306000640 1 -- 172.21.15.87:0/704679856 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f40aba40 con 0x7f23080d0810 2024-05-27T06:28:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.294+0000 7f230e200640 1 -- 172.21.15.87:0/704679856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23080d0810 msgr2=0x7f23080d1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.294+0000 7f230e200640 1 --2- 172.21.15.87:0/704679856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23080d0810 0x7f23080d1700 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2308071cd0 tx=0x7f22f401c480 comp rx=0 tx=0).stop 2024-05-27T06:28:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.294+0000 7f230e200640 1 -- 172.21.15.87:0/704679856 shutdown_connections 2024-05-27T06:28:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.294+0000 7f230e200640 1 --2- 172.21.15.87:0/704679856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23080d0810 0x7f23080d1700 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.294+0000 7f230e200640 1 --2- 172.21.15.87:0/704679856 >> v2:172.21.15.149:3300/0 conn(0x7f23081610c0 0x7f23080d02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.294+0000 7f230e200640 1 -- 172.21.15.87:0/704679856 >> 172.21.15.87:0/704679856 conn(0x7f23080b46b0 msgr2=0x7f23080b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:22.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.294+0000 7f230e200640 1 -- 172.21.15.87:0/704679856 shutdown_connections 2024-05-27T06:28:22.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.294+0000 7f230e200640 1 -- 172.21.15.87:0/704679856 wait complete. 2024-05-27T06:28:22.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.298+0000 7f230e200640 1 Processor -- start 2024-05-27T06:28:22.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.298+0000 7f230e200640 1 -- start start 2024-05-27T06:28:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.298+0000 7f230e200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23080d0810 0x7f230809a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.298+0000 7f230e200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23080d1c40 0x7f23080af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.298+0000 7f230e200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23081610c0 0x7f23080afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.298+0000 7f230e200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f23081614d0 con 0x7f23080d1c40 2024-05-27T06:28:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.298+0000 7f230e200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2308147a30 con 0x7f23081610c0 2024-05-27T06:28:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.298+0000 7f230e200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2308161650 con 0x7f23080d0810 2024-05-27T06:28:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.298+0000 7f2306a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23080d1c40 0x7f23080af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.298+0000 7f2306a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23080d1c40 0x7f23080af8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34854/0 (socket says 172.21.15.87:34854) 2024-05-27T06:28:22.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.298+0000 7f2306a00640 1 -- 172.21.15.87:0/4175828763 learned_addr learned my addr 172.21.15.87:0/4175828763 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.298+0000 7f2307400640 1 --2- 172.21.15.87:0/4175828763 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23080d0810 0x7f230809a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.298+0000 7f2307e00640 1 --2- 172.21.15.87:0/4175828763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23081610c0 0x7f23080afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.298+0000 7f2306a00640 1 -- 172.21.15.87:0/4175828763 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23080d0810 msgr2=0x7f230809a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.298+0000 7f2306a00640 1 --2- 172.21.15.87:0/4175828763 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23080d0810 0x7f230809a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.298+0000 7f2306a00640 1 -- 172.21.15.87:0/4175828763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23081610c0 msgr2=0x7f23080afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.298+0000 7f2306a00640 1 --2- 172.21.15.87:0/4175828763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23081610c0 0x7f23080afdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.298+0000 7f2306a00640 1 -- 172.21.15.87:0/4175828763 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2308146a30 con 0x7f23080d1c40 2024-05-27T06:28:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.298+0000 7f2307e00640 1 --2- 172.21.15.87:0/4175828763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23081610c0 0x7f23080afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.298+0000 7f2306a00640 1 --2- 172.21.15.87:0/4175828763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23080d1c40 0x7f23080af8b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f22f40ad040 tx=0x7f22f4019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.298+0000 7f22ff400640 1 -- 172.21.15.87:0/4175828763 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f40bf610 con 0x7f23080d1c40 2024-05-27T06:28:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.298+0000 7f22ff400640 1 -- 172.21.15.87:0/4175828763 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22f40a7070 con 0x7f23080d1c40 2024-05-27T06:28:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.298+0000 7f230e200640 1 -- 172.21.15.87:0/4175828763 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f230809ae80 con 0x7f23080d1c40 2024-05-27T06:28:22.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.298+0000 7f230e200640 1 -- 172.21.15.87:0/4175828763 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23080b1390 con 0x7f23080d1c40 2024-05-27T06:28:22.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.298+0000 7f22ff400640 1 -- 172.21.15.87:0/4175828763 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f40bf9d0 con 0x7f23080d1c40 2024-05-27T06:28:22.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.302+0000 7f230e200640 1 -- 172.21.15.87:0/4175828763 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22e00052a0 con 0x7f23080d1c40 2024-05-27T06:28:22.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.302+0000 7f22ff400640 1 -- 172.21.15.87:0/4175828763 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f22f40bd020 con 0x7f23080d1c40 2024-05-27T06:28:22.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.302+0000 7f22ff400640 1 --2- 172.21.15.87:0/4175828763 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f22e806f430 0x7f22e8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:22.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.302+0000 7f22ff400640 1 -- 172.21.15.87:0/4175828763 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f22f4129e40 con 0x7f23080d1c40 2024-05-27T06:28:22.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.302+0000 7f2307400640 1 --2- 172.21.15.87:0/4175828763 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f22e806f430 0x7f22e8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:22.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.302+0000 7f2307400640 1 --2- 172.21.15.87:0/4175828763 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f22e806f430 0x7f22e8071940 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f22f8003fd0 tx=0x7f22f80039a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.306+0000 7f22ff400640 1 -- 172.21.15.87:0/4175828763 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f22f4016070 con 0x7f23080d1c40 2024-05-27T06:28:22.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.462+0000 7f230e200640 1 -- 172.21.15.87:0/4175828763 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f22e0005da0 con 0x7f23080d1c40 2024-05-27T06:28:22.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.462+0000 7f22ff400640 1 -- 172.21.15.87:0/4175828763 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f22f40f6900 con 0x7f23080d1c40 2024-05-27T06:28:22.462 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-05-27T06:28:22.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.466+0000 7f230e200640 1 -- 172.21.15.87:0/4175828763 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f22e806f430 msgr2=0x7f22e8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:22.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.466+0000 7f230e200640 1 --2- 172.21.15.87:0/4175828763 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f22e806f430 0x7f22e8071940 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f22f8003fd0 tx=0x7f22f80039a0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.466+0000 7f230e200640 1 -- 172.21.15.87:0/4175828763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23080d1c40 msgr2=0x7f23080af8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:22.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.466+0000 7f230e200640 1 --2- 172.21.15.87:0/4175828763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23080d1c40 0x7f23080af8b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f22f40ad040 tx=0x7f22f4019220 comp rx=0 tx=0).stop 2024-05-27T06:28:22.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.466+0000 7f230e200640 1 -- 172.21.15.87:0/4175828763 shutdown_connections 2024-05-27T06:28:22.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.466+0000 7f230e200640 1 --2- 172.21.15.87:0/4175828763 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f22e806f430 0x7f22e8071940 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.466+0000 7f230e200640 1 --2- 172.21.15.87:0/4175828763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23081610c0 0x7f23080afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.466+0000 7f230e200640 1 --2- 172.21.15.87:0/4175828763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23080d1c40 0x7f23080af8b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.466+0000 7f230e200640 1 --2- 172.21.15.87:0/4175828763 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23080d0810 0x7f230809a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.466+0000 7f230e200640 1 -- 172.21.15.87:0/4175828763 >> 172.21.15.87:0/4175828763 conn(0x7f23080b46b0 msgr2=0x7f23080b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:22.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.466+0000 7f230e200640 1 -- 172.21.15.87:0/4175828763 shutdown_connections 2024-05-27T06:28:22.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.466+0000 7f230e200640 1 -- 172.21.15.87:0/4175828763 wait complete. 2024-05-27T06:28:22.483 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-27T06:28:22.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.638+0000 7fc936200640 1 Processor -- start 2024-05-27T06:28:22.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.638+0000 7fc936200640 1 -- start start 2024-05-27T06:28:22.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.638+0000 7fc936200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc9301610c0 0x7fc9300d02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:22.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.638+0000 7fc936200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9300d1130 con 0x7fc9300d0810 2024-05-27T06:28:22.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.638+0000 7fc936200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9300d0e50 con 0x7fc9300d1e10 2024-05-27T06:28:22.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.638+0000 7fc936200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fc9300d0c20 con 0x7fc9301610c0 2024-05-27T06:28:22.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.638+0000 7fc926a00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fc9300d0810 0x7fc9300d1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57550/0 (socket says 172.21.15.87:57550) 2024-05-27T06:28:22.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.638+0000 7fc926a00640 1 -- 172.21.15.87:0/2143753371 learned_addr learned my addr 172.21.15.87:0/2143753371 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:22.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.638+0000 7fc92f400640 1 --2- 172.21.15.87:0/2143753371 >> v2:172.21.15.149:3300/0 conn(0x7fc9301610c0 0x7fc9300d02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:22.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.638+0000 7fc92ea00640 1 -- 172.21.15.87:0/2143753371 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1312325693 0 0) 0x7fc9300d1130 con 0x7fc9300d0810 2024-05-27T06:28:22.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.642+0000 7fc92ea00640 1 -- 172.21.15.87:0/2143753371 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc914003530 con 0x7fc9300d0810 2024-05-27T06:28:22.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.642+0000 7fc92ea00640 1 -- 172.21.15.87:0/2143753371 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2734884839 0 0) 0x7fc9300d0e50 con 0x7fc9300d1e10 2024-05-27T06:28:22.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.642+0000 7fc92ea00640 1 -- 172.21.15.87:0/2143753371 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9300d1130 con 0x7fc9300d1e10 2024-05-27T06:28:22.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.642+0000 7fc92ea00640 1 -- 172.21.15.87:0/2143753371 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2767392938 0 0) 0x7fc914003530 con 0x7fc9300d0810 2024-05-27T06:28:22.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.642+0000 7fc92ea00640 1 -- 172.21.15.87:0/2143753371 >> v2:172.21.15.149:3300/0 conn(0x7fc9301610c0 msgr2=0x7fc9300d02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:22.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.642+0000 7fc92ea00640 1 --2- 172.21.15.87:0/2143753371 >> v2:172.21.15.149:3300/0 conn(0x7fc9301610c0 0x7fc9300d02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.642+0000 7fc92ea00640 1 -- 172.21.15.87:0/2143753371 >> v1:172.21.15.149:6789/0 conn(0x7fc9300d1e10 legacy=0x7fc93006eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:22.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.642+0000 7fc92ea00640 1 -- 172.21.15.87:0/2143753371 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc930161a00 con 0x7fc9300d0810 2024-05-27T06:28:22.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.642+0000 7fc92ea00640 1 -- 172.21.15.87:0/2143753371 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7fc918001700 con 0x7fc9300d0810 2024-05-27T06:28:22.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.642+0000 7fc92ea00640 1 -- 172.21.15.87:0/2143753371 >> v1:172.21.15.87:6789/0 conn(0x7fc9300d0810 legacy=0x7fc9300d1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:22.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.642+0000 7fc92ea00640 1 --2- 172.21.15.87:0/2143753371 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc914003c40 0x7fc914004090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:22.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.642+0000 7fc92ea00640 1 --2- 172.21.15.87:0/2143753371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc914004810 0x7fc914004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:22.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.642+0000 7fc92ea00640 1 --2- 172.21.15.87:0/2143753371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc914005290 0x7fc91400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:22.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.642+0000 7fc92ea00640 1 -- 172.21.15.87:0/2143753371 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc91400c210 con 0x7fc914004810 2024-05-27T06:28:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.642+0000 7fc92ea00640 1 -- 172.21.15.87:0/2143753371 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc91400c3c0 con 0x7fc914005290 2024-05-27T06:28:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.642+0000 7fc92ea00640 1 -- 172.21.15.87:0/2143753371 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc91400c5c0 con 0x7fc914003c40 2024-05-27T06:28:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.642+0000 7fc926a00640 1 --2- 172.21.15.87:0/2143753371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc914004810 0x7fc914004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.642+0000 7fc92fe00640 1 --2- 172.21.15.87:0/2143753371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc914005290 0x7fc91400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.642+0000 7fc92f400640 1 --2- 172.21.15.87:0/2143753371 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc914003c40 0x7fc914004090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.642+0000 7fc926a00640 1 -- 172.21.15.87:0/2143753371 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc914003c40 msgr2=0x7fc914004090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.642+0000 7fc926a00640 1 --2- 172.21.15.87:0/2143753371 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc914003c40 0x7fc914004090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.642+0000 7fc926a00640 1 -- 172.21.15.87:0/2143753371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc914005290 msgr2=0x7fc91400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.642+0000 7fc926a00640 1 --2- 172.21.15.87:0/2143753371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc914005290 0x7fc91400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.642+0000 7fc926a00640 1 -- 172.21.15.87:0/2143753371 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc914003530 con 0x7fc914004810 2024-05-27T06:28:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.642+0000 7fc92fe00640 1 --2- 172.21.15.87:0/2143753371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc914005290 0x7fc91400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.642+0000 7fc92fe00640 1 -- 172.21.15.87:0/2143753371 reap_dead start 2024-05-27T06:28:22.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.642+0000 7fc926a00640 1 --2- 172.21.15.87:0/2143753371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc914004810 0x7fc914004c20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc91800c190 tx=0x7fc91801cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433505970f312e2f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:22.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.646+0000 7fc92ea00640 1 -- 172.21.15.87:0/2143753371 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc918007cb0 con 0x7fc914004810 2024-05-27T06:28:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.646+0000 7fc92ea00640 1 -- 172.21.15.87:0/2143753371 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9180a9020 con 0x7fc914004810 2024-05-27T06:28:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.646+0000 7fc92ea00640 1 -- 172.21.15.87:0/2143753371 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc918005b00 con 0x7fc914004810 2024-05-27T06:28:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.646+0000 7fc936200640 1 -- 172.21.15.87:0/2143753371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc914004810 msgr2=0x7fc914004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.646+0000 7fc936200640 1 --2- 172.21.15.87:0/2143753371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc914004810 0x7fc914004c20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc91800c190 tx=0x7fc91801cb40 comp rx=0 tx=0).stop 2024-05-27T06:28:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.646+0000 7fc936200640 1 -- 172.21.15.87:0/2143753371 shutdown_connections 2024-05-27T06:28:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.646+0000 7fc936200640 1 --2- 172.21.15.87:0/2143753371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc914004810 0x7fc914004c20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.646+0000 7fc936200640 1 -- 172.21.15.87:0/2143753371 >> 172.21.15.87:0/2143753371 conn(0x7fc9300b46b0 msgr2=0x7fc9300b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.646+0000 7fc936200640 1 -- 172.21.15.87:0/2143753371 shutdown_connections 2024-05-27T06:28:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.646+0000 7fc936200640 1 -- 172.21.15.87:0/2143753371 wait complete. 2024-05-27T06:28:22.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.646+0000 7fc936200640 1 Processor -- start 2024-05-27T06:28:22.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.646+0000 7fc936200640 1 -- start start 2024-05-27T06:28:22.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.650+0000 7fc936200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc914004810 0x7fc9301f1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:22.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.650+0000 7fc936200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc93015c600 0x7fc93015ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:22.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.650+0000 7fc936200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc930138d30 0x7fc930139140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:22.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.650+0000 7fc936200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc930147a30 con 0x7fc930138d30 2024-05-27T06:28:22.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.650+0000 7fc936200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc930161fc0 con 0x7fc914004810 2024-05-27T06:28:22.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.650+0000 7fc936200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc9301614d0 con 0x7fc93015c600 2024-05-27T06:28:22.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.650+0000 7fc92fe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc930138d30 0x7fc930139140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:22.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.650+0000 7fc92fe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc930138d30 0x7fc930139140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34884/0 (socket says 172.21.15.87:34884) 2024-05-27T06:28:22.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.650+0000 7fc92fe00640 1 -- 172.21.15.87:0/926262155 learned_addr learned my addr 172.21.15.87:0/926262155 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:22.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.650+0000 7fc92f400640 1 --2- 172.21.15.87:0/926262155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc914004810 0x7fc9301f1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:22.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.650+0000 7fc926a00640 1 --2- 172.21.15.87:0/926262155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc93015c600 0x7fc93015ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:22.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.650+0000 7fc92fe00640 1 -- 172.21.15.87:0/926262155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc93015c600 msgr2=0x7fc93015ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:22.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.650+0000 7fc92fe00640 1 --2- 172.21.15.87:0/926262155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc93015c600 0x7fc93015ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.650+0000 7fc92fe00640 1 -- 172.21.15.87:0/926262155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc914004810 msgr2=0x7fc9301f1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:22.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.650+0000 7fc92fe00640 1 --2- 172.21.15.87:0/926262155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc914004810 0x7fc9301f1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.650+0000 7fc92fe00640 1 -- 172.21.15.87:0/926262155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc93015cf50 con 0x7fc930138d30 2024-05-27T06:28:22.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.650+0000 7fc92fe00640 1 --2- 172.21.15.87:0/926262155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc930138d30 0x7fc930139140 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc9280059b0 tx=0x7fc9280154b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:22.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.650+0000 7fc927e00640 1 -- 172.21.15.87:0/926262155 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92801c450 con 0x7fc930138d30 2024-05-27T06:28:22.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.650+0000 7fc927e00640 1 -- 172.21.15.87:0/926262155 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc92801c5f0 con 0x7fc930138d30 2024-05-27T06:28:22.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.650+0000 7fc927e00640 1 -- 172.21.15.87:0/926262155 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92801c9c0 con 0x7fc930138d30 2024-05-27T06:28:22.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.650+0000 7fc936200640 1 -- 172.21.15.87:0/926262155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9300b0de0 con 0x7fc930138d30 2024-05-27T06:28:22.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.650+0000 7fc936200640 1 -- 172.21.15.87:0/926262155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9300b13a0 con 0x7fc930138d30 2024-05-27T06:28:22.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.650+0000 7fc936200640 1 -- 172.21.15.87:0/926262155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc93006aa30 con 0x7fc930138d30 2024-05-27T06:28:22.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.654+0000 7fc927e00640 1 -- 172.21.15.87:0/926262155 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc92801a350 con 0x7fc930138d30 2024-05-27T06:28:22.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.654+0000 7fc927e00640 1 --2- 172.21.15.87:0/926262155 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc90c06f400 0x7fc90c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:22.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.654+0000 7fc927e00640 1 -- 172.21.15.87:0/926262155 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fc928096080 con 0x7fc930138d30 2024-05-27T06:28:22.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.654+0000 7fc92f400640 1 --2- 172.21.15.87:0/926262155 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc90c06f400 0x7fc90c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:22.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.654+0000 7fc92f400640 1 --2- 172.21.15.87:0/926262155 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc90c06f400 0x7fc90c071910 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc9200090e0 tx=0x7fc920008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:22.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.658+0000 7fc927e00640 1 -- 172.21.15.87:0/926262155 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fc928023070 con 0x7fc930138d30 2024-05-27T06:28:22.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.822+0000 7fc936200640 1 -- 172.21.15.87:0/926262155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fc930070de0 con 0x7fc930138d30 2024-05-27T06:28:22.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.822+0000 7fc927e00640 1 -- 172.21.15.87:0/926262155 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fc93015cf50 con 0x7fc930138d30 2024-05-27T06:28:22.820 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-05-27T06:28:22.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.826+0000 7fc936200640 1 -- 172.21.15.87:0/926262155 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc90c06f400 msgr2=0x7fc90c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:22.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.826+0000 7fc936200640 1 --2- 172.21.15.87:0/926262155 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc90c06f400 0x7fc90c071910 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc9200090e0 tx=0x7fc920008040 comp rx=0 tx=0).stop 2024-05-27T06:28:22.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.826+0000 7fc936200640 1 -- 172.21.15.87:0/926262155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc930138d30 msgr2=0x7fc930139140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:22.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.826+0000 7fc936200640 1 --2- 172.21.15.87:0/926262155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc930138d30 0x7fc930139140 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc9280059b0 tx=0x7fc9280154b0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.826+0000 7fc936200640 1 -- 172.21.15.87:0/926262155 shutdown_connections 2024-05-27T06:28:22.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.826+0000 7fc936200640 1 --2- 172.21.15.87:0/926262155 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc90c06f400 0x7fc90c071910 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.826+0000 7fc936200640 1 --2- 172.21.15.87:0/926262155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc930138d30 0x7fc930139140 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.826+0000 7fc936200640 1 --2- 172.21.15.87:0/926262155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc93015c600 0x7fc93015ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.826+0000 7fc936200640 1 --2- 172.21.15.87:0/926262155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc914004810 0x7fc9301f1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.826+0000 7fc936200640 1 -- 172.21.15.87:0/926262155 >> 172.21.15.87:0/926262155 conn(0x7fc9300b46b0 msgr2=0x7fc9300b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:22.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.826+0000 7fc936200640 1 -- 172.21.15.87:0/926262155 shutdown_connections 2024-05-27T06:28:22.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.826+0000 7fc936200640 1 -- 172.21.15.87:0/926262155 wait complete. 2024-05-27T06:28:22.846 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2024-05-27T06:28:22.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.994+0000 7fb46a600640 1 Processor -- start 2024-05-27T06:28:22.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.994+0000 7fb46a600640 1 -- start start 2024-05-27T06:28:22.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.994+0000 7fb46a600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb4640cbf90 0x7fb46406cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:22.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.994+0000 7fb46a600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb46406d500 0x7fb46415cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:22.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.994+0000 7fb46a600640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb46415d930 con 0x7fb46415d520 2024-05-27T06:28:22.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.994+0000 7fb46a600640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fb46406d910 con 0x7fb4640cbf90 2024-05-27T06:28:22.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.994+0000 7fb46a600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fb46415dbb0 con 0x7fb46406d500 2024-05-27T06:28:22.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.994+0000 7fb463400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb4640cbf90 0x7fb46406cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:22.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.994+0000 7fb463400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb4640cbf90 0x7fb46406cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34896/0 (socket says 172.21.15.87:34896) 2024-05-27T06:28:22.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.994+0000 7fb463e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb46415d520 0x7fb4640d1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57556/0 (socket says 172.21.15.87:57556) 2024-05-27T06:28:22.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.994+0000 7fb463400640 1 -- 172.21.15.87:0/3291332109 learned_addr learned my addr 172.21.15.87:0/3291332109 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:22.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.994+0000 7fb462a00640 1 --2- 172.21.15.87:0/3291332109 >> v2:172.21.15.149:3300/0 conn(0x7fb46406d500 0x7fb46415cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:22.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.998+0000 7fb463400640 1 -- 172.21.15.87:0/3291332109 >> v2:172.21.15.149:3300/0 conn(0x7fb46406d500 msgr2=0x7fb46415cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:22.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.998+0000 7fb463400640 1 --2- 172.21.15.87:0/3291332109 >> v2:172.21.15.149:3300/0 conn(0x7fb46406d500 0x7fb46415cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.998+0000 7fb463400640 1 -- 172.21.15.87:0/3291332109 >> v1:172.21.15.87:6789/0 conn(0x7fb46415d520 legacy=0x7fb4640d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:22.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.998+0000 7fb463400640 1 -- 172.21.15.87:0/3291332109 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb46415de90 con 0x7fb4640cbf90 2024-05-27T06:28:22.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.998+0000 7fb462a00640 1 --2- 172.21.15.87:0/3291332109 >> v2:172.21.15.149:3300/0 conn(0x7fb46406d500 0x7fb46415cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:22.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.998+0000 7fb462000640 1 -- 172.21.15.87:0/3291332109 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3824429360 0 0) 0x7fb45c001120 con 0x7fb46415d520 2024-05-27T06:28:22.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.998+0000 7fb463400640 1 --2- 172.21.15.87:0/3291332109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4640cbf90 0x7fb46406cfc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb4640cdc20 tx=0x7fb45401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44489e4ae63963e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:22.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.998+0000 7fb462000640 1 -- 172.21.15.87:0/3291332109 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4540b4070 con 0x7fb4640cbf90 2024-05-27T06:28:22.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.998+0000 7fb462000640 1 -- 172.21.15.87:0/3291332109 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4540af400 con 0x7fb4640cbf90 2024-05-27T06:28:22.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:22.998+0000 7fb462000640 1 -- 172.21.15.87:0/3291332109 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4540af7d0 con 0x7fb4640cbf90 2024-05-27T06:28:22.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.002+0000 7fb46a600640 1 -- 172.21.15.87:0/3291332109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4640cbf90 msgr2=0x7fb46406cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:22.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.002+0000 7fb46a600640 1 --2- 172.21.15.87:0/3291332109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4640cbf90 0x7fb46406cfc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb4640cdc20 tx=0x7fb45401f1e0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.002+0000 7fb46a600640 1 -- 172.21.15.87:0/3291332109 shutdown_connections 2024-05-27T06:28:22.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.002+0000 7fb46a600640 1 --2- 172.21.15.87:0/3291332109 >> v2:172.21.15.149:3300/0 conn(0x7fb46406d500 0x7fb46415cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.002+0000 7fb46a600640 1 --2- 172.21.15.87:0/3291332109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4640cbf90 0x7fb46406cfc0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:22.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.002+0000 7fb46a600640 1 -- 172.21.15.87:0/3291332109 >> 172.21.15.87:0/3291332109 conn(0x7fb4640b46b0 msgr2=0x7fb4640b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:22.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.002+0000 7fb46a600640 1 -- 172.21.15.87:0/3291332109 shutdown_connections 2024-05-27T06:28:22.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.002+0000 7fb46a600640 1 -- 172.21.15.87:0/3291332109 wait complete. 2024-05-27T06:28:23.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.002+0000 7fb46a600640 1 Processor -- start 2024-05-27T06:28:23.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.002+0000 7fb46a600640 1 -- start start 2024-05-27T06:28:23.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.006+0000 7fb46a600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb46406d500 0x7fb4640aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:23.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.006+0000 7fb46a600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4640cbf90 0x7fb4640c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:23.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.006+0000 7fb46a600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb46415d520 0x7fb4640c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:23.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.006+0000 7fb46a600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb46415e170 con 0x7fb4640cbf90 2024-05-27T06:28:23.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.006+0000 7fb46a600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb46406caa0 con 0x7fb46406d500 2024-05-27T06:28:23.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.006+0000 7fb46a600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb4640cc3a0 con 0x7fb46415d520 2024-05-27T06:28:23.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.006+0000 7fb462a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4640cbf90 0x7fb4640c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:23.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.006+0000 7fb462a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4640cbf90 0x7fb4640c99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34906/0 (socket says 172.21.15.87:34906) 2024-05-27T06:28:23.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.006+0000 7fb462a00640 1 -- 172.21.15.87:0/2969037816 learned_addr learned my addr 172.21.15.87:0/2969037816 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:23.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.006+0000 7fb463400640 1 --2- 172.21.15.87:0/2969037816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb46406d500 0x7fb4640aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:23.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.006+0000 7fb463e00640 1 --2- 172.21.15.87:0/2969037816 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb46415d520 0x7fb4640c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:23.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.006+0000 7fb462a00640 1 -- 172.21.15.87:0/2969037816 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb46415d520 msgr2=0x7fb4640c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:23.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.006+0000 7fb462a00640 1 --2- 172.21.15.87:0/2969037816 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb46415d520 0x7fb4640c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:23.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.006+0000 7fb462a00640 1 -- 172.21.15.87:0/2969037816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb46406d500 msgr2=0x7fb4640aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:23.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.006+0000 7fb462a00640 1 --2- 172.21.15.87:0/2969037816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb46406d500 0x7fb4640aeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:23.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.006+0000 7fb462a00640 1 -- 172.21.15.87:0/2969037816 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4640af3f0 con 0x7fb4640cbf90 2024-05-27T06:28:23.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.006+0000 7fb462a00640 1 --2- 172.21.15.87:0/2969037816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4640cbf90 0x7fb4640c99d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb45000d800 tx=0x7fb45000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:23.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.006+0000 7fb45b400640 1 -- 172.21.15.87:0/2969037816 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb450018020 con 0x7fb4640cbf90 2024-05-27T06:28:23.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.006+0000 7fb45b400640 1 -- 172.21.15.87:0/2969037816 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4500096c0 con 0x7fb4640cbf90 2024-05-27T06:28:23.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.006+0000 7fb46a600640 1 -- 172.21.15.87:0/2969037816 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4640af6d0 con 0x7fb4640cbf90 2024-05-27T06:28:23.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.006+0000 7fb45b400640 1 -- 172.21.15.87:0/2969037816 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb450009ab0 con 0x7fb4640cbf90 2024-05-27T06:28:23.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.006+0000 7fb46a600640 1 -- 172.21.15.87:0/2969037816 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4640afc90 con 0x7fb4640cbf90 2024-05-27T06:28:23.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.006+0000 7fb46a600640 1 -- 172.21.15.87:0/2969037816 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb46406aa30 con 0x7fb4640cbf90 2024-05-27T06:28:23.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.006+0000 7fb45b400640 1 -- 172.21.15.87:0/2969037816 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb45001b020 con 0x7fb4640cbf90 2024-05-27T06:28:23.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.010+0000 7fb45b400640 1 --2- 172.21.15.87:0/2969037816 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb44406f430 0x7fb444071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:23.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.010+0000 7fb45b400640 1 -- 172.21.15.87:0/2969037816 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fb45008fc30 con 0x7fb4640cbf90 2024-05-27T06:28:23.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.010+0000 7fb463400640 1 --2- 172.21.15.87:0/2969037816 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb44406f430 0x7fb444071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:23.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.010+0000 7fb463400640 1 --2- 172.21.15.87:0/2969037816 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb44406f430 0x7fb444071940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb4540b1000 tx=0x7fb4540aa000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:23.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.014+0000 7fb45b400640 1 -- 172.21.15.87:0/2969037816 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb450022020 con 0x7fb4640cbf90 2024-05-27T06:28:23.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.222+0000 7fb46a600640 1 -- 172.21.15.87:0/2969037816 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) -- 0x7fb4640b29d0 con 0x7fb4640cbf90 2024-05-27T06:28:23.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.806+0000 7fb45b400640 1 -- 172.21.15.87:0/2969037816 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v60) ==== 150+0+0 (secure 0 0 0) 0x7fb45005c010 con 0x7fb4640cbf90 2024-05-27T06:28:23.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.810+0000 7fb46a600640 1 -- 172.21.15.87:0/2969037816 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb44406f430 msgr2=0x7fb444071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:23.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.810+0000 7fb46a600640 1 --2- 172.21.15.87:0/2969037816 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb44406f430 0x7fb444071940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb4540b1000 tx=0x7fb4540aa000 comp rx=0 tx=0).stop 2024-05-27T06:28:23.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.810+0000 7fb46a600640 1 -- 172.21.15.87:0/2969037816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4640cbf90 msgr2=0x7fb4640c99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:23.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.810+0000 7fb46a600640 1 --2- 172.21.15.87:0/2969037816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4640cbf90 0x7fb4640c99d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb45000d800 tx=0x7fb45000dcc0 comp rx=0 tx=0).stop 2024-05-27T06:28:23.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.810+0000 7fb46a600640 1 -- 172.21.15.87:0/2969037816 shutdown_connections 2024-05-27T06:28:23.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.810+0000 7fb46a600640 1 --2- 172.21.15.87:0/2969037816 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb44406f430 0x7fb444071940 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:23.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.810+0000 7fb46a600640 1 --2- 172.21.15.87:0/2969037816 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb46415d520 0x7fb4640c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:23.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.810+0000 7fb46a600640 1 --2- 172.21.15.87:0/2969037816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4640cbf90 0x7fb4640c99d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:23.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.810+0000 7fb46a600640 1 --2- 172.21.15.87:0/2969037816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb46406d500 0x7fb4640aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:23.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.810+0000 7fb46a600640 1 -- 172.21.15.87:0/2969037816 >> 172.21.15.87:0/2969037816 conn(0x7fb4640b46b0 msgr2=0x7fb4640cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:23.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.810+0000 7fb46a600640 1 -- 172.21.15.87:0/2969037816 shutdown_connections 2024-05-27T06:28:23.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.810+0000 7fb46a600640 1 -- 172.21.15.87:0/2969037816 wait complete. 2024-05-27T06:28:23.827 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-27T06:28:23.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.978+0000 7efe42200640 1 Processor -- start 2024-05-27T06:28:23.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.978+0000 7efe42200640 1 -- start start 2024-05-27T06:28:23.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.978+0000 7efe42200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efe3c15c3f0 0x7efe3c15d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:23.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.978+0000 7efe42200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe3c0ce3f0 0x7efe3c06c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:23.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.982+0000 7efe42200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe3c06db10 con 0x7efe3c160740 2024-05-27T06:28:23.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.982+0000 7efe42200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7efe3c0cf2a0 con 0x7efe3c15c3f0 2024-05-27T06:28:23.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.982+0000 7efe42200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efe3c0cf580 con 0x7efe3c0ce3f0 2024-05-27T06:28:23.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.982+0000 7efe3b400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efe3c15c3f0 0x7efe3c15d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:23.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.982+0000 7efe3b400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efe3c15c3f0 0x7efe3c15d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34910/0 (socket says 172.21.15.87:34910) 2024-05-27T06:28:23.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.982+0000 7efe3b400640 1 -- 172.21.15.87:0/1763725194 learned_addr learned my addr 172.21.15.87:0/1763725194 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:23.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.982+0000 7efe3be00640 1 --2- 172.21.15.87:0/1763725194 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe3c0ce3f0 0x7efe3c06c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:23.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.982+0000 7efe3b400640 1 -- 172.21.15.87:0/1763725194 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe3c0ce3f0 msgr2=0x7efe3c06c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:23.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.982+0000 7efe3b400640 1 --2- 172.21.15.87:0/1763725194 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe3c0ce3f0 0x7efe3c06c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:23.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.982+0000 7efe3b400640 1 -- 172.21.15.87:0/1763725194 >> v1:172.21.15.149:6789/0 conn(0x7efe3c160740 legacy=0x7efe3c0cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:23.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.982+0000 7efe3b400640 1 -- 172.21.15.87:0/1763725194 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3c15ff40 con 0x7efe3c15c3f0 2024-05-27T06:28:23.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.982+0000 7efe3b400640 1 --2- 172.21.15.87:0/1763725194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3c15c3f0 0x7efe3c15d350 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efe2c006fd0 tx=0x7efe2c01e9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c18a4821b4f683b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:23.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.982+0000 7efe3aa00640 1 -- 172.21.15.87:0/1763725194 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c0ad070 con 0x7efe3c15c3f0 2024-05-27T06:28:23.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.986+0000 7efe3aa00640 1 -- 172.21.15.87:0/1763725194 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe2c004230 con 0x7efe3c15c3f0 2024-05-27T06:28:23.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.986+0000 7efe3aa00640 1 -- 172.21.15.87:0/1763725194 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c0a7650 con 0x7efe3c15c3f0 2024-05-27T06:28:23.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.986+0000 7efe42200640 1 -- 172.21.15.87:0/1763725194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3c15c3f0 msgr2=0x7efe3c15d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:23.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.986+0000 7efe42200640 1 --2- 172.21.15.87:0/1763725194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3c15c3f0 0x7efe3c15d350 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efe2c006fd0 tx=0x7efe2c01e9f0 comp rx=0 tx=0).stop 2024-05-27T06:28:23.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.986+0000 7efe42200640 1 -- 172.21.15.87:0/1763725194 shutdown_connections 2024-05-27T06:28:23.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.986+0000 7efe42200640 1 --2- 172.21.15.87:0/1763725194 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe3c0ce3f0 0x7efe3c06c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:23.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.986+0000 7efe42200640 1 --2- 172.21.15.87:0/1763725194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3c15c3f0 0x7efe3c15d350 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:23.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.986+0000 7efe42200640 1 -- 172.21.15.87:0/1763725194 >> 172.21.15.87:0/1763725194 conn(0x7efe3c0b46b0 msgr2=0x7efe3c0b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:23.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.986+0000 7efe42200640 1 -- 172.21.15.87:0/1763725194 shutdown_connections 2024-05-27T06:28:23.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.986+0000 7efe42200640 1 -- 172.21.15.87:0/1763725194 wait complete. 2024-05-27T06:28:23.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.986+0000 7efe42200640 1 Processor -- start 2024-05-27T06:28:23.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.986+0000 7efe42200640 1 -- start start 2024-05-27T06:28:23.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.990+0000 7efe42200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe3c15c3f0 0x7efe3c14a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:23.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.990+0000 7efe42200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe3c160740 0x7efe3c0b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:23.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.990+0000 7efe42200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3c15a190 0x7efe3c15a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:23.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.990+0000 7efe42200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efe3c160cd0 con 0x7efe3c15a190 2024-05-27T06:28:23.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.990+0000 7efe42200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efe3c160b50 con 0x7efe3c160740 2024-05-27T06:28:23.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.990+0000 7efe42200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efe3c169030 con 0x7efe3c15c3f0 2024-05-27T06:28:23.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.990+0000 7efe3be00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3c15a190 0x7efe3c15a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:23.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.990+0000 7efe3be00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3c15a190 0x7efe3c15a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34916/0 (socket says 172.21.15.87:34916) 2024-05-27T06:28:23.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.990+0000 7efe3be00640 1 -- 172.21.15.87:0/4170919093 learned_addr learned my addr 172.21.15.87:0/4170919093 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:23.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.990+0000 7efe3b400640 1 --2- 172.21.15.87:0/4170919093 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe3c15c3f0 0x7efe3c14a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:23.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.990+0000 7efe32a00640 1 --2- 172.21.15.87:0/4170919093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe3c160740 0x7efe3c0b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:23.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.990+0000 7efe3be00640 1 -- 172.21.15.87:0/4170919093 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe3c15c3f0 msgr2=0x7efe3c14a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:23.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.990+0000 7efe3be00640 1 --2- 172.21.15.87:0/4170919093 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe3c15c3f0 0x7efe3c14a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:23.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.990+0000 7efe3be00640 1 -- 172.21.15.87:0/4170919093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe3c160740 msgr2=0x7efe3c0b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:23.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.990+0000 7efe3be00640 1 --2- 172.21.15.87:0/4170919093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe3c160740 0x7efe3c0b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:23.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.990+0000 7efe3be00640 1 -- 172.21.15.87:0/4170919093 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3c14ab80 con 0x7efe3c15a190 2024-05-27T06:28:23.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.990+0000 7efe32a00640 1 --2- 172.21.15.87:0/4170919093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe3c160740 0x7efe3c0b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:23.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.990+0000 7efe3be00640 1 --2- 172.21.15.87:0/4170919093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3c15a190 0x7efe3c15a5a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efe34007d70 tx=0x7efe3400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:23.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.990+0000 7efe33e00640 1 -- 172.21.15.87:0/4170919093 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34014420 con 0x7efe3c15a190 2024-05-27T06:28:23.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.990+0000 7efe33e00640 1 -- 172.21.15.87:0/4170919093 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe34019070 con 0x7efe3c15a190 2024-05-27T06:28:23.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.990+0000 7efe33e00640 1 -- 172.21.15.87:0/4170919093 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34014820 con 0x7efe3c15a190 2024-05-27T06:28:23.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.990+0000 7efe42200640 1 -- 172.21.15.87:0/4170919093 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe3c15aae0 con 0x7efe3c15a190 2024-05-27T06:28:23.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.990+0000 7efe42200640 1 -- 172.21.15.87:0/4170919093 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe3c0b1b30 con 0x7efe3c15a190 2024-05-27T06:28:23.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.990+0000 7efe42200640 1 -- 172.21.15.87:0/4170919093 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe3c06aa30 con 0x7efe3c15a190 2024-05-27T06:28:23.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.994+0000 7efe33e00640 1 -- 172.21.15.87:0/4170919093 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7efe340149c0 con 0x7efe3c15a190 2024-05-27T06:28:23.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.994+0000 7efe33e00640 1 --2- 172.21.15.87:0/4170919093 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efe1806f400 0x7efe18071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:23.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.994+0000 7efe33e00640 1 -- 172.21.15.87:0/4170919093 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7efe3408ff40 con 0x7efe3c15a190 2024-05-27T06:28:23.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.994+0000 7efe3b400640 1 --2- 172.21.15.87:0/4170919093 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efe1806f400 0x7efe18071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:23.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.994+0000 7efe3b400640 1 --2- 172.21.15.87:0/4170919093 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efe1806f400 0x7efe18071910 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0b1000 tx=0x7efe2c0a9070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:23.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:23.998+0000 7efe33e00640 1 -- 172.21.15.87:0/4170919093 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7efe3c15aae0 con 0x7efe3c15a190 2024-05-27T06:28:24.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.154+0000 7efe42200640 1 -- 172.21.15.87:0/4170919093 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7efe3c0b15e0 con 0x7efe3c15a190 2024-05-27T06:28:24.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.158+0000 7efe33e00640 1 -- 172.21.15.87:0/4170919093 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7efe3405c970 con 0x7efe3c15a190 2024-05-27T06:28:24.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.162+0000 7efe42200640 1 -- 172.21.15.87:0/4170919093 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efe1806f400 msgr2=0x7efe18071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:24.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.162+0000 7efe42200640 1 --2- 172.21.15.87:0/4170919093 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efe1806f400 0x7efe18071910 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0b1000 tx=0x7efe2c0a9070 comp rx=0 tx=0).stop 2024-05-27T06:28:24.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.162+0000 7efe42200640 1 -- 172.21.15.87:0/4170919093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3c15a190 msgr2=0x7efe3c15a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:24.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.162+0000 7efe42200640 1 --2- 172.21.15.87:0/4170919093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3c15a190 0x7efe3c15a5a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efe34007d70 tx=0x7efe3400e4b0 comp rx=0 tx=0).stop 2024-05-27T06:28:24.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.162+0000 7efe42200640 1 -- 172.21.15.87:0/4170919093 shutdown_connections 2024-05-27T06:28:24.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.162+0000 7efe42200640 1 --2- 172.21.15.87:0/4170919093 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efe1806f400 0x7efe18071910 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:24.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.162+0000 7efe42200640 1 --2- 172.21.15.87:0/4170919093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3c15a190 0x7efe3c15a5a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:24.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.162+0000 7efe42200640 1 --2- 172.21.15.87:0/4170919093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe3c160740 0x7efe3c0b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:24.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.162+0000 7efe42200640 1 --2- 172.21.15.87:0/4170919093 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe3c15c3f0 0x7efe3c14a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:24.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.162+0000 7efe42200640 1 -- 172.21.15.87:0/4170919093 >> 172.21.15.87:0/4170919093 conn(0x7efe3c0b46b0 msgr2=0x7efe3c072bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:24.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.162+0000 7efe42200640 1 -- 172.21.15.87:0/4170919093 shutdown_connections 2024-05-27T06:28:24.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.162+0000 7efe42200640 1 -- 172.21.15.87:0/4170919093 wait complete. 2024-05-27T06:28:24.179 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-27T06:28:24.179 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-27T06:28:24.268 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-27T06:28:24.324 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-27T06:28:24.324 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:28:24.324 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:28:24.332 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:28:24.332 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:28:24.381 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T06:28:24.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.578+0000 7f3d57200640 1 Processor -- start 2024-05-27T06:28:24.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.578+0000 7f3d57200640 1 -- start start 2024-05-27T06:28:24.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.578+0000 7f3d57200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d500b57a0 0x7f3d501643b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:24.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.578+0000 7f3d57200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3d501648f0 0x7f3d50166d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:24.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.578+0000 7f3d57200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d5006f140 con 0x7f3d500cf4e0 2024-05-27T06:28:24.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.578+0000 7f3d57200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f3d5006fd50 con 0x7f3d501648f0 2024-05-27T06:28:24.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.578+0000 7f3d57200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3d5006f420 con 0x7f3d500b57a0 2024-05-27T06:28:24.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.578+0000 7f3d55400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d500b57a0 0x7f3d501643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:24.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.578+0000 7f3d55e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f3d500cf4e0 0x7f3d500cf8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.87:57148/0 (socket says 172.21.15.87:57148) 2024-05-27T06:28:24.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.578+0000 7f3d55e00640 1 -- 172.21.15.87:0/1743942653 learned_addr learned my addr 172.21.15.87:0/1743942653 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:24.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.578+0000 7f3d55400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d500b57a0 0x7f3d501643b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.87:39676/0 (socket says 172.21.15.87:39676) 2024-05-27T06:28:24.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.578+0000 7f3d56800640 1 --2- 172.21.15.87:0/1743942653 >> v2:172.21.15.149:3300/0 conn(0x7f3d501648f0 0x7f3d50166d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:24.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.578+0000 7f3d54a00640 1 -- 172.21.15.87:0/1743942653 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1514354638 0 0) 0x7f3d5006f140 con 0x7f3d500cf4e0 2024-05-27T06:28:24.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.578+0000 7f3d54a00640 1 -- 172.21.15.87:0/1743942653 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d38003530 con 0x7f3d500cf4e0 2024-05-27T06:28:24.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.578+0000 7f3d55400640 1 -- 172.21.15.87:0/1743942653 >> v2:172.21.15.149:3300/0 conn(0x7f3d501648f0 msgr2=0x7f3d50166d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:24.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.578+0000 7f3d55400640 1 --2- 172.21.15.87:0/1743942653 >> v2:172.21.15.149:3300/0 conn(0x7f3d501648f0 0x7f3d50166d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:24.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.578+0000 7f3d55400640 1 -- 172.21.15.87:0/1743942653 >> v1:172.21.15.149:6789/0 conn(0x7f3d500cf4e0 legacy=0x7f3d500cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:24.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.578+0000 7f3d55400640 1 -- 172.21.15.87:0/1743942653 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d5006f700 con 0x7f3d500b57a0 2024-05-27T06:28:24.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.578+0000 7f3d56800640 1 --2- 172.21.15.87:0/1743942653 >> v2:172.21.15.149:3300/0 conn(0x7f3d501648f0 0x7f3d50166d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:28:24.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.582+0000 7f3d55400640 1 --2- 172.21.15.87:0/1743942653 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d500b57a0 0x7f3d501643b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3d400097c0 tx=0x7f3d4001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9a67748592c66ac server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:24.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.582+0000 7f3d54a00640 1 -- 172.21.15.87:0/1743942653 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d400b0070 con 0x7f3d500b57a0 2024-05-27T06:28:24.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.582+0000 7f3d54a00640 1 -- 172.21.15.87:0/1743942653 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d400ab600 con 0x7f3d500b57a0 2024-05-27T06:28:24.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.582+0000 7f3d54a00640 1 -- 172.21.15.87:0/1743942653 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d400ab9d0 con 0x7f3d500b57a0 2024-05-27T06:28:24.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.582+0000 7f3d57200640 1 -- 172.21.15.87:0/1743942653 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d500b57a0 msgr2=0x7f3d501643b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:24.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.582+0000 7f3d57200640 1 --2- 172.21.15.87:0/1743942653 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d500b57a0 0x7f3d501643b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3d400097c0 tx=0x7f3d4001c470 comp rx=0 tx=0).stop 2024-05-27T06:28:24.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.582+0000 7f3d57200640 1 -- 172.21.15.87:0/1743942653 shutdown_connections 2024-05-27T06:28:24.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.582+0000 7f3d57200640 1 --2- 172.21.15.87:0/1743942653 >> v2:172.21.15.149:3300/0 conn(0x7f3d501648f0 0x7f3d50166d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:24.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.582+0000 7f3d57200640 1 --2- 172.21.15.87:0/1743942653 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d500b57a0 0x7f3d501643b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:24.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.582+0000 7f3d57200640 1 -- 172.21.15.87:0/1743942653 >> 172.21.15.87:0/1743942653 conn(0x7f3d500b3d80 msgr2=0x7f3d500d1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:24.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.582+0000 7f3d57200640 1 -- 172.21.15.87:0/1743942653 shutdown_connections 2024-05-27T06:28:24.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.582+0000 7f3d57200640 1 -- 172.21.15.87:0/1743942653 wait complete. 2024-05-27T06:28:24.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.586+0000 7f3d57200640 1 Processor -- start 2024-05-27T06:28:24.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.586+0000 7f3d57200640 1 -- start start 2024-05-27T06:28:24.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.586+0000 7f3d57200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d500b57a0 0x7f3d50141080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:24.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.586+0000 7f3d57200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d500cf4e0 0x7f3d50164d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:24.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.586+0000 7f3d57200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d501648f0 0x7f3d50151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:24.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.586+0000 7f3d57200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5006eee0 con 0x7f3d500b57a0 2024-05-27T06:28:24.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.586+0000 7f3d57200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5006ed60 con 0x7f3d501648f0 2024-05-27T06:28:24.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.586+0000 7f3d57200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3d500d0000 con 0x7f3d500cf4e0 2024-05-27T06:28:24.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.586+0000 7f3d55e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d500b57a0 0x7f3d50141080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:24.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.586+0000 7f3d55e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d500b57a0 0x7f3d50141080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34932/0 (socket says 172.21.15.87:34932) 2024-05-27T06:28:24.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.586+0000 7f3d55e00640 1 -- 172.21.15.87:0/830768750 learned_addr learned my addr 172.21.15.87:0/830768750 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:24.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.590+0000 7f3d55400640 1 --2- 172.21.15.87:0/830768750 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d500cf4e0 0x7f3d50164d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:24.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.590+0000 7f3d56800640 1 --2- 172.21.15.87:0/830768750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d501648f0 0x7f3d50151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:24.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.590+0000 7f3d55e00640 1 -- 172.21.15.87:0/830768750 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d500cf4e0 msgr2=0x7f3d50164d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:24.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.590+0000 7f3d55e00640 1 --2- 172.21.15.87:0/830768750 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d500cf4e0 0x7f3d50164d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:24.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.590+0000 7f3d55e00640 1 -- 172.21.15.87:0/830768750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d501648f0 msgr2=0x7f3d50151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:24.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.590+0000 7f3d55e00640 1 --2- 172.21.15.87:0/830768750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d501648f0 0x7f3d50151520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:24.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.590+0000 7f3d55e00640 1 -- 172.21.15.87:0/830768750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d50069d40 con 0x7f3d500b57a0 2024-05-27T06:28:24.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.590+0000 7f3d55400640 1 --2- 172.21.15.87:0/830768750 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d500cf4e0 0x7f3d50164d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:24.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.590+0000 7f3d55e00640 1 --2- 172.21.15.87:0/830768750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d500b57a0 0x7f3d50141080 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400c400 tx=0x7f3d4400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:24.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.590+0000 7f3d4a000640 1 -- 172.21.15.87:0/830768750 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d44017070 con 0x7f3d500b57a0 2024-05-27T06:28:24.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.590+0000 7f3d4a000640 1 -- 172.21.15.87:0/830768750 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d44005cf0 con 0x7f3d500b57a0 2024-05-27T06:28:24.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.590+0000 7f3d57200640 1 -- 172.21.15.87:0/830768750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d50156b10 con 0x7f3d500b57a0 2024-05-27T06:28:24.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.590+0000 7f3d4a000640 1 -- 172.21.15.87:0/830768750 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d440072f0 con 0x7f3d500b57a0 2024-05-27T06:28:24.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.590+0000 7f3d57200640 1 -- 172.21.15.87:0/830768750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d501570d0 con 0x7f3d500b57a0 2024-05-27T06:28:24.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.590+0000 7f3d57200640 1 -- 172.21.15.87:0/830768750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d500508e0 con 0x7f3d500b57a0 2024-05-27T06:28:24.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.590+0000 7f3d4a000640 1 -- 172.21.15.87:0/830768750 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3d4401a070 con 0x7f3d500b57a0 2024-05-27T06:28:24.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.594+0000 7f3d4a000640 1 --2- 172.21.15.87:0/830768750 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3d3406f400 0x7f3d34071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:24.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.594+0000 7f3d4a000640 1 -- 172.21.15.87:0/830768750 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f3d4408ea50 con 0x7f3d500b57a0 2024-05-27T06:28:24.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.594+0000 7f3d55400640 1 --2- 172.21.15.87:0/830768750 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3d3406f400 0x7f3d34071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:24.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.594+0000 7f3d55400640 1 --2- 172.21.15.87:0/830768750 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3d3406f400 0x7f3d34071910 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3d400ad000 tx=0x7f3d40008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:24.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.598+0000 7f3d4a000640 1 -- 172.21.15.87:0/830768750 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f3d4405aed0 con 0x7f3d500b57a0 2024-05-27T06:28:24.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.766+0000 7f3d57200640 1 -- 172.21.15.87:0/830768750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3d500cfbd0 con 0x7f3d500b57a0 2024-05-27T06:28:24.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.766+0000 7f3d4a000640 1 -- 172.21.15.87:0/830768750 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f3d4405f1d0 con 0x7f3d500b57a0 2024-05-27T06:28:24.831 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2024-05-27T06:28:24.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.770+0000 7f3d57200640 1 -- 172.21.15.87:0/830768750 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3d3406f400 msgr2=0x7f3d34071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:24.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.770+0000 7f3d57200640 1 --2- 172.21.15.87:0/830768750 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3d3406f400 0x7f3d34071910 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3d400ad000 tx=0x7f3d40008040 comp rx=0 tx=0).stop 2024-05-27T06:28:24.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.770+0000 7f3d57200640 1 -- 172.21.15.87:0/830768750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d500b57a0 msgr2=0x7f3d50141080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:24.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.770+0000 7f3d57200640 1 --2- 172.21.15.87:0/830768750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d500b57a0 0x7f3d50141080 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400c400 tx=0x7f3d4400c8c0 comp rx=0 tx=0).stop 2024-05-27T06:28:24.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.770+0000 7f3d57200640 1 -- 172.21.15.87:0/830768750 shutdown_connections 2024-05-27T06:28:24.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.770+0000 7f3d57200640 1 --2- 172.21.15.87:0/830768750 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3d3406f400 0x7f3d34071910 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:24.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.770+0000 7f3d57200640 1 --2- 172.21.15.87:0/830768750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d501648f0 0x7f3d50151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:24.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.770+0000 7f3d57200640 1 --2- 172.21.15.87:0/830768750 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d500cf4e0 0x7f3d50164d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:24.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.770+0000 7f3d57200640 1 --2- 172.21.15.87:0/830768750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d500b57a0 0x7f3d50141080 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:24.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.770+0000 7f3d57200640 1 -- 172.21.15.87:0/830768750 >> 172.21.15.87:0/830768750 conn(0x7f3d500b3d80 msgr2=0x7f3d500d03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:24.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.770+0000 7f3d57200640 1 -- 172.21.15.87:0/830768750 shutdown_connections 2024-05-27T06:28:24.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:24.770+0000 7f3d57200640 1 -- 172.21.15.87:0/830768750 wait complete. 2024-05-27T06:28:24.835 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:28:24.835 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:28:24.843 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T06:28:25.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.034+0000 7f76ab000640 1 Processor -- start 2024-05-27T06:28:25.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.034+0000 7f76ab000640 1 -- start start 2024-05-27T06:28:25.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.038+0000 7f76ab000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f76a40aec30 0x7f76a40702b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:25.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.038+0000 7f76ab000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f76a406c720 0x7f76a406cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:25.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.038+0000 7f76ab000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76a406fe20 con 0x7f76a406efc0 2024-05-27T06:28:25.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.038+0000 7f76ab000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f76a40b0ba0 con 0x7f76a40aec30 2024-05-27T06:28:25.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.038+0000 7f76ab000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f76a415ef50 con 0x7f76a406c720 2024-05-27T06:28:25.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.038+0000 7f76a3e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f76a40aec30 0x7f76a40702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:25.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.038+0000 7f76a3e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f76a40aec30 0x7f76a40702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50792/0 (socket says 172.21.15.87:50792) 2024-05-27T06:28:25.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.038+0000 7f76a3e00640 1 -- 172.21.15.87:0/1742254502 learned_addr learned my addr 172.21.15.87:0/1742254502 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:25.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.038+0000 7f76a9000640 1 --2- 172.21.15.87:0/1742254502 >> v2:172.21.15.149:3300/0 conn(0x7f76a406c720 0x7f76a406cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:25.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.038+0000 7f76a3e00640 1 -- 172.21.15.87:0/1742254502 >> v2:172.21.15.149:3300/0 conn(0x7f76a406c720 msgr2=0x7f76a406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:25.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.038+0000 7f76a3e00640 1 --2- 172.21.15.87:0/1742254502 >> v2:172.21.15.149:3300/0 conn(0x7f76a406c720 0x7f76a406cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:25.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.038+0000 7f76a3e00640 1 -- 172.21.15.87:0/1742254502 >> v1:172.21.15.87:6789/0 conn(0x7f76a406efc0 legacy=0x7f76a406f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:25.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.038+0000 7f76a3e00640 1 -- 172.21.15.87:0/1742254502 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a40b08c0 con 0x7f76a40aec30 2024-05-27T06:28:25.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.038+0000 7f76a3e00640 1 --2- 172.21.15.87:0/1742254502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76a40aec30 0x7f76a40702b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f76a40afb20 tx=0x7f769401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd3cbc68c823852 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:25.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.038+0000 7f76a3400640 1 -- 172.21.15.87:0/1742254502 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76940b1070 con 0x7f76a40aec30 2024-05-27T06:28:25.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.042+0000 7f76a3400640 1 -- 172.21.15.87:0/1742254502 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76940ac640 con 0x7f76a40aec30 2024-05-27T06:28:25.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.042+0000 7f76a3400640 1 -- 172.21.15.87:0/1742254502 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76940aca10 con 0x7f76a40aec30 2024-05-27T06:28:25.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.042+0000 7f76ab000640 1 -- 172.21.15.87:0/1742254502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76a40aec30 msgr2=0x7f76a40702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:25.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.042+0000 7f76ab000640 1 --2- 172.21.15.87:0/1742254502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76a40aec30 0x7f76a40702b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f76a40afb20 tx=0x7f769401c400 comp rx=0 tx=0).stop 2024-05-27T06:28:25.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.042+0000 7f76ab000640 1 -- 172.21.15.87:0/1742254502 shutdown_connections 2024-05-27T06:28:25.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.042+0000 7f76ab000640 1 --2- 172.21.15.87:0/1742254502 >> v2:172.21.15.149:3300/0 conn(0x7f76a406c720 0x7f76a406cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:25.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.042+0000 7f76ab000640 1 --2- 172.21.15.87:0/1742254502 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76a40aec30 0x7f76a40702b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:25.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.042+0000 7f76ab000640 1 -- 172.21.15.87:0/1742254502 >> 172.21.15.87:0/1742254502 conn(0x7f76a40b2fb0 msgr2=0x7f76a40b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:25.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.042+0000 7f76ab000640 1 -- 172.21.15.87:0/1742254502 shutdown_connections 2024-05-27T06:28:25.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.042+0000 7f76ab000640 1 -- 172.21.15.87:0/1742254502 wait complete. 2024-05-27T06:28:25.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.042+0000 7f76ab000640 1 Processor -- start 2024-05-27T06:28:25.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.042+0000 7f76ab000640 1 -- start start 2024-05-27T06:28:25.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.046+0000 7f76ab000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76a406c720 0x7f76a40737d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:25.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.046+0000 7f76ab000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76a406efc0 0x7f76a409aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:25.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.046+0000 7f76ab000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76a40aec30 0x7f76a41f94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:25.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.046+0000 7f76ab000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f76a406e0c0 con 0x7f76a406efc0 2024-05-27T06:28:25.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.046+0000 7f76ab000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f76a406df40 con 0x7f76a406c720 2024-05-27T06:28:25.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.046+0000 7f76ab000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f76a406d070 con 0x7f76a40aec30 2024-05-27T06:28:25.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.046+0000 7f769b400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76a406efc0 0x7f76a409aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:25.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.046+0000 7f769b400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76a406efc0 0x7f76a409aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50796/0 (socket says 172.21.15.87:50796) 2024-05-27T06:28:25.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.046+0000 7f769b400640 1 -- 172.21.15.87:0/1612722969 learned_addr learned my addr 172.21.15.87:0/1612722969 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:25.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.046+0000 7f76a3e00640 1 --2- 172.21.15.87:0/1612722969 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76a406c720 0x7f76a40737d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:25.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.046+0000 7f76a9000640 1 --2- 172.21.15.87:0/1612722969 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76a40aec30 0x7f76a41f94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:25.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.046+0000 7f769b400640 1 -- 172.21.15.87:0/1612722969 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76a40aec30 msgr2=0x7f76a41f94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:25.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.046+0000 7f769b400640 1 --2- 172.21.15.87:0/1612722969 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76a40aec30 0x7f76a41f94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:25.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.046+0000 7f769b400640 1 -- 172.21.15.87:0/1612722969 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76a406c720 msgr2=0x7f76a40737d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:25.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.046+0000 7f769b400640 1 --2- 172.21.15.87:0/1612722969 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76a406c720 0x7f76a40737d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:25.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.046+0000 7f769b400640 1 -- 172.21.15.87:0/1612722969 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a4150bb0 con 0x7f76a406efc0 2024-05-27T06:28:25.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.046+0000 7f76a9000640 1 --2- 172.21.15.87:0/1612722969 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76a40aec30 0x7f76a41f94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:25.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.046+0000 7f769b400640 1 --2- 172.21.15.87:0/1612722969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76a406efc0 0x7f76a409aa60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f768c00c3f0 tx=0x7f768c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:25.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.046+0000 7f76a0c00640 1 -- 172.21.15.87:0/1612722969 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f768c017070 con 0x7f76a406efc0 2024-05-27T06:28:25.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.046+0000 7f76a0c00640 1 -- 172.21.15.87:0/1612722969 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f768c0052d0 con 0x7f76a406efc0 2024-05-27T06:28:25.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.046+0000 7f76ab000640 1 -- 172.21.15.87:0/1612722969 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76a4156e00 con 0x7f76a406efc0 2024-05-27T06:28:25.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.046+0000 7f76a0c00640 1 -- 172.21.15.87:0/1612722969 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f768c003840 con 0x7f76a406efc0 2024-05-27T06:28:25.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.046+0000 7f76ab000640 1 -- 172.21.15.87:0/1612722969 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76a41573c0 con 0x7f76a406efc0 2024-05-27T06:28:25.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.046+0000 7f76ab000640 1 -- 172.21.15.87:0/1612722969 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76a409f130 con 0x7f76a406efc0 2024-05-27T06:28:25.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.050+0000 7f76a0c00640 1 -- 172.21.15.87:0/1612722969 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f768c01a070 con 0x7f76a406efc0 2024-05-27T06:28:25.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.050+0000 7f76a0c00640 1 --2- 172.21.15.87:0/1612722969 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f768006f400 0x7f7680071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:25.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.050+0000 7f76a0c00640 1 -- 172.21.15.87:0/1612722969 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f768c08e9e0 con 0x7f76a406efc0 2024-05-27T06:28:25.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.050+0000 7f76a3e00640 1 --2- 172.21.15.87:0/1612722969 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f768006f400 0x7f7680071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:25.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.050+0000 7f76a3e00640 1 --2- 172.21.15.87:0/1612722969 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f768006f400 0x7f7680071910 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f76940ae000 tx=0x7f7694008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:25.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.054+0000 7f76a0c00640 1 -- 172.21.15.87:0/1612722969 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f768c005480 con 0x7f76a406efc0 2024-05-27T06:28:25.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.222+0000 7f76ab000640 1 -- 172.21.15.87:0/1612722969 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f76a406aa30 con 0x7f76a406efc0 2024-05-27T06:28:25.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.222+0000 7f76a0c00640 1 -- 172.21.15.87:0/1612722969 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f768c001090 con 0x7f76a406efc0 2024-05-27T06:28:25.221 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2024-05-27T06:28:25.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.226+0000 7f76ab000640 1 -- 172.21.15.87:0/1612722969 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f768006f400 msgr2=0x7f7680071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:25.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.226+0000 7f76ab000640 1 --2- 172.21.15.87:0/1612722969 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f768006f400 0x7f7680071910 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f76940ae000 tx=0x7f7694008040 comp rx=0 tx=0).stop 2024-05-27T06:28:25.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.226+0000 7f76ab000640 1 -- 172.21.15.87:0/1612722969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76a406efc0 msgr2=0x7f76a409aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:25.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.226+0000 7f76ab000640 1 --2- 172.21.15.87:0/1612722969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76a406efc0 0x7f76a409aa60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f768c00c3f0 tx=0x7f768c00c8b0 comp rx=0 tx=0).stop 2024-05-27T06:28:25.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.226+0000 7f76ab000640 1 -- 172.21.15.87:0/1612722969 shutdown_connections 2024-05-27T06:28:25.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.226+0000 7f76ab000640 1 --2- 172.21.15.87:0/1612722969 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f768006f400 0x7f7680071910 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:25.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.226+0000 7f76ab000640 1 --2- 172.21.15.87:0/1612722969 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76a40aec30 0x7f76a41f94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:25.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.226+0000 7f76ab000640 1 --2- 172.21.15.87:0/1612722969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76a406efc0 0x7f76a409aa60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:25.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.226+0000 7f76ab000640 1 --2- 172.21.15.87:0/1612722969 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76a406c720 0x7f76a40737d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:25.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.226+0000 7f76ab000640 1 -- 172.21.15.87:0/1612722969 >> 172.21.15.87:0/1612722969 conn(0x7f76a40b2fb0 msgr2=0x7f76a40b24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:25.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.226+0000 7f76ab000640 1 -- 172.21.15.87:0/1612722969 shutdown_connections 2024-05-27T06:28:25.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.226+0000 7f76ab000640 1 -- 172.21.15.87:0/1612722969 wait complete. 2024-05-27T06:28:25.243 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-05-27T06:28:25.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:25.243 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-27T06:28:25.264 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:28:25.264 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-05-27T06:28:25.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:25.264 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-27T06:28:25.314 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:28:25.314 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:28:25.324 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:28:25.324 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:28:25.374 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T06:28:25.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.522+0000 7f4f13a00640 1 Processor -- start 2024-05-27T06:28:25.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.522+0000 7f4f13a00640 1 -- start start 2024-05-27T06:28:25.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.526+0000 7f4f13a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4f0c0b4250 0x7f4f0c0d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:25.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.526+0000 7f4f13a00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f0c0d2250 con 0x7f4f0c0d17d0 2024-05-27T06:28:25.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.526+0000 7f4f13a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f0c0d2530 con 0x7f4f0c06ea70 2024-05-27T06:28:25.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.526+0000 7f4f13a00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f4f0c0d2810 con 0x7f4f0c0b4250 2024-05-27T06:28:25.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.526+0000 7f4f11a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4f0c0b4250 0x7f4f0c0d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:25.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.526+0000 7f4f11a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4f0c0b4250 0x7f4f0c0d1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50800/0 (socket says 172.21.15.87:50800) 2024-05-27T06:28:25.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.526+0000 7f4f11a00640 1 -- 172.21.15.87:0/1960678560 learned_addr learned my addr 172.21.15.87:0/1960678560 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:25.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.526+0000 7f4f11a00640 1 -- 172.21.15.87:0/1960678560 >> v1:172.21.15.149:6789/0 conn(0x7f4f0c06ea70 legacy=0x7f4f0c15d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:25.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.526+0000 7f4f11a00640 1 -- 172.21.15.87:0/1960678560 >> v1:172.21.15.87:6789/0 conn(0x7f4f0c0d17d0 legacy=0x7f4f0c06e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:25.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.526+0000 7f4f11a00640 1 -- 172.21.15.87:0/1960678560 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f0c0d2af0 con 0x7f4f0c0b4250 2024-05-27T06:28:25.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.530+0000 7f4f11a00640 1 --2- 172.21.15.87:0/1960678560 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f0c0b4250 0x7f4f0c0d1be0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4f04009e50 tx=0x7f4f0401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc37d8dc7c215a16 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:25.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.530+0000 7f4f0be00640 1 -- 172.21.15.87:0/1960678560 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f040a5770 con 0x7f4f0c0b4250 2024-05-27T06:28:25.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.530+0000 7f4f0be00640 1 -- 172.21.15.87:0/1960678560 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f040a5910 con 0x7f4f0c0b4250 2024-05-27T06:28:25.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.530+0000 7f4f0be00640 1 -- 172.21.15.87:0/1960678560 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f040a5ce0 con 0x7f4f0c0b4250 2024-05-27T06:28:25.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.530+0000 7f4f13a00640 1 -- 172.21.15.87:0/1960678560 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f0c0b4250 msgr2=0x7f4f0c0d1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:25.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.530+0000 7f4f13a00640 1 --2- 172.21.15.87:0/1960678560 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f0c0b4250 0x7f4f0c0d1be0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4f04009e50 tx=0x7f4f0401c9a0 comp rx=0 tx=0).stop 2024-05-27T06:28:25.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.530+0000 7f4f13a00640 1 -- 172.21.15.87:0/1960678560 shutdown_connections 2024-05-27T06:28:25.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.530+0000 7f4f13a00640 1 --2- 172.21.15.87:0/1960678560 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f0c0b4250 0x7f4f0c0d1be0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:25.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.530+0000 7f4f13a00640 1 -- 172.21.15.87:0/1960678560 >> 172.21.15.87:0/1960678560 conn(0x7f4f0c0d3570 msgr2=0x7f4f0c0d3980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:25.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.530+0000 7f4f13a00640 1 -- 172.21.15.87:0/1960678560 shutdown_connections 2024-05-27T06:28:25.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.530+0000 7f4f13a00640 1 -- 172.21.15.87:0/1960678560 wait complete. 2024-05-27T06:28:25.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.534+0000 7f4f13a00640 1 Processor -- start 2024-05-27T06:28:25.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.534+0000 7f4f13a00640 1 -- start start 2024-05-27T06:28:25.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.534+0000 7f4f13a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f0c0b4250 0x7f4f0c15b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:25.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.534+0000 7f4f13a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f0c0d17d0 0x7f4f0c156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:25.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.534+0000 7f4f13a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f0c15cc50 0x7f4f0c15d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:25.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.534+0000 7f4f13a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4f0c16e600 con 0x7f4f0c15cc50 2024-05-27T06:28:25.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.534+0000 7f4f13a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4f0c15def0 con 0x7f4f0c0d17d0 2024-05-27T06:28:25.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.534+0000 7f4f13a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4f0c16e780 con 0x7f4f0c0b4250 2024-05-27T06:28:25.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.534+0000 7f4f11a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f0c15cc50 0x7f4f0c15d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:25.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.534+0000 7f4f11a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f0c15cc50 0x7f4f0c15d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50808/0 (socket says 172.21.15.87:50808) 2024-05-27T06:28:25.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.534+0000 7f4f11a00640 1 -- 172.21.15.87:0/1681217330 learned_addr learned my addr 172.21.15.87:0/1681217330 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:25.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.534+0000 7f4f11000640 1 --2- 172.21.15.87:0/1681217330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f0c0b4250 0x7f4f0c15b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:25.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.534+0000 7f4f03e00640 1 --2- 172.21.15.87:0/1681217330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f0c0d17d0 0x7f4f0c156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:25.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.534+0000 7f4f11a00640 1 -- 172.21.15.87:0/1681217330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f0c0b4250 msgr2=0x7f4f0c15b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:25.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.534+0000 7f4f11a00640 1 --2- 172.21.15.87:0/1681217330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f0c0b4250 0x7f4f0c15b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:25.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.534+0000 7f4f11a00640 1 -- 172.21.15.87:0/1681217330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f0c0d17d0 msgr2=0x7f4f0c156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:25.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.534+0000 7f4f11a00640 1 --2- 172.21.15.87:0/1681217330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f0c0d17d0 0x7f4f0c156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:25.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.534+0000 7f4f11a00640 1 -- 172.21.15.87:0/1681217330 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f0c15d5a0 con 0x7f4f0c15cc50 2024-05-27T06:28:25.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.534+0000 7f4f11a00640 1 --2- 172.21.15.87:0/1681217330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f0c15cc50 0x7f4f0c15d060 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4f040af040 tx=0x7f4f04019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:25.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.534+0000 7f4f09600640 1 -- 172.21.15.87:0/1681217330 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f040b8470 con 0x7f4f0c15cc50 2024-05-27T06:28:25.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.534+0000 7f4f09600640 1 -- 172.21.15.87:0/1681217330 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f040b8630 con 0x7f4f0c15cc50 2024-05-27T06:28:25.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.534+0000 7f4f13a00640 1 -- 172.21.15.87:0/1681217330 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f0c156120 con 0x7f4f0c15cc50 2024-05-27T06:28:25.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.534+0000 7f4f09600640 1 -- 172.21.15.87:0/1681217330 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f040b8a20 con 0x7f4f0c15cc50 2024-05-27T06:28:25.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.534+0000 7f4f13a00640 1 -- 172.21.15.87:0/1681217330 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f0c1fd3f0 con 0x7f4f0c15cc50 2024-05-27T06:28:25.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.538+0000 7f4f13a00640 1 -- 172.21.15.87:0/1681217330 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f0c06aa30 con 0x7f4f0c15cc50 2024-05-27T06:28:25.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.538+0000 7f4f09600640 1 -- 172.21.15.87:0/1681217330 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4f040c0020 con 0x7f4f0c15cc50 2024-05-27T06:28:25.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.538+0000 7f4f09600640 1 --2- 172.21.15.87:0/1681217330 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f4ee806f430 0x7f4ee8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:25.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.538+0000 7f4f09600640 1 -- 172.21.15.87:0/1681217330 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f4f0412adc0 con 0x7f4f0c15cc50 2024-05-27T06:28:25.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.538+0000 7f4f11000640 1 --2- 172.21.15.87:0/1681217330 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f4ee806f430 0x7f4ee8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:25.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.538+0000 7f4f11000640 1 --2- 172.21.15.87:0/1681217330 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f4ee806f430 0x7f4ee8071940 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4efc007fd0 tx=0x7f4efc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:25.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.542+0000 7f4f09600640 1 -- 172.21.15.87:0/1681217330 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f4f0c15d5a0 con 0x7f4f0c15cc50 2024-05-27T06:28:25.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.714+0000 7f4f13a00640 1 -- 172.21.15.87:0/1681217330 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4f0c0d15b0 con 0x7f4f0c15cc50 2024-05-27T06:28:25.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.714+0000 7f4f09600640 1 -- 172.21.15.87:0/1681217330 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f4f04016620 con 0x7f4f0c15cc50 2024-05-27T06:28:25.711 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2024-05-27T06:28:25.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.714+0000 7f4f13a00640 1 -- 172.21.15.87:0/1681217330 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f4ee806f430 msgr2=0x7f4ee8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:25.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.714+0000 7f4f13a00640 1 --2- 172.21.15.87:0/1681217330 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f4ee806f430 0x7f4ee8071940 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4efc007fd0 tx=0x7f4efc009040 comp rx=0 tx=0).stop 2024-05-27T06:28:25.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.714+0000 7f4f13a00640 1 -- 172.21.15.87:0/1681217330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f0c15cc50 msgr2=0x7f4f0c15d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:25.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.714+0000 7f4f13a00640 1 --2- 172.21.15.87:0/1681217330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f0c15cc50 0x7f4f0c15d060 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4f040af040 tx=0x7f4f04019740 comp rx=0 tx=0).stop 2024-05-27T06:28:25.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.714+0000 7f4f13a00640 1 -- 172.21.15.87:0/1681217330 shutdown_connections 2024-05-27T06:28:25.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.714+0000 7f4f13a00640 1 --2- 172.21.15.87:0/1681217330 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f4ee806f430 0x7f4ee8071940 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:25.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.714+0000 7f4f13a00640 1 --2- 172.21.15.87:0/1681217330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f0c15cc50 0x7f4f0c15d060 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:25.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.714+0000 7f4f13a00640 1 --2- 172.21.15.87:0/1681217330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f0c0d17d0 0x7f4f0c156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:25.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.714+0000 7f4f13a00640 1 --2- 172.21.15.87:0/1681217330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f0c0b4250 0x7f4f0c15b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:25.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.714+0000 7f4f13a00640 1 -- 172.21.15.87:0/1681217330 >> 172.21.15.87:0/1681217330 conn(0x7f4f0c0d3570 msgr2=0x7f4f0c0b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:25.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.714+0000 7f4f13a00640 1 -- 172.21.15.87:0/1681217330 shutdown_connections 2024-05-27T06:28:25.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.714+0000 7f4f13a00640 1 -- 172.21.15.87:0/1681217330 wait complete. 2024-05-27T06:28:25.733 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:28:25.733 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:28:25.743 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T06:28:25.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.894+0000 7fda9c400640 1 Processor -- start 2024-05-27T06:28:25.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.894+0000 7fda9c400640 1 -- start start 2024-05-27T06:28:25.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.894+0000 7fda9c400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fda9415deb0 0x7fda94163860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:25.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.894+0000 7fda9c400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fda94163da0 0x7fda94162820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:25.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.894+0000 7fda9c400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda94162d60 0x7fda94163170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:25.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.894+0000 7fda9c400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fda94162390 con 0x7fda94163da0 2024-05-27T06:28:25.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.894+0000 7fda9c400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fda941641b0 con 0x7fda9415deb0 2024-05-27T06:28:25.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.894+0000 7fda9c400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fda94161780 con 0x7fda94162d60 2024-05-27T06:28:25.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.894+0000 7fda99000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fda94163da0 0x7fda94162820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:25.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.894+0000 7fda99000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fda94163da0 0x7fda94162820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50818/0 (socket says 172.21.15.87:50818) 2024-05-27T06:28:25.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.894+0000 7fda99000640 1 -- 172.21.15.87:0/3985727472 learned_addr learned my addr 172.21.15.87:0/3985727472 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:25.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.894+0000 7fda9a400640 1 --2- 172.21.15.87:0/3985727472 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda94162d60 0x7fda94163170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:25.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.894+0000 7fda99a00640 1 --2- 172.21.15.87:0/3985727472 >> v2:172.21.15.149:3300/0 conn(0x7fda9415deb0 0x7fda94163860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:25.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.894+0000 7fda99000640 1 -- 172.21.15.87:0/3985727472 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda94162d60 msgr2=0x7fda94163170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:25.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.894+0000 7fda99000640 1 --2- 172.21.15.87:0/3985727472 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda94162d60 0x7fda94163170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:25.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.894+0000 7fda99000640 1 -- 172.21.15.87:0/3985727472 >> v2:172.21.15.149:3300/0 conn(0x7fda9415deb0 msgr2=0x7fda94163860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:25.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.894+0000 7fda99000640 1 --2- 172.21.15.87:0/3985727472 >> v2:172.21.15.149:3300/0 conn(0x7fda9415deb0 0x7fda94163860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:25.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.894+0000 7fda99000640 1 -- 172.21.15.87:0/3985727472 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda94161a60 con 0x7fda94163da0 2024-05-27T06:28:25.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.898+0000 7fda99000640 1 --2- 172.21.15.87:0/3985727472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda94163da0 0x7fda94162820 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fda940732a0 tx=0x7fda8001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc108d555522007 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:25.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.898+0000 7fda93e00640 1 -- 172.21.15.87:0/3985727472 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda800b1070 con 0x7fda94163da0 2024-05-27T06:28:25.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.898+0000 7fda93e00640 1 -- 172.21.15.87:0/3985727472 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda800ac630 con 0x7fda94163da0 2024-05-27T06:28:25.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.898+0000 7fda93e00640 1 -- 172.21.15.87:0/3985727472 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda800a8050 con 0x7fda94163da0 2024-05-27T06:28:25.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.898+0000 7fda9c400640 1 -- 172.21.15.87:0/3985727472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda94163da0 msgr2=0x7fda94162820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:25.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.898+0000 7fda9c400640 1 --2- 172.21.15.87:0/3985727472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda94163da0 0x7fda94162820 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fda940732a0 tx=0x7fda8001c520 comp rx=0 tx=0).stop 2024-05-27T06:28:25.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.898+0000 7fda9c400640 1 -- 172.21.15.87:0/3985727472 shutdown_connections 2024-05-27T06:28:25.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.898+0000 7fda9c400640 1 --2- 172.21.15.87:0/3985727472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda94163da0 0x7fda94162820 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:25.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.898+0000 7fda9c400640 1 --2- 172.21.15.87:0/3985727472 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda94162d60 0x7fda94163170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:25.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.898+0000 7fda9c400640 1 --2- 172.21.15.87:0/3985727472 >> v2:172.21.15.149:3300/0 conn(0x7fda9415deb0 0x7fda94163860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:25.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.898+0000 7fda9c400640 1 -- 172.21.15.87:0/3985727472 >> 172.21.15.87:0/3985727472 conn(0x7fda940712e0 msgr2=0x7fda940716f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:25.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.898+0000 7fda9c400640 1 -- 172.21.15.87:0/3985727472 shutdown_connections 2024-05-27T06:28:25.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.898+0000 7fda9c400640 1 -- 172.21.15.87:0/3985727472 wait complete. 2024-05-27T06:28:25.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.902+0000 7fda9c400640 1 Processor -- start 2024-05-27T06:28:25.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.902+0000 7fda9c400640 1 -- start start 2024-05-27T06:28:25.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.902+0000 7fda9c400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda9415deb0 0x7fda940aa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:25.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.902+0000 7fda9c400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda94162d60 0x7fda940ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:25.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.902+0000 7fda9c400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda94163da0 0x7fda9415cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:25.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.902+0000 7fda9c400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fda940b61d0 con 0x7fda94163da0 2024-05-27T06:28:25.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.902+0000 7fda9c400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fda940b6050 con 0x7fda94162d60 2024-05-27T06:28:25.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.902+0000 7fda9c400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fda940b6350 con 0x7fda9415deb0 2024-05-27T06:28:25.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.902+0000 7fda9a400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda94163da0 0x7fda9415cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:25.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.902+0000 7fda9a400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda94163da0 0x7fda9415cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50834/0 (socket says 172.21.15.87:50834) 2024-05-27T06:28:25.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.902+0000 7fda9a400640 1 -- 172.21.15.87:0/848984703 learned_addr learned my addr 172.21.15.87:0/848984703 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:25.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.906+0000 7fda99000640 1 --2- 172.21.15.87:0/848984703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda94162d60 0x7fda940ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:25.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.906+0000 7fda99a00640 1 --2- 172.21.15.87:0/848984703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda9415deb0 0x7fda940aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:25.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.906+0000 7fda9a400640 1 -- 172.21.15.87:0/848984703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda9415deb0 msgr2=0x7fda940aa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:25.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.906+0000 7fda9a400640 1 --2- 172.21.15.87:0/848984703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda9415deb0 0x7fda940aa480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:25.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.906+0000 7fda9a400640 1 -- 172.21.15.87:0/848984703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda94162d60 msgr2=0x7fda940ae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:25.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.906+0000 7fda9a400640 1 --2- 172.21.15.87:0/848984703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda94162d60 0x7fda940ae100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:25.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.906+0000 7fda9a400640 1 -- 172.21.15.87:0/848984703 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda940aa9c0 con 0x7fda94163da0 2024-05-27T06:28:25.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.906+0000 7fda99a00640 1 --2- 172.21.15.87:0/848984703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda9415deb0 0x7fda940aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:25.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.906+0000 7fda9a400640 1 --2- 172.21.15.87:0/848984703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda94163da0 0x7fda9415cb00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fda8c007d80 tx=0x7fda8c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:25.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.906+0000 7fda91600640 1 -- 172.21.15.87:0/848984703 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c014420 con 0x7fda94163da0 2024-05-27T06:28:25.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.906+0000 7fda91600640 1 -- 172.21.15.87:0/848984703 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda8c019070 con 0x7fda94163da0 2024-05-27T06:28:25.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.906+0000 7fda91600640 1 -- 172.21.15.87:0/848984703 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c014800 con 0x7fda94163da0 2024-05-27T06:28:25.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.906+0000 7fda9c400640 1 -- 172.21.15.87:0/848984703 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda940aff80 con 0x7fda94163da0 2024-05-27T06:28:25.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.906+0000 7fda9c400640 1 -- 172.21.15.87:0/848984703 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda94148a50 con 0x7fda94163da0 2024-05-27T06:28:25.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.906+0000 7fda9c400640 1 -- 172.21.15.87:0/848984703 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda94148840 con 0x7fda94163da0 2024-05-27T06:28:25.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.906+0000 7fda91600640 1 -- 172.21.15.87:0/848984703 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fda8c0149a0 con 0x7fda94163da0 2024-05-27T06:28:25.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.910+0000 7fda91600640 1 --2- 172.21.15.87:0/848984703 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fda7406f400 0x7fda74071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:25.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.910+0000 7fda91600640 1 -- 172.21.15.87:0/848984703 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fda8c08fe70 con 0x7fda94163da0 2024-05-27T06:28:25.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.910+0000 7fda99a00640 1 --2- 172.21.15.87:0/848984703 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fda7406f400 0x7fda74071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:25.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.910+0000 7fda99a00640 1 --2- 172.21.15.87:0/848984703 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fda7406f400 0x7fda74071910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fda940b7850 tx=0x7fda88008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:25.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:25.914+0000 7fda91600640 1 -- 172.21.15.87:0/848984703 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fda8c05c930 con 0x7fda94163da0 2024-05-27T06:28:26.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.082+0000 7fda9c400640 1 -- 172.21.15.87:0/848984703 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fda9406aa30 con 0x7fda94163da0 2024-05-27T06:28:26.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.082+0000 7fda91600640 1 -- 172.21.15.87:0/848984703 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fda8c05c230 con 0x7fda94163da0 2024-05-27T06:28:26.081 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2024-05-27T06:28:26.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.086+0000 7fda9c400640 1 -- 172.21.15.87:0/848984703 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fda7406f400 msgr2=0x7fda74071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:26.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.086+0000 7fda9c400640 1 --2- 172.21.15.87:0/848984703 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fda7406f400 0x7fda74071910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fda940b7850 tx=0x7fda88008040 comp rx=0 tx=0).stop 2024-05-27T06:28:26.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.086+0000 7fda9c400640 1 -- 172.21.15.87:0/848984703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda94163da0 msgr2=0x7fda9415cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:26.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.086+0000 7fda9c400640 1 --2- 172.21.15.87:0/848984703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda94163da0 0x7fda9415cb00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fda8c007d80 tx=0x7fda8c00e4b0 comp rx=0 tx=0).stop 2024-05-27T06:28:26.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.086+0000 7fda9c400640 1 -- 172.21.15.87:0/848984703 shutdown_connections 2024-05-27T06:28:26.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.086+0000 7fda9c400640 1 --2- 172.21.15.87:0/848984703 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fda7406f400 0x7fda74071910 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:26.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.086+0000 7fda9c400640 1 --2- 172.21.15.87:0/848984703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda94163da0 0x7fda9415cb00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:26.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.086+0000 7fda9c400640 1 --2- 172.21.15.87:0/848984703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda94162d60 0x7fda940ae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:26.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.086+0000 7fda9c400640 1 --2- 172.21.15.87:0/848984703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fda9415deb0 0x7fda940aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:26.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.086+0000 7fda9c400640 1 -- 172.21.15.87:0/848984703 >> 172.21.15.87:0/848984703 conn(0x7fda940712e0 msgr2=0x7fda940b6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:26.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.086+0000 7fda9c400640 1 -- 172.21.15.87:0/848984703 shutdown_connections 2024-05-27T06:28:26.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.086+0000 7fda9c400640 1 -- 172.21.15.87:0/848984703 wait complete. 2024-05-27T06:28:26.102 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi149.front.sepia.ceph.com... 2024-05-27T06:28:26.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:26.103 DEBUG:teuthology.orchestra.run.smithi149:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-05-27T06:28:26.138 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:28:26.138 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-05-27T06:28:26.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:26.138 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-27T06:28:26.199 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:28:26.199 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:28:26.208 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:28:26.208 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:28:26.257 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T06:28:26.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.446+0000 7f6d68200640 1 Processor -- start 2024-05-27T06:28:26.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.446+0000 7f6d68200640 1 -- start start 2024-05-27T06:28:26.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d68200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6d60073f30 0x7f6d60072a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:26.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d68200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d6006fcf0 0x7f6d60070100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:26.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d68200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d60070640 con 0x7f6d60072fb0 2024-05-27T06:28:26.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d68200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f6d6015d720 con 0x7f6d60073f30 2024-05-27T06:28:26.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d68200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6d6015fee0 con 0x7f6d6006fcf0 2024-05-27T06:28:26.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d64e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f6d60072fb0 0x7f6d60160370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51716/0 (socket says 172.21.15.87:51716) 2024-05-27T06:28:26.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d64e00640 1 -- 172.21.15.87:0/3341270327 learned_addr learned my addr 172.21.15.87:0/3341270327 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:26.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d65800640 1 --2- 172.21.15.87:0/3341270327 >> v2:172.21.15.149:3300/0 conn(0x7f6d60073f30 0x7f6d60072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:26.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d66200640 1 --2- 172.21.15.87:0/3341270327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d6006fcf0 0x7f6d60070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:26.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d5fe00640 1 -- 172.21.15.87:0/3341270327 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1493451686 0 0) 0x7f6d4c001120 con 0x7f6d60072fb0 2024-05-27T06:28:26.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d5fe00640 1 -- 172.21.15.87:0/3341270327 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d48003530 con 0x7f6d60072fb0 2024-05-27T06:28:26.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d5fe00640 1 -- 172.21.15.87:0/3341270327 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 451269935 0 0) 0x7f6d48003530 con 0x7f6d60072fb0 2024-05-27T06:28:26.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d5fe00640 1 -- 172.21.15.87:0/3341270327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d6006fcf0 msgr2=0x7f6d60070100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:26.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d5fe00640 1 --2- 172.21.15.87:0/3341270327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d6006fcf0 0x7f6d60070100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:26.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d5fe00640 1 -- 172.21.15.87:0/3341270327 >> v2:172.21.15.149:3300/0 conn(0x7f6d60073f30 msgr2=0x7f6d60072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:26.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d5fe00640 1 --2- 172.21.15.87:0/3341270327 >> v2:172.21.15.149:3300/0 conn(0x7f6d60073f30 0x7f6d60072a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:26.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d5fe00640 1 -- 172.21.15.87:0/3341270327 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d6015ce80 con 0x7f6d60072fb0 2024-05-27T06:28:26.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d5fe00640 1 -- 172.21.15.87:0/3341270327 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7f6d4c0018d0 con 0x7f6d60072fb0 2024-05-27T06:28:26.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d5fe00640 1 -- 172.21.15.87:0/3341270327 >> v1:172.21.15.87:6789/0 conn(0x7f6d60072fb0 legacy=0x7f6d60160370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:26.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d5fe00640 1 --2- 172.21.15.87:0/3341270327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d48003a10 0x7f6d48003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:26.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d5fe00640 1 --2- 172.21.15.87:0/3341270327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d48004810 0x7f6d48004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:26.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d5fe00640 1 --2- 172.21.15.87:0/3341270327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d6006fcf0 0x7f6d48005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:26.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d5fe00640 1 -- 172.21.15.87:0/3341270327 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6015d720 con 0x7f6d48004810 2024-05-27T06:28:26.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d5fe00640 1 -- 172.21.15.87:0/3341270327 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6015fee0 con 0x7f6d48003a10 2024-05-27T06:28:26.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d5fe00640 1 -- 172.21.15.87:0/3341270327 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6d4800bb00 con 0x7f6d6006fcf0 2024-05-27T06:28:26.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d64e00640 1 --2- 172.21.15.87:0/3341270327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d48004810 0x7f6d48004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:26.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d65800640 1 --2- 172.21.15.87:0/3341270327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d48003a10 0x7f6d48003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:26.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d66200640 1 --2- 172.21.15.87:0/3341270327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d6006fcf0 0x7f6d48005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:26.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d64e00640 1 -- 172.21.15.87:0/3341270327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d6006fcf0 msgr2=0x7f6d48005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:26.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d64e00640 1 --2- 172.21.15.87:0/3341270327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d6006fcf0 0x7f6d48005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:26.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d64e00640 1 -- 172.21.15.87:0/3341270327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d48003a10 msgr2=0x7f6d48003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:26.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d64e00640 1 --2- 172.21.15.87:0/3341270327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d48003a10 0x7f6d48003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:26.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d64e00640 1 -- 172.21.15.87:0/3341270327 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d48003530 con 0x7f6d48004810 2024-05-27T06:28:26.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.450+0000 7f6d66200640 1 --2- 172.21.15.87:0/3341270327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d6006fcf0 0x7f6d48005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:26.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.454+0000 7f6d64e00640 1 --2- 172.21.15.87:0/3341270327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d48004810 0x7f6d48004c20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c00e6d0 tx=0x7f6d4c01f020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76b88096bb5eec3 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:26.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.454+0000 7f6d5fe00640 1 -- 172.21.15.87:0/3341270327 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c00e2f0 con 0x7f6d48004810 2024-05-27T06:28:26.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.454+0000 7f6d5fe00640 1 -- 172.21.15.87:0/3341270327 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d4c005ae0 con 0x7f6d48004810 2024-05-27T06:28:26.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.454+0000 7f6d5fe00640 1 -- 172.21.15.87:0/3341270327 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c007070 con 0x7f6d48004810 2024-05-27T06:28:26.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.454+0000 7f6d68200640 1 -- 172.21.15.87:0/3341270327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d48004810 msgr2=0x7f6d48004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:26.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.454+0000 7f6d68200640 1 --2- 172.21.15.87:0/3341270327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d48004810 0x7f6d48004c20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c00e6d0 tx=0x7f6d4c01f020 comp rx=0 tx=0).stop 2024-05-27T06:28:26.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.454+0000 7f6d66200640 1 -- 172.21.15.87:0/3341270327 reap_dead start 2024-05-27T06:28:26.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.454+0000 7f6d68200640 1 -- 172.21.15.87:0/3341270327 shutdown_connections 2024-05-27T06:28:26.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.454+0000 7f6d68200640 1 -- 172.21.15.87:0/3341270327 >> 172.21.15.87:0/3341270327 conn(0x7f6d600b2fb0 msgr2=0x7f6d600b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:26.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.454+0000 7f6d68200640 1 -- 172.21.15.87:0/3341270327 shutdown_connections 2024-05-27T06:28:26.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.454+0000 7f6d68200640 1 -- 172.21.15.87:0/3341270327 wait complete. 2024-05-27T06:28:26.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.458+0000 7f6d68200640 1 Processor -- start 2024-05-27T06:28:26.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.458+0000 7f6d68200640 1 -- start start 2024-05-27T06:28:26.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.458+0000 7f6d68200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d48004810 0x7f6d6014c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:26.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.458+0000 7f6d68200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d6014d7e0 0x7f6d60155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:26.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.458+0000 7f6d68200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d6015e8f0 0x7f6d6015ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:26.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.458+0000 7f6d68200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6d60156bc0 con 0x7f6d48004810 2024-05-27T06:28:26.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.458+0000 7f6d68200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6d60156a40 con 0x7f6d6015e8f0 2024-05-27T06:28:26.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.458+0000 7f6d68200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6d60074340 con 0x7f6d6014d7e0 2024-05-27T06:28:26.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.458+0000 7f6d65800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d48004810 0x7f6d6014c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:26.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.458+0000 7f6d65800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d48004810 0x7f6d6014c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50856/0 (socket says 172.21.15.87:50856) 2024-05-27T06:28:26.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.458+0000 7f6d65800640 1 -- 172.21.15.87:0/3044027605 learned_addr learned my addr 172.21.15.87:0/3044027605 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:26.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.458+0000 7f6d64e00640 1 --2- 172.21.15.87:0/3044027605 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d6014d7e0 0x7f6d60155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:26.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.458+0000 7f6d66200640 1 --2- 172.21.15.87:0/3044027605 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d6015e8f0 0x7f6d6015ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:26.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.458+0000 7f6d65800640 1 -- 172.21.15.87:0/3044027605 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d6014d7e0 msgr2=0x7f6d60155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:26.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.458+0000 7f6d65800640 1 --2- 172.21.15.87:0/3044027605 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d6014d7e0 0x7f6d60155d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:26.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.458+0000 7f6d65800640 1 -- 172.21.15.87:0/3044027605 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d6015e8f0 msgr2=0x7f6d6015ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:26.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.458+0000 7f6d65800640 1 --2- 172.21.15.87:0/3044027605 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d6015e8f0 0x7f6d6015ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:26.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.458+0000 7f6d65800640 1 -- 172.21.15.87:0/3044027605 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d6015f240 con 0x7f6d48004810 2024-05-27T06:28:26.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.458+0000 7f6d64e00640 1 --2- 172.21.15.87:0/3044027605 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d6014d7e0 0x7f6d60155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:26.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.458+0000 7f6d65800640 1 --2- 172.21.15.87:0/3044027605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d48004810 0x7f6d6014c3f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6d5400afb0 tx=0x7f6d54003ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:26.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.458+0000 7f6d5d600640 1 -- 172.21.15.87:0/3044027605 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5401f070 con 0x7f6d48004810 2024-05-27T06:28:26.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.462+0000 7f6d5d600640 1 -- 172.21.15.87:0/3044027605 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d54011a50 con 0x7f6d48004810 2024-05-27T06:28:26.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.462+0000 7f6d68200640 1 -- 172.21.15.87:0/3044027605 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d60156270 con 0x7f6d48004810 2024-05-27T06:28:26.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.462+0000 7f6d5d600640 1 -- 172.21.15.87:0/3044027605 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5400b040 con 0x7f6d48004810 2024-05-27T06:28:26.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.462+0000 7f6d68200640 1 -- 172.21.15.87:0/3044027605 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d600cd9a0 con 0x7f6d48004810 2024-05-27T06:28:26.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.462+0000 7f6d68200640 1 -- 172.21.15.87:0/3044027605 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d60148be0 con 0x7f6d48004810 2024-05-27T06:28:26.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.462+0000 7f6d5d600640 1 -- 172.21.15.87:0/3044027605 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6d54022070 con 0x7f6d48004810 2024-05-27T06:28:26.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.462+0000 7f6d5d600640 1 --2- 172.21.15.87:0/3044027605 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f6d4006f2e0 0x7f6d400717f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:26.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.462+0000 7f6d5d600640 1 -- 172.21.15.87:0/3044027605 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f6d5408fd90 con 0x7f6d48004810 2024-05-27T06:28:26.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.462+0000 7f6d64e00640 1 --2- 172.21.15.87:0/3044027605 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f6d4006f2e0 0x7f6d400717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:26.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.466+0000 7f6d64e00640 1 --2- 172.21.15.87:0/3044027605 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f6d4006f2e0 0x7f6d400717f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c0ae000 tx=0x7f6d4c0a9000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:26.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.466+0000 7f6d5d600640 1 -- 172.21.15.87:0/3044027605 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f6d6015f240 con 0x7f6d48004810 2024-05-27T06:28:26.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.642+0000 7f6d68200640 1 -- 172.21.15.87:0/3044027605 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6d6006aa30 con 0x7f6d48004810 2024-05-27T06:28:26.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.642+0000 7f6d5d600640 1 -- 172.21.15.87:0/3044027605 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f6d5405c210 con 0x7f6d48004810 2024-05-27T06:28:26.640 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2024-05-27T06:28:26.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.646+0000 7f6d68200640 1 -- 172.21.15.87:0/3044027605 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f6d4006f2e0 msgr2=0x7f6d400717f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:26.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.646+0000 7f6d68200640 1 --2- 172.21.15.87:0/3044027605 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f6d4006f2e0 0x7f6d400717f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c0ae000 tx=0x7f6d4c0a9000 comp rx=0 tx=0).stop 2024-05-27T06:28:26.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.646+0000 7f6d68200640 1 -- 172.21.15.87:0/3044027605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d48004810 msgr2=0x7f6d6014c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:26.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.646+0000 7f6d68200640 1 --2- 172.21.15.87:0/3044027605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d48004810 0x7f6d6014c3f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6d5400afb0 tx=0x7f6d54003ab0 comp rx=0 tx=0).stop 2024-05-27T06:28:26.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.646+0000 7f6d68200640 1 -- 172.21.15.87:0/3044027605 shutdown_connections 2024-05-27T06:28:26.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.646+0000 7f6d68200640 1 --2- 172.21.15.87:0/3044027605 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f6d4006f2e0 0x7f6d400717f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:26.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.646+0000 7f6d68200640 1 --2- 172.21.15.87:0/3044027605 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d6015e8f0 0x7f6d6015ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:26.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.646+0000 7f6d68200640 1 --2- 172.21.15.87:0/3044027605 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d6014d7e0 0x7f6d60155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:26.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.646+0000 7f6d68200640 1 --2- 172.21.15.87:0/3044027605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d48004810 0x7f6d6014c3f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:26.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.646+0000 7f6d68200640 1 -- 172.21.15.87:0/3044027605 >> 172.21.15.87:0/3044027605 conn(0x7f6d600b2fb0 msgr2=0x7f6d600afa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:26.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.646+0000 7f6d68200640 1 -- 172.21.15.87:0/3044027605 shutdown_connections 2024-05-27T06:28:26.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.646+0000 7f6d68200640 1 -- 172.21.15.87:0/3044027605 wait complete. 2024-05-27T06:28:26.662 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:28:26.663 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:28:26.671 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T06:28:26.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.862+0000 7efe89200640 1 Processor -- start 2024-05-27T06:28:26.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.862+0000 7efe89200640 1 -- start start 2024-05-27T06:28:26.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.866+0000 7efe89200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe840cddb0 0x7efe840b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:26.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.866+0000 7efe89200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe84071d60 con 0x7efe840ce1c0 2024-05-27T06:28:26.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.866+0000 7efe89200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe840b0e30 con 0x7efe840b0a20 2024-05-27T06:28:26.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.866+0000 7efe89200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efe84141080 con 0x7efe840cddb0 2024-05-27T06:28:26.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.866+0000 7efe79400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7efe840ce1c0 0x7efe84161860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51718/0 (socket says 172.21.15.87:51718) 2024-05-27T06:28:26.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.866+0000 7efe79400640 1 -- 172.21.15.87:0/568989572 learned_addr learned my addr 172.21.15.87:0/568989572 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:26.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.866+0000 7efe81e00640 1 --2- 172.21.15.87:0/568989572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe840cddb0 0x7efe840b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:26.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.866+0000 7efe81400640 1 -- 172.21.15.87:0/568989572 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1753710109 0 0) 0x7efe84071d60 con 0x7efe840ce1c0 2024-05-27T06:28:26.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.866+0000 7efe81400640 1 -- 172.21.15.87:0/568989572 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe68003530 con 0x7efe840ce1c0 2024-05-27T06:28:26.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.866+0000 7efe81400640 1 -- 172.21.15.87:0/568989572 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2334445364 0 0) 0x7efe7c0014a0 con 0x7efe840b0a20 2024-05-27T06:28:26.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.866+0000 7efe81400640 1 -- 172.21.15.87:0/568989572 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe84071d60 con 0x7efe840b0a20 2024-05-27T06:28:26.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.866+0000 7efe81e00640 1 -- 172.21.15.87:0/568989572 >> v1:172.21.15.149:6789/0 conn(0x7efe840b0a20 legacy=0x7efe84161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:26.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.866+0000 7efe81e00640 1 -- 172.21.15.87:0/568989572 >> v1:172.21.15.87:6789/0 conn(0x7efe840ce1c0 legacy=0x7efe84161860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:26.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.866+0000 7efe81400640 1 -- 172.21.15.87:0/568989572 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2620631098 0 0) 0x7efe68003530 con 0x7efe840ce1c0 2024-05-27T06:28:26.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.866+0000 7efe81e00640 1 -- 172.21.15.87:0/568989572 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe84162680 con 0x7efe840cddb0 2024-05-27T06:28:26.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.870+0000 7efe81e00640 1 --2- 172.21.15.87:0/568989572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe840cddb0 0x7efe840b04e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efe740097f0 tx=0x7efe7401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fa7cadc0351655 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:26.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.870+0000 7efe81400640 1 -- 172.21.15.87:0/568989572 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe740b0070 con 0x7efe840cddb0 2024-05-27T06:28:26.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.870+0000 7efe81400640 1 -- 172.21.15.87:0/568989572 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe740ab400 con 0x7efe840cddb0 2024-05-27T06:28:26.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.870+0000 7efe81400640 1 -- 172.21.15.87:0/568989572 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe6c001700 con 0x7efe840cddb0 2024-05-27T06:28:26.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.870+0000 7efe89200640 1 -- 172.21.15.87:0/568989572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe840cddb0 msgr2=0x7efe840b04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:26.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.870+0000 7efe89200640 1 --2- 172.21.15.87:0/568989572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe840cddb0 0x7efe840b04e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efe740097f0 tx=0x7efe7401c400 comp rx=0 tx=0).stop 2024-05-27T06:28:26.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.870+0000 7efe89200640 1 -- 172.21.15.87:0/568989572 shutdown_connections 2024-05-27T06:28:26.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.870+0000 7efe89200640 1 --2- 172.21.15.87:0/568989572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe840cddb0 0x7efe840b04e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:26.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.870+0000 7efe89200640 1 -- 172.21.15.87:0/568989572 >> 172.21.15.87:0/568989572 conn(0x7efe840ce610 msgr2=0x7efe840cea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:26.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.870+0000 7efe89200640 1 -- 172.21.15.87:0/568989572 shutdown_connections 2024-05-27T06:28:26.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.870+0000 7efe89200640 1 -- 172.21.15.87:0/568989572 wait complete. 2024-05-27T06:28:26.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.870+0000 7efe89200640 1 Processor -- start 2024-05-27T06:28:26.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.870+0000 7efe89200640 1 -- start start 2024-05-27T06:28:26.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.874+0000 7efe89200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe840b0a20 0x7efe84152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:26.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.874+0000 7efe89200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe840cddb0 0x7efe84139af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:26.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.874+0000 7efe89200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe840ce1c0 0x7efe841534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:26.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.874+0000 7efe89200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efe8415f0c0 con 0x7efe840ce1c0 2024-05-27T06:28:26.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.874+0000 7efe89200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efe8406e6d0 con 0x7efe840b0a20 2024-05-27T06:28:26.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.874+0000 7efe89200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efe8415f240 con 0x7efe840cddb0 2024-05-27T06:28:26.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.874+0000 7efe82800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe840ce1c0 0x7efe841534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:26.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.874+0000 7efe82800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe840ce1c0 0x7efe841534c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50860/0 (socket says 172.21.15.87:50860) 2024-05-27T06:28:26.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.874+0000 7efe82800640 1 -- 172.21.15.87:0/784826711 learned_addr learned my addr 172.21.15.87:0/784826711 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:26.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.874+0000 7efe79400640 1 --2- 172.21.15.87:0/784826711 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe840cddb0 0x7efe84139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:26.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.874+0000 7efe81e00640 1 --2- 172.21.15.87:0/784826711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe840b0a20 0x7efe84152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:26.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.874+0000 7efe82800640 1 -- 172.21.15.87:0/784826711 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe840cddb0 msgr2=0x7efe84139af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:26.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.874+0000 7efe82800640 1 --2- 172.21.15.87:0/784826711 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe840cddb0 0x7efe84139af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:26.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.874+0000 7efe82800640 1 -- 172.21.15.87:0/784826711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe840b0a20 msgr2=0x7efe84152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:26.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.874+0000 7efe82800640 1 --2- 172.21.15.87:0/784826711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe840b0a20 0x7efe84152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:26.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.874+0000 7efe82800640 1 -- 172.21.15.87:0/784826711 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe8413a860 con 0x7efe840ce1c0 2024-05-27T06:28:26.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.874+0000 7efe81e00640 1 --2- 172.21.15.87:0/784826711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe840b0a20 0x7efe84152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:26.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.874+0000 7efe79400640 1 --2- 172.21.15.87:0/784826711 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe840cddb0 0x7efe84139af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:26.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.874+0000 7efe82800640 1 --2- 172.21.15.87:0/784826711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe840ce1c0 0x7efe841534c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00c6c0 tx=0x7efe7c00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:26.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.874+0000 7efe7aa00640 1 -- 172.21.15.87:0/784826711 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c003b80 con 0x7efe840ce1c0 2024-05-27T06:28:26.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.874+0000 7efe7aa00640 1 -- 172.21.15.87:0/784826711 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe7c003d20 con 0x7efe840ce1c0 2024-05-27T06:28:26.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.874+0000 7efe89200640 1 -- 172.21.15.87:0/784826711 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe8413ab40 con 0x7efe840ce1c0 2024-05-27T06:28:26.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.874+0000 7efe7aa00640 1 -- 172.21.15.87:0/784826711 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c005310 con 0x7efe840ce1c0 2024-05-27T06:28:26.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.874+0000 7efe89200640 1 -- 172.21.15.87:0/784826711 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe8413b100 con 0x7efe840ce1c0 2024-05-27T06:28:26.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.874+0000 7efe89200640 1 -- 172.21.15.87:0/784826711 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe8413a5d0 con 0x7efe840ce1c0 2024-05-27T06:28:26.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.878+0000 7efe7aa00640 1 -- 172.21.15.87:0/784826711 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7efe7c0054b0 con 0x7efe840ce1c0 2024-05-27T06:28:26.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.878+0000 7efe7aa00640 1 --2- 172.21.15.87:0/784826711 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efe6006f400 0x7efe60071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:26.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.878+0000 7efe7aa00640 1 -- 172.21.15.87:0/784826711 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7efe7c08f5c0 con 0x7efe840ce1c0 2024-05-27T06:28:26.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.878+0000 7efe81e00640 1 --2- 172.21.15.87:0/784826711 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efe6006f400 0x7efe60071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:26.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.878+0000 7efe81e00640 1 --2- 172.21.15.87:0/784826711 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efe6006f400 0x7efe60071910 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efe740ad000 tx=0x7efe740a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:26.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:26.882+0000 7efe7aa00640 1 -- 172.21.15.87:0/784826711 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7efe840b0e30 con 0x7efe840ce1c0 2024-05-27T06:28:27.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.050+0000 7efe89200640 1 -- 172.21.15.87:0/784826711 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7efe8406aa30 con 0x7efe840ce1c0 2024-05-27T06:28:27.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.050+0000 7efe7aa00640 1 -- 172.21.15.87:0/784826711 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7efe7c05c080 con 0x7efe840ce1c0 2024-05-27T06:28:27.049 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2024-05-27T06:28:27.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.054+0000 7efe89200640 1 -- 172.21.15.87:0/784826711 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efe6006f400 msgr2=0x7efe60071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:27.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.054+0000 7efe89200640 1 --2- 172.21.15.87:0/784826711 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efe6006f400 0x7efe60071910 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efe740ad000 tx=0x7efe740a6000 comp rx=0 tx=0).stop 2024-05-27T06:28:27.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.054+0000 7efe89200640 1 -- 172.21.15.87:0/784826711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe840ce1c0 msgr2=0x7efe841534c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:27.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.054+0000 7efe89200640 1 --2- 172.21.15.87:0/784826711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe840ce1c0 0x7efe841534c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00c6c0 tx=0x7efe7c00cb80 comp rx=0 tx=0).stop 2024-05-27T06:28:27.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.054+0000 7efe89200640 1 -- 172.21.15.87:0/784826711 shutdown_connections 2024-05-27T06:28:27.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.054+0000 7efe89200640 1 --2- 172.21.15.87:0/784826711 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efe6006f400 0x7efe60071910 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:27.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.054+0000 7efe89200640 1 --2- 172.21.15.87:0/784826711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe840ce1c0 0x7efe841534c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:27.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.054+0000 7efe89200640 1 --2- 172.21.15.87:0/784826711 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe840cddb0 0x7efe84139af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:27.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.054+0000 7efe89200640 1 --2- 172.21.15.87:0/784826711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe840b0a20 0x7efe84152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:27.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.054+0000 7efe89200640 1 -- 172.21.15.87:0/784826711 >> 172.21.15.87:0/784826711 conn(0x7efe840ce610 msgr2=0x7efe840cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:27.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.054+0000 7efe89200640 1 -- 172.21.15.87:0/784826711 shutdown_connections 2024-05-27T06:28:27.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.054+0000 7efe89200640 1 -- 172.21.15.87:0/784826711 wait complete. 2024-05-27T06:28:27.071 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-05-27T06:28:27.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:27.071 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-05-27T06:28:27.090 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:28:27.091 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-05-27T06:28:27.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:27.091 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-27T06:28:27.141 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:28:27.141 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:28:27.150 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:28:27.153 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:28:27.201 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T06:28:27.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.350+0000 7f83dba00640 1 Processor -- start 2024-05-27T06:28:27.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.350+0000 7f83dba00640 1 -- start start 2024-05-27T06:28:27.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.354+0000 7f83dba00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83d40aec30 0x7f83d40702b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:27.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.354+0000 7f83dba00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f83d406efc0 0x7f83d406f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:27.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.354+0000 7f83dba00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83d406f910 con 0x7f83d406c720 2024-05-27T06:28:27.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.354+0000 7f83dba00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f83d406fe20 con 0x7f83d406efc0 2024-05-27T06:28:27.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.354+0000 7f83dba00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f83d40b0ba0 con 0x7f83d40aec30 2024-05-27T06:28:27.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.354+0000 7f83d9a00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f83d406c720 0x7f83d406cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51720/0 (socket says 172.21.15.87:51720) 2024-05-27T06:28:27.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.354+0000 7f83d9a00640 1 -- 172.21.15.87:0/2343903079 learned_addr learned my addr 172.21.15.87:0/2343903079 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:27.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.354+0000 7f83d3e00640 1 --2- 172.21.15.87:0/2343903079 >> v2:172.21.15.149:3300/0 conn(0x7f83d406efc0 0x7f83d406f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:27.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.354+0000 7f83d9000640 1 --2- 172.21.15.87:0/2343903079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83d40aec30 0x7f83d40702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:27.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.354+0000 7f83d3400640 1 -- 172.21.15.87:0/2343903079 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 217059274 0 0) 0x7f83cc001120 con 0x7f83d406c720 2024-05-27T06:28:27.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.354+0000 7f83d3400640 1 -- 172.21.15.87:0/2343903079 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83b8003530 con 0x7f83d406c720 2024-05-27T06:28:27.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.354+0000 7f83d9000640 1 -- 172.21.15.87:0/2343903079 >> v2:172.21.15.149:3300/0 conn(0x7f83d406efc0 msgr2=0x7f83d406f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:27.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.354+0000 7f83d9000640 1 --2- 172.21.15.87:0/2343903079 >> v2:172.21.15.149:3300/0 conn(0x7f83d406efc0 0x7f83d406f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:27.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.354+0000 7f83d9000640 1 -- 172.21.15.87:0/2343903079 >> v1:172.21.15.87:6789/0 conn(0x7f83d406c720 legacy=0x7f83d406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:27.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.354+0000 7f83d3400640 1 -- 172.21.15.87:0/2343903079 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3982342986 0 0) 0x7f83b8003530 con 0x7f83d406c720 2024-05-27T06:28:27.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.354+0000 7f83d9000640 1 -- 172.21.15.87:0/2343903079 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d415ef50 con 0x7f83d40aec30 2024-05-27T06:28:27.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.354+0000 7f83d3e00640 1 --2- 172.21.15.87:0/2343903079 >> v2:172.21.15.149:3300/0 conn(0x7f83d406efc0 0x7f83d406f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:28:27.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.358+0000 7f83d9000640 1 --2- 172.21.15.87:0/2343903079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83d40aec30 0x7f83d40702b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f83c4009d90 tx=0x7f83c401c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80857656f224c7e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:27.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.358+0000 7f83d3400640 1 -- 172.21.15.87:0/2343903079 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c40b2070 con 0x7f83d40aec30 2024-05-27T06:28:27.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.358+0000 7f83d3400640 1 -- 172.21.15.87:0/2343903079 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c40a5820 con 0x7f83d40aec30 2024-05-27T06:28:27.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.358+0000 7f83d3400640 1 -- 172.21.15.87:0/2343903079 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c40a5bd0 con 0x7f83d40aec30 2024-05-27T06:28:27.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.358+0000 7f83dba00640 1 -- 172.21.15.87:0/2343903079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83d40aec30 msgr2=0x7f83d40702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:27.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.358+0000 7f83dba00640 1 --2- 172.21.15.87:0/2343903079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83d40aec30 0x7f83d40702b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f83c4009d90 tx=0x7f83c401c850 comp rx=0 tx=0).stop 2024-05-27T06:28:27.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.358+0000 7f83dba00640 1 -- 172.21.15.87:0/2343903079 shutdown_connections 2024-05-27T06:28:27.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.358+0000 7f83dba00640 1 --2- 172.21.15.87:0/2343903079 >> v2:172.21.15.149:3300/0 conn(0x7f83d406efc0 0x7f83d406f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:27.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.358+0000 7f83dba00640 1 --2- 172.21.15.87:0/2343903079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83d40aec30 0x7f83d40702b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:27.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.358+0000 7f83dba00640 1 -- 172.21.15.87:0/2343903079 >> 172.21.15.87:0/2343903079 conn(0x7f83d40b2fb0 msgr2=0x7f83d40b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:27.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.358+0000 7f83dba00640 1 -- 172.21.15.87:0/2343903079 shutdown_connections 2024-05-27T06:28:27.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.358+0000 7f83dba00640 1 -- 172.21.15.87:0/2343903079 wait complete. 2024-05-27T06:28:27.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.362+0000 7f83dba00640 1 Processor -- start 2024-05-27T06:28:27.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.362+0000 7f83dba00640 1 -- start start 2024-05-27T06:28:27.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.362+0000 7f83dba00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83d406c720 0x7f83d415cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:27.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.362+0000 7f83dba00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83d406efc0 0x7f83d415d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:27.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.362+0000 7f83dba00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83d40aec30 0x7f83d4072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:27.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.362+0000 7f83dba00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f83d406df40 con 0x7f83d40aec30 2024-05-27T06:28:27.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.362+0000 7f83dba00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f83d40af040 con 0x7f83d406c720 2024-05-27T06:28:27.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.362+0000 7f83dba00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f83d406e0c0 con 0x7f83d406efc0 2024-05-27T06:28:27.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.362+0000 7f83d9a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83d40aec30 0x7f83d4072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:27.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.362+0000 7f83d9a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83d40aec30 0x7f83d4072a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50872/0 (socket says 172.21.15.87:50872) 2024-05-27T06:28:27.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.362+0000 7f83d9a00640 1 -- 172.21.15.87:0/644820236 learned_addr learned my addr 172.21.15.87:0/644820236 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:27.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.362+0000 7f83d9000640 1 --2- 172.21.15.87:0/644820236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83d406c720 0x7f83d415cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:27.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.362+0000 7f83d9a00640 1 -- 172.21.15.87:0/644820236 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83d406efc0 msgr2=0x7f83d415d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:27.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.362+0000 7f83d3e00640 1 --2- 172.21.15.87:0/644820236 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83d406efc0 0x7f83d415d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:27.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.362+0000 7f83d9a00640 1 --2- 172.21.15.87:0/644820236 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83d406efc0 0x7f83d415d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:27.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.362+0000 7f83d9a00640 1 -- 172.21.15.87:0/644820236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83d406c720 msgr2=0x7f83d415cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:27.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.362+0000 7f83d9a00640 1 --2- 172.21.15.87:0/644820236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83d406c720 0x7f83d415cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:27.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.362+0000 7f83d9a00640 1 -- 172.21.15.87:0/644820236 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d4074630 con 0x7f83d40aec30 2024-05-27T06:28:27.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.362+0000 7f83d9000640 1 --2- 172.21.15.87:0/644820236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83d406c720 0x7f83d415cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:27.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.362+0000 7f83d3e00640 1 --2- 172.21.15.87:0/644820236 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83d406efc0 0x7f83d415d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:27.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.362+0000 7f83d9a00640 1 --2- 172.21.15.87:0/644820236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83d40aec30 0x7f83d4072a70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f83cc00c3f0 tx=0x7f83cc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:27.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.362+0000 7f83d0c00640 1 -- 172.21.15.87:0/644820236 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83cc017070 con 0x7f83d40aec30 2024-05-27T06:28:27.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.362+0000 7f83d0c00640 1 -- 172.21.15.87:0/644820236 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83cc005cf0 con 0x7f83d40aec30 2024-05-27T06:28:27.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.362+0000 7f83dba00640 1 -- 172.21.15.87:0/644820236 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83d41530f0 con 0x7f83d40aec30 2024-05-27T06:28:27.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.362+0000 7f83d0c00640 1 -- 172.21.15.87:0/644820236 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83cc007310 con 0x7f83d40aec30 2024-05-27T06:28:27.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.362+0000 7f83dba00640 1 -- 172.21.15.87:0/644820236 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83d4147500 con 0x7f83d40aec30 2024-05-27T06:28:27.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.366+0000 7f83dba00640 1 -- 172.21.15.87:0/644820236 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83d406aa30 con 0x7f83d40aec30 2024-05-27T06:28:27.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.366+0000 7f83d0c00640 1 -- 172.21.15.87:0/644820236 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f83cc01a070 con 0x7f83d40aec30 2024-05-27T06:28:27.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.366+0000 7f83d0c00640 1 --2- 172.21.15.87:0/644820236 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f83b406f400 0x7f83b4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:27.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.366+0000 7f83d0c00640 1 -- 172.21.15.87:0/644820236 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f83cc08eaa0 con 0x7f83d40aec30 2024-05-27T06:28:27.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.366+0000 7f83d9000640 1 --2- 172.21.15.87:0/644820236 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f83b406f400 0x7f83b4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:27.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.366+0000 7f83d9000640 1 --2- 172.21.15.87:0/644820236 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f83b406f400 0x7f83b4071910 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f83c40af000 tx=0x7f83c40a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:27.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.370+0000 7f83d0c00640 1 -- 172.21.15.87:0/644820236 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f83cc090e20 con 0x7f83d40aec30 2024-05-27T06:28:27.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.538+0000 7f83dba00640 1 -- 172.21.15.87:0/644820236 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f83d4155a60 con 0x7f83d40aec30 2024-05-27T06:28:27.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.538+0000 7f83d0c00640 1 -- 172.21.15.87:0/644820236 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f83d406f910 con 0x7f83d40aec30 2024-05-27T06:28:27.537 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2024-05-27T06:28:27.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.542+0000 7f83dba00640 1 -- 172.21.15.87:0/644820236 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f83b406f400 msgr2=0x7f83b4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:27.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.542+0000 7f83dba00640 1 --2- 172.21.15.87:0/644820236 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f83b406f400 0x7f83b4071910 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f83c40af000 tx=0x7f83c40a7070 comp rx=0 tx=0).stop 2024-05-27T06:28:27.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.542+0000 7f83dba00640 1 -- 172.21.15.87:0/644820236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83d40aec30 msgr2=0x7f83d4072a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:27.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.542+0000 7f83dba00640 1 --2- 172.21.15.87:0/644820236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83d40aec30 0x7f83d4072a70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f83cc00c3f0 tx=0x7f83cc00c8b0 comp rx=0 tx=0).stop 2024-05-27T06:28:27.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.542+0000 7f83dba00640 1 -- 172.21.15.87:0/644820236 shutdown_connections 2024-05-27T06:28:27.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.542+0000 7f83dba00640 1 --2- 172.21.15.87:0/644820236 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f83b406f400 0x7f83b4071910 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:27.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.542+0000 7f83dba00640 1 --2- 172.21.15.87:0/644820236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83d40aec30 0x7f83d4072a70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:27.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.542+0000 7f83dba00640 1 --2- 172.21.15.87:0/644820236 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83d406efc0 0x7f83d415d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:27.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.542+0000 7f83dba00640 1 --2- 172.21.15.87:0/644820236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83d406c720 0x7f83d415cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:27.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.542+0000 7f83dba00640 1 -- 172.21.15.87:0/644820236 >> 172.21.15.87:0/644820236 conn(0x7f83d40b2fb0 msgr2=0x7f83d415f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:27.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.542+0000 7f83dba00640 1 -- 172.21.15.87:0/644820236 shutdown_connections 2024-05-27T06:28:27.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.542+0000 7f83dba00640 1 -- 172.21.15.87:0/644820236 wait complete. 2024-05-27T06:28:27.559 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:28:27.559 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:28:27.569 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T06:28:27.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.718+0000 7f08f6a00640 1 Processor -- start 2024-05-27T06:28:27.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.718+0000 7f08f6a00640 1 -- start start 2024-05-27T06:28:27.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.722+0000 7f08f6a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f08f00aec30 0x7f08f00702b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:27.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.722+0000 7f08f6a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f08f006efc0 0x7f08f006f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:27.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.722+0000 7f08f6a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08f006c720 0x7f08f006cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:27.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.722+0000 7f08f6a00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f08f006f910 con 0x7f08f00aec30 2024-05-27T06:28:27.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.722+0000 7f08f6a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f08f006fe20 con 0x7f08f006efc0 2024-05-27T06:28:27.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.722+0000 7f08f6a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f08f00b0ba0 con 0x7f08f006c720 2024-05-27T06:28:27.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.722+0000 7f08efe00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f08f00aec30 0x7f08f00702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:27.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.722+0000 7f08efe00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f08f00aec30 0x7f08f00702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50874/0 (socket says 172.21.15.87:50874) 2024-05-27T06:28:27.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.722+0000 7f08efe00640 1 -- 172.21.15.87:0/3222688278 learned_addr learned my addr 172.21.15.87:0/3222688278 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:27.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.722+0000 7f08e7400640 1 --2- 172.21.15.87:0/3222688278 >> v2:172.21.15.149:3300/0 conn(0x7f08f006efc0 0x7f08f006f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:27.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.722+0000 7f08f4a00640 1 --2- 172.21.15.87:0/3222688278 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08f006c720 0x7f08f006cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:27.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.722+0000 7f08efe00640 1 -- 172.21.15.87:0/3222688278 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08f006c720 msgr2=0x7f08f006cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:27.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.722+0000 7f08efe00640 1 --2- 172.21.15.87:0/3222688278 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08f006c720 0x7f08f006cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:27.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.722+0000 7f08efe00640 1 -- 172.21.15.87:0/3222688278 >> v2:172.21.15.149:3300/0 conn(0x7f08f006efc0 msgr2=0x7f08f006f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:27.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.722+0000 7f08efe00640 1 --2- 172.21.15.87:0/3222688278 >> v2:172.21.15.149:3300/0 conn(0x7f08f006efc0 0x7f08f006f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:27.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.722+0000 7f08efe00640 1 -- 172.21.15.87:0/3222688278 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f015ef50 con 0x7f08f00aec30 2024-05-27T06:28:27.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.722+0000 7f08e7400640 1 --2- 172.21.15.87:0/3222688278 >> v2:172.21.15.149:3300/0 conn(0x7f08f006efc0 0x7f08f006f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:27.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.722+0000 7f08f4a00640 1 --2- 172.21.15.87:0/3222688278 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08f006c720 0x7f08f006cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:27.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.726+0000 7f08efe00640 1 --2- 172.21.15.87:0/3222688278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08f00aec30 0x7f08f00702b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f08f00b0340 tx=0x7f08e001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15cfb5b39805b869 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:27.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.726+0000 7f08ef400640 1 -- 172.21.15.87:0/3222688278 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e00b0070 con 0x7f08f00aec30 2024-05-27T06:28:27.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.726+0000 7f08ef400640 1 -- 172.21.15.87:0/3222688278 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e00ab600 con 0x7f08f00aec30 2024-05-27T06:28:27.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.726+0000 7f08ef400640 1 -- 172.21.15.87:0/3222688278 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e00ab9d0 con 0x7f08f00aec30 2024-05-27T06:28:27.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.726+0000 7f08f6a00640 1 -- 172.21.15.87:0/3222688278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08f00aec30 msgr2=0x7f08f00702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:27.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.726+0000 7f08f6a00640 1 --2- 172.21.15.87:0/3222688278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08f00aec30 0x7f08f00702b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f08f00b0340 tx=0x7f08e001c400 comp rx=0 tx=0).stop 2024-05-27T06:28:27.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.726+0000 7f08f6a00640 1 -- 172.21.15.87:0/3222688278 shutdown_connections 2024-05-27T06:28:27.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.726+0000 7f08f6a00640 1 --2- 172.21.15.87:0/3222688278 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08f006c720 0x7f08f006cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:27.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.726+0000 7f08f6a00640 1 --2- 172.21.15.87:0/3222688278 >> v2:172.21.15.149:3300/0 conn(0x7f08f006efc0 0x7f08f006f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:27.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.726+0000 7f08f6a00640 1 --2- 172.21.15.87:0/3222688278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08f00aec30 0x7f08f00702b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:27.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.726+0000 7f08f6a00640 1 -- 172.21.15.87:0/3222688278 >> 172.21.15.87:0/3222688278 conn(0x7f08f00b2fb0 msgr2=0x7f08f00b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:27.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.726+0000 7f08f6a00640 1 -- 172.21.15.87:0/3222688278 shutdown_connections 2024-05-27T06:28:27.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.726+0000 7f08f6a00640 1 -- 172.21.15.87:0/3222688278 wait complete. 2024-05-27T06:28:27.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.726+0000 7f08f6a00640 1 Processor -- start 2024-05-27T06:28:27.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.726+0000 7f08f6a00640 1 -- start start 2024-05-27T06:28:27.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.730+0000 7f08f6a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08f006c720 0x7f08f014eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:27.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.730+0000 7f08f6a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08f006efc0 0x7f08f01499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:27.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.730+0000 7f08f6a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08f00aec30 0x7f08f0156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:27.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.730+0000 7f08f6a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f08f006df40 con 0x7f08f006efc0 2024-05-27T06:28:27.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.730+0000 7f08f6a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f08f00af040 con 0x7f08f00aec30 2024-05-27T06:28:27.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.730+0000 7f08f6a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f08f006e0c0 con 0x7f08f006c720 2024-05-27T06:28:27.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.730+0000 7f08e7400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08f006efc0 0x7f08f01499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:27.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.730+0000 7f08e7400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08f006efc0 0x7f08f01499f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50876/0 (socket says 172.21.15.87:50876) 2024-05-27T06:28:27.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.730+0000 7f08e7400640 1 -- 172.21.15.87:0/2932455169 learned_addr learned my addr 172.21.15.87:0/2932455169 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:27.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.730+0000 7f08efe00640 1 --2- 172.21.15.87:0/2932455169 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08f006c720 0x7f08f014eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:27.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.730+0000 7f08f4a00640 1 --2- 172.21.15.87:0/2932455169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08f00aec30 0x7f08f0156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:27.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.730+0000 7f08e7400640 1 -- 172.21.15.87:0/2932455169 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08f006c720 msgr2=0x7f08f014eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:27.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.730+0000 7f08e7400640 1 --2- 172.21.15.87:0/2932455169 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08f006c720 0x7f08f014eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:27.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.730+0000 7f08e7400640 1 -- 172.21.15.87:0/2932455169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08f00aec30 msgr2=0x7f08f0156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:27.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.730+0000 7f08e7400640 1 --2- 172.21.15.87:0/2932455169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08f00aec30 0x7f08f0156460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:27.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.730+0000 7f08e7400640 1 -- 172.21.15.87:0/2932455169 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f0149f30 con 0x7f08f006efc0 2024-05-27T06:28:27.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.730+0000 7f08e7400640 1 --2- 172.21.15.87:0/2932455169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08f006efc0 0x7f08f01499f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f08d800c820 tx=0x7f08d800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:27.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.730+0000 7f08ecc00640 1 -- 172.21.15.87:0/2932455169 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d8015070 con 0x7f08f006efc0 2024-05-27T06:28:27.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.730+0000 7f08ecc00640 1 -- 172.21.15.87:0/2932455169 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d8004220 con 0x7f08f006efc0 2024-05-27T06:28:27.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.730+0000 7f08f6a00640 1 -- 172.21.15.87:0/2932455169 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08f0150750 con 0x7f08f006efc0 2024-05-27T06:28:27.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.730+0000 7f08ecc00640 1 -- 172.21.15.87:0/2932455169 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d800ce10 con 0x7f08f006efc0 2024-05-27T06:28:27.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.730+0000 7f08f6a00640 1 -- 172.21.15.87:0/2932455169 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08f0150d10 con 0x7f08f006efc0 2024-05-27T06:28:27.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.730+0000 7f08f6a00640 1 -- 172.21.15.87:0/2932455169 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08f006aa30 con 0x7f08f006efc0 2024-05-27T06:28:27.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.734+0000 7f08ecc00640 1 -- 172.21.15.87:0/2932455169 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f08d8007830 con 0x7f08f006efc0 2024-05-27T06:28:27.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.734+0000 7f08ecc00640 1 --2- 172.21.15.87:0/2932455169 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f08cc06f430 0x7f08cc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:27.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.734+0000 7f08ecc00640 1 -- 172.21.15.87:0/2932455169 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f08d808f410 con 0x7f08f006efc0 2024-05-27T06:28:27.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.734+0000 7f08efe00640 1 --2- 172.21.15.87:0/2932455169 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f08cc06f430 0x7f08cc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:27.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.734+0000 7f08efe00640 1 --2- 172.21.15.87:0/2932455169 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f08cc06f430 0x7f08cc071940 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f08e00ad000 tx=0x7f08e0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:27.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.738+0000 7f08ecc00640 1 -- 172.21.15.87:0/2932455169 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f08d805b880 con 0x7f08f006efc0 2024-05-27T06:28:27.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.906+0000 7f08f6a00640 1 -- 172.21.15.87:0/2932455169 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f08f01576a0 con 0x7f08f006efc0 2024-05-27T06:28:27.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.906+0000 7f08ecc00640 1 -- 172.21.15.87:0/2932455169 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f08d805fb80 con 0x7f08f006efc0 2024-05-27T06:28:27.907 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2024-05-27T06:28:27.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.910+0000 7f08f6a00640 1 -- 172.21.15.87:0/2932455169 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f08cc06f430 msgr2=0x7f08cc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:27.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.910+0000 7f08f6a00640 1 --2- 172.21.15.87:0/2932455169 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f08cc06f430 0x7f08cc071940 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f08e00ad000 tx=0x7f08e0008040 comp rx=0 tx=0).stop 2024-05-27T06:28:27.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.910+0000 7f08f6a00640 1 -- 172.21.15.87:0/2932455169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08f006efc0 msgr2=0x7f08f01499f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:27.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.910+0000 7f08f6a00640 1 --2- 172.21.15.87:0/2932455169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08f006efc0 0x7f08f01499f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f08d800c820 tx=0x7f08d800cce0 comp rx=0 tx=0).stop 2024-05-27T06:28:27.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.910+0000 7f08f6a00640 1 -- 172.21.15.87:0/2932455169 shutdown_connections 2024-05-27T06:28:27.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.910+0000 7f08f6a00640 1 --2- 172.21.15.87:0/2932455169 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f08cc06f430 0x7f08cc071940 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:27.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.910+0000 7f08f6a00640 1 --2- 172.21.15.87:0/2932455169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08f00aec30 0x7f08f0156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:27.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.910+0000 7f08f6a00640 1 --2- 172.21.15.87:0/2932455169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08f006efc0 0x7f08f01499f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:27.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.910+0000 7f08f6a00640 1 --2- 172.21.15.87:0/2932455169 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08f006c720 0x7f08f014eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:27.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.910+0000 7f08f6a00640 1 -- 172.21.15.87:0/2932455169 >> 172.21.15.87:0/2932455169 conn(0x7f08f00b2fb0 msgr2=0x7f08f006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:27.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.910+0000 7f08f6a00640 1 -- 172.21.15.87:0/2932455169 shutdown_connections 2024-05-27T06:28:27.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:27.910+0000 7f08f6a00640 1 -- 172.21.15.87:0/2932455169 wait complete. 2024-05-27T06:28:27.927 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi149.front.sepia.ceph.com... 2024-05-27T06:28:27.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:27.928 DEBUG:teuthology.orchestra.run.smithi149:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-05-27T06:28:27.950 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:28:27.950 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-05-27T06:28:27.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:27.950 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-27T06:28:28.002 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-27T06:28:28.002 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T06:28:28.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.150+0000 7f621bc00640 1 Processor -- start 2024-05-27T06:28:28.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f621bc00640 1 -- start start 2024-05-27T06:28:28.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f621bc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f621415cfe0 0x7f621415d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:28.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f621bc00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f62140d1740 0x7f62140d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:28.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f621bc00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f621415d930 con 0x7f62140cbf90 2024-05-27T06:28:28.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f621bc00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f62140d2090 con 0x7f62140d1740 2024-05-27T06:28:28.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f621bc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f621415dbb0 con 0x7f621415cfe0 2024-05-27T06:28:28.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6219200640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f62140cbf90 0x7f621406cfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51736/0 (socket says 172.21.15.87:51736) 2024-05-27T06:28:28.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6219200640 1 -- 172.21.15.87:0/3449702754 learned_addr learned my addr 172.21.15.87:0/3449702754 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:28.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6219c00640 1 --2- 172.21.15.87:0/3449702754 >> v2:172.21.15.149:3300/0 conn(0x7f62140d1740 0x7f62140d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:28.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6213400640 1 -- 172.21.15.87:0/3449702754 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 761322781 0 0) 0x7f62040014a0 con 0x7f62140cbf90 2024-05-27T06:28:28.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6213e00640 1 --2- 172.21.15.87:0/3449702754 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f621415cfe0 0x7f621415d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:28.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6213400640 1 -- 172.21.15.87:0/3449702754 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61f8003530 con 0x7f62140cbf90 2024-05-27T06:28:28.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6213400640 1 -- 172.21.15.87:0/3449702754 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3730561416 0 0) 0x7f61f8003530 con 0x7f62140cbf90 2024-05-27T06:28:28.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6213400640 1 -- 172.21.15.87:0/3449702754 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f621415cfe0 msgr2=0x7f621415d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:28.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6213400640 1 --2- 172.21.15.87:0/3449702754 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f621415cfe0 0x7f621415d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6213400640 1 -- 172.21.15.87:0/3449702754 >> v2:172.21.15.149:3300/0 conn(0x7f62140d1740 msgr2=0x7f62140d1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:28.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6213400640 1 --2- 172.21.15.87:0/3449702754 >> v2:172.21.15.149:3300/0 conn(0x7f62140d1740 0x7f62140d1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6213400640 1 -- 172.21.15.87:0/3449702754 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f621415de90 con 0x7f62140cbf90 2024-05-27T06:28:28.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6213400640 1 -- 172.21.15.87:0/3449702754 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7f6204001c50 con 0x7f62140cbf90 2024-05-27T06:28:28.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6213400640 1 -- 172.21.15.87:0/3449702754 >> v1:172.21.15.87:6789/0 conn(0x7f62140cbf90 legacy=0x7f621406cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:28.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6213400640 1 --2- 172.21.15.87:0/3449702754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61f8003a80 0x7f61f8003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:28.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6213400640 1 --2- 172.21.15.87:0/3449702754 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f621415cfe0 0x7f61f8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:28.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6213400640 1 --2- 172.21.15.87:0/3449702754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61f8004d50 0x7f61f8005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:28.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6213400640 1 -- 172.21.15.87:0/3449702754 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f62140d2090 con 0x7f61f8003a80 2024-05-27T06:28:28.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6213400640 1 -- 172.21.15.87:0/3449702754 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f621415dbb0 con 0x7f61f8004d50 2024-05-27T06:28:28.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6213400640 1 -- 172.21.15.87:0/3449702754 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f61f800bb90 con 0x7f621415cfe0 2024-05-27T06:28:28.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6219200640 1 --2- 172.21.15.87:0/3449702754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61f8003a80 0x7f61f8003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:28.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6219c00640 1 --2- 172.21.15.87:0/3449702754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61f8004d50 0x7f61f8005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:28.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6213e00640 1 --2- 172.21.15.87:0/3449702754 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f621415cfe0 0x7f61f8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:28.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6219200640 1 -- 172.21.15.87:0/3449702754 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f621415cfe0 msgr2=0x7f61f8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:28.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6219200640 1 --2- 172.21.15.87:0/3449702754 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f621415cfe0 0x7f61f8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6219200640 1 -- 172.21.15.87:0/3449702754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61f8004d50 msgr2=0x7f61f8005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:28.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6219200640 1 --2- 172.21.15.87:0/3449702754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61f8004d50 0x7f61f8005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6219200640 1 -- 172.21.15.87:0/3449702754 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f8003530 con 0x7f61f8003a80 2024-05-27T06:28:28.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.154+0000 7f6213e00640 1 --2- 172.21.15.87:0/3449702754 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f621415cfe0 0x7f61f8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:28.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.158+0000 7f6219200640 1 --2- 172.21.15.87:0/3449702754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61f8003a80 0x7f61f8003ef0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f620400aa70 tx=0x7f620401fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d736d821c6774d13 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:28.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.158+0000 7f6213400640 1 -- 172.21.15.87:0/3449702754 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620400a690 con 0x7f61f8003a80 2024-05-27T06:28:28.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.158+0000 7f6213400640 1 -- 172.21.15.87:0/3449702754 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62040ad070 con 0x7f61f8003a80 2024-05-27T06:28:28.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.158+0000 7f6213400640 1 -- 172.21.15.87:0/3449702754 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62040a99a0 con 0x7f61f8003a80 2024-05-27T06:28:28.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.158+0000 7f621bc00640 1 -- 172.21.15.87:0/3449702754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61f8003a80 msgr2=0x7f61f8003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:28.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.158+0000 7f621bc00640 1 --2- 172.21.15.87:0/3449702754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61f8003a80 0x7f61f8003ef0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f620400aa70 tx=0x7f620401fa80 comp rx=0 tx=0).stop 2024-05-27T06:28:28.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.158+0000 7f6219c00640 1 -- 172.21.15.87:0/3449702754 reap_dead start 2024-05-27T06:28:28.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.158+0000 7f621bc00640 1 -- 172.21.15.87:0/3449702754 shutdown_connections 2024-05-27T06:28:28.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.158+0000 7f621bc00640 1 -- 172.21.15.87:0/3449702754 >> 172.21.15.87:0/3449702754 conn(0x7f62140b46b0 msgr2=0x7f62140b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:28.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.158+0000 7f621bc00640 1 -- 172.21.15.87:0/3449702754 shutdown_connections 2024-05-27T06:28:28.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.158+0000 7f621bc00640 1 -- 172.21.15.87:0/3449702754 wait complete. 2024-05-27T06:28:28.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.162+0000 7f621bc00640 1 Processor -- start 2024-05-27T06:28:28.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.162+0000 7f621bc00640 1 -- start start 2024-05-27T06:28:28.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.162+0000 7f621bc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61f8003a80 0x7f62140c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:28.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.162+0000 7f621bc00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62140c5c90 0x7f62140c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:28.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.162+0000 7f621bc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62140c91d0 0x7f62140c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:28.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.162+0000 7f621bc00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f621415e170 con 0x7f62140c5c90 2024-05-27T06:28:28.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.162+0000 7f621bc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f621406caa0 con 0x7f62140c91d0 2024-05-27T06:28:28.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.162+0000 7f621bc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f62140cc3a0 con 0x7f61f8003a80 2024-05-27T06:28:28.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.162+0000 7f6213e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62140c5c90 0x7f62140c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:28.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.162+0000 7f6213e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62140c5c90 0x7f62140c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50894/0 (socket says 172.21.15.87:50894) 2024-05-27T06:28:28.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.162+0000 7f6213e00640 1 -- 172.21.15.87:0/1291936705 learned_addr learned my addr 172.21.15.87:0/1291936705 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:28.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.166+0000 7f6219200640 1 --2- 172.21.15.87:0/1291936705 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61f8003a80 0x7f62140c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:28.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.166+0000 7f6213e00640 1 -- 172.21.15.87:0/1291936705 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61f8003a80 msgr2=0x7f62140c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:28.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.166+0000 7f6213e00640 1 --2- 172.21.15.87:0/1291936705 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61f8003a80 0x7f62140c5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.166+0000 7f6213e00640 1 -- 172.21.15.87:0/1291936705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62140c91d0 msgr2=0x7f62140c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:28.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.166+0000 7f6219c00640 1 --2- 172.21.15.87:0/1291936705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62140c91d0 0x7f62140c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:28.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.166+0000 7f6213e00640 1 --2- 172.21.15.87:0/1291936705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62140c91d0 0x7f62140c95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.166+0000 7f6213e00640 1 -- 172.21.15.87:0/1291936705 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f621415ba50 con 0x7f62140c5c90 2024-05-27T06:28:28.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.166+0000 7f6219200640 1 --2- 172.21.15.87:0/1291936705 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61f8003a80 0x7f62140c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:28.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.166+0000 7f6219c00640 1 --2- 172.21.15.87:0/1291936705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62140c91d0 0x7f62140c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:28.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.166+0000 7f6213e00640 1 --2- 172.21.15.87:0/1291936705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62140c5c90 0x7f62140c8c90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6200009fd0 tx=0x7f6200011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:28.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.166+0000 7f6210c00640 1 -- 172.21.15.87:0/1291936705 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6200004220 con 0x7f62140c5c90 2024-05-27T06:28:28.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.166+0000 7f6210c00640 1 -- 172.21.15.87:0/1291936705 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62000043c0 con 0x7f62140c5c90 2024-05-27T06:28:28.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.166+0000 7f6210c00640 1 -- 172.21.15.87:0/1291936705 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620000f9e0 con 0x7f62140c5c90 2024-05-27T06:28:28.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.166+0000 7f621bc00640 1 -- 172.21.15.87:0/1291936705 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62140c9b20 con 0x7f62140c5c90 2024-05-27T06:28:28.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.166+0000 7f621bc00640 1 -- 172.21.15.87:0/1291936705 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62140c63f0 con 0x7f62140c5c90 2024-05-27T06:28:28.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.166+0000 7f621bc00640 1 -- 172.21.15.87:0/1291936705 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f621406aa30 con 0x7f62140c5c90 2024-05-27T06:28:28.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.166+0000 7f6210c00640 1 -- 172.21.15.87:0/1291936705 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f620000fb80 con 0x7f62140c5c90 2024-05-27T06:28:28.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.166+0000 7f6210c00640 1 --2- 172.21.15.87:0/1291936705 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f61f406f430 0x7f61f4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:28.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.166+0000 7f6210c00640 1 -- 172.21.15.87:0/1291936705 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f620008fec0 con 0x7f62140c5c90 2024-05-27T06:28:28.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.170+0000 7f6219200640 1 --2- 172.21.15.87:0/1291936705 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f61f406f430 0x7f61f4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:28.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.170+0000 7f6219200640 1 --2- 172.21.15.87:0/1291936705 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f61f406f430 0x7f61f4071940 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f62040b1000 tx=0x7f62040ab070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:28.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.174+0000 7f6210c00640 1 -- 172.21.15.87:0/1291936705 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f6200019030 con 0x7f62140c5c90 2024-05-27T06:28:28.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.362+0000 7f621bc00640 1 -- 172.21.15.87:0/1291936705 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f62140b2870 con 0x7f62140c5c90 2024-05-27T06:28:28.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.366+0000 7f6210c00640 1 -- 172.21.15.87:0/1291936705 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7f620005c8f0 con 0x7f62140c5c90 2024-05-27T06:28:28.362 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:28.362 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1075024068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1075024068},{"type":"v1","addr":"172.21.15.87:6835","nonce":1075024068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/437385084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":437385084},{"type":"v1","addr":"172.21.15.149:6833","nonce":437385084}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/852280291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":852280291},{"type":"v1","addr":"172.21.15.149:6835","nonce":852280291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T06:27:37.964959+0000","modified":"2024-05-27T06:27:59.081534+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/1799934036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1799934036},{"type":"v1","addr":"172.21.15.87:6837","nonce":1799934036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-27T06:28:28.362 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 9 2024-05-27T06:28:28.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.366+0000 7f621bc00640 1 -- 172.21.15.87:0/1291936705 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f61f406f430 msgr2=0x7f61f4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:28.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.366+0000 7f621bc00640 1 --2- 172.21.15.87:0/1291936705 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f61f406f430 0x7f61f4071940 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f62040b1000 tx=0x7f62040ab070 comp rx=0 tx=0).stop 2024-05-27T06:28:28.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.366+0000 7f621bc00640 1 -- 172.21.15.87:0/1291936705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62140c5c90 msgr2=0x7f62140c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:28.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.366+0000 7f621bc00640 1 --2- 172.21.15.87:0/1291936705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62140c5c90 0x7f62140c8c90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6200009fd0 tx=0x7f6200011b30 comp rx=0 tx=0).stop 2024-05-27T06:28:28.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.366+0000 7f621bc00640 1 -- 172.21.15.87:0/1291936705 shutdown_connections 2024-05-27T06:28:28.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.366+0000 7f621bc00640 1 --2- 172.21.15.87:0/1291936705 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f61f406f430 0x7f61f4071940 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.366+0000 7f621bc00640 1 --2- 172.21.15.87:0/1291936705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62140c91d0 0x7f62140c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.366+0000 7f621bc00640 1 --2- 172.21.15.87:0/1291936705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62140c5c90 0x7f62140c8c90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.366+0000 7f621bc00640 1 --2- 172.21.15.87:0/1291936705 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61f8003a80 0x7f62140c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.366+0000 7f621bc00640 1 -- 172.21.15.87:0/1291936705 >> 172.21.15.87:0/1291936705 conn(0x7f62140b46b0 msgr2=0x7f62140cc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:28.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.366+0000 7f621bc00640 1 -- 172.21.15.87:0/1291936705 shutdown_connections 2024-05-27T06:28:28.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.366+0000 7f621bc00640 1 -- 172.21.15.87:0/1291936705 wait complete. 2024-05-27T06:28:28.384 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T06:28:28.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.534+0000 7fa7a1800640 1 Processor -- start 2024-05-27T06:28:28.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.534+0000 7fa7a1800640 1 -- start start 2024-05-27T06:28:28.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.534+0000 7fa7a1800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa79c0d26f0 0x7fa79c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:28.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.534+0000 7fa7a1800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa79c0ccee0 con 0x7fa79c0ce430 2024-05-27T06:28:28.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.534+0000 7fa7a1800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa79c0cd1c0 con 0x7fa79c0b7940 2024-05-27T06:28:28.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.534+0000 7fa7a1800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fa79c0ca540 con 0x7fa79c0d26f0 2024-05-27T06:28:28.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.534+0000 7fa79be00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fa79c0ce430 0x7fa79c0d1fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51748/0 (socket says 172.21.15.87:51748) 2024-05-27T06:28:28.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.534+0000 7fa79be00640 1 -- 172.21.15.87:0/803402020 learned_addr learned my addr 172.21.15.87:0/803402020 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:28.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.534+0000 7fa79b400640 1 --2- 172.21.15.87:0/803402020 >> v2:172.21.15.149:3300/0 conn(0x7fa79c0d26f0 0x7fa79c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:28.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.534+0000 7fa79aa00640 1 -- 172.21.15.87:0/803402020 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 55865869 0 0) 0x7fa79c0ccee0 con 0x7fa79c0ce430 2024-05-27T06:28:28.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.534+0000 7fa79aa00640 1 -- 172.21.15.87:0/803402020 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa780003530 con 0x7fa79c0ce430 2024-05-27T06:28:28.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.534+0000 7fa79aa00640 1 -- 172.21.15.87:0/803402020 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4224718321 0 0) 0x7fa780003530 con 0x7fa79c0ce430 2024-05-27T06:28:28.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.534+0000 7fa79aa00640 1 -- 172.21.15.87:0/803402020 >> v2:172.21.15.149:3300/0 conn(0x7fa79c0d26f0 msgr2=0x7fa79c0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:28.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.534+0000 7fa79aa00640 1 --2- 172.21.15.87:0/803402020 >> v2:172.21.15.149:3300/0 conn(0x7fa79c0d26f0 0x7fa79c0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.534+0000 7fa79aa00640 1 -- 172.21.15.87:0/803402020 >> v1:172.21.15.149:6789/0 conn(0x7fa79c0b7940 legacy=0x7fa79c169700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:28.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.534+0000 7fa79aa00640 1 -- 172.21.15.87:0/803402020 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa79c0cd4a0 con 0x7fa79c0ce430 2024-05-27T06:28:28.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.534+0000 7fa79aa00640 1 -- 172.21.15.87:0/803402020 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7fa78c001a80 con 0x7fa79c0ce430 2024-05-27T06:28:28.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.534+0000 7fa79aa00640 1 -- 172.21.15.87:0/803402020 >> v1:172.21.15.87:6789/0 conn(0x7fa79c0ce430 legacy=0x7fa79c0d1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:28.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.534+0000 7fa79aa00640 1 --2- 172.21.15.87:0/803402020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa780003a60 0x7fa780003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:28.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.534+0000 7fa79aa00640 1 --2- 172.21.15.87:0/803402020 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa780004810 0x7fa780004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:28.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.534+0000 7fa79aa00640 1 --2- 172.21.15.87:0/803402020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa780005260 0x7fa78000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:28.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.538+0000 7fa79aa00640 1 -- 172.21.15.87:0/803402020 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa78000c1c0 con 0x7fa780005260 2024-05-27T06:28:28.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.538+0000 7fa79aa00640 1 -- 172.21.15.87:0/803402020 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa78000c370 con 0x7fa780003a60 2024-05-27T06:28:28.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.538+0000 7fa79aa00640 1 -- 172.21.15.87:0/803402020 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa78000c570 con 0x7fa780004810 2024-05-27T06:28:28.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.538+0000 7fa7a0e00640 1 --2- 172.21.15.87:0/803402020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa780005260 0x7fa78000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:28.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.538+0000 7fa79be00640 1 --2- 172.21.15.87:0/803402020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa780003a60 0x7fa780003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:28.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.538+0000 7fa79b400640 1 --2- 172.21.15.87:0/803402020 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa780004810 0x7fa780004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:28.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.538+0000 7fa7a0e00640 1 -- 172.21.15.87:0/803402020 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa780004810 msgr2=0x7fa780004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:28.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.538+0000 7fa7a0e00640 1 --2- 172.21.15.87:0/803402020 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa780004810 0x7fa780004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.538+0000 7fa7a0e00640 1 -- 172.21.15.87:0/803402020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa780003a60 msgr2=0x7fa780003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:28.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.538+0000 7fa7a0e00640 1 --2- 172.21.15.87:0/803402020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa780003a60 0x7fa780003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.538+0000 7fa7a0e00640 1 -- 172.21.15.87:0/803402020 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa780003530 con 0x7fa780005260 2024-05-27T06:28:28.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.538+0000 7fa7a0e00640 1 -- 172.21.15.87:0/803402020 reap_dead start 2024-05-27T06:28:28.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.538+0000 7fa7a0e00640 1 --2- 172.21.15.87:0/803402020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa780005260 0x7fa78000b9d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0d2e70 tx=0x7fa79401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f8a2f583450b4d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:28.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.542+0000 7fa79aa00640 1 -- 172.21.15.87:0/803402020 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7940013e0 con 0x7fa780005260 2024-05-27T06:28:28.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.542+0000 7fa79aa00640 1 -- 172.21.15.87:0/803402020 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7940052d0 con 0x7fa780005260 2024-05-27T06:28:28.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.542+0000 7fa79aa00640 1 -- 172.21.15.87:0/803402020 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa794003840 con 0x7fa780005260 2024-05-27T06:28:28.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.542+0000 7fa7a1800640 1 -- 172.21.15.87:0/803402020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa780005260 msgr2=0x7fa78000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:28.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.542+0000 7fa7a1800640 1 --2- 172.21.15.87:0/803402020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa780005260 0x7fa78000b9d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0d2e70 tx=0x7fa79401c3d0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.542+0000 7fa7a1800640 1 -- 172.21.15.87:0/803402020 shutdown_connections 2024-05-27T06:28:28.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.542+0000 7fa7a1800640 1 --2- 172.21.15.87:0/803402020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa780005260 0x7fa78000b9d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.542+0000 7fa7a1800640 1 -- 172.21.15.87:0/803402020 >> 172.21.15.87:0/803402020 conn(0x7fa79c0cfe80 msgr2=0x7fa79c0d0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:28.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.542+0000 7fa7a1800640 1 -- 172.21.15.87:0/803402020 shutdown_connections 2024-05-27T06:28:28.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.542+0000 7fa7a1800640 1 -- 172.21.15.87:0/803402020 wait complete. 2024-05-27T06:28:28.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.542+0000 7fa7a1800640 1 Processor -- start 2024-05-27T06:28:28.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.542+0000 7fa7a1800640 1 -- start start 2024-05-27T06:28:28.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.546+0000 7fa7a1800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa780005260 0x7fa79c149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:28.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.546+0000 7fa7a1800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa79c14a090 0x7fa79c14b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:28.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.546+0000 7fa7a1800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa79c14be80 0x7fa79c14f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:28.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.546+0000 7fa7a1800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c0ce840 con 0x7fa79c14a090 2024-05-27T06:28:28.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.546+0000 7fa7a1800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c0cfb90 con 0x7fa79c14be80 2024-05-27T06:28:28.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.546+0000 7fa7a1800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa79c0ce9c0 con 0x7fa780005260 2024-05-27T06:28:28.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.546+0000 7fa79b400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa79c14a090 0x7fa79c14b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:28.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.546+0000 7fa79b400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa79c14a090 0x7fa79c14b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50914/0 (socket says 172.21.15.87:50914) 2024-05-27T06:28:28.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.546+0000 7fa79b400640 1 -- 172.21.15.87:0/2141869403 learned_addr learned my addr 172.21.15.87:0/2141869403 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:28.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.546+0000 7fa79be00640 1 --2- 172.21.15.87:0/2141869403 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa780005260 0x7fa79c149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:28.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.546+0000 7fa7a0e00640 1 --2- 172.21.15.87:0/2141869403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa79c14be80 0x7fa79c14f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:28.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.546+0000 7fa79b400640 1 -- 172.21.15.87:0/2141869403 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa780005260 msgr2=0x7fa79c149b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:28.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.546+0000 7fa79b400640 1 --2- 172.21.15.87:0/2141869403 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa780005260 0x7fa79c149b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.546+0000 7fa79b400640 1 -- 172.21.15.87:0/2141869403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa79c14be80 msgr2=0x7fa79c14f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:28.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.546+0000 7fa79b400640 1 --2- 172.21.15.87:0/2141869403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa79c14be80 0x7fa79c14f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.546+0000 7fa79b400640 1 -- 172.21.15.87:0/2141869403 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa79c14c290 con 0x7fa79c14a090 2024-05-27T06:28:28.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.546+0000 7fa79b400640 1 --2- 172.21.15.87:0/2141869403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa79c14a090 0x7fa79c14b940 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa788011990 tx=0x7fa788011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:28.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.546+0000 7fa793e00640 1 -- 172.21.15.87:0/2141869403 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78800fad0 con 0x7fa79c14a090 2024-05-27T06:28:28.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.546+0000 7fa793e00640 1 -- 172.21.15.87:0/2141869403 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa78800fc70 con 0x7fa79c14a090 2024-05-27T06:28:28.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.546+0000 7fa7a1800640 1 -- 172.21.15.87:0/2141869403 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa79c14a8c0 con 0x7fa79c14a090 2024-05-27T06:28:28.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.546+0000 7fa793e00640 1 -- 172.21.15.87:0/2141869403 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa788014440 con 0x7fa79c14a090 2024-05-27T06:28:28.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.546+0000 7fa7a1800640 1 -- 172.21.15.87:0/2141869403 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa79c14ae80 con 0x7fa79c14a090 2024-05-27T06:28:28.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.546+0000 7fa7a1800640 1 -- 172.21.15.87:0/2141869403 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa79c06aa30 con 0x7fa79c14a090 2024-05-27T06:28:28.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.550+0000 7fa793e00640 1 -- 172.21.15.87:0/2141869403 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa788012040 con 0x7fa79c14a090 2024-05-27T06:28:28.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.550+0000 7fa793e00640 1 --2- 172.21.15.87:0/2141869403 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa77c06f400 0x7fa77c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:28.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.550+0000 7fa793e00640 1 -- 172.21.15.87:0/2141869403 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fa78808fde0 con 0x7fa79c14a090 2024-05-27T06:28:28.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.550+0000 7fa79be00640 1 --2- 172.21.15.87:0/2141869403 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa77c06f400 0x7fa77c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:28.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.550+0000 7fa79be00640 1 --2- 172.21.15.87:0/2141869403 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa77c06f400 0x7fa77c071910 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0cd990 tx=0x7fa78c006040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:28.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.554+0000 7fa793e00640 1 -- 172.21.15.87:0/2141869403 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa79c14c290 con 0x7fa79c14a090 2024-05-27T06:28:28.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.746+0000 7fa7a1800640 1 -- 172.21.15.87:0/2141869403 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa79c14a650 con 0x7fa79c14a090 2024-05-27T06:28:28.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.746+0000 7fa793e00640 1 -- 172.21.15.87:0/2141869403 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7fa788019030 con 0x7fa79c14a090 2024-05-27T06:28:28.744 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:28.744 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1075024068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1075024068},{"type":"v1","addr":"172.21.15.87:6835","nonce":1075024068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/437385084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":437385084},{"type":"v1","addr":"172.21.15.149:6833","nonce":437385084}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/852280291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":852280291},{"type":"v1","addr":"172.21.15.149:6835","nonce":852280291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T06:27:37.964959+0000","modified":"2024-05-27T06:27:59.081534+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/1799934036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1799934036},{"type":"v1","addr":"172.21.15.87:6837","nonce":1799934036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-27T06:28:28.744 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 9 2024-05-27T06:28:28.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.750+0000 7fa7a1800640 1 -- 172.21.15.87:0/2141869403 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa77c06f400 msgr2=0x7fa77c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:28.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.750+0000 7fa7a1800640 1 --2- 172.21.15.87:0/2141869403 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa77c06f400 0x7fa77c071910 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0cd990 tx=0x7fa78c006040 comp rx=0 tx=0).stop 2024-05-27T06:28:28.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.750+0000 7fa7a1800640 1 -- 172.21.15.87:0/2141869403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa79c14a090 msgr2=0x7fa79c14b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:28.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.750+0000 7fa7a1800640 1 --2- 172.21.15.87:0/2141869403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa79c14a090 0x7fa79c14b940 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa788011990 tx=0x7fa788011e50 comp rx=0 tx=0).stop 2024-05-27T06:28:28.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.750+0000 7fa7a1800640 1 -- 172.21.15.87:0/2141869403 shutdown_connections 2024-05-27T06:28:28.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.750+0000 7fa7a1800640 1 --2- 172.21.15.87:0/2141869403 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa77c06f400 0x7fa77c071910 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.750+0000 7fa7a1800640 1 --2- 172.21.15.87:0/2141869403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa79c14be80 0x7fa79c14f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.750+0000 7fa7a1800640 1 --2- 172.21.15.87:0/2141869403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa79c14a090 0x7fa79c14b940 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.750+0000 7fa7a1800640 1 --2- 172.21.15.87:0/2141869403 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa780005260 0x7fa79c149b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.750+0000 7fa7a1800640 1 -- 172.21.15.87:0/2141869403 >> 172.21.15.87:0/2141869403 conn(0x7fa79c0cfe80 msgr2=0x7fa79c0d1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:28.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.750+0000 7fa7a1800640 1 -- 172.21.15.87:0/2141869403 shutdown_connections 2024-05-27T06:28:28.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.750+0000 7fa7a1800640 1 -- 172.21.15.87:0/2141869403 wait complete. 2024-05-27T06:28:28.766 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T06:28:28.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.914+0000 7f98f2600640 1 Processor -- start 2024-05-27T06:28:28.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.914+0000 7f98f2600640 1 -- start start 2024-05-27T06:28:28.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.918+0000 7f98f2600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f98ec0b03c0 0x7f98ec0cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:28.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.918+0000 7f98f2600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f98ec0b07d0 0x7f98ec0ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:28.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.918+0000 7f98f2600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98ec15fd70 0x7f98ec160180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:28.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.918+0000 7f98f2600640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f98ec06d610 con 0x7f98ec0b07d0 2024-05-27T06:28:28.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.918+0000 7f98f2600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f98ec0d10f0 con 0x7f98ec0b03c0 2024-05-27T06:28:28.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.918+0000 7f98f2600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f98ec06c720 con 0x7f98ec15fd70 2024-05-27T06:28:28.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.918+0000 7f98e3e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f98ec0b07d0 0x7f98ec0ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:28.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.918+0000 7f98e3e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f98ec0b07d0 0x7f98ec0ce270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50918/0 (socket says 172.21.15.87:50918) 2024-05-27T06:28:28.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.918+0000 7f98e3e00640 1 -- 172.21.15.87:0/3604124118 learned_addr learned my addr 172.21.15.87:0/3604124118 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:28.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.918+0000 7f98eb400640 1 --2- 172.21.15.87:0/3604124118 >> v2:172.21.15.149:3300/0 conn(0x7f98ec0b03c0 0x7f98ec0cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:28.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.918+0000 7f98ebe00640 1 --2- 172.21.15.87:0/3604124118 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98ec15fd70 0x7f98ec160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:28.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.918+0000 7f98e3e00640 1 -- 172.21.15.87:0/3604124118 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98ec15fd70 msgr2=0x7f98ec160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:28.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.918+0000 7f98e3e00640 1 --2- 172.21.15.87:0/3604124118 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98ec15fd70 0x7f98ec160180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.918+0000 7f98e3e00640 1 -- 172.21.15.87:0/3604124118 >> v2:172.21.15.149:3300/0 conn(0x7f98ec0b03c0 msgr2=0x7f98ec0cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:28.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.918+0000 7f98e3e00640 1 --2- 172.21.15.87:0/3604124118 >> v2:172.21.15.149:3300/0 conn(0x7f98ec0b03c0 0x7f98ec0cdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.918+0000 7f98e3e00640 1 -- 172.21.15.87:0/3604124118 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98ec06ca00 con 0x7f98ec0b07d0 2024-05-27T06:28:28.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.922+0000 7f98e3e00640 1 --2- 172.21.15.87:0/3604124118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98ec0b07d0 0x7f98ec0ce270 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f98ec072270 tx=0x7f98d401d8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2032575c1141f8eb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:28.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.922+0000 7f98eaa00640 1 -- 172.21.15.87:0/3604124118 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d40b3070 con 0x7f98ec0b07d0 2024-05-27T06:28:28.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.922+0000 7f98eaa00640 1 -- 172.21.15.87:0/3604124118 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d40a68b0 con 0x7f98ec0b07d0 2024-05-27T06:28:28.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.922+0000 7f98eaa00640 1 -- 172.21.15.87:0/3604124118 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d400b040 con 0x7f98ec0b07d0 2024-05-27T06:28:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.922+0000 7f98f2600640 1 -- 172.21.15.87:0/3604124118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98ec0b07d0 msgr2=0x7f98ec0ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.922+0000 7f98f2600640 1 --2- 172.21.15.87:0/3604124118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98ec0b07d0 0x7f98ec0ce270 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f98ec072270 tx=0x7f98d401d8c0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.922+0000 7f98f2600640 1 -- 172.21.15.87:0/3604124118 shutdown_connections 2024-05-27T06:28:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.922+0000 7f98f2600640 1 --2- 172.21.15.87:0/3604124118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98ec0b07d0 0x7f98ec0ce270 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.922+0000 7f98f2600640 1 --2- 172.21.15.87:0/3604124118 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98ec15fd70 0x7f98ec160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.922+0000 7f98f2600640 1 --2- 172.21.15.87:0/3604124118 >> v2:172.21.15.149:3300/0 conn(0x7f98ec0b03c0 0x7f98ec0cdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.922+0000 7f98f2600640 1 -- 172.21.15.87:0/3604124118 >> 172.21.15.87:0/3604124118 conn(0x7f98ec0b46b0 msgr2=0x7f98ec0b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.922+0000 7f98f2600640 1 -- 172.21.15.87:0/3604124118 shutdown_connections 2024-05-27T06:28:28.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.922+0000 7f98f2600640 1 -- 172.21.15.87:0/3604124118 wait complete. 2024-05-27T06:28:28.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.926+0000 7f98f2600640 1 Processor -- start 2024-05-27T06:28:28.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.926+0000 7f98f2600640 1 -- start start 2024-05-27T06:28:28.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.926+0000 7f98f2600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98ec0b03c0 0x7f98ec09aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:28.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.926+0000 7f98f2600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98ec0b07d0 0x7f98ec0b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:28.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.926+0000 7f98f2600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98ec15fd70 0x7f98ec0b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:28.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.926+0000 7f98f2600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f98ec160ad0 con 0x7f98ec0b03c0 2024-05-27T06:28:28.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.926+0000 7f98f2600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f98ec15c620 con 0x7f98ec0b07d0 2024-05-27T06:28:28.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.926+0000 7f98f2600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f98ec0ae340 con 0x7f98ec15fd70 2024-05-27T06:28:28.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.926+0000 7f98eb400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98ec0b03c0 0x7f98ec09aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:28.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.926+0000 7f98eb400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98ec0b03c0 0x7f98ec09aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50934/0 (socket says 172.21.15.87:50934) 2024-05-27T06:28:28.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.926+0000 7f98eb400640 1 -- 172.21.15.87:0/264232198 learned_addr learned my addr 172.21.15.87:0/264232198 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:28.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.926+0000 7f98ebe00640 1 --2- 172.21.15.87:0/264232198 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98ec15fd70 0x7f98ec0b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:28.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.926+0000 7f98e3e00640 1 --2- 172.21.15.87:0/264232198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98ec0b07d0 0x7f98ec0b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:28.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.926+0000 7f98eb400640 1 -- 172.21.15.87:0/264232198 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98ec15fd70 msgr2=0x7f98ec0b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:28.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.926+0000 7f98eb400640 1 --2- 172.21.15.87:0/264232198 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98ec15fd70 0x7f98ec0b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.926+0000 7f98eb400640 1 -- 172.21.15.87:0/264232198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98ec0b07d0 msgr2=0x7f98ec0b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:28.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.926+0000 7f98eb400640 1 --2- 172.21.15.87:0/264232198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98ec0b07d0 0x7f98ec0b2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:28.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.926+0000 7f98eb400640 1 -- 172.21.15.87:0/264232198 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98ec0cd080 con 0x7f98ec0b03c0 2024-05-27T06:28:28.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.926+0000 7f98eb400640 1 --2- 172.21.15.87:0/264232198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98ec0b03c0 0x7f98ec09aa60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f98dc00e8a0 tx=0x7f98dc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:28.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.926+0000 7f98e3400640 1 -- 172.21.15.87:0/264232198 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98dc017070 con 0x7f98ec0b03c0 2024-05-27T06:28:28.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.926+0000 7f98e3400640 1 -- 172.21.15.87:0/264232198 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98dc00ee90 con 0x7f98ec0b03c0 2024-05-27T06:28:28.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.926+0000 7f98f2600640 1 -- 172.21.15.87:0/264232198 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98ec0cd360 con 0x7f98ec0b03c0 2024-05-27T06:28:28.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.926+0000 7f98e3400640 1 -- 172.21.15.87:0/264232198 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98dc00cb80 con 0x7f98ec0b03c0 2024-05-27T06:28:28.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.926+0000 7f98f2600640 1 -- 172.21.15.87:0/264232198 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98ec1655f0 con 0x7f98ec0b03c0 2024-05-27T06:28:28.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.926+0000 7f98f2600640 1 -- 172.21.15.87:0/264232198 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98ec06aa30 con 0x7f98ec0b03c0 2024-05-27T06:28:28.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.930+0000 7f98e3400640 1 -- 172.21.15.87:0/264232198 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f98dc01a070 con 0x7f98ec0b03c0 2024-05-27T06:28:28.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.930+0000 7f98e3400640 1 --2- 172.21.15.87:0/264232198 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f98c806f430 0x7f98c8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:28.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.930+0000 7f98e3400640 1 -- 172.21.15.87:0/264232198 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f98dc08fa20 con 0x7f98ec0b03c0 2024-05-27T06:28:28.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.930+0000 7f98e3e00640 1 --2- 172.21.15.87:0/264232198 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f98c806f430 0x7f98c8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:28.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.930+0000 7f98e3e00640 1 --2- 172.21.15.87:0/264232198 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f98c806f430 0x7f98c8071940 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f98d40b0000 tx=0x7f98d40a8070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:28.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:28.934+0000 7f98e3400640 1 -- 172.21.15.87:0/264232198 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f98dc05c3d0 con 0x7f98ec0b03c0 2024-05-27T06:28:29.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.094+0000 7f98f2600640 1 -- 172.21.15.87:0/264232198 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f98ec0c45b0 con 0x7f98ec0b03c0 2024-05-27T06:28:29.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.094+0000 7f98e3400640 1 -- 172.21.15.87:0/264232198 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18938 (secure 0 0 0) 0x7f98dc05bcd0 con 0x7f98ec0b03c0 2024-05-27T06:28:29.092 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:29.092 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":26,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:28:19.781895+0000","last_up_change":"2024-05-27T06:27:25.988592+0000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T06:27:26.590191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T06:27:35.840893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T06:27:36.929608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-27T06:27:40.638358+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6801","nonce":3674824716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6803","nonce":3674824716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6807","nonce":3674824716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6805","nonce":3674824716}]},"public_addr":"172.21.15.87:6801/3674824716","cluster_addr":"172.21.15.87:6803/3674824716","heartbeat_back_addr":"172.21.15.87:6807/3674824716","heartbeat_front_addr":"172.21.15.87:6805/3674824716","state":["exists","up"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6809","nonce":2443981288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6811","nonce":2443981288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6815","nonce":2443981288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6813","nonce":2443981288}]},"public_addr":"172.21.15.87:6809/2443981288","cluster_addr":"172.21.15.87:6811/2443981288","heartbeat_back_addr":"172.21.15.87:6815/2443981288","heartbeat_front_addr":"172.21.15.87:6813/2443981288","state":["exists","up"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6819","nonce":1441249238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6823","nonce":1441249238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6831","nonce":1441249238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6825","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6827","nonce":1441249238}]},"public_addr":"172.21.15.87:6819/1441249238","cluster_addr":"172.21.15.87:6823/1441249238","heartbeat_back_addr":"172.21.15.87:6831/1441249238","heartbeat_front_addr":"172.21.15.87:6827/1441249238","state":["exists","up"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6818","nonce":1173805234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6822","nonce":1173805234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6829","nonce":1173805234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6826","nonce":1173805234}]},"public_addr":"172.21.15.87:6818/1173805234","cluster_addr":"172.21.15.87:6822/1173805234","heartbeat_back_addr":"172.21.15.87:6829/1173805234","heartbeat_front_addr":"172.21.15.87:6826/1173805234","state":["exists","up"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6819","nonce":1551871079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6823","nonce":1551871079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6831","nonce":1551871079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6827","nonce":1551871079}]},"public_addr":"172.21.15.149:6819/1551871079","cluster_addr":"172.21.15.149:6823/1551871079","heartbeat_back_addr":"172.21.15.149:6831/1551871079","heartbeat_front_addr":"172.21.15.149:6827/1551871079","state":["exists","up"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6818","nonce":582864816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6822","nonce":582864816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6830","nonce":582864816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6826","nonce":582864816}]},"public_addr":"172.21.15.149:6818/582864816","cluster_addr":"172.21.15.149:6822/582864816","heartbeat_back_addr":"172.21.15.149:6830/582864816","heartbeat_front_addr":"172.21.15.149:6826/582864816","state":["exists","up"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6801","nonce":531351314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6803","nonce":531351314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6807","nonce":531351314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6805","nonce":531351314}]},"public_addr":"172.21.15.149:6801/531351314","cluster_addr":"172.21.15.149:6803/531351314","heartbeat_back_addr":"172.21.15.149:6807/531351314","heartbeat_front_addr":"172.21.15.149:6805/531351314","state":["exists","up"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6809","nonce":1171039913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6811","nonce":1171039913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6815","nonce":1171039913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6813","nonce":1171039913}]},"public_addr":"172.21.15.149:6809/1171039913","cluster_addr":"172.21.15.149:6811/1171039913","heartbeat_back_addr":"172.21.15.149:6815/1171039913","heartbeat_front_addr":"172.21.15.149:6813/1171039913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.589776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.819787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.767566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.683842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.038885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.120319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.687007+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.812832+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:28:29.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.094+0000 7f98f2600640 1 -- 172.21.15.87:0/264232198 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f98c806f430 msgr2=0x7f98c8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:29.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.094+0000 7f98f2600640 1 --2- 172.21.15.87:0/264232198 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f98c806f430 0x7f98c8071940 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f98d40b0000 tx=0x7f98d40a8070 comp rx=0 tx=0).stop 2024-05-27T06:28:29.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.094+0000 7f98f2600640 1 -- 172.21.15.87:0/264232198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98ec0b03c0 msgr2=0x7f98ec09aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:29.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.094+0000 7f98f2600640 1 --2- 172.21.15.87:0/264232198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98ec0b03c0 0x7f98ec09aa60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f98dc00e8a0 tx=0x7f98dc00ed60 comp rx=0 tx=0).stop 2024-05-27T06:28:29.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.094+0000 7f98f2600640 1 -- 172.21.15.87:0/264232198 shutdown_connections 2024-05-27T06:28:29.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.094+0000 7f98f2600640 1 --2- 172.21.15.87:0/264232198 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f98c806f430 0x7f98c8071940 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:29.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.094+0000 7f98f2600640 1 --2- 172.21.15.87:0/264232198 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98ec15fd70 0x7f98ec0b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:29.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.094+0000 7f98f2600640 1 --2- 172.21.15.87:0/264232198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98ec0b07d0 0x7f98ec0b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:29.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.094+0000 7f98f2600640 1 --2- 172.21.15.87:0/264232198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98ec0b03c0 0x7f98ec09aa60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:29.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.094+0000 7f98f2600640 1 -- 172.21.15.87:0/264232198 >> 172.21.15.87:0/264232198 conn(0x7f98ec0b46b0 msgr2=0x7f98ec159fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:29.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.094+0000 7f98f2600640 1 -- 172.21.15.87:0/264232198 shutdown_connections 2024-05-27T06:28:29.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.098+0000 7f98f2600640 1 -- 172.21.15.87:0/264232198 wait complete. 2024-05-27T06:28:29.114 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-27T06:28:29.114 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T06:28:29.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.266+0000 7faeba600640 1 Processor -- start 2024-05-27T06:28:29.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.266+0000 7faeba600640 1 -- start start 2024-05-27T06:28:29.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.266+0000 7faeba600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faeb40cea40 0x7faeb4158360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:29.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.266+0000 7faeba600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7faeb40b2fb0 0x7faeb40b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:29.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.266+0000 7faeba600640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faeb40b2cd0 con 0x7faeb40d2010 2024-05-27T06:28:29.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.266+0000 7faeba600640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7faeb40ce5b0 con 0x7faeb40b2fb0 2024-05-27T06:28:29.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.266+0000 7faeba600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7faeb40cdc80 con 0x7faeb40cea40 2024-05-27T06:28:29.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.266+0000 7faeb3e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7faeb40b2fb0 0x7faeb40b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:29.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.266+0000 7faeaaa00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7faeb40d2010 0x7faeb40d2420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51752/0 (socket says 172.21.15.87:51752) 2024-05-27T06:28:29.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.266+0000 7faeaaa00640 1 -- 172.21.15.87:0/3368415388 learned_addr learned my addr 172.21.15.87:0/3368415388 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:29.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.266+0000 7faeb3400640 1 --2- 172.21.15.87:0/3368415388 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faeb40cea40 0x7faeb4158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:29.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.266+0000 7faeb3e00640 1 -- 172.21.15.87:0/3368415388 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faeb40cea40 msgr2=0x7faeb4158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:29.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.266+0000 7faeb3e00640 1 --2- 172.21.15.87:0/3368415388 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faeb40cea40 0x7faeb4158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:29.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.266+0000 7faeb3e00640 1 -- 172.21.15.87:0/3368415388 >> v1:172.21.15.87:6789/0 conn(0x7faeb40d2010 legacy=0x7faeb40d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:29.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.266+0000 7faeb3e00640 1 -- 172.21.15.87:0/3368415388 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb40cdf60 con 0x7faeb40b2fb0 2024-05-27T06:28:29.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.266+0000 7faeb2a00640 1 -- 172.21.15.87:0/3368415388 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 731053317 0 0) 0x7faeb40b2cd0 con 0x7faeb40d2010 2024-05-27T06:28:29.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.270+0000 7faeb3e00640 1 --2- 172.21.15.87:0/3368415388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faeb40b2fb0 0x7faeb40b33c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faeac009d90 tx=0x7faeac01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59fc59f3a4fb3f6f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:29.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.270+0000 7faeb2a00640 1 -- 172.21.15.87:0/3368415388 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac0b2070 con 0x7faeb40b2fb0 2024-05-27T06:28:29.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.270+0000 7faeb2a00640 1 -- 172.21.15.87:0/3368415388 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeac0a5a00 con 0x7faeb40b2fb0 2024-05-27T06:28:29.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.270+0000 7faeb2a00640 1 -- 172.21.15.87:0/3368415388 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac0a5dd0 con 0x7faeb40b2fb0 2024-05-27T06:28:29.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.270+0000 7faeba600640 1 -- 172.21.15.87:0/3368415388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faeb40b2fb0 msgr2=0x7faeb40b33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:29.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.270+0000 7faeba600640 1 --2- 172.21.15.87:0/3368415388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faeb40b2fb0 0x7faeb40b33c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faeac009d90 tx=0x7faeac01c940 comp rx=0 tx=0).stop 2024-05-27T06:28:29.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.270+0000 7faeba600640 1 -- 172.21.15.87:0/3368415388 shutdown_connections 2024-05-27T06:28:29.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.270+0000 7faeba600640 1 --2- 172.21.15.87:0/3368415388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faeb40b2fb0 0x7faeb40b33c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:29.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.270+0000 7faeba600640 1 --2- 172.21.15.87:0/3368415388 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faeb40cea40 0x7faeb4158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:29.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.270+0000 7faeba600640 1 -- 172.21.15.87:0/3368415388 >> 172.21.15.87:0/3368415388 conn(0x7faeb40d3590 msgr2=0x7faeb40d39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:29.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.270+0000 7faeba600640 1 -- 172.21.15.87:0/3368415388 shutdown_connections 2024-05-27T06:28:29.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.270+0000 7faeba600640 1 -- 172.21.15.87:0/3368415388 wait complete. 2024-05-27T06:28:29.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.274+0000 7faeba600640 1 Processor -- start 2024-05-27T06:28:29.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.274+0000 7faeba600640 1 -- start start 2024-05-27T06:28:29.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.274+0000 7faeba600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb40b2fb0 0x7faeb4156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:29.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.274+0000 7faeba600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faeb40cea40 0x7faeb41513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:29.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.274+0000 7faeba600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faeb40d2010 0x7faeb4151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:29.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.274+0000 7faeba600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7faeb40d2ee0 con 0x7faeb40d2010 2024-05-27T06:28:29.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.274+0000 7faeba600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7faeb40d2d60 con 0x7faeb40b2fb0 2024-05-27T06:28:29.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.274+0000 7faeba600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7faeb40cee50 con 0x7faeb40cea40 2024-05-27T06:28:29.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.274+0000 7faeb3e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faeb40d2010 0x7faeb4151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:29.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.274+0000 7faeb3e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faeb40d2010 0x7faeb4151910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50944/0 (socket says 172.21.15.87:50944) 2024-05-27T06:28:29.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.274+0000 7faeb3e00640 1 -- 172.21.15.87:0/845523869 learned_addr learned my addr 172.21.15.87:0/845523869 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:29.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.274+0000 7faeb3400640 1 --2- 172.21.15.87:0/845523869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb40b2fb0 0x7faeb4156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:29.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.274+0000 7faeaaa00640 1 --2- 172.21.15.87:0/845523869 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faeb40cea40 0x7faeb41513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:29.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.278+0000 7faeb3e00640 1 -- 172.21.15.87:0/845523869 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faeb40cea40 msgr2=0x7faeb41513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:29.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.278+0000 7faeb3e00640 1 --2- 172.21.15.87:0/845523869 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faeb40cea40 0x7faeb41513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:29.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.278+0000 7faeb3e00640 1 -- 172.21.15.87:0/845523869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb40b2fb0 msgr2=0x7faeb4156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:29.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.278+0000 7faeb3e00640 1 --2- 172.21.15.87:0/845523869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb40b2fb0 0x7faeb4156870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:29.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.278+0000 7faeb3e00640 1 -- 172.21.15.87:0/845523869 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb415b9a0 con 0x7faeb40d2010 2024-05-27T06:28:29.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.278+0000 7faeb3e00640 1 --2- 172.21.15.87:0/845523869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faeb40d2010 0x7faeb4151910 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faeac0b0040 tx=0x7faeac0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:29.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.278+0000 7faeabe00640 1 -- 172.21.15.87:0/845523869 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac0b2050 con 0x7faeb40d2010 2024-05-27T06:28:29.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.278+0000 7faeabe00640 1 -- 172.21.15.87:0/845523869 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeac0be070 con 0x7faeb40d2010 2024-05-27T06:28:29.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.278+0000 7faeabe00640 1 -- 172.21.15.87:0/845523869 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac0adad0 con 0x7faeb40d2010 2024-05-27T06:28:29.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.278+0000 7faeba600640 1 -- 172.21.15.87:0/845523869 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeb415b3e0 con 0x7faeb40d2010 2024-05-27T06:28:29.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.278+0000 7faeba600640 1 -- 172.21.15.87:0/845523869 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeb414ae60 con 0x7faeb40d2010 2024-05-27T06:28:29.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.278+0000 7faeba600640 1 -- 172.21.15.87:0/845523869 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faeb4159a40 con 0x7faeb40d2010 2024-05-27T06:28:29.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.278+0000 7faeabe00640 1 -- 172.21.15.87:0/845523869 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7faeac0adc70 con 0x7faeb40d2010 2024-05-27T06:28:29.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.282+0000 7faeabe00640 1 --2- 172.21.15.87:0/845523869 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fae9006f430 0x7fae90071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:29.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.282+0000 7faeabe00640 1 -- 172.21.15.87:0/845523869 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7faeac12a480 con 0x7faeb40d2010 2024-05-27T06:28:29.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.282+0000 7faeb3400640 1 --2- 172.21.15.87:0/845523869 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fae9006f430 0x7fae90071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:29.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.282+0000 7faeb3400640 1 --2- 172.21.15.87:0/845523869 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fae9006f430 0x7fae90071940 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faeb40d1610 tx=0x7faea4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:29.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.286+0000 7faeabe00640 1 -- 172.21.15.87:0/845523869 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7faeac0c7020 con 0x7faeb40d2010 2024-05-27T06:28:29.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.474+0000 7faeba600640 1 -- 172.21.15.87:0/845523869 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faeb406aa30 con 0x7faeb40d2010 2024-05-27T06:28:29.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.474+0000 7faeabe00640 1 -- 172.21.15.87:0/845523869 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7faeac016560 con 0x7faeb40d2010 2024-05-27T06:28:29.474 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:29.474 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1075024068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1075024068},{"type":"v1","addr":"172.21.15.87:6835","nonce":1075024068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/437385084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":437385084},{"type":"v1","addr":"172.21.15.149:6833","nonce":437385084}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/852280291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":852280291},{"type":"v1","addr":"172.21.15.149:6835","nonce":852280291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T06:27:37.964959+0000","modified":"2024-05-27T06:27:59.081534+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/1799934036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1799934036},{"type":"v1","addr":"172.21.15.87:6837","nonce":1799934036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-27T06:28:29.474 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 9 2024-05-27T06:28:29.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.478+0000 7faeba600640 1 -- 172.21.15.87:0/845523869 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fae9006f430 msgr2=0x7fae90071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:29.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.478+0000 7faeba600640 1 --2- 172.21.15.87:0/845523869 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fae9006f430 0x7fae90071940 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faeb40d1610 tx=0x7faea4008040 comp rx=0 tx=0).stop 2024-05-27T06:28:29.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.478+0000 7faeba600640 1 -- 172.21.15.87:0/845523869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faeb40d2010 msgr2=0x7faeb4151910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:29.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.478+0000 7faeba600640 1 --2- 172.21.15.87:0/845523869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faeb40d2010 0x7faeb4151910 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faeac0b0040 tx=0x7faeac0196e0 comp rx=0 tx=0).stop 2024-05-27T06:28:29.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.478+0000 7faeba600640 1 -- 172.21.15.87:0/845523869 shutdown_connections 2024-05-27T06:28:29.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.478+0000 7faeba600640 1 --2- 172.21.15.87:0/845523869 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fae9006f430 0x7fae90071940 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:29.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.478+0000 7faeba600640 1 --2- 172.21.15.87:0/845523869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faeb40d2010 0x7faeb4151910 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:29.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.478+0000 7faeba600640 1 --2- 172.21.15.87:0/845523869 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faeb40cea40 0x7faeb41513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:29.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.478+0000 7faeba600640 1 --2- 172.21.15.87:0/845523869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb40b2fb0 0x7faeb4156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:29.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.478+0000 7faeba600640 1 -- 172.21.15.87:0/845523869 >> 172.21.15.87:0/845523869 conn(0x7faeb40d3590 msgr2=0x7faeb40686b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:29.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.478+0000 7faeba600640 1 -- 172.21.15.87:0/845523869 shutdown_connections 2024-05-27T06:28:29.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.478+0000 7faeba600640 1 -- 172.21.15.87:0/845523869 wait complete. 2024-05-27T06:28:29.496 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T06:28:29.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.646+0000 7f00bf400640 1 Processor -- start 2024-05-27T06:28:29.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.646+0000 7f00bf400640 1 -- start start 2024-05-27T06:28:29.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.646+0000 7f00bf400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00b80ce2d0 0x7f00b80ce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:29.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.646+0000 7f00bf400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f00b8070890 0x7f00b8070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:29.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.646+0000 7f00bf400640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00b80d2b10 con 0x7f00b815daf0 2024-05-27T06:28:29.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.646+0000 7f00bf400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f00b815df00 con 0x7f00b8070890 2024-05-27T06:28:29.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.646+0000 7f00bf400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f00b80d2270 con 0x7f00b80ce2d0 2024-05-27T06:28:29.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.646+0000 7f00bca00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f00b815daf0 0x7f00b80b8f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51762/0 (socket says 172.21.15.87:51762) 2024-05-27T06:28:29.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.646+0000 7f00bca00640 1 -- 172.21.15.87:0/1542859317 learned_addr learned my addr 172.21.15.87:0/1542859317 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:29.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.646+0000 7f00bd400640 1 --2- 172.21.15.87:0/1542859317 >> v2:172.21.15.149:3300/0 conn(0x7f00b8070890 0x7f00b8070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:29.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.646+0000 7f00afe00640 1 --2- 172.21.15.87:0/1542859317 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00b80ce2d0 0x7f00b80ce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:29.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.650+0000 7f00b7e00640 1 -- 172.21.15.87:0/1542859317 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 665397258 0 0) 0x7f00b80d2b10 con 0x7f00b815daf0 2024-05-27T06:28:29.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.650+0000 7f00b7e00640 1 -- 172.21.15.87:0/1542859317 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f009c003530 con 0x7f00b815daf0 2024-05-27T06:28:29.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.650+0000 7f00bd400640 1 -- 172.21.15.87:0/1542859317 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00b80ce2d0 msgr2=0x7f00b80ce6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:29.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.650+0000 7f00bd400640 1 --2- 172.21.15.87:0/1542859317 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00b80ce2d0 0x7f00b80ce6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:29.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.650+0000 7f00bd400640 1 -- 172.21.15.87:0/1542859317 >> v1:172.21.15.87:6789/0 conn(0x7f00b815daf0 legacy=0x7f00b80b8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:29.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.650+0000 7f00bd400640 1 -- 172.21.15.87:0/1542859317 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b80d2550 con 0x7f00b8070890 2024-05-27T06:28:29.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.650+0000 7f00bd400640 1 --2- 172.21.15.87:0/1542859317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00b8070890 0x7f00b8070ca0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009d90 tx=0x7f00b001c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cda72c3bfdfe851 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:29.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.650+0000 7f00b7e00640 1 -- 172.21.15.87:0/1542859317 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b00b2070 con 0x7f00b8070890 2024-05-27T06:28:29.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.650+0000 7f00b7e00640 1 -- 172.21.15.87:0/1542859317 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b00a5a00 con 0x7f00b8070890 2024-05-27T06:28:29.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.650+0000 7f00b7e00640 1 -- 172.21.15.87:0/1542859317 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b00a5db0 con 0x7f00b8070890 2024-05-27T06:28:29.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.654+0000 7f00bf400640 1 -- 172.21.15.87:0/1542859317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00b8070890 msgr2=0x7f00b8070ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:29.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.654+0000 7f00bf400640 1 --2- 172.21.15.87:0/1542859317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00b8070890 0x7f00b8070ca0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009d90 tx=0x7f00b001c940 comp rx=0 tx=0).stop 2024-05-27T06:28:29.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.654+0000 7f00bf400640 1 -- 172.21.15.87:0/1542859317 shutdown_connections 2024-05-27T06:28:29.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.654+0000 7f00bf400640 1 --2- 172.21.15.87:0/1542859317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00b8070890 0x7f00b8070ca0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:29.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.654+0000 7f00bf400640 1 --2- 172.21.15.87:0/1542859317 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00b80ce2d0 0x7f00b80ce6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:29.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.654+0000 7f00bf400640 1 -- 172.21.15.87:0/1542859317 >> 172.21.15.87:0/1542859317 conn(0x7f00b80d3600 msgr2=0x7f00b80d3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:29.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.654+0000 7f00bf400640 1 -- 172.21.15.87:0/1542859317 shutdown_connections 2024-05-27T06:28:29.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.654+0000 7f00bf400640 1 -- 172.21.15.87:0/1542859317 wait complete. 2024-05-27T06:28:29.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.654+0000 7f00bf400640 1 Processor -- start 2024-05-27T06:28:29.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.654+0000 7f00bf400640 1 -- start start 2024-05-27T06:28:29.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.658+0000 7f00bf400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00b8070890 0x7f00b8155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:29.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.658+0000 7f00bf400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00b80ce2d0 0x7f00b806f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:29.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.658+0000 7f00bf400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00b815daf0 0x7f00b80b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:29.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.658+0000 7f00bf400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f00b816a930 con 0x7f00b815daf0 2024-05-27T06:28:29.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.658+0000 7f00bf400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f00b816a7b0 con 0x7f00b80ce2d0 2024-05-27T06:28:29.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.658+0000 7f00bf400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f00b816aab0 con 0x7f00b8070890 2024-05-27T06:28:29.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.658+0000 7f00bd400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00b815daf0 0x7f00b80b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:29.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.658+0000 7f00bd400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00b815daf0 0x7f00b80b35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50960/0 (socket says 172.21.15.87:50960) 2024-05-27T06:28:29.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.658+0000 7f00bd400640 1 -- 172.21.15.87:0/2124535795 learned_addr learned my addr 172.21.15.87:0/2124535795 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:29.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.658+0000 7f00bca00640 1 --2- 172.21.15.87:0/2124535795 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00b8070890 0x7f00b8155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:29.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.658+0000 7f00afe00640 1 --2- 172.21.15.87:0/2124535795 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00b80ce2d0 0x7f00b806f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:29.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.658+0000 7f00bd400640 1 -- 172.21.15.87:0/2124535795 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00b8070890 msgr2=0x7f00b8155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:29.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.658+0000 7f00bd400640 1 --2- 172.21.15.87:0/2124535795 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00b8070890 0x7f00b8155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:29.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.658+0000 7f00bd400640 1 -- 172.21.15.87:0/2124535795 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00b80ce2d0 msgr2=0x7f00b806f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:29.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.658+0000 7f00bd400640 1 --2- 172.21.15.87:0/2124535795 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00b80ce2d0 0x7f00b806f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:29.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.658+0000 7f00bd400640 1 -- 172.21.15.87:0/2124535795 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b80cbb40 con 0x7f00b815daf0 2024-05-27T06:28:29.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.658+0000 7f00afe00640 1 --2- 172.21.15.87:0/2124535795 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00b80ce2d0 0x7f00b806f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:29.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.658+0000 7f00bca00640 1 --2- 172.21.15.87:0/2124535795 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00b8070890 0x7f00b8155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:29.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.658+0000 7f00bd400640 1 --2- 172.21.15.87:0/2124535795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00b815daf0 0x7f00b80b35b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f00b00b0040 tx=0x7f00b00196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:29.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.658+0000 7f00b5600640 1 -- 172.21.15.87:0/2124535795 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b00b2050 con 0x7f00b815daf0 2024-05-27T06:28:29.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.658+0000 7f00b5600640 1 -- 172.21.15.87:0/2124535795 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b00be070 con 0x7f00b815daf0 2024-05-27T06:28:29.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.658+0000 7f00bf400640 1 -- 172.21.15.87:0/2124535795 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b80cbe20 con 0x7f00b815daf0 2024-05-27T06:28:29.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.658+0000 7f00b5600640 1 -- 172.21.15.87:0/2124535795 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b0004040 con 0x7f00b815daf0 2024-05-27T06:28:29.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.658+0000 7f00bf400640 1 -- 172.21.15.87:0/2124535795 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b80cc3e0 con 0x7f00b815daf0 2024-05-27T06:28:29.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.658+0000 7f00bf400640 1 -- 172.21.15.87:0/2124535795 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00b806aa30 con 0x7f00b815daf0 2024-05-27T06:28:29.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.662+0000 7f00b5600640 1 -- 172.21.15.87:0/2124535795 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f00b00041e0 con 0x7f00b815daf0 2024-05-27T06:28:29.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.662+0000 7f00b5600640 1 --2- 172.21.15.87:0/2124535795 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f009406f400 0x7f0094071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:29.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.662+0000 7f00b5600640 1 -- 172.21.15.87:0/2124535795 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f00b012a950 con 0x7f00b815daf0 2024-05-27T06:28:29.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.662+0000 7f00bca00640 1 --2- 172.21.15.87:0/2124535795 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f009406f400 0x7f0094071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:29.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.662+0000 7f00bca00640 1 --2- 172.21.15.87:0/2124535795 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f009406f400 0x7f0094071910 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f00a8001230 tx=0x7f00a8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:29.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.666+0000 7f00b5600640 1 -- 172.21.15.87:0/2124535795 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f00b0016560 con 0x7f00b815daf0 2024-05-27T06:28:29.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.858+0000 7f00bf400640 1 -- 172.21.15.87:0/2124535795 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00b806ff20 con 0x7f00b815daf0 2024-05-27T06:28:29.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.858+0000 7f00b5600640 1 -- 172.21.15.87:0/2124535795 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7f00b00f7390 con 0x7f00b815daf0 2024-05-27T06:28:29.856 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:29.856 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1075024068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1075024068},{"type":"v1","addr":"172.21.15.87:6835","nonce":1075024068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/437385084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":437385084},{"type":"v1","addr":"172.21.15.149:6833","nonce":437385084}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/852280291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":852280291},{"type":"v1","addr":"172.21.15.149:6835","nonce":852280291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T06:27:37.964959+0000","modified":"2024-05-27T06:27:59.081534+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/1799934036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1799934036},{"type":"v1","addr":"172.21.15.87:6837","nonce":1799934036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-27T06:28:29.856 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 9 2024-05-27T06:28:29.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.862+0000 7f00bf400640 1 -- 172.21.15.87:0/2124535795 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f009406f400 msgr2=0x7f0094071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:29.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.862+0000 7f00bf400640 1 --2- 172.21.15.87:0/2124535795 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f009406f400 0x7f0094071910 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f00a8001230 tx=0x7f00a8009040 comp rx=0 tx=0).stop 2024-05-27T06:28:29.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.862+0000 7f00bf400640 1 -- 172.21.15.87:0/2124535795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00b815daf0 msgr2=0x7f00b80b35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:29.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.862+0000 7f00bf400640 1 --2- 172.21.15.87:0/2124535795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00b815daf0 0x7f00b80b35b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f00b00b0040 tx=0x7f00b00196e0 comp rx=0 tx=0).stop 2024-05-27T06:28:29.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.862+0000 7f00bf400640 1 -- 172.21.15.87:0/2124535795 shutdown_connections 2024-05-27T06:28:29.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.862+0000 7f00bf400640 1 --2- 172.21.15.87:0/2124535795 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f009406f400 0x7f0094071910 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:29.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.862+0000 7f00bf400640 1 --2- 172.21.15.87:0/2124535795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00b815daf0 0x7f00b80b35b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:29.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.862+0000 7f00bf400640 1 --2- 172.21.15.87:0/2124535795 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f00b80ce2d0 0x7f00b806f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:29.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.862+0000 7f00bf400640 1 --2- 172.21.15.87:0/2124535795 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f00b8070890 0x7f00b8155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:29.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.862+0000 7f00bf400640 1 -- 172.21.15.87:0/2124535795 >> 172.21.15.87:0/2124535795 conn(0x7f00b80d3600 msgr2=0x7f00b80b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:29.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.862+0000 7f00bf400640 1 -- 172.21.15.87:0/2124535795 shutdown_connections 2024-05-27T06:28:29.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:29.862+0000 7f00bf400640 1 -- 172.21.15.87:0/2124535795 wait complete. 2024-05-27T06:28:29.878 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T06:28:30.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.026+0000 7f6e81400640 1 Processor -- start 2024-05-27T06:28:30.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.026+0000 7f6e81400640 1 -- start start 2024-05-27T06:28:30.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.030+0000 7f6e81400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6e7c0ce7e0 0x7f6e7c15fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:30.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.030+0000 7f6e81400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6e7c0b5460 0x7f6e7c0713c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:30.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.030+0000 7f6e81400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e7c163ed0 con 0x7f6e7c0b5870 2024-05-27T06:28:30.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.030+0000 7f6e81400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f6e7c1641b0 con 0x7f6e7c0b5460 2024-05-27T06:28:30.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.030+0000 7f6e81400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f6e7c164490 con 0x7f6e7c0ce7e0 2024-05-27T06:28:30.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.030+0000 7f6e79e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6e7c0b5460 0x7f6e7c0713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:30.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.030+0000 7f6e79e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6e7c0b5460 0x7f6e7c0713c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50972/0 (socket says 172.21.15.87:50972) 2024-05-27T06:28:30.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.030+0000 7f6e79e00640 1 -- 172.21.15.87:0/1844345242 learned_addr learned my addr 172.21.15.87:0/1844345242 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:30.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.030+0000 7f6e79e00640 1 -- 172.21.15.87:0/1844345242 >> v2:172.21.15.149:3300/0 conn(0x7f6e7c0ce7e0 msgr2=0x7f6e7c15fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:30.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.030+0000 7f6e79e00640 1 --2- 172.21.15.87:0/1844345242 >> v2:172.21.15.149:3300/0 conn(0x7f6e7c0ce7e0 0x7f6e7c15fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.030+0000 7f6e79e00640 1 -- 172.21.15.87:0/1844345242 >> v1:172.21.15.149:6789/0 conn(0x7f6e7c0b5870 legacy=0x7f6e7c1608c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:30.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.030+0000 7f6e79e00640 1 -- 172.21.15.87:0/1844345242 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e7c164770 con 0x7f6e7c0b5460 2024-05-27T06:28:30.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.034+0000 7f6e79e00640 1 --2- 172.21.15.87:0/1844345242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e7c0b5460 0x7f6e7c0713c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c0b6780 tx=0x7f6e6801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6776034f4bd01434 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:30.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.034+0000 7f6e79400640 1 -- 172.21.15.87:0/1844345242 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0cee00 con 0x7f6e7c0b5460 2024-05-27T06:28:30.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.034+0000 7f6e79400640 1 -- 172.21.15.87:0/1844345242 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e680af070 con 0x7f6e7c0b5460 2024-05-27T06:28:30.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.034+0000 7f6e79400640 1 -- 172.21.15.87:0/1844345242 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e680aa810 con 0x7f6e7c0b5460 2024-05-27T06:28:30.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.034+0000 7f6e81400640 1 -- 172.21.15.87:0/1844345242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e7c0b5460 msgr2=0x7f6e7c0713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:30.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.034+0000 7f6e81400640 1 --2- 172.21.15.87:0/1844345242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e7c0b5460 0x7f6e7c0713c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c0b6780 tx=0x7f6e6801c4b0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.034+0000 7f6e81400640 1 -- 172.21.15.87:0/1844345242 shutdown_connections 2024-05-27T06:28:30.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.034+0000 7f6e81400640 1 --2- 172.21.15.87:0/1844345242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e7c0b5460 0x7f6e7c0713c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.034+0000 7f6e81400640 1 --2- 172.21.15.87:0/1844345242 >> v2:172.21.15.149:3300/0 conn(0x7f6e7c0ce7e0 0x7f6e7c15fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.034+0000 7f6e81400640 1 -- 172.21.15.87:0/1844345242 >> 172.21.15.87:0/1844345242 conn(0x7f6e7c0d2550 msgr2=0x7f6e7c0d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:30.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.034+0000 7f6e81400640 1 -- 172.21.15.87:0/1844345242 shutdown_connections 2024-05-27T06:28:30.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.034+0000 7f6e81400640 1 -- 172.21.15.87:0/1844345242 wait complete. 2024-05-27T06:28:30.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.034+0000 7f6e81400640 1 Processor -- start 2024-05-27T06:28:30.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.034+0000 7f6e81400640 1 -- start start 2024-05-27T06:28:30.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.038+0000 7f6e81400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e7c0b5460 0x7f6e7c0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:30.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.038+0000 7f6e81400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e7c0b5870 0x7f6e7c14ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:30.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.038+0000 7f6e81400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e7c0ce7e0 0x7f6e7c15b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:30.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.038+0000 7f6e81400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c16d720 con 0x7f6e7c0b5460 2024-05-27T06:28:30.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.038+0000 7f6e81400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c071d10 con 0x7f6e7c0ce7e0 2024-05-27T06:28:30.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.038+0000 7f6e81400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6e7c16d8a0 con 0x7f6e7c0b5870 2024-05-27T06:28:30.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.038+0000 7f6e7a800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e7c0b5460 0x7f6e7c0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:30.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.038+0000 7f6e7a800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e7c0b5460 0x7f6e7c0b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50974/0 (socket says 172.21.15.87:50974) 2024-05-27T06:28:30.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.038+0000 7f6e7a800640 1 -- 172.21.15.87:0/3239753929 learned_addr learned my addr 172.21.15.87:0/3239753929 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:30.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.038+0000 7f6e79e00640 1 --2- 172.21.15.87:0/3239753929 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e7c0b5870 0x7f6e7c14ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:30.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.038+0000 7f6e7b200640 1 --2- 172.21.15.87:0/3239753929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e7c0ce7e0 0x7f6e7c15b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:30.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.038+0000 7f6e7a800640 1 -- 172.21.15.87:0/3239753929 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e7c0b5870 msgr2=0x7f6e7c14ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:30.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.038+0000 7f6e7a800640 1 --2- 172.21.15.87:0/3239753929 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e7c0b5870 0x7f6e7c14ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.038+0000 7f6e7a800640 1 -- 172.21.15.87:0/3239753929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e7c0ce7e0 msgr2=0x7f6e7c15b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:30.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.038+0000 7f6e7a800640 1 --2- 172.21.15.87:0/3239753929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e7c0ce7e0 0x7f6e7c15b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.038+0000 7f6e7a800640 1 -- 172.21.15.87:0/3239753929 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e7c0afb20 con 0x7f6e7c0b5460 2024-05-27T06:28:30.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.038+0000 7f6e79e00640 1 --2- 172.21.15.87:0/3239753929 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e7c0b5870 0x7f6e7c14ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:30.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.038+0000 7f6e7b200640 1 --2- 172.21.15.87:0/3239753929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e7c0ce7e0 0x7f6e7c15b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:30.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.038+0000 7f6e7a800640 1 --2- 172.21.15.87:0/3239753929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e7c0b5460 0x7f6e7c0b1710 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c00b3c0 tx=0x7f6e6c00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:30.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.038+0000 7f6e72a00640 1 -- 172.21.15.87:0/3239753929 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c011830 con 0x7f6e7c0b5460 2024-05-27T06:28:30.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.038+0000 7f6e72a00640 1 -- 172.21.15.87:0/3239753929 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e6c016070 con 0x7f6e7c0b5460 2024-05-27T06:28:30.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.038+0000 7f6e81400640 1 -- 172.21.15.87:0/3239753929 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e7c0afe00 con 0x7f6e7c0b5460 2024-05-27T06:28:30.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.038+0000 7f6e72a00640 1 -- 172.21.15.87:0/3239753929 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c011c30 con 0x7f6e7c0b5460 2024-05-27T06:28:30.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.038+0000 7f6e81400640 1 -- 172.21.15.87:0/3239753929 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e7c0b03c0 con 0x7f6e7c0b5460 2024-05-27T06:28:30.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.038+0000 7f6e81400640 1 -- 172.21.15.87:0/3239753929 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e7c06aa30 con 0x7f6e7c0b5460 2024-05-27T06:28:30.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.042+0000 7f6e72a00640 1 -- 172.21.15.87:0/3239753929 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6e6c01b460 con 0x7f6e7c0b5460 2024-05-27T06:28:30.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.042+0000 7f6e72a00640 1 --2- 172.21.15.87:0/3239753929 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f6e5c06f400 0x7f6e5c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:30.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.042+0000 7f6e72a00640 1 -- 172.21.15.87:0/3239753929 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f6e6c08f4d0 con 0x7f6e7c0b5460 2024-05-27T06:28:30.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.042+0000 7f6e79e00640 1 --2- 172.21.15.87:0/3239753929 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f6e5c06f400 0x7f6e5c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:30.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.042+0000 7f6e79e00640 1 --2- 172.21.15.87:0/3239753929 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f6e5c06f400 0x7f6e5c071910 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6e680ae000 tx=0x7f6e680a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:30.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.046+0000 7f6e72a00640 1 -- 172.21.15.87:0/3239753929 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f6e6c05bf00 con 0x7f6e7c0b5460 2024-05-27T06:28:30.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.206+0000 7f6e81400640 1 -- 172.21.15.87:0/3239753929 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e7c0b6a50 con 0x7f6e7c0b5460 2024-05-27T06:28:30.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.206+0000 7f6e72a00640 1 -- 172.21.15.87:0/3239753929 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18938 (secure 0 0 0) 0x7f6e6c05b800 con 0x7f6e7c0b5460 2024-05-27T06:28:30.204 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:30.204 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":26,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:28:19.781895+0000","last_up_change":"2024-05-27T06:27:25.988592+0000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T06:27:26.590191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T06:27:35.840893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T06:27:36.929608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-27T06:27:40.638358+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6801","nonce":3674824716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6803","nonce":3674824716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6807","nonce":3674824716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6805","nonce":3674824716}]},"public_addr":"172.21.15.87:6801/3674824716","cluster_addr":"172.21.15.87:6803/3674824716","heartbeat_back_addr":"172.21.15.87:6807/3674824716","heartbeat_front_addr":"172.21.15.87:6805/3674824716","state":["exists","up"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6809","nonce":2443981288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6811","nonce":2443981288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6815","nonce":2443981288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6813","nonce":2443981288}]},"public_addr":"172.21.15.87:6809/2443981288","cluster_addr":"172.21.15.87:6811/2443981288","heartbeat_back_addr":"172.21.15.87:6815/2443981288","heartbeat_front_addr":"172.21.15.87:6813/2443981288","state":["exists","up"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6819","nonce":1441249238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6823","nonce":1441249238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6831","nonce":1441249238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6825","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6827","nonce":1441249238}]},"public_addr":"172.21.15.87:6819/1441249238","cluster_addr":"172.21.15.87:6823/1441249238","heartbeat_back_addr":"172.21.15.87:6831/1441249238","heartbeat_front_addr":"172.21.15.87:6827/1441249238","state":["exists","up"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6818","nonce":1173805234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6822","nonce":1173805234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6829","nonce":1173805234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6826","nonce":1173805234}]},"public_addr":"172.21.15.87:6818/1173805234","cluster_addr":"172.21.15.87:6822/1173805234","heartbeat_back_addr":"172.21.15.87:6829/1173805234","heartbeat_front_addr":"172.21.15.87:6826/1173805234","state":["exists","up"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6819","nonce":1551871079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6823","nonce":1551871079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6831","nonce":1551871079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6827","nonce":1551871079}]},"public_addr":"172.21.15.149:6819/1551871079","cluster_addr":"172.21.15.149:6823/1551871079","heartbeat_back_addr":"172.21.15.149:6831/1551871079","heartbeat_front_addr":"172.21.15.149:6827/1551871079","state":["exists","up"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6818","nonce":582864816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6822","nonce":582864816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6830","nonce":582864816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6826","nonce":582864816}]},"public_addr":"172.21.15.149:6818/582864816","cluster_addr":"172.21.15.149:6822/582864816","heartbeat_back_addr":"172.21.15.149:6830/582864816","heartbeat_front_addr":"172.21.15.149:6826/582864816","state":["exists","up"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6801","nonce":531351314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6803","nonce":531351314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6807","nonce":531351314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6805","nonce":531351314}]},"public_addr":"172.21.15.149:6801/531351314","cluster_addr":"172.21.15.149:6803/531351314","heartbeat_back_addr":"172.21.15.149:6807/531351314","heartbeat_front_addr":"172.21.15.149:6805/531351314","state":["exists","up"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6809","nonce":1171039913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6811","nonce":1171039913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6815","nonce":1171039913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6813","nonce":1171039913}]},"public_addr":"172.21.15.149:6809/1171039913","cluster_addr":"172.21.15.149:6811/1171039913","heartbeat_back_addr":"172.21.15.149:6815/1171039913","heartbeat_front_addr":"172.21.15.149:6813/1171039913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.589776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.819787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.767566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.683842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.038885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.120319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.687007+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.812832+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:28:30.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.206+0000 7f6e81400640 1 -- 172.21.15.87:0/3239753929 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f6e5c06f400 msgr2=0x7f6e5c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:30.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.206+0000 7f6e81400640 1 --2- 172.21.15.87:0/3239753929 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f6e5c06f400 0x7f6e5c071910 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6e680ae000 tx=0x7f6e680a7000 comp rx=0 tx=0).stop 2024-05-27T06:28:30.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.206+0000 7f6e81400640 1 -- 172.21.15.87:0/3239753929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e7c0b5460 msgr2=0x7f6e7c0b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:30.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.206+0000 7f6e81400640 1 --2- 172.21.15.87:0/3239753929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e7c0b5460 0x7f6e7c0b1710 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c00b3c0 tx=0x7f6e6c00b880 comp rx=0 tx=0).stop 2024-05-27T06:28:30.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.210+0000 7f6e81400640 1 -- 172.21.15.87:0/3239753929 shutdown_connections 2024-05-27T06:28:30.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.210+0000 7f6e81400640 1 --2- 172.21.15.87:0/3239753929 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f6e5c06f400 0x7f6e5c071910 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.210+0000 7f6e81400640 1 --2- 172.21.15.87:0/3239753929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e7c0ce7e0 0x7f6e7c15b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.210+0000 7f6e81400640 1 --2- 172.21.15.87:0/3239753929 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e7c0b5870 0x7f6e7c14ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.210+0000 7f6e81400640 1 --2- 172.21.15.87:0/3239753929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e7c0b5460 0x7f6e7c0b1710 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.210+0000 7f6e81400640 1 -- 172.21.15.87:0/3239753929 >> 172.21.15.87:0/3239753929 conn(0x7f6e7c0d2550 msgr2=0x7f6e7c06cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:30.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.210+0000 7f6e81400640 1 -- 172.21.15.87:0/3239753929 shutdown_connections 2024-05-27T06:28:30.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.210+0000 7f6e81400640 1 -- 172.21.15.87:0/3239753929 wait complete. 2024-05-27T06:28:30.226 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-27T06:28:30.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.378+0000 7f498a200640 1 Processor -- start 2024-05-27T06:28:30.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.378+0000 7f498a200640 1 -- start start 2024-05-27T06:28:30.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.378+0000 7f498a200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f498415cbc0 0x7f49840af540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:30.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.378+0000 7f498a200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4984074330 0x7f4984074740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:30.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.378+0000 7f498a200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4984072a70 0x7f4984072e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:30.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.378+0000 7f498a200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f498415cfd0 con 0x7f4984074330 2024-05-27T06:28:30.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.378+0000 7f498a200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f498406c9b0 con 0x7f4984072a70 2024-05-27T06:28:30.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.378+0000 7f498a200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f49840b0950 con 0x7f498415cbc0 2024-05-27T06:28:30.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.378+0000 7f497aa00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4984074330 0x7f4984074740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:30.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.378+0000 7f497aa00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4984074330 0x7f4984074740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50988/0 (socket says 172.21.15.87:50988) 2024-05-27T06:28:30.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.378+0000 7f497aa00640 1 -- 172.21.15.87:0/1848997869 learned_addr learned my addr 172.21.15.87:0/1848997869 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:30.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.378+0000 7f497aa00640 1 -- 172.21.15.87:0/1848997869 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f498415cbc0 msgr2=0x7f49840af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:30.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.378+0000 7f497aa00640 1 --2- 172.21.15.87:0/1848997869 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f498415cbc0 0x7f49840af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.378+0000 7f497aa00640 1 -- 172.21.15.87:0/1848997869 >> v2:172.21.15.149:3300/0 conn(0x7f4984072a70 msgr2=0x7f4984072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:30.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.378+0000 7f497aa00640 1 --2- 172.21.15.87:0/1848997869 >> v2:172.21.15.149:3300/0 conn(0x7f4984072a70 0x7f4984072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.378+0000 7f497aa00640 1 -- 172.21.15.87:0/1848997869 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4984074c80 con 0x7f4984074330 2024-05-27T06:28:30.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.382+0000 7f497aa00640 1 --2- 172.21.15.87:0/1848997869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4984074330 0x7f4984074740 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f49840b08c0 tx=0x7f496c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1142fb50457750 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:30.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.382+0000 7f4982a00640 1 -- 172.21.15.87:0/1848997869 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c0a7070 con 0x7f4984074330 2024-05-27T06:28:30.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.382+0000 7f4982a00640 1 -- 172.21.15.87:0/1848997869 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f496c0b0070 con 0x7f4984074330 2024-05-27T06:28:30.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.382+0000 7f4982a00640 1 -- 172.21.15.87:0/1848997869 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c0ab890 con 0x7f4984074330 2024-05-27T06:28:30.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.382+0000 7f498a200640 1 -- 172.21.15.87:0/1848997869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4984074330 msgr2=0x7f4984074740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:30.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.382+0000 7f498a200640 1 --2- 172.21.15.87:0/1848997869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4984074330 0x7f4984074740 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f49840b08c0 tx=0x7f496c01c4b0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.382+0000 7f498a200640 1 -- 172.21.15.87:0/1848997869 shutdown_connections 2024-05-27T06:28:30.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.382+0000 7f498a200640 1 --2- 172.21.15.87:0/1848997869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4984074330 0x7f4984074740 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.382+0000 7f498a200640 1 --2- 172.21.15.87:0/1848997869 >> v2:172.21.15.149:3300/0 conn(0x7f4984072a70 0x7f4984072e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.382+0000 7f498a200640 1 --2- 172.21.15.87:0/1848997869 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f498415cbc0 0x7f49840af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.382+0000 7f498a200640 1 -- 172.21.15.87:0/1848997869 >> 172.21.15.87:0/1848997869 conn(0x7f49840b2fb0 msgr2=0x7f49840b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:30.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.382+0000 7f498a200640 1 -- 172.21.15.87:0/1848997869 shutdown_connections 2024-05-27T06:28:30.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.382+0000 7f498a200640 1 -- 172.21.15.87:0/1848997869 wait complete. 2024-05-27T06:28:30.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.386+0000 7f498a200640 1 Processor -- start 2024-05-27T06:28:30.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.386+0000 7f498a200640 1 -- start start 2024-05-27T06:28:30.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.386+0000 7f498a200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4984072a70 0x7f4984150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:30.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.386+0000 7f498a200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4984074330 0x7f49841f8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:30.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.386+0000 7f498a200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f498415cbc0 0x7f498409cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:30.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.386+0000 7f498a200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f49840b05e0 con 0x7f4984074330 2024-05-27T06:28:30.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.386+0000 7f498a200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f49840b0300 con 0x7f4984072a70 2024-05-27T06:28:30.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.386+0000 7f498a200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f49840737d0 con 0x7f498415cbc0 2024-05-27T06:28:30.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.386+0000 7f497aa00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4984074330 0x7f49841f8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:30.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.386+0000 7f497aa00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4984074330 0x7f49841f8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50996/0 (socket says 172.21.15.87:50996) 2024-05-27T06:28:30.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.386+0000 7f497aa00640 1 -- 172.21.15.87:0/450101858 learned_addr learned my addr 172.21.15.87:0/450101858 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:30.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.386+0000 7f4983e00640 1 --2- 172.21.15.87:0/450101858 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f498415cbc0 0x7f498409cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:30.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.386+0000 7f4983400640 1 --2- 172.21.15.87:0/450101858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4984072a70 0x7f4984150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:30.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.386+0000 7f497aa00640 1 -- 172.21.15.87:0/450101858 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f498415cbc0 msgr2=0x7f498409cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:30.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.386+0000 7f497aa00640 1 --2- 172.21.15.87:0/450101858 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f498415cbc0 0x7f498409cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.386+0000 7f497aa00640 1 -- 172.21.15.87:0/450101858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4984072a70 msgr2=0x7f4984150e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:30.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.386+0000 7f497aa00640 1 --2- 172.21.15.87:0/450101858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4984072a70 0x7f4984150e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.386+0000 7f497aa00640 1 -- 172.21.15.87:0/450101858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f498414ecb0 con 0x7f4984074330 2024-05-27T06:28:30.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.390+0000 7f497aa00640 1 --2- 172.21.15.87:0/450101858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4984074330 0x7f49841f8ff0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f496c01ab60 tx=0x7f496c01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:30.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.390+0000 7f497be00640 1 -- 172.21.15.87:0/450101858 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c0b48c0 con 0x7f4984074330 2024-05-27T06:28:30.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.390+0000 7f497be00640 1 -- 172.21.15.87:0/450101858 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f496c0b4a80 con 0x7f4984074330 2024-05-27T06:28:30.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.390+0000 7f498a200640 1 -- 172.21.15.87:0/450101858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f498414ef90 con 0x7f4984074330 2024-05-27T06:28:30.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.390+0000 7f497be00640 1 -- 172.21.15.87:0/450101858 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c0be3f0 con 0x7f4984074330 2024-05-27T06:28:30.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.390+0000 7f498a200640 1 -- 172.21.15.87:0/450101858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f498414f550 con 0x7f4984074330 2024-05-27T06:28:30.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.390+0000 7f498a200640 1 -- 172.21.15.87:0/450101858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f498406aa30 con 0x7f4984074330 2024-05-27T06:28:30.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.390+0000 7f497be00640 1 -- 172.21.15.87:0/450101858 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f496c0c6390 con 0x7f4984074330 2024-05-27T06:28:30.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.390+0000 7f497be00640 1 --2- 172.21.15.87:0/450101858 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f496006f400 0x7f4960071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:30.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.390+0000 7f497be00640 1 -- 172.21.15.87:0/450101858 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f496c12a5b0 con 0x7f4984074330 2024-05-27T06:28:30.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.390+0000 7f4983400640 1 --2- 172.21.15.87:0/450101858 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f496006f400 0x7f4960071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:30.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.394+0000 7f4983400640 1 --2- 172.21.15.87:0/450101858 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f496006f400 0x7f4960071910 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4984161800 tx=0x7f4974006f90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:30.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.398+0000 7f497be00640 1 -- 172.21.15.87:0/450101858 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f4984074c80 con 0x7f4984074330 2024-05-27T06:28:30.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.590+0000 7f498a200640 1 -- 172.21.15.87:0/450101858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f49840b3ba0 con 0x7f4984074330 2024-05-27T06:28:30.587 INFO:tasks.ceph.mon.a.smithi087.stderr:2024-05-27T06:28:30.590+0000 7f7cc0e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-27T06:28:30.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.590+0000 7f497be00640 1 -- 172.21.15.87:0/450101858 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f496c016130 con 0x7f4984074330 2024-05-27T06:28:30.589 INFO:teuthology.orchestra.run.smithi087.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-27T06:28:30.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.594+0000 7f498a200640 1 -- 172.21.15.87:0/450101858 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f496006f400 msgr2=0x7f4960071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:30.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.594+0000 7f498a200640 1 --2- 172.21.15.87:0/450101858 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f496006f400 0x7f4960071910 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4984161800 tx=0x7f4974006f90 comp rx=0 tx=0).stop 2024-05-27T06:28:30.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.594+0000 7f498a200640 1 -- 172.21.15.87:0/450101858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4984074330 msgr2=0x7f49841f8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:30.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.594+0000 7f498a200640 1 --2- 172.21.15.87:0/450101858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4984074330 0x7f49841f8ff0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f496c01ab60 tx=0x7f496c01acf0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.594+0000 7f498a200640 1 -- 172.21.15.87:0/450101858 shutdown_connections 2024-05-27T06:28:30.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.594+0000 7f498a200640 1 --2- 172.21.15.87:0/450101858 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f496006f400 0x7f4960071910 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.594+0000 7f498a200640 1 --2- 172.21.15.87:0/450101858 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f498415cbc0 0x7f498409cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.594+0000 7f498a200640 1 --2- 172.21.15.87:0/450101858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4984074330 0x7f49841f8ff0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.594+0000 7f498a200640 1 --2- 172.21.15.87:0/450101858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4984072a70 0x7f4984150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.594+0000 7f498a200640 1 -- 172.21.15.87:0/450101858 >> 172.21.15.87:0/450101858 conn(0x7f49840b2fb0 msgr2=0x7f49840b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:30.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.594+0000 7f498a200640 1 -- 172.21.15.87:0/450101858 shutdown_connections 2024-05-27T06:28:30.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.594+0000 7f498a200640 1 -- 172.21.15.87:0/450101858 wait complete. 2024-05-27T06:28:30.600 INFO:tasks.ceph.mds.c.smithi087.stderr: -3666> 2024-05-27T06:27:43.543+0000 7f55db400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-27T06:28:30.615 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-27T06:28:30.724 INFO:tasks.ceph.mds.c.smithi087.stdout:starting mds.c at 2024-05-27T06:28:30.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.774+0000 7f08a7000640 1 Processor -- start 2024-05-27T06:28:30.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.774+0000 7f08a7000640 1 -- start start 2024-05-27T06:28:30.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.774+0000 7f08a7000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08a00b42a0 0x7f08a00d2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:30.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.774+0000 7f08a7000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08a00b7170 con 0x7f08a01638f0 2024-05-27T06:28:30.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.774+0000 7f08a7000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08a00b7450 con 0x7f08a0156c80 2024-05-27T06:28:30.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.774+0000 7f08a7000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f08a00b7cf0 con 0x7f08a00b42a0 2024-05-27T06:28:30.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.774+0000 7f0897400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f08a01638f0 0x7f08a0163d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51770/0 (socket says 172.21.15.87:51770) 2024-05-27T06:28:30.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.774+0000 7f0897400640 1 -- 172.21.15.87:0/2738264988 learned_addr learned my addr 172.21.15.87:0/2738264988 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:30.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.778+0000 7f08a5000640 1 --2- 172.21.15.87:0/2738264988 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08a00b42a0 0x7f08a00d2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:30.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.778+0000 7f089f400640 1 -- 172.21.15.87:0/2738264988 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2812088565 0 0) 0x7f08a00b7170 con 0x7f08a01638f0 2024-05-27T06:28:30.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.778+0000 7f089f400640 1 -- 172.21.15.87:0/2738264988 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0884003530 con 0x7f08a01638f0 2024-05-27T06:28:30.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.778+0000 7f089f400640 1 -- 172.21.15.87:0/2738264988 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1584990028 0 0) 0x7f0884003530 con 0x7f08a01638f0 2024-05-27T06:28:30.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.778+0000 7f089f400640 1 -- 172.21.15.87:0/2738264988 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08a00b42a0 msgr2=0x7f08a00d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:30.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.778+0000 7f089f400640 1 --2- 172.21.15.87:0/2738264988 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08a00b42a0 0x7f08a00d2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.778+0000 7f089f400640 1 -- 172.21.15.87:0/2738264988 >> v1:172.21.15.149:6789/0 conn(0x7f08a0156c80 legacy=0x7f08a00b69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:30.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.778+0000 7f089f400640 1 -- 172.21.15.87:0/2738264988 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a00b7730 con 0x7f08a01638f0 2024-05-27T06:28:30.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.778+0000 7f089f400640 1 -- 172.21.15.87:0/2738264988 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7f0888001700 con 0x7f08a01638f0 2024-05-27T06:28:30.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.778+0000 7f089f400640 1 -- 172.21.15.87:0/2738264988 >> v1:172.21.15.87:6789/0 conn(0x7f08a01638f0 legacy=0x7f08a0163d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:30.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.778+0000 7f089f400640 1 --2- 172.21.15.87:0/2738264988 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08a00b42a0 0x7f0884003a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:30.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.778+0000 7f089f400640 1 --2- 172.21.15.87:0/2738264988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0884004010 0x7f0884004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:30.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.778+0000 7f089f400640 1 --2- 172.21.15.87:0/2738264988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0884004d50 0x7f0884005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:30.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.778+0000 7f089f400640 1 -- 172.21.15.87:0/2738264988 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f08a00b7cf0 con 0x7f0884004010 2024-05-27T06:28:30.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.778+0000 7f089f400640 1 -- 172.21.15.87:0/2738264988 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f088400bc10 con 0x7f0884004d50 2024-05-27T06:28:30.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.778+0000 7f089f400640 1 -- 172.21.15.87:0/2738264988 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f088400be10 con 0x7f08a00b42a0 2024-05-27T06:28:30.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.778+0000 7f0897400640 1 --2- 172.21.15.87:0/2738264988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0884004010 0x7f0884004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:30.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.778+0000 7f089fe00640 1 --2- 172.21.15.87:0/2738264988 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08a00b42a0 0x7f0884003a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:30.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.778+0000 7f08a5000640 1 --2- 172.21.15.87:0/2738264988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0884004d50 0x7f0884005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:30.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.778+0000 7f0897400640 1 -- 172.21.15.87:0/2738264988 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08a00b42a0 msgr2=0x7f0884003a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:30.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.778+0000 7f0897400640 1 --2- 172.21.15.87:0/2738264988 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08a00b42a0 0x7f0884003a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.778+0000 7f0897400640 1 -- 172.21.15.87:0/2738264988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0884004d50 msgr2=0x7f0884005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:30.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.778+0000 7f0897400640 1 --2- 172.21.15.87:0/2738264988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0884004d50 0x7f0884005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.778+0000 7f0897400640 1 -- 172.21.15.87:0/2738264988 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0884003530 con 0x7f0884004010 2024-05-27T06:28:30.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.782+0000 7f0897400640 1 --2- 172.21.15.87:0/2738264988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0884004010 0x7f0884004810 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f088800c240 tx=0x7f088801f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63892b1af6b6f526 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:30.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.782+0000 7f089f400640 1 -- 172.21.15.87:0/2738264988 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0888007d80 con 0x7f0884004010 2024-05-27T06:28:30.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.782+0000 7f089f400640 1 -- 172.21.15.87:0/2738264988 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0888005ae0 con 0x7f0884004010 2024-05-27T06:28:30.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.782+0000 7f089f400640 1 -- 172.21.15.87:0/2738264988 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0888007070 con 0x7f0884004010 2024-05-27T06:28:30.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.782+0000 7f08a7000640 1 -- 172.21.15.87:0/2738264988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0884004010 msgr2=0x7f0884004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:30.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.782+0000 7f08a7000640 1 --2- 172.21.15.87:0/2738264988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0884004010 0x7f0884004810 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f088800c240 tx=0x7f088801f330 comp rx=0 tx=0).stop 2024-05-27T06:28:30.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.782+0000 7f08a5000640 1 -- 172.21.15.87:0/2738264988 reap_dead start 2024-05-27T06:28:30.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.782+0000 7f08a7000640 1 -- 172.21.15.87:0/2738264988 shutdown_connections 2024-05-27T06:28:30.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.782+0000 7f08a7000640 1 -- 172.21.15.87:0/2738264988 >> 172.21.15.87:0/2738264988 conn(0x7f08a00d34f0 msgr2=0x7f08a00d3900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:30.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.782+0000 7f08a7000640 1 -- 172.21.15.87:0/2738264988 shutdown_connections 2024-05-27T06:28:30.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.782+0000 7f08a7000640 1 -- 172.21.15.87:0/2738264988 wait complete. 2024-05-27T06:28:30.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.782+0000 7f08a7000640 1 Processor -- start 2024-05-27T06:28:30.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.782+0000 7f08a7000640 1 -- start start 2024-05-27T06:28:30.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.786+0000 7f08a7000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0884004010 0x7f08a00b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:30.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.786+0000 7f08a7000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08a00aa480 0x7f08a00ce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:30.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.786+0000 7f08a7000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08a00b3190 0x7f08a00b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:30.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.786+0000 7f08a7000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f08a0157090 con 0x7f08a00aa480 2024-05-27T06:28:30.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.786+0000 7f08a7000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f08a00700a0 con 0x7f0884004010 2024-05-27T06:28:30.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.786+0000 7f08a7000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f08a0157210 con 0x7f08a00b3190 2024-05-27T06:28:30.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.786+0000 7f0897400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08a00aa480 0x7f08a00ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:30.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.786+0000 7f0897400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08a00aa480 0x7f08a00ce240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51034/0 (socket says 172.21.15.87:51034) 2024-05-27T06:28:30.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.786+0000 7f0897400640 1 -- 172.21.15.87:0/2103432029 learned_addr learned my addr 172.21.15.87:0/2103432029 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:30.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.786+0000 7f089fe00640 1 --2- 172.21.15.87:0/2103432029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0884004010 0x7f08a00b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:30.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.786+0000 7f08a5000640 1 --2- 172.21.15.87:0/2103432029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08a00b3190 0x7f08a00b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:30.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.786+0000 7f0897400640 1 -- 172.21.15.87:0/2103432029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08a00b3190 msgr2=0x7f08a00b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:30.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.786+0000 7f0897400640 1 --2- 172.21.15.87:0/2103432029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08a00b3190 0x7f08a00b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.786+0000 7f0897400640 1 -- 172.21.15.87:0/2103432029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0884004010 msgr2=0x7f08a00b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:30.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.786+0000 7f0897400640 1 --2- 172.21.15.87:0/2103432029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0884004010 0x7f08a00b21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:30.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.786+0000 7f0897400640 1 -- 172.21.15.87:0/2103432029 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a00b3ae0 con 0x7f08a00aa480 2024-05-27T06:28:30.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.786+0000 7f0897400640 1 --2- 172.21.15.87:0/2103432029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08a00aa480 0x7f08a00ce240 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f088800c240 tx=0x7f0884005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:30.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.786+0000 7f089cc00640 1 -- 172.21.15.87:0/2103432029 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0888005d50 con 0x7f08a00aa480 2024-05-27T06:28:30.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.786+0000 7f089cc00640 1 -- 172.21.15.87:0/2103432029 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08880047f0 con 0x7f08a00aa480 2024-05-27T06:28:30.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.786+0000 7f08a7000640 1 -- 172.21.15.87:0/2103432029 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08a00acdd0 con 0x7f08a00aa480 2024-05-27T06:28:30.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.786+0000 7f089cc00640 1 -- 172.21.15.87:0/2103432029 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0888004bc0 con 0x7f08a00aa480 2024-05-27T06:28:30.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.786+0000 7f08a7000640 1 -- 172.21.15.87:0/2103432029 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08a0145fd0 con 0x7f08a00aa480 2024-05-27T06:28:30.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.786+0000 7f08a7000640 1 -- 172.21.15.87:0/2103432029 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08a006aa30 con 0x7f08a00aa480 2024-05-27T06:28:30.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.790+0000 7f089cc00640 1 -- 172.21.15.87:0/2103432029 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f08880ba030 con 0x7f08a00aa480 2024-05-27T06:28:30.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.790+0000 7f089cc00640 1 --2- 172.21.15.87:0/2103432029 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f087c06f430 0x7f087c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:30.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.790+0000 7f089cc00640 1 -- 172.21.15.87:0/2103432029 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6850+0+0 (secure 0 0 0) 0x7f088812c510 con 0x7f08a00aa480 2024-05-27T06:28:30.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.790+0000 7f089fe00640 1 --2- 172.21.15.87:0/2103432029 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f087c06f430 0x7f087c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:30.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.790+0000 7f089fe00640 1 --2- 172.21.15.87:0/2103432029 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f087c06f430 0x7f087c071940 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0890000c10 tx=0x7f0890009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:30.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.794+0000 7f089cc00640 1 -- 172.21.15.87:0/2103432029 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f08a00b3ae0 con 0x7f08a00aa480 2024-05-27T06:28:30.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:30.990+0000 7f08a7000640 1 -- 172.21.15.87:0/2103432029 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f08a006e9b0 con 0x7f08a00aa480 2024-05-27T06:28:31.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.594+0000 7f089cc00640 1 -- 172.21.15.87:0/2103432029 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f08880190e0 con 0x7f08a00aa480 2024-05-27T06:28:31.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.598+0000 7f08a7000640 1 -- 172.21.15.87:0/2103432029 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f087c06f430 msgr2=0x7f087c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:31.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.598+0000 7f08a7000640 1 --2- 172.21.15.87:0/2103432029 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f087c06f430 0x7f087c071940 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0890000c10 tx=0x7f0890009040 comp rx=0 tx=0).stop 2024-05-27T06:28:31.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.598+0000 7f08a7000640 1 -- 172.21.15.87:0/2103432029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08a00aa480 msgr2=0x7f08a00ce240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:31.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.598+0000 7f08a7000640 1 --2- 172.21.15.87:0/2103432029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08a00aa480 0x7f08a00ce240 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f088800c240 tx=0x7f0884005840 comp rx=0 tx=0).stop 2024-05-27T06:28:31.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.598+0000 7f08a7000640 1 -- 172.21.15.87:0/2103432029 shutdown_connections 2024-05-27T06:28:31.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.598+0000 7f08a7000640 1 --2- 172.21.15.87:0/2103432029 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f087c06f430 0x7f087c071940 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:31.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.598+0000 7f08a7000640 1 --2- 172.21.15.87:0/2103432029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08a00b3190 0x7f08a00b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:31.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.598+0000 7f08a7000640 1 --2- 172.21.15.87:0/2103432029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08a00aa480 0x7f08a00ce240 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:31.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.598+0000 7f08a7000640 1 --2- 172.21.15.87:0/2103432029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0884004010 0x7f08a00b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:31.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.598+0000 7f08a7000640 1 -- 172.21.15.87:0/2103432029 >> 172.21.15.87:0/2103432029 conn(0x7f08a00d34f0 msgr2=0x7f08a00702d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:31.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.598+0000 7f08a7000640 1 -- 172.21.15.87:0/2103432029 shutdown_connections 2024-05-27T06:28:31.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.598+0000 7f08a7000640 1 -- 172.21.15.87:0/2103432029 wait complete. 2024-05-27T06:28:31.616 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-27T06:28:31.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.770+0000 7faf1c800640 1 Processor -- start 2024-05-27T06:28:31.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.770+0000 7faf1c800640 1 -- start start 2024-05-27T06:28:31.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.770+0000 7faf1c800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf14157310 0x7faf1415dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:31.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.770+0000 7faf1c800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7faf1406c940 0x7faf1406cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:31.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.770+0000 7faf1c800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf1415e110 con 0x7faf140d1700 2024-05-27T06:28:31.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.770+0000 7faf1c800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7faf140d0140 con 0x7faf1406c940 2024-05-27T06:28:31.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.770+0000 7faf1c800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7faf140cf530 con 0x7faf14157310 2024-05-27T06:28:31.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.770+0000 7faf1a800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7faf1406c940 0x7faf1406cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:31.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.770+0000 7faf1a800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7faf1406c940 0x7faf1406cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51042/0 (socket says 172.21.15.87:51042) 2024-05-27T06:28:31.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.770+0000 7faf1a800640 1 -- 172.21.15.87:0/4280210867 learned_addr learned my addr 172.21.15.87:0/4280210867 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:31.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.770+0000 7faf19e00640 1 --2- 172.21.15.87:0/4280210867 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf14157310 0x7faf1415dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:31.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.770+0000 7faf1a800640 1 -- 172.21.15.87:0/4280210867 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf14157310 msgr2=0x7faf1415dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:31.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.770+0000 7faf1a800640 1 --2- 172.21.15.87:0/4280210867 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf14157310 0x7faf1415dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:31.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.770+0000 7faf1a800640 1 -- 172.21.15.87:0/4280210867 >> v1:172.21.15.149:6789/0 conn(0x7faf140d1700 legacy=0x7faf140d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:31.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.770+0000 7faf1a800640 1 -- 172.21.15.87:0/4280210867 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf140cf810 con 0x7faf1406c940 2024-05-27T06:28:31.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.774+0000 7faf1a800640 1 --2- 172.21.15.87:0/4280210867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf1406c940 0x7faf1406cd50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7faf10009e50 tx=0x7faf1001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2d5cf2d9aff81f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:31.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.774+0000 7faf18a00640 1 -- 172.21.15.87:0/4280210867 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf100a57f0 con 0x7faf1406c940 2024-05-27T06:28:31.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.774+0000 7faf18a00640 1 -- 172.21.15.87:0/4280210867 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf100a5990 con 0x7faf1406c940 2024-05-27T06:28:31.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.774+0000 7faf18a00640 1 -- 172.21.15.87:0/4280210867 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf100a5d60 con 0x7faf1406c940 2024-05-27T06:28:31.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.774+0000 7faf1c800640 1 -- 172.21.15.87:0/4280210867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf1406c940 msgr2=0x7faf1406cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:31.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.774+0000 7faf1c800640 1 --2- 172.21.15.87:0/4280210867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf1406c940 0x7faf1406cd50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7faf10009e50 tx=0x7faf1001ca30 comp rx=0 tx=0).stop 2024-05-27T06:28:31.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.774+0000 7faf1c800640 1 -- 172.21.15.87:0/4280210867 shutdown_connections 2024-05-27T06:28:31.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.774+0000 7faf1c800640 1 --2- 172.21.15.87:0/4280210867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf1406c940 0x7faf1406cd50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:31.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.774+0000 7faf1c800640 1 --2- 172.21.15.87:0/4280210867 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf14157310 0x7faf1415dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:31.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.774+0000 7faf1c800640 1 -- 172.21.15.87:0/4280210867 >> 172.21.15.87:0/4280210867 conn(0x7faf140b46b0 msgr2=0x7faf140b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:31.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.774+0000 7faf1c800640 1 -- 172.21.15.87:0/4280210867 shutdown_connections 2024-05-27T06:28:31.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.774+0000 7faf1c800640 1 -- 172.21.15.87:0/4280210867 wait complete. 2024-05-27T06:28:31.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.778+0000 7faf1c800640 1 Processor -- start 2024-05-27T06:28:31.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.778+0000 7faf1c800640 1 -- start start 2024-05-27T06:28:31.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.778+0000 7faf1c800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf1406c940 0x7faf1415fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:31.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.778+0000 7faf1c800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf140d1700 0x7faf14153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:31.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.778+0000 7faf1c800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf14157310 0x7faf14153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:31.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.778+0000 7faf1c800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7faf14070640 con 0x7faf140d1700 2024-05-27T06:28:31.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.778+0000 7faf1c800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7faf1406d6a0 con 0x7faf14157310 2024-05-27T06:28:31.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.778+0000 7faf1c800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7faf140707c0 con 0x7faf1406c940 2024-05-27T06:28:31.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.778+0000 7faf19400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf140d1700 0x7faf14153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:31.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.778+0000 7faf19400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf140d1700 0x7faf14153350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51056/0 (socket says 172.21.15.87:51056) 2024-05-27T06:28:31.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.778+0000 7faf19400640 1 -- 172.21.15.87:0/2432094728 learned_addr learned my addr 172.21.15.87:0/2432094728 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:31.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.778+0000 7faf1a800640 1 --2- 172.21.15.87:0/2432094728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf14157310 0x7faf14153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:31.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.778+0000 7faf19e00640 1 --2- 172.21.15.87:0/2432094728 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf1406c940 0x7faf1415fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:31.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.778+0000 7faf19400640 1 -- 172.21.15.87:0/2432094728 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf1406c940 msgr2=0x7faf1415fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:31.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.778+0000 7faf19400640 1 --2- 172.21.15.87:0/2432094728 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf1406c940 0x7faf1415fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:31.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.778+0000 7faf19400640 1 -- 172.21.15.87:0/2432094728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf14157310 msgr2=0x7faf14153890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:31.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.778+0000 7faf19400640 1 --2- 172.21.15.87:0/2432094728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf14157310 0x7faf14153890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:31.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.778+0000 7faf19400640 1 -- 172.21.15.87:0/2432094728 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf14151270 con 0x7faf140d1700 2024-05-27T06:28:31.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.778+0000 7faf19400640 1 --2- 172.21.15.87:0/2432094728 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf140d1700 0x7faf14153350 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faf0400c3f0 tx=0x7faf0400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:31.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.782+0000 7faf0e000640 1 -- 172.21.15.87:0/2432094728 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf04017070 con 0x7faf140d1700 2024-05-27T06:28:31.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.782+0000 7faf0e000640 1 -- 172.21.15.87:0/2432094728 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf040052d0 con 0x7faf140d1700 2024-05-27T06:28:31.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.782+0000 7faf1c800640 1 -- 172.21.15.87:0/2432094728 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf14151550 con 0x7faf140d1700 2024-05-27T06:28:31.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.782+0000 7faf0e000640 1 -- 172.21.15.87:0/2432094728 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf04003820 con 0x7faf140d1700 2024-05-27T06:28:31.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.782+0000 7faf1c800640 1 -- 172.21.15.87:0/2432094728 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf14151b10 con 0x7faf140d1700 2024-05-27T06:28:31.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.782+0000 7faf1c800640 1 -- 172.21.15.87:0/2432094728 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf14150fe0 con 0x7faf140d1700 2024-05-27T06:28:31.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.782+0000 7faf0e000640 1 -- 172.21.15.87:0/2432094728 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7faf0401a070 con 0x7faf140d1700 2024-05-27T06:28:31.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.782+0000 7faf0e000640 1 --2- 172.21.15.87:0/2432094728 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7faef806f430 0x7faef8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:31.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.782+0000 7faf0e000640 1 -- 172.21.15.87:0/2432094728 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6850+0+0 (secure 0 0 0) 0x7faf0408e9d0 con 0x7faf140d1700 2024-05-27T06:28:31.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.782+0000 7faf19e00640 1 --2- 172.21.15.87:0/2432094728 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7faef806f430 0x7faef8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:31.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.786+0000 7faf19e00640 1 --2- 172.21.15.87:0/2432094728 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7faef806f430 0x7faef8071940 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faf140d2290 tx=0x7faf08009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:31.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.786+0000 7faf0e000640 1 -- 172.21.15.87:0/2432094728 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7faf1415e110 con 0x7faf140d1700 2024-05-27T06:28:31.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:31.942+0000 7faf1c800640 1 -- 172.21.15.87:0/2432094728 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7faf14069a10 con 0x7faf140d1700 2024-05-27T06:28:32.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.594+0000 7faf0e000640 1 -- 172.21.15.87:0/2432094728 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) ==== 181+0+0 (secure 0 0 0) 0x7faf14069a10 con 0x7faf140d1700 2024-05-27T06:28:32.593 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_metadata' removed 2024-05-27T06:28:32.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.598+0000 7faf1c800640 1 -- 172.21.15.87:0/2432094728 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7faef806f430 msgr2=0x7faef8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:32.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.598+0000 7faf1c800640 1 --2- 172.21.15.87:0/2432094728 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7faef806f430 0x7faef8071940 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faf140d2290 tx=0x7faf08009190 comp rx=0 tx=0).stop 2024-05-27T06:28:32.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.598+0000 7faf1c800640 1 -- 172.21.15.87:0/2432094728 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf140d1700 msgr2=0x7faf14153350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:32.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.598+0000 7faf1c800640 1 --2- 172.21.15.87:0/2432094728 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf140d1700 0x7faf14153350 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faf0400c3f0 tx=0x7faf0400c8b0 comp rx=0 tx=0).stop 2024-05-27T06:28:32.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.598+0000 7faf1c800640 1 -- 172.21.15.87:0/2432094728 shutdown_connections 2024-05-27T06:28:32.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.598+0000 7faf1c800640 1 --2- 172.21.15.87:0/2432094728 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7faef806f430 0x7faef8071940 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:32.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.598+0000 7faf1c800640 1 --2- 172.21.15.87:0/2432094728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf14157310 0x7faf14153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:32.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.598+0000 7faf1c800640 1 --2- 172.21.15.87:0/2432094728 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf140d1700 0x7faf14153350 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:32.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.598+0000 7faf1c800640 1 --2- 172.21.15.87:0/2432094728 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf1406c940 0x7faf1415fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:32.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.598+0000 7faf1c800640 1 -- 172.21.15.87:0/2432094728 >> 172.21.15.87:0/2432094728 conn(0x7faf140b46b0 msgr2=0x7faf140cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:32.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.598+0000 7faf1c800640 1 -- 172.21.15.87:0/2432094728 shutdown_connections 2024-05-27T06:28:32.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.602+0000 7faf1c800640 1 -- 172.21.15.87:0/2432094728 wait complete. 2024-05-27T06:28:32.619 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-27T06:28:32.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.770+0000 7f87a3400640 1 Processor -- start 2024-05-27T06:28:32.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.770+0000 7f87a3400640 1 -- start start 2024-05-27T06:28:32.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.774+0000 7f87a3400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f879c0c9b50 0x7f879c16ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:32.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.774+0000 7f87a3400640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f879c0d2530 con 0x7f879c06e3f0 2024-05-27T06:28:32.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.774+0000 7f87a3400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f879c0d2810 con 0x7f879c15a420 2024-05-27T06:28:32.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.774+0000 7f87a3400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f879c0d2af0 con 0x7f879c0c9b50 2024-05-27T06:28:32.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.774+0000 7f8793e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f879c06e3f0 0x7f879c06e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51782/0 (socket says 172.21.15.87:51782) 2024-05-27T06:28:32.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.774+0000 7f87a1400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f879c0c9b50 0x7f879c16ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:32.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.774+0000 7f8793e00640 1 -- 172.21.15.87:0/1372886380 learned_addr learned my addr 172.21.15.87:0/1372886380 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:32.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.774+0000 7f87a1400640 1 -- 172.21.15.87:0/1372886380 >> v1:172.21.15.149:6789/0 conn(0x7f879c15a420 legacy=0x7f879c0d1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:32.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.774+0000 7f87a1400640 1 -- 172.21.15.87:0/1372886380 >> v1:172.21.15.87:6789/0 conn(0x7f879c06e3f0 legacy=0x7f879c06e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:32.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.774+0000 7f87a1400640 1 -- 172.21.15.87:0/1372886380 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f879c0d2dd0 con 0x7f879c0c9b50 2024-05-27T06:28:32.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.778+0000 7f87a1400640 1 --2- 172.21.15.87:0/1372886380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f879c0c9b50 0x7f879c16ac40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8794009d90 tx=0x7f879401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321d232ee56def4a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:32.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.778+0000 7f879be00640 1 -- 172.21.15.87:0/1372886380 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87940b2070 con 0x7f879c0c9b50 2024-05-27T06:28:32.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.778+0000 7f879be00640 1 -- 172.21.15.87:0/1372886380 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87940a5820 con 0x7f879c0c9b50 2024-05-27T06:28:32.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.778+0000 7f879be00640 1 -- 172.21.15.87:0/1372886380 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87940a5bf0 con 0x7f879c0c9b50 2024-05-27T06:28:32.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.778+0000 7f87a3400640 1 -- 172.21.15.87:0/1372886380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f879c0c9b50 msgr2=0x7f879c16ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:32.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.778+0000 7f87a3400640 1 --2- 172.21.15.87:0/1372886380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f879c0c9b50 0x7f879c16ac40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8794009d90 tx=0x7f879401c850 comp rx=0 tx=0).stop 2024-05-27T06:28:32.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.778+0000 7f87a3400640 1 -- 172.21.15.87:0/1372886380 shutdown_connections 2024-05-27T06:28:32.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.778+0000 7f87a3400640 1 --2- 172.21.15.87:0/1372886380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f879c0c9b50 0x7f879c16ac40 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:32.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.778+0000 7f87a3400640 1 -- 172.21.15.87:0/1372886380 >> 172.21.15.87:0/1372886380 conn(0x7f879c0cffd0 msgr2=0x7f879c0d03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:32.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.778+0000 7f87a3400640 1 -- 172.21.15.87:0/1372886380 shutdown_connections 2024-05-27T06:28:32.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.778+0000 7f87a3400640 1 -- 172.21.15.87:0/1372886380 wait complete. 2024-05-27T06:28:32.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.782+0000 7f87a3400640 1 Processor -- start 2024-05-27T06:28:32.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.782+0000 7f87a3400640 1 -- start start 2024-05-27T06:28:32.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.782+0000 7f87a3400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f879c06e3f0 0x7f879c15f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:32.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.782+0000 7f87a3400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f879c0c9b50 0x7f879c14f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:32.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.782+0000 7f87a3400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f879c15a420 0x7f879c154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:32.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.782+0000 7f87a3400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f879c16dd30 con 0x7f879c0c9b50 2024-05-27T06:28:32.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.782+0000 7f87a3400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f879c16dbb0 con 0x7f879c06e3f0 2024-05-27T06:28:32.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.782+0000 7f87a3400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f879c16deb0 con 0x7f879c15a420 2024-05-27T06:28:32.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.782+0000 7f8793e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f879c0c9b50 0x7f879c14f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:32.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.782+0000 7f8793e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f879c0c9b50 0x7f879c14f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51080/0 (socket says 172.21.15.87:51080) 2024-05-27T06:28:32.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.782+0000 7f8793e00640 1 -- 172.21.15.87:0/4216457202 learned_addr learned my addr 172.21.15.87:0/4216457202 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:32.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.782+0000 7f87a0a00640 1 --2- 172.21.15.87:0/4216457202 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f879c06e3f0 0x7f879c15f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:32.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.782+0000 7f87a1400640 1 --2- 172.21.15.87:0/4216457202 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f879c15a420 0x7f879c154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:32.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.782+0000 7f8793e00640 1 -- 172.21.15.87:0/4216457202 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f879c15a420 msgr2=0x7f879c154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:32.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.782+0000 7f8793e00640 1 --2- 172.21.15.87:0/4216457202 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f879c15a420 0x7f879c154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:32.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.782+0000 7f8793e00640 1 -- 172.21.15.87:0/4216457202 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f879c06e3f0 msgr2=0x7f879c15f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:32.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.782+0000 7f8793e00640 1 --2- 172.21.15.87:0/4216457202 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f879c06e3f0 0x7f879c15f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:32.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.782+0000 7f8793e00640 1 -- 172.21.15.87:0/4216457202 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f879c15fa20 con 0x7f879c0c9b50 2024-05-27T06:28:32.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.782+0000 7f8793e00640 1 --2- 172.21.15.87:0/4216457202 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f879c0c9b50 0x7f879c14f100 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f878400c400 tx=0x7f878400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:32.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.782+0000 7f8799600640 1 -- 172.21.15.87:0/4216457202 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8784017070 con 0x7f879c0c9b50 2024-05-27T06:28:32.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.782+0000 7f8799600640 1 -- 172.21.15.87:0/4216457202 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8784005cf0 con 0x7f879c0c9b50 2024-05-27T06:28:32.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.782+0000 7f8799600640 1 -- 172.21.15.87:0/4216457202 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87840072f0 con 0x7f879c0c9b50 2024-05-27T06:28:32.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.782+0000 7f87a3400640 1 -- 172.21.15.87:0/4216457202 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f879c0b85e0 con 0x7f879c0c9b50 2024-05-27T06:28:32.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.782+0000 7f87a3400640 1 -- 172.21.15.87:0/4216457202 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f879c0b8ba0 con 0x7f879c0c9b50 2024-05-27T06:28:32.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.786+0000 7f87a3400640 1 -- 172.21.15.87:0/4216457202 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f879c0b8330 con 0x7f879c0c9b50 2024-05-27T06:28:32.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.786+0000 7f8799600640 1 -- 172.21.15.87:0/4216457202 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f878401a070 con 0x7f879c0c9b50 2024-05-27T06:28:32.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.786+0000 7f8799600640 1 --2- 172.21.15.87:0/4216457202 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f877806f400 0x7f8778071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:32.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.786+0000 7f8799600640 1 -- 172.21.15.87:0/4216457202 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6412+0+0 (secure 0 0 0) 0x7f878408e940 con 0x7f879c0c9b50 2024-05-27T06:28:32.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.786+0000 7f87a0a00640 1 --2- 172.21.15.87:0/4216457202 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f877806f400 0x7f8778071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:32.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.786+0000 7f87a0a00640 1 --2- 172.21.15.87:0/4216457202 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f877806f400 0x7f8778071910 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f878c007fd0 tx=0x7f878c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:32.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.790+0000 7f8799600640 1 -- 172.21.15.87:0/4216457202 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f878405ae80 con 0x7f879c0c9b50 2024-05-27T06:28:32.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:32.950+0000 7f87a3400640 1 -- 172.21.15.87:0/4216457202 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f879c06aa30 con 0x7f879c0c9b50 2024-05-27T06:28:33.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.606+0000 7f8799600640 1 -- 172.21.15.87:0/4216457202 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) ==== 169+0+0 (secure 0 0 0) 0x7f878405f180 con 0x7f879c0c9b50 2024-05-27T06:28:33.605 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_data' removed 2024-05-27T06:28:33.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.610+0000 7f87a3400640 1 -- 172.21.15.87:0/4216457202 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f877806f400 msgr2=0x7f8778071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:33.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.610+0000 7f87a3400640 1 --2- 172.21.15.87:0/4216457202 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f877806f400 0x7f8778071910 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f878c007fd0 tx=0x7f878c009040 comp rx=0 tx=0).stop 2024-05-27T06:28:33.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.610+0000 7f87a3400640 1 -- 172.21.15.87:0/4216457202 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f879c0c9b50 msgr2=0x7f879c14f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:33.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.610+0000 7f87a3400640 1 --2- 172.21.15.87:0/4216457202 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f879c0c9b50 0x7f879c14f100 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f878400c400 tx=0x7f878400c8c0 comp rx=0 tx=0).stop 2024-05-27T06:28:33.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.610+0000 7f87a3400640 1 -- 172.21.15.87:0/4216457202 shutdown_connections 2024-05-27T06:28:33.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.610+0000 7f87a3400640 1 --2- 172.21.15.87:0/4216457202 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f877806f400 0x7f8778071910 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:33.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.610+0000 7f87a3400640 1 --2- 172.21.15.87:0/4216457202 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f879c15a420 0x7f879c154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:33.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.610+0000 7f87a3400640 1 --2- 172.21.15.87:0/4216457202 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f879c0c9b50 0x7f879c14f100 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:33.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.610+0000 7f87a3400640 1 --2- 172.21.15.87:0/4216457202 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f879c06e3f0 0x7f879c15f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:33.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.610+0000 7f87a3400640 1 -- 172.21.15.87:0/4216457202 >> 172.21.15.87:0/4216457202 conn(0x7f879c0cffd0 msgr2=0x7f879c0704b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:33.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.614+0000 7f87a3400640 1 -- 172.21.15.87:0/4216457202 shutdown_connections 2024-05-27T06:28:33.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.614+0000 7f87a3400640 1 -- 172.21.15.87:0/4216457202 wait complete. 2024-05-27T06:28:33.632 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-05-27T06:28:33.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.786+0000 7f6b5e600640 1 Processor -- start 2024-05-27T06:28:33.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.786+0000 7f6b5e600640 1 -- start start 2024-05-27T06:28:33.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.786+0000 7f6b5e600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b580ce4d0 0x7f6b58161800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:33.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.786+0000 7f6b5e600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6b58161d40 0x7f6b580c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:33.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b56a00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f6b580ce8e0 0x7f6b580c8300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51786/0 (socket says 172.21.15.87:51786) 2024-05-27T06:28:33.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b56a00640 1 -- 172.21.15.87:0/2655079803 learned_addr learned my addr 172.21.15.87:0/2655079803 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:33.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b5e600640 1 -- 172.21.15.87:0/2655079803 --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b58162150 con 0x7f6b580ce8e0 2024-05-27T06:28:33.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b5e600640 1 -- 172.21.15.87:0/2655079803 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f6b580b8480 con 0x7f6b58161d40 2024-05-27T06:28:33.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b5e600640 1 -- 172.21.15.87:0/2655079803 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6b580b73e0 con 0x7f6b580ce4d0 2024-05-27T06:28:33.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b57400640 1 --2- 172.21.15.87:0/2655079803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b580ce4d0 0x7f6b58161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:33.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b57e00640 1 --2- 172.21.15.87:0/2655079803 >> v2:172.21.15.149:3300/0 conn(0x7f6b58161d40 0x7f6b580c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:33.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b56000640 1 -- 172.21.15.87:0/2655079803 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3133142738 0 0) 0x7f6b44001120 con 0x7f6b580ce8e0 2024-05-27T06:28:33.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b56000640 1 -- 172.21.15.87:0/2655079803 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b3c003530 con 0x7f6b580ce8e0 2024-05-27T06:28:33.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b56000640 1 -- 172.21.15.87:0/2655079803 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 126604185 0 0) 0x7f6b3c003530 con 0x7f6b580ce8e0 2024-05-27T06:28:33.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b56000640 1 -- 172.21.15.87:0/2655079803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b580ce4d0 msgr2=0x7f6b58161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:33.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b56000640 1 --2- 172.21.15.87:0/2655079803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b580ce4d0 0x7f6b58161800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:33.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b56000640 1 -- 172.21.15.87:0/2655079803 >> v2:172.21.15.149:3300/0 conn(0x7f6b58161d40 msgr2=0x7f6b580c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:33.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b56000640 1 --2- 172.21.15.87:0/2655079803 >> v2:172.21.15.149:3300/0 conn(0x7f6b58161d40 0x7f6b580c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:33.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b56000640 1 -- 172.21.15.87:0/2655079803 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b580b76c0 con 0x7f6b580ce8e0 2024-05-27T06:28:33.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b56000640 1 -- 172.21.15.87:0/2655079803 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7f6b440018d0 con 0x7f6b580ce8e0 2024-05-27T06:28:33.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b56000640 1 -- 172.21.15.87:0/2655079803 >> v1:172.21.15.87:6789/0 conn(0x7f6b580ce8e0 legacy=0x7f6b580c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:33.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b56000640 1 --2- 172.21.15.87:0/2655079803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b3c003a10 0x7f6b3c003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:33.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b56000640 1 --2- 172.21.15.87:0/2655079803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b3c004810 0x7f6b3c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:33.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b56000640 1 --2- 172.21.15.87:0/2655079803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b3c005160 0x7f6b3c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:33.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b56000640 1 -- 172.21.15.87:0/2655079803 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6b580b8480 con 0x7f6b3c004810 2024-05-27T06:28:33.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b56000640 1 -- 172.21.15.87:0/2655079803 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6b580b73e0 con 0x7f6b3c005160 2024-05-27T06:28:33.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b56000640 1 -- 172.21.15.87:0/2655079803 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6b3c00c040 con 0x7f6b3c003a10 2024-05-27T06:28:33.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b56a00640 1 --2- 172.21.15.87:0/2655079803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b3c004810 0x7f6b3c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:33.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b57400640 1 --2- 172.21.15.87:0/2655079803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b3c003a10 0x7f6b3c003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:33.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b57e00640 1 --2- 172.21.15.87:0/2655079803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b3c005160 0x7f6b3c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:33.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b56a00640 1 -- 172.21.15.87:0/2655079803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b3c003a10 msgr2=0x7f6b3c003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:33.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b56a00640 1 --2- 172.21.15.87:0/2655079803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b3c003a10 0x7f6b3c003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:33.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b56a00640 1 -- 172.21.15.87:0/2655079803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b3c005160 msgr2=0x7f6b3c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:33.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b56a00640 1 --2- 172.21.15.87:0/2655079803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b3c005160 0x7f6b3c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:33.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b56a00640 1 -- 172.21.15.87:0/2655079803 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b3c003530 con 0x7f6b3c004810 2024-05-27T06:28:33.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.790+0000 7f6b57e00640 1 --2- 172.21.15.87:0/2655079803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b3c005160 0x7f6b3c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:33.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.794+0000 7f6b56a00640 1 --2- 172.21.15.87:0/2655079803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b3c004810 0x7f6b3c004c20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6b4400c4c0 tx=0x7f6b4401f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93cf35cb426f127c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:33.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.794+0000 7f6b56000640 1 -- 172.21.15.87:0/2655079803 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4400c0e0 con 0x7f6b3c004810 2024-05-27T06:28:33.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.794+0000 7f6b56000640 1 -- 172.21.15.87:0/2655079803 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b44005ae0 con 0x7f6b3c004810 2024-05-27T06:28:33.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.794+0000 7f6b56000640 1 -- 172.21.15.87:0/2655079803 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b44007070 con 0x7f6b3c004810 2024-05-27T06:28:33.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.794+0000 7f6b5e600640 1 -- 172.21.15.87:0/2655079803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b3c004810 msgr2=0x7f6b3c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:33.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.794+0000 7f6b5e600640 1 --2- 172.21.15.87:0/2655079803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b3c004810 0x7f6b3c004c20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6b4400c4c0 tx=0x7f6b4401f3a0 comp rx=0 tx=0).stop 2024-05-27T06:28:33.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.794+0000 7f6b57e00640 1 -- 172.21.15.87:0/2655079803 reap_dead start 2024-05-27T06:28:33.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.794+0000 7f6b5e600640 1 -- 172.21.15.87:0/2655079803 shutdown_connections 2024-05-27T06:28:33.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.794+0000 7f6b5e600640 1 -- 172.21.15.87:0/2655079803 >> 172.21.15.87:0/2655079803 conn(0x7f6b580712e0 msgr2=0x7f6b580716f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:33.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.794+0000 7f6b5e600640 1 -- 172.21.15.87:0/2655079803 shutdown_connections 2024-05-27T06:28:33.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.794+0000 7f6b5e600640 1 -- 172.21.15.87:0/2655079803 wait complete. 2024-05-27T06:28:33.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.798+0000 7f6b5e600640 1 Processor -- start 2024-05-27T06:28:33.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.798+0000 7f6b5e600640 1 -- start start 2024-05-27T06:28:33.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.798+0000 7f6b5e600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b3c004810 0x7f6b5814cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:33.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.798+0000 7f6b5e600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b581f7720 0x7f6b581f7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:33.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.798+0000 7f6b5e600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b581f8070 0x7f6b58158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:33.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.798+0000 7f6b5e600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6b580b7f60 con 0x7f6b581f7720 2024-05-27T06:28:33.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.798+0000 7f6b5e600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6b580b7c80 con 0x7f6b581f8070 2024-05-27T06:28:33.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.798+0000 7f6b5e600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6b580b70d0 con 0x7f6b3c004810 2024-05-27T06:28:33.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.798+0000 7f6b56a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b581f7720 0x7f6b581f7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:33.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.798+0000 7f6b56a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b581f7720 0x7f6b581f7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51094/0 (socket says 172.21.15.87:51094) 2024-05-27T06:28:33.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.798+0000 7f6b56a00640 1 -- 172.21.15.87:0/3672418433 learned_addr learned my addr 172.21.15.87:0/3672418433 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:33.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.798+0000 7f6b57400640 1 --2- 172.21.15.87:0/3672418433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b3c004810 0x7f6b5814cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:33.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.798+0000 7f6b57e00640 1 --2- 172.21.15.87:0/3672418433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b581f8070 0x7f6b58158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:33.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.798+0000 7f6b56a00640 1 -- 172.21.15.87:0/3672418433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b3c004810 msgr2=0x7f6b5814cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:33.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.798+0000 7f6b56a00640 1 --2- 172.21.15.87:0/3672418433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b3c004810 0x7f6b5814cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:33.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.798+0000 7f6b56a00640 1 -- 172.21.15.87:0/3672418433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b581f8070 msgr2=0x7f6b58158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:33.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.798+0000 7f6b56a00640 1 --2- 172.21.15.87:0/3672418433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b581f8070 0x7f6b58158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:33.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.798+0000 7f6b56a00640 1 -- 172.21.15.87:0/3672418433 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b580ca220 con 0x7f6b581f7720 2024-05-27T06:28:33.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.798+0000 7f6b57400640 1 --2- 172.21.15.87:0/3672418433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b3c004810 0x7f6b5814cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:33.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.798+0000 7f6b57e00640 1 --2- 172.21.15.87:0/3672418433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b581f8070 0x7f6b58158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:33.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.798+0000 7f6b56a00640 1 --2- 172.21.15.87:0/3672418433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b581f7720 0x7f6b581f7b30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6b4401daa0 tx=0x7f6b3c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:33.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.798+0000 7f6b4f400640 1 -- 172.21.15.87:0/3672418433 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b44005c90 con 0x7f6b581f7720 2024-05-27T06:28:33.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.798+0000 7f6b4f400640 1 -- 172.21.15.87:0/3672418433 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b440b6040 con 0x7f6b581f7720 2024-05-27T06:28:33.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.798+0000 7f6b4f400640 1 -- 172.21.15.87:0/3672418433 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b440049f0 con 0x7f6b581f7720 2024-05-27T06:28:33.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.798+0000 7f6b5e600640 1 -- 172.21.15.87:0/3672418433 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b580ca500 con 0x7f6b581f7720 2024-05-27T06:28:33.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.798+0000 7f6b5e600640 1 -- 172.21.15.87:0/3672418433 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b580caac0 con 0x7f6b581f7720 2024-05-27T06:28:33.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.802+0000 7f6b5e600640 1 -- 172.21.15.87:0/3672418433 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b580c9f90 con 0x7f6b581f7720 2024-05-27T06:28:33.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.802+0000 7f6b4f400640 1 -- 172.21.15.87:0/3672418433 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6b44004b90 con 0x7f6b581f7720 2024-05-27T06:28:33.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.802+0000 7f6b4f400640 1 --2- 172.21.15.87:0/3672418433 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f6b3806f400 0x7f6b38071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:33.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.802+0000 7f6b4f400640 1 -- 172.21.15.87:0/3672418433 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5853+0+0 (secure 0 0 0) 0x7f6b4412c240 con 0x7f6b581f7720 2024-05-27T06:28:33.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.802+0000 7f6b57400640 1 --2- 172.21.15.87:0/3672418433 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f6b3806f400 0x7f6b38071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:33.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.802+0000 7f6b57400640 1 --2- 172.21.15.87:0/3672418433 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f6b3806f400 0x7f6b38071910 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6b480090e0 tx=0x7f6b48008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:33.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.806+0000 7f6b4f400640 1 -- 172.21.15.87:0/3672418433 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f6b58162150 con 0x7f6b581f7720 2024-05-27T06:28:33.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:33.962+0000 7f6b5e600640 1 -- 172.21.15.87:0/3672418433 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6b5806aa30 con 0x7f6b581f7720 2024-05-27T06:28:34.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.614+0000 7f6b4f400640 1 -- 172.21.15.87:0/3672418433 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) ==== 178+0+0 (secure 0 0 0) 0x7f6b440f9090 con 0x7f6b581f7720 2024-05-27T06:28:34.612 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_data_ec' removed 2024-05-27T06:28:34.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.618+0000 7f6b5e600640 1 -- 172.21.15.87:0/3672418433 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f6b3806f400 msgr2=0x7f6b38071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:34.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.618+0000 7f6b5e600640 1 --2- 172.21.15.87:0/3672418433 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f6b3806f400 0x7f6b38071910 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6b480090e0 tx=0x7f6b48008040 comp rx=0 tx=0).stop 2024-05-27T06:28:34.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.618+0000 7f6b5e600640 1 -- 172.21.15.87:0/3672418433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b581f7720 msgr2=0x7f6b581f7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:34.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.618+0000 7f6b5e600640 1 --2- 172.21.15.87:0/3672418433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b581f7720 0x7f6b581f7b30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6b4401daa0 tx=0x7f6b3c005840 comp rx=0 tx=0).stop 2024-05-27T06:28:34.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.618+0000 7f6b5e600640 1 -- 172.21.15.87:0/3672418433 shutdown_connections 2024-05-27T06:28:34.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.618+0000 7f6b5e600640 1 --2- 172.21.15.87:0/3672418433 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f6b3806f400 0x7f6b38071910 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:34.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.618+0000 7f6b5e600640 1 --2- 172.21.15.87:0/3672418433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b581f8070 0x7f6b58158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:34.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.618+0000 7f6b5e600640 1 --2- 172.21.15.87:0/3672418433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b581f7720 0x7f6b581f7b30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:34.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.618+0000 7f6b5e600640 1 --2- 172.21.15.87:0/3672418433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b3c004810 0x7f6b5814cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:34.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.618+0000 7f6b5e600640 1 -- 172.21.15.87:0/3672418433 >> 172.21.15.87:0/3672418433 conn(0x7f6b580712e0 msgr2=0x7f6b580c72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:34.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.618+0000 7f6b5e600640 1 -- 172.21.15.87:0/3672418433 shutdown_connections 2024-05-27T06:28:34.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.618+0000 7f6b5e600640 1 -- 172.21.15.87:0/3672418433 wait complete. 2024-05-27T06:28:34.637 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-27T06:28:34.638 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-27T06:28:34.638 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-27T06:28:34.638 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:28:34.638 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-27T06:28:34.638 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-27T06:28:34.638 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-27T06:28:34.639 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:28:34.639 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-27T06:28:34.639 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-27T06:28:34.639 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-27T06:28:34.639 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:28:34.639 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-27T06:28:34.639 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-27T06:28:34.639 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-27T06:28:34.640 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:28:34.653 INFO:tasks.ceph.mds.a:Stopped 2024-05-27T06:28:34.653 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-27T06:28:34.654 INFO:tasks.ceph.mds.b:Stopped 2024-05-27T06:28:34.654 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-27T06:28:34.656 INFO:tasks.ceph.mds.d:Stopped 2024-05-27T06:28:34.656 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-27T06:28:34.662 INFO:tasks.ceph.mds.c:Stopped 2024-05-27T06:28:34.662 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-27T06:28:34.698 INFO:tasks.ceph.mds.b:Started 2024-05-27T06:28:34.699 DEBUG:teuthology.parallel:result is None 2024-05-27T06:28:34.700 INFO:tasks.ceph.mds.d:Started 2024-05-27T06:28:34.701 DEBUG:teuthology.parallel:result is None 2024-05-27T06:28:34.707 INFO:tasks.ceph.mds.a:Started 2024-05-27T06:28:34.707 DEBUG:teuthology.parallel:result is None 2024-05-27T06:28:34.709 INFO:tasks.ceph.mds.c:Started 2024-05-27T06:28:34.709 DEBUG:teuthology.parallel:result is None 2024-05-27T06:28:34.710 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-27T06:28:34.805 INFO:tasks.ceph.mds.a.smithi087.stdout:starting mds.a at 2024-05-27T06:28:34.806 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-05-27T06:28:34.806 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-05-27T06:28:34.807 INFO:tasks.ceph.mds.c.smithi087.stdout:starting mds.c at 2024-05-27T06:28:34.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.870+0000 7f4e53e00640 1 Processor -- start 2024-05-27T06:28:34.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.870+0000 7f4e53e00640 1 -- start start 2024-05-27T06:28:34.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.870+0000 7f4e53e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e540b3580 0x7f4e5415dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:34.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.870+0000 7f4e53e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4e540d2f20 0x7f4e5415e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:34.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.870+0000 7f4e53e00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e540d1d90 con 0x7f4e540d2b10 2024-05-27T06:28:34.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.870+0000 7f4e53e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f4e540b6780 con 0x7f4e540d2f20 2024-05-27T06:28:34.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.870+0000 7f4e53e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4e540d2030 con 0x7f4e540b3580 2024-05-27T06:28:34.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.874+0000 7f4e52a00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f4e540d2b10 0x7f4e540b2e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:47594/0 (socket says 172.21.15.87:47594) 2024-05-27T06:28:34.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.874+0000 7f4e52a00640 1 -- 172.21.15.87:0/2486123552 learned_addr learned my addr 172.21.15.87:0/2486123552 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:34.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.874+0000 7f4e4a000640 1 --2- 172.21.15.87:0/2486123552 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e540b3580 0x7f4e5415dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:34.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.874+0000 7f4e53400640 1 --2- 172.21.15.87:0/2486123552 >> v2:172.21.15.149:3300/0 conn(0x7f4e540d2f20 0x7f4e5415e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:34.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.874+0000 7f4e52000640 1 -- 172.21.15.87:0/2486123552 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2709188257 0 0) 0x7f4e540d1d90 con 0x7f4e540d2b10 2024-05-27T06:28:34.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.874+0000 7f4e52000640 1 -- 172.21.15.87:0/2486123552 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e38003530 con 0x7f4e540d2b10 2024-05-27T06:28:34.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.874+0000 7f4e4a000640 1 -- 172.21.15.87:0/2486123552 >> v2:172.21.15.149:3300/0 conn(0x7f4e540d2f20 msgr2=0x7f4e5415e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:34.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.874+0000 7f4e4a000640 1 --2- 172.21.15.87:0/2486123552 >> v2:172.21.15.149:3300/0 conn(0x7f4e540d2f20 0x7f4e5415e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:34.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.874+0000 7f4e4a000640 1 -- 172.21.15.87:0/2486123552 >> v1:172.21.15.87:6789/0 conn(0x7f4e540d2b10 legacy=0x7f4e540b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:34.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.874+0000 7f4e4a000640 1 -- 172.21.15.87:0/2486123552 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e540d2310 con 0x7f4e540b3580 2024-05-27T06:28:34.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.874+0000 7f4e4a000640 1 --2- 172.21.15.87:0/2486123552 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e540b3580 0x7f4e5415dd80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c0097c0 tx=0x7f4e3c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a7ae1c6690f29e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:34.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.874+0000 7f4e52000640 1 -- 172.21.15.87:0/2486123552 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c0b1070 con 0x7f4e540b3580 2024-05-27T06:28:34.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.874+0000 7f4e52000640 1 -- 172.21.15.87:0/2486123552 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e3c0ac410 con 0x7f4e540b3580 2024-05-27T06:28:34.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.874+0000 7f4e52000640 1 -- 172.21.15.87:0/2486123552 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c0ac7e0 con 0x7f4e540b3580 2024-05-27T06:28:34.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.878+0000 7f4e53e00640 1 -- 172.21.15.87:0/2486123552 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e540b3580 msgr2=0x7f4e5415dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:34.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.878+0000 7f4e53e00640 1 --2- 172.21.15.87:0/2486123552 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e540b3580 0x7f4e5415dd80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c0097c0 tx=0x7f4e3c01c4a0 comp rx=0 tx=0).stop 2024-05-27T06:28:34.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.878+0000 7f4e53e00640 1 -- 172.21.15.87:0/2486123552 shutdown_connections 2024-05-27T06:28:34.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.878+0000 7f4e53e00640 1 --2- 172.21.15.87:0/2486123552 >> v2:172.21.15.149:3300/0 conn(0x7f4e540d2f20 0x7f4e5415e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:34.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.878+0000 7f4e53e00640 1 --2- 172.21.15.87:0/2486123552 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e540b3580 0x7f4e5415dd80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:34.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.878+0000 7f4e53e00640 1 -- 172.21.15.87:0/2486123552 >> 172.21.15.87:0/2486123552 conn(0x7f4e540d35c0 msgr2=0x7f4e540d39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:34.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.878+0000 7f4e53e00640 1 -- 172.21.15.87:0/2486123552 shutdown_connections 2024-05-27T06:28:34.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.878+0000 7f4e53e00640 1 -- 172.21.15.87:0/2486123552 wait complete. 2024-05-27T06:28:34.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.878+0000 7f4e53e00640 1 Processor -- start 2024-05-27T06:28:34.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.878+0000 7f4e53e00640 1 -- start start 2024-05-27T06:28:34.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.882+0000 7f4e53e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e540b3580 0x7f4e54150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:34.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.882+0000 7f4e53e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e540d2b10 0x7f4e54167530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:34.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.882+0000 7f4e53e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e540d2f20 0x7f4e54153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:34.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.882+0000 7f4e53e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4e5415f190 con 0x7f4e540b3580 2024-05-27T06:28:34.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.882+0000 7f4e53e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4e5415f010 con 0x7f4e540d2f20 2024-05-27T06:28:34.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.882+0000 7f4e53e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4e5416ac70 con 0x7f4e540d2b10 2024-05-27T06:28:34.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.882+0000 7f4e52a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e540b3580 0x7f4e54150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:34.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.882+0000 7f4e52a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e540b3580 0x7f4e54150540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33914/0 (socket says 172.21.15.87:33914) 2024-05-27T06:28:34.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.882+0000 7f4e52a00640 1 -- 172.21.15.87:0/30944813 learned_addr learned my addr 172.21.15.87:0/30944813 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:34.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.882+0000 7f4e4a000640 1 --2- 172.21.15.87:0/30944813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e540d2b10 0x7f4e54167530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:34.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.882+0000 7f4e53400640 1 --2- 172.21.15.87:0/30944813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e540d2f20 0x7f4e54153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:34.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.882+0000 7f4e52a00640 1 -- 172.21.15.87:0/30944813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e540d2b10 msgr2=0x7f4e54167530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:34.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.882+0000 7f4e52a00640 1 --2- 172.21.15.87:0/30944813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e540d2b10 0x7f4e54167530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:34.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.882+0000 7f4e52a00640 1 -- 172.21.15.87:0/30944813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e540d2f20 msgr2=0x7f4e54153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:34.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.882+0000 7f4e52a00640 1 --2- 172.21.15.87:0/30944813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e540d2f20 0x7f4e54153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:34.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.882+0000 7f4e52a00640 1 -- 172.21.15.87:0/30944813 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e54150a80 con 0x7f4e540b3580 2024-05-27T06:28:34.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.882+0000 7f4e52a00640 1 --2- 172.21.15.87:0/30944813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e540b3580 0x7f4e54150540 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400c430 tx=0x7f4e4400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:34.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.882+0000 7f4e4be00640 1 -- 172.21.15.87:0/30944813 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e44017070 con 0x7f4e540b3580 2024-05-27T06:28:34.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.882+0000 7f4e4be00640 1 -- 172.21.15.87:0/30944813 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e44005cf0 con 0x7f4e540b3580 2024-05-27T06:28:34.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.882+0000 7f4e53e00640 1 -- 172.21.15.87:0/30944813 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e5406e0c0 con 0x7f4e540b3580 2024-05-27T06:28:34.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.882+0000 7f4e4be00640 1 -- 172.21.15.87:0/30944813 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e440072d0 con 0x7f4e540b3580 2024-05-27T06:28:34.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.882+0000 7f4e53e00640 1 -- 172.21.15.87:0/30944813 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e541515e0 con 0x7f4e540b3580 2024-05-27T06:28:34.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.882+0000 7f4e53e00640 1 -- 172.21.15.87:0/30944813 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e5406e290 con 0x7f4e540b3580 2024-05-27T06:28:34.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.882+0000 7f4e4be00640 1 -- 172.21.15.87:0/30944813 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4e4401a070 con 0x7f4e540b3580 2024-05-27T06:28:34.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.886+0000 7f4e4be00640 1 --2- 172.21.15.87:0/30944813 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f4e3006f400 0x7f4e30071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:34.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.886+0000 7f4e4be00640 1 -- 172.21.15.87:0/30944813 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5335+0+0 (secure 0 0 0) 0x7f4e4408e4a0 con 0x7f4e540b3580 2024-05-27T06:28:34.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.886+0000 7f4e4a000640 1 --2- 172.21.15.87:0/30944813 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f4e3006f400 0x7f4e30071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:34.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.886+0000 7f4e4a000640 1 --2- 172.21.15.87:0/30944813 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f4e3006f400 0x7f4e30071910 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c0ae000 tx=0x7f4e3c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:34.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:34.890+0000 7f4e4be00640 1 -- 172.21.15.87:0/30944813 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f4e4405aed0 con 0x7f4e540b3580 2024-05-27T06:28:35.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.058+0000 7f4e53e00640 1 -- 172.21.15.87:0/30944813 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f4e540508e0 con 0x7f4e540b3580 2024-05-27T06:28:35.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.630+0000 7f4e4be00640 1 -- 172.21.15.87:0/30944813 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) ==== 97+0+0 (secure 0 0 0) 0x7f4e4405f1d0 con 0x7f4e540b3580 2024-05-27T06:28:35.628 INFO:teuthology.orchestra.run.smithi087.stderr: removed all blocklist entries 2024-05-27T06:28:35.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.634+0000 7f4e53e00640 1 -- 172.21.15.87:0/30944813 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f4e3006f400 msgr2=0x7f4e30071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:35.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.634+0000 7f4e53e00640 1 --2- 172.21.15.87:0/30944813 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f4e3006f400 0x7f4e30071910 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c0ae000 tx=0x7f4e3c008040 comp rx=0 tx=0).stop 2024-05-27T06:28:35.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.634+0000 7f4e53e00640 1 -- 172.21.15.87:0/30944813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e540b3580 msgr2=0x7f4e54150540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:35.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.634+0000 7f4e53e00640 1 --2- 172.21.15.87:0/30944813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e540b3580 0x7f4e54150540 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400c430 tx=0x7f4e4400c8f0 comp rx=0 tx=0).stop 2024-05-27T06:28:35.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.634+0000 7f4e53e00640 1 -- 172.21.15.87:0/30944813 shutdown_connections 2024-05-27T06:28:35.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.634+0000 7f4e53e00640 1 --2- 172.21.15.87:0/30944813 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f4e3006f400 0x7f4e30071910 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:35.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.634+0000 7f4e53e00640 1 --2- 172.21.15.87:0/30944813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e540d2f20 0x7f4e54153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:35.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.634+0000 7f4e53e00640 1 --2- 172.21.15.87:0/30944813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e540d2b10 0x7f4e54167530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:35.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.634+0000 7f4e53e00640 1 --2- 172.21.15.87:0/30944813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e540b3580 0x7f4e54150540 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:35.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.634+0000 7f4e53e00640 1 -- 172.21.15.87:0/30944813 >> 172.21.15.87:0/30944813 conn(0x7f4e540d35c0 msgr2=0x7f4e540713c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:35.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.634+0000 7f4e53e00640 1 -- 172.21.15.87:0/30944813 shutdown_connections 2024-05-27T06:28:35.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.634+0000 7f4e53e00640 1 -- 172.21.15.87:0/30944813 wait complete. 2024-05-27T06:28:35.653 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-27T06:28:35.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.806+0000 7f0ba9c00640 1 Processor -- start 2024-05-27T06:28:35.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.806+0000 7f0ba9c00640 1 -- start start 2024-05-27T06:28:35.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.806+0000 7f0ba9c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0ba41605d0 0x7f0ba41609e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:35.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.806+0000 7f0ba9c00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ba40ce7a0 con 0x7f0ba406e8b0 2024-05-27T06:28:35.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.806+0000 7f0ba9c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ba40cea80 con 0x7f0ba40d1d50 2024-05-27T06:28:35.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.806+0000 7f0ba9c00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f0ba40ced60 con 0x7f0ba41605d0 2024-05-27T06:28:35.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.806+0000 7f0ba2a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0ba41605d0 0x7f0ba41609e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:35.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.806+0000 7f0ba2000640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f0ba406e8b0 0x7f0ba406ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:47602/0 (socket says 172.21.15.87:47602) 2024-05-27T06:28:35.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.806+0000 7f0ba2000640 1 -- 172.21.15.87:0/1787890374 learned_addr learned my addr 172.21.15.87:0/1787890374 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:35.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.806+0000 7f0ba2a00640 1 -- 172.21.15.87:0/1787890374 >> v1:172.21.15.149:6789/0 conn(0x7f0ba40d1d50 legacy=0x7f0ba40d2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:35.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.806+0000 7f0ba2a00640 1 -- 172.21.15.87:0/1787890374 >> v1:172.21.15.87:6789/0 conn(0x7f0ba406e8b0 legacy=0x7f0ba406ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:35.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.806+0000 7f0ba2a00640 1 -- 172.21.15.87:0/1787890374 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ba40cf040 con 0x7f0ba41605d0 2024-05-27T06:28:35.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.806+0000 7f0ba1600640 1 -- 172.21.15.87:0/1787890374 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2478264112 0 0) 0x7f0ba40ce7a0 con 0x7f0ba406e8b0 2024-05-27T06:28:35.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.810+0000 7f0ba2a00640 1 --2- 172.21.15.87:0/1787890374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ba41605d0 0x7f0ba41609e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0b940097c0 tx=0x7f0b9401ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=256acb8ef709ae04 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:35.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.810+0000 7f0ba1600640 1 -- 172.21.15.87:0/1787890374 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b940b0070 con 0x7f0ba41605d0 2024-05-27T06:28:35.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.810+0000 7f0ba1600640 1 -- 172.21.15.87:0/1787890374 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b940ab600 con 0x7f0ba41605d0 2024-05-27T06:28:35.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.810+0000 7f0ba1600640 1 -- 172.21.15.87:0/1787890374 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b940ab9d0 con 0x7f0ba41605d0 2024-05-27T06:28:35.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.810+0000 7f0ba9c00640 1 -- 172.21.15.87:0/1787890374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ba41605d0 msgr2=0x7f0ba41609e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:35.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.810+0000 7f0ba9c00640 1 --2- 172.21.15.87:0/1787890374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ba41605d0 0x7f0ba41609e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0b940097c0 tx=0x7f0b9401ce70 comp rx=0 tx=0).stop 2024-05-27T06:28:35.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.810+0000 7f0ba9c00640 1 -- 172.21.15.87:0/1787890374 shutdown_connections 2024-05-27T06:28:35.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.810+0000 7f0ba9c00640 1 --2- 172.21.15.87:0/1787890374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ba41605d0 0x7f0ba41609e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:35.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.810+0000 7f0ba9c00640 1 -- 172.21.15.87:0/1787890374 >> 172.21.15.87:0/1787890374 conn(0x7f0ba40d3590 msgr2=0x7f0ba40d39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:35.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.810+0000 7f0ba9c00640 1 -- 172.21.15.87:0/1787890374 shutdown_connections 2024-05-27T06:28:35.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.810+0000 7f0ba9c00640 1 -- 172.21.15.87:0/1787890374 wait complete. 2024-05-27T06:28:35.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.814+0000 7f0ba9c00640 1 Processor -- start 2024-05-27T06:28:35.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.814+0000 7f0ba9c00640 1 -- start start 2024-05-27T06:28:35.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.814+0000 7f0ba9c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ba406e8b0 0x7f0ba414e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:35.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.814+0000 7f0ba9c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ba40d1d50 0x7f0ba4157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:35.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.814+0000 7f0ba9c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ba41605d0 0x7f0ba40b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:35.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.814+0000 7f0ba9c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba416e140 con 0x7f0ba406e8b0 2024-05-27T06:28:35.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.814+0000 7f0ba9c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba416dfc0 con 0x7f0ba40d1d50 2024-05-27T06:28:35.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.814+0000 7f0ba9c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0ba416e2c0 con 0x7f0ba41605d0 2024-05-27T06:28:35.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.814+0000 7f0ba2a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ba406e8b0 0x7f0ba414e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:35.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.814+0000 7f0ba2a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ba406e8b0 0x7f0ba414e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33934/0 (socket says 172.21.15.87:33934) 2024-05-27T06:28:35.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.814+0000 7f0ba2a00640 1 -- 172.21.15.87:0/1731797822 learned_addr learned my addr 172.21.15.87:0/1731797822 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:35.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.818+0000 7f0ba2a00640 1 -- 172.21.15.87:0/1731797822 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ba41605d0 msgr2=0x7f0ba40b39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:35.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.818+0000 7f0ba2a00640 1 --2- 172.21.15.87:0/1731797822 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ba41605d0 0x7f0ba40b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:35.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.818+0000 7f0ba2a00640 1 -- 172.21.15.87:0/1731797822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ba40d1d50 msgr2=0x7f0ba4157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:35.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.818+0000 7f0ba2000640 1 --2- 172.21.15.87:0/1731797822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ba40d1d50 0x7f0ba4157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:35.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.818+0000 7f0ba2a00640 1 --2- 172.21.15.87:0/1731797822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ba40d1d50 0x7f0ba4157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:35.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.818+0000 7f0ba2a00640 1 -- 172.21.15.87:0/1731797822 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ba4157dd0 con 0x7f0ba406e8b0 2024-05-27T06:28:35.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.818+0000 7f0ba2000640 1 --2- 172.21.15.87:0/1731797822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ba40d1d50 0x7f0ba4157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:35.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.818+0000 7f0ba2a00640 1 --2- 172.21.15.87:0/1731797822 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ba406e8b0 0x7f0ba414e8d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0b9401a040 tx=0x7f0b940191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:35.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.818+0000 7f0b9aa00640 1 -- 172.21.15.87:0/1731797822 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b940b0040 con 0x7f0ba406e8b0 2024-05-27T06:28:35.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.818+0000 7f0b9aa00640 1 -- 172.21.15.87:0/1731797822 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b940ba070 con 0x7f0ba406e8b0 2024-05-27T06:28:35.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.818+0000 7f0b9aa00640 1 -- 172.21.15.87:0/1731797822 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b940b4830 con 0x7f0ba406e8b0 2024-05-27T06:28:35.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.818+0000 7f0ba9c00640 1 -- 172.21.15.87:0/1731797822 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ba40b72c0 con 0x7f0ba406e8b0 2024-05-27T06:28:35.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.818+0000 7f0ba9c00640 1 -- 172.21.15.87:0/1731797822 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ba40b6d00 con 0x7f0ba406e8b0 2024-05-27T06:28:35.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.818+0000 7f0ba9c00640 1 -- 172.21.15.87:0/1731797822 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ba406aa30 con 0x7f0ba406e8b0 2024-05-27T06:28:35.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.818+0000 7f0b9aa00640 1 -- 172.21.15.87:0/1731797822 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0b940ab4c0 con 0x7f0ba406e8b0 2024-05-27T06:28:35.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.818+0000 7f0b9aa00640 1 --2- 172.21.15.87:0/1731797822 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0b8406f400 0x7f0b84071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:35.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.818+0000 7f0b9aa00640 1 -- 172.21.15.87:0/1731797822 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f0b94128ed0 con 0x7f0ba406e8b0 2024-05-27T06:28:35.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.822+0000 7f0ba2000640 1 --2- 172.21.15.87:0/1731797822 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0b8406f400 0x7f0b84071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:35.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.822+0000 7f0ba2000640 1 --2- 172.21.15.87:0/1731797822 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0b8406f400 0x7f0b84071910 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0ba40b9610 tx=0x7f0b90009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:35.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:35.826+0000 7f0b9aa00640 1 -- 172.21.15.87:0/1731797822 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f0b94016090 con 0x7f0ba406e8b0 2024-05-27T06:28:36.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.034+0000 7f0ba9c00640 1 -- 172.21.15.87:0/1731797822 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f0ba40cfdf0 con 0x7f0ba406e8b0 2024-05-27T06:28:36.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.034+0000 7f0b9aa00640 1 -- 172.21.15.87:0/1731797822 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7f0b940f5f70 con 0x7f0ba406e8b0 2024-05-27T06:28:36.031 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:36.031 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-27T06:28:36.031 INFO:teuthology.orchestra.run.smithi087.stdout: "auth_dump": [ 2024-05-27T06:28:36.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:28:36.031 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "mds.a", 2024-05-27T06:28:36.031 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCeJ1RmervxKBAAoI8i952fjbs3eqb1PTsgIw==", 2024-05-27T06:28:36.031 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:28:36.031 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow", 2024-05-27T06:28:36.031 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow *", 2024-05-27T06:28:36.032 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow *", 2024-05-27T06:28:36.032 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:28:36.032 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:36.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:36.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:28:36.032 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "mds.b", 2024-05-27T06:28:36.032 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCeJ1RmUgx4NhAAG6bWGMQa3nvZwlrIuqIoPw==", 2024-05-27T06:28:36.032 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:28:36.032 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow", 2024-05-27T06:28:36.032 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow *", 2024-05-27T06:28:36.032 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow *", 2024-05-27T06:28:36.032 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:28:36.033 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:36.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:36.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:28:36.033 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "mds.c", 2024-05-27T06:28:36.033 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCeJ1RmHqu/MBAAL1h8SSHzJkmv2qutGkSlpw==", 2024-05-27T06:28:36.033 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:28:36.033 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow", 2024-05-27T06:28:36.033 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow *", 2024-05-27T06:28:36.033 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow *", 2024-05-27T06:28:36.033 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:28:36.033 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:36.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:36.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:28:36.033 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "mds.d", 2024-05-27T06:28:36.033 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCfJ1RmkhfMAhAAh2P/KsxH6TjNuN1lcdi34g==", 2024-05-27T06:28:36.034 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:28:36.034 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow", 2024-05-27T06:28:36.034 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow *", 2024-05-27T06:28:36.034 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow *", 2024-05-27T06:28:36.034 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:28:36.034 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:36.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:36.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:28:36.034 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "osd.0", 2024-05-27T06:28:36.034 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCiJ1RmVDNWBhAA1OmU3UT0GCj5L+VKhDGH7g==", 2024-05-27T06:28:36.034 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:28:36.034 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow profile osd", 2024-05-27T06:28:36.034 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile osd", 2024-05-27T06:28:36.035 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:28:36.035 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:36.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:36.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:28:36.035 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "osd.1", 2024-05-27T06:28:36.035 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQClJ1RmoDbTEhAAUG495eGC9Oj4rJ6FUu8fuw==", 2024-05-27T06:28:36.035 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:28:36.035 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow profile osd", 2024-05-27T06:28:36.035 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile osd", 2024-05-27T06:28:36.035 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:28:36.035 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:36.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:36.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:28:36.035 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "osd.2", 2024-05-27T06:28:36.036 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCoJ1RmKRaYHRAAxvkg0738G5fXJkSs7Op5hg==", 2024-05-27T06:28:36.036 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:28:36.036 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow profile osd", 2024-05-27T06:28:36.036 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile osd", 2024-05-27T06:28:36.036 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:28:36.036 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:36.036 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:36.036 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:28:36.036 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "osd.3", 2024-05-27T06:28:36.036 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCrJ1RmILNKKRAAnZgVA/Egm8DHMZ/2YQqmHA==", 2024-05-27T06:28:36.036 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:28:36.036 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow profile osd", 2024-05-27T06:28:36.036 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile osd", 2024-05-27T06:28:36.036 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:28:36.037 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:36.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:36.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:28:36.037 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "osd.4", 2024-05-27T06:28:36.037 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCxJ1RmlldAIRAAE7xPqjOhCXGBy8R8SetoAQ==", 2024-05-27T06:28:36.037 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:28:36.037 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow profile osd", 2024-05-27T06:28:36.037 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile osd", 2024-05-27T06:28:36.037 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:28:36.037 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:36.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:36.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:28:36.037 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "osd.5", 2024-05-27T06:28:36.037 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQC0J1RmctJ5LRAAJNyV09Axs44PTvNsplmyjg==", 2024-05-27T06:28:36.038 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:28:36.038 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow profile osd", 2024-05-27T06:28:36.038 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile osd", 2024-05-27T06:28:36.038 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:28:36.038 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:36.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:36.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:28:36.038 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "osd.6", 2024-05-27T06:28:36.038 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQC3J1RmMU3QOBAAxSaigZ2H/6Rh/9zzFjD2EQ==", 2024-05-27T06:28:36.038 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:28:36.038 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow profile osd", 2024-05-27T06:28:36.038 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile osd", 2024-05-27T06:28:36.038 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:28:36.039 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:36.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:36.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:28:36.039 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "osd.7", 2024-05-27T06:28:36.039 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQC7J1RmhVUWCBAAsehamp4zjDXhU3shpMkqrQ==", 2024-05-27T06:28:36.039 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:28:36.039 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow profile osd", 2024-05-27T06:28:36.039 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile osd", 2024-05-27T06:28:36.039 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:28:36.039 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:36.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:36.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:28:36.039 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "client.0", 2024-05-27T06:28:36.039 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCfJ1RmAld8BxAAigqU2F3mGXtAfw0L9Bfp2A==", 2024-05-27T06:28:36.040 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:28:36.040 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow", 2024-05-27T06:28:36.040 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow r", 2024-05-27T06:28:36.040 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow rw", 2024-05-27T06:28:36.040 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow rwx" 2024-05-27T06:28:36.040 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:36.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:36.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:28:36.040 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "client.1", 2024-05-27T06:28:36.040 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCfJ1RmZDSHDxAAv5a4tqOVEtCQpM2NLf/Hhw==", 2024-05-27T06:28:36.040 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:28:36.040 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow", 2024-05-27T06:28:36.040 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow r", 2024-05-27T06:28:36.040 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow rw", 2024-05-27T06:28:36.041 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow rwx" 2024-05-27T06:28:36.041 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:36.041 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:36.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:28:36.041 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "client.2", 2024-05-27T06:28:36.041 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCfJ1RmUByHCxAASgfa8jGPseHppkHqVMb++Q==", 2024-05-27T06:28:36.041 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:28:36.041 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow", 2024-05-27T06:28:36.041 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow r", 2024-05-27T06:28:36.041 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow rw", 2024-05-27T06:28:36.041 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow rwx" 2024-05-27T06:28:36.041 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:36.041 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:36.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:28:36.042 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "client.3", 2024-05-27T06:28:36.042 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCfJ1Rm2gSgExAAzkY0fRetTrfU8VqBpP3GJQ==", 2024-05-27T06:28:36.042 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:28:36.042 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow", 2024-05-27T06:28:36.042 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow r", 2024-05-27T06:28:36.042 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow rw", 2024-05-27T06:28:36.042 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow rwx" 2024-05-27T06:28:36.042 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:36.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:36.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:28:36.042 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "client.admin", 2024-05-27T06:28:36.042 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCeJ1Rm6DrNCBAAE7UK9ea59/Ferleyl8efMQ==", 2024-05-27T06:28:36.042 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:28:36.042 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow *", 2024-05-27T06:28:36.043 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow *", 2024-05-27T06:28:36.043 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow *", 2024-05-27T06:28:36.043 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:28:36.043 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:36.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:36.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:28:36.043 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "client.bootstrap-mds", 2024-05-27T06:28:36.043 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQDBJ1RmcK7mGBAAVE9E5O9n8nvXazRxM0ksbQ==", 2024-05-27T06:28:36.043 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:28:36.043 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile bootstrap-mds" 2024-05-27T06:28:36.043 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:36.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:36.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:28:36.044 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "client.bootstrap-mgr", 2024-05-27T06:28:36.044 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQDBJ1RmRLjmGBAA/UNVacv+3zabstFEa6ddlQ==", 2024-05-27T06:28:36.044 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:28:36.044 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-27T06:28:36.044 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:36.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:36.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:28:36.044 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "client.bootstrap-osd", 2024-05-27T06:28:36.044 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQDBJ1RmMcHmGBAAb845nm53MY/aHyF8ipIUqA==", 2024-05-27T06:28:36.044 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:28:36.044 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile bootstrap-osd" 2024-05-27T06:28:36.044 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:36.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:36.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:28:36.045 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "client.bootstrap-rbd", 2024-05-27T06:28:36.045 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQDBJ1Rmm8nmGBAASWYzon/A7uSNiNa4hPGsgw==", 2024-05-27T06:28:36.045 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:28:36.045 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-27T06:28:36.045 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:36.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:36.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:28:36.045 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-27T06:28:36.045 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQDBJ1RmXNLmGBAA9AAVypAD0lHfvEjv58wcVw==", 2024-05-27T06:28:36.045 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:28:36.045 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-27T06:28:36.045 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:36.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:36.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:28:36.046 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "client.bootstrap-rgw", 2024-05-27T06:28:36.046 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQDBJ1RmM9vmGBAAv7WEhzE0JHQb6voa0rZlQw==", 2024-05-27T06:28:36.046 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:28:36.046 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-27T06:28:36.046 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:36.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:36.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:28:36.046 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "mgr.x", 2024-05-27T06:28:36.046 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCeJ1Rmf+/gIxAA4Spz0TeMdwjCMfsfGi1+lQ==", 2024-05-27T06:28:36.046 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:28:36.046 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow *", 2024-05-27T06:28:36.046 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile mgr", 2024-05-27T06:28:36.046 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:28:36.046 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:36.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:36.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:28:36.047 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "mgr.y", 2024-05-27T06:28:36.047 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCeJ1RmMh1fHxAAV0EJocBVjB0EIzmInIZFVw==", 2024-05-27T06:28:36.047 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:28:36.047 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow *", 2024-05-27T06:28:36.047 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile mgr", 2024-05-27T06:28:36.047 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:28:36.047 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:36.047 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:36.047 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-05-27T06:28:36.047 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-27T06:28:36.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.034+0000 7f0ba9c00640 1 -- 172.21.15.87:0/1731797822 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0b8406f400 msgr2=0x7f0b84071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:36.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.034+0000 7f0ba9c00640 1 --2- 172.21.15.87:0/1731797822 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0b8406f400 0x7f0b84071910 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0ba40b9610 tx=0x7f0b90009040 comp rx=0 tx=0).stop 2024-05-27T06:28:36.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.034+0000 7f0ba9c00640 1 -- 172.21.15.87:0/1731797822 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ba406e8b0 msgr2=0x7f0ba414e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:36.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.034+0000 7f0ba9c00640 1 --2- 172.21.15.87:0/1731797822 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ba406e8b0 0x7f0ba414e8d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0b9401a040 tx=0x7f0b940191b0 comp rx=0 tx=0).stop 2024-05-27T06:28:36.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.034+0000 7f0ba9c00640 1 -- 172.21.15.87:0/1731797822 shutdown_connections 2024-05-27T06:28:36.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.034+0000 7f0ba9c00640 1 --2- 172.21.15.87:0/1731797822 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0b8406f400 0x7f0b84071910 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:36.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.034+0000 7f0ba9c00640 1 --2- 172.21.15.87:0/1731797822 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ba41605d0 0x7f0ba40b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:36.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.034+0000 7f0ba9c00640 1 --2- 172.21.15.87:0/1731797822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ba40d1d50 0x7f0ba4157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:36.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.034+0000 7f0ba9c00640 1 --2- 172.21.15.87:0/1731797822 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ba406e8b0 0x7f0ba414e8d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:36.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.034+0000 7f0ba9c00640 1 -- 172.21.15.87:0/1731797822 >> 172.21.15.87:0/1731797822 conn(0x7f0ba40d3590 msgr2=0x7f0ba4071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:36.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.034+0000 7f0ba9c00640 1 -- 172.21.15.87:0/1731797822 shutdown_connections 2024-05-27T06:28:36.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.034+0000 7f0ba9c00640 1 -- 172.21.15.87:0/1731797822 wait complete. 2024-05-27T06:28:36.052 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-27T06:28:36.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.206+0000 7fc047600640 1 Processor -- start 2024-05-27T06:28:36.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.206+0000 7fc047600640 1 -- start start 2024-05-27T06:28:36.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.206+0000 7fc047600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0400caa50 0x7fc0400cae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:36.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.206+0000 7fc047600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc040163af0 0x7fc040163f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:36.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.206+0000 7fc047600640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0400b10e0 con 0x7fc040070120 2024-05-27T06:28:36.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.206+0000 7fc047600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fc040070de0 con 0x7fc040163af0 2024-05-27T06:28:36.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.206+0000 7fc047600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc0400cb3a0 con 0x7fc0400caa50 2024-05-27T06:28:36.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.206+0000 7fc044c00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fc040070120 0x7fc040160ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:47614/0 (socket says 172.21.15.87:47614) 2024-05-27T06:28:36.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.206+0000 7fc044c00640 1 -- 172.21.15.87:0/3313054341 learned_addr learned my addr 172.21.15.87:0/3313054341 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:36.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.206+0000 7fc045600640 1 --2- 172.21.15.87:0/3313054341 >> v2:172.21.15.149:3300/0 conn(0x7fc040163af0 0x7fc040163f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:36.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.206+0000 7fc03fe00640 1 --2- 172.21.15.87:0/3313054341 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0400caa50 0x7fc0400cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:36.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.206+0000 7fc03f400640 1 -- 172.21.15.87:0/3313054341 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3262613890 0 0) 0x7fc034001120 con 0x7fc040070120 2024-05-27T06:28:36.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.206+0000 7fc03f400640 1 -- 172.21.15.87:0/3313054341 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc028003530 con 0x7fc040070120 2024-05-27T06:28:36.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.206+0000 7fc045600640 1 -- 172.21.15.87:0/3313054341 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0400caa50 msgr2=0x7fc0400cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:36.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.206+0000 7fc045600640 1 --2- 172.21.15.87:0/3313054341 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0400caa50 0x7fc0400cae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:36.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.206+0000 7fc045600640 1 -- 172.21.15.87:0/3313054341 >> v1:172.21.15.87:6789/0 conn(0x7fc040070120 legacy=0x7fc040160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:36.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.206+0000 7fc045600640 1 -- 172.21.15.87:0/3313054341 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc040160710 con 0x7fc040163af0 2024-05-27T06:28:36.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.210+0000 7fc045600640 1 --2- 172.21.15.87:0/3313054341 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc040163af0 0x7fc040163f00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc038009d90 tx=0x7fc03801c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4624a26d05dd86f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:36.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.210+0000 7fc03f400640 1 -- 172.21.15.87:0/3313054341 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0380b2070 con 0x7fc040163af0 2024-05-27T06:28:36.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.210+0000 7fc03f400640 1 -- 172.21.15.87:0/3313054341 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0380a5830 con 0x7fc040163af0 2024-05-27T06:28:36.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.210+0000 7fc03f400640 1 -- 172.21.15.87:0/3313054341 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0380a5be0 con 0x7fc040163af0 2024-05-27T06:28:36.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.210+0000 7fc047600640 1 -- 172.21.15.87:0/3313054341 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc040163af0 msgr2=0x7fc040163f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:36.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.210+0000 7fc047600640 1 --2- 172.21.15.87:0/3313054341 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc040163af0 0x7fc040163f00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc038009d90 tx=0x7fc03801c880 comp rx=0 tx=0).stop 2024-05-27T06:28:36.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.210+0000 7fc047600640 1 -- 172.21.15.87:0/3313054341 shutdown_connections 2024-05-27T06:28:36.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.210+0000 7fc047600640 1 --2- 172.21.15.87:0/3313054341 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc040163af0 0x7fc040163f00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:36.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.210+0000 7fc047600640 1 --2- 172.21.15.87:0/3313054341 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0400caa50 0x7fc0400cae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:36.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.210+0000 7fc047600640 1 -- 172.21.15.87:0/3313054341 >> 172.21.15.87:0/3313054341 conn(0x7fc0400d2190 msgr2=0x7fc0400ce180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:36.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.210+0000 7fc047600640 1 -- 172.21.15.87:0/3313054341 shutdown_connections 2024-05-27T06:28:36.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.210+0000 7fc047600640 1 -- 172.21.15.87:0/3313054341 wait complete. 2024-05-27T06:28:36.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.214+0000 7fc047600640 1 Processor -- start 2024-05-27T06:28:36.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.214+0000 7fc047600640 1 -- start start 2024-05-27T06:28:36.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.214+0000 7fc047600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc040070120 0x7fc04014ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:36.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.214+0000 7fc047600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0400caa50 0x7fc04014f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:36.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.214+0000 7fc047600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc040163af0 0x7fc0400b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:36.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.214+0000 7fc047600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc040070530 con 0x7fc040070120 2024-05-27T06:28:36.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.214+0000 7fc047600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc0401609b0 con 0x7fc0400caa50 2024-05-27T06:28:36.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.214+0000 7fc047600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc04016d6a0 con 0x7fc040163af0 2024-05-27T06:28:36.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.214+0000 7fc044c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc040070120 0x7fc04014ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:36.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.214+0000 7fc044c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc040070120 0x7fc04014ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33936/0 (socket says 172.21.15.87:33936) 2024-05-27T06:28:36.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.214+0000 7fc044c00640 1 -- 172.21.15.87:0/3155297593 learned_addr learned my addr 172.21.15.87:0/3155297593 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:36.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.214+0000 7fc03fe00640 1 --2- 172.21.15.87:0/3155297593 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0400caa50 0x7fc04014f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:36.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.214+0000 7fc045600640 1 --2- 172.21.15.87:0/3155297593 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc040163af0 0x7fc0400b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:36.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.218+0000 7fc044c00640 1 -- 172.21.15.87:0/3155297593 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc040163af0 msgr2=0x7fc0400b53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:36.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.218+0000 7fc044c00640 1 --2- 172.21.15.87:0/3155297593 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc040163af0 0x7fc0400b53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:36.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.218+0000 7fc044c00640 1 -- 172.21.15.87:0/3155297593 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0400caa50 msgr2=0x7fc04014f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:36.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.218+0000 7fc044c00640 1 --2- 172.21.15.87:0/3155297593 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0400caa50 0x7fc04014f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:36.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.218+0000 7fc044c00640 1 -- 172.21.15.87:0/3155297593 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0400cea90 con 0x7fc040070120 2024-05-27T06:28:36.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.218+0000 7fc045600640 1 --2- 172.21.15.87:0/3155297593 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc040163af0 0x7fc0400b53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:36.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.218+0000 7fc044c00640 1 --2- 172.21.15.87:0/3155297593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc040070120 0x7fc04014ce10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc03400c760 tx=0x7fc03400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:36.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.218+0000 7fc03cc00640 1 -- 172.21.15.87:0/3155297593 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc034017070 con 0x7fc040070120 2024-05-27T06:28:36.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.218+0000 7fc03cc00640 1 -- 172.21.15.87:0/3155297593 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc034005ac0 con 0x7fc040070120 2024-05-27T06:28:36.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.218+0000 7fc03cc00640 1 -- 172.21.15.87:0/3155297593 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc034001d20 con 0x7fc040070120 2024-05-27T06:28:36.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.218+0000 7fc047600640 1 -- 172.21.15.87:0/3155297593 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc04014fc70 con 0x7fc040070120 2024-05-27T06:28:36.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.218+0000 7fc047600640 1 -- 172.21.15.87:0/3155297593 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc040150460 con 0x7fc040070120 2024-05-27T06:28:36.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.218+0000 7fc047600640 1 -- 172.21.15.87:0/3155297593 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc04006aa30 con 0x7fc040070120 2024-05-27T06:28:36.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.218+0000 7fc03cc00640 1 -- 172.21.15.87:0/3155297593 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc03401a070 con 0x7fc040070120 2024-05-27T06:28:36.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.218+0000 7fc03cc00640 1 --2- 172.21.15.87:0/3155297593 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc02006f400 0x7fc020071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:36.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.218+0000 7fc03cc00640 1 -- 172.21.15.87:0/3155297593 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fc03408e220 con 0x7fc040070120 2024-05-27T06:28:36.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.218+0000 7fc03fe00640 1 --2- 172.21.15.87:0/3155297593 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc02006f400 0x7fc020071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:36.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.222+0000 7fc03fe00640 1 --2- 172.21.15.87:0/3155297593 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc02006f400 0x7fc020071910 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc0401643a0 tx=0x7fc02c009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:36.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.226+0000 7fc03cc00640 1 -- 172.21.15.87:0/3155297593 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fc0400b10e0 con 0x7fc040070120 2024-05-27T06:28:36.380 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T06:28:36.383 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T06:28:36.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.437+0000 7fc047600640 1 -- 172.21.15.87:0/3155297593 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fc0400d0fd0 con 0x7fc040070120 2024-05-27T06:28:36.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.437+0000 7fc03cc00640 1 -- 172.21.15.87:0/3155297593 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7fc034063350 con 0x7fc040070120 2024-05-27T06:28:36.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.441+0000 7fc047600640 1 -- 172.21.15.87:0/3155297593 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc02006f400 msgr2=0x7fc020071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:36.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.441+0000 7fc047600640 1 --2- 172.21.15.87:0/3155297593 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc02006f400 0x7fc020071910 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc0401643a0 tx=0x7fc02c009190 comp rx=0 tx=0).stop 2024-05-27T06:28:36.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.441+0000 7fc047600640 1 -- 172.21.15.87:0/3155297593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc040070120 msgr2=0x7fc04014ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:36.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.441+0000 7fc047600640 1 --2- 172.21.15.87:0/3155297593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc040070120 0x7fc04014ce10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc03400c760 tx=0x7fc03400cc20 comp rx=0 tx=0).stop 2024-05-27T06:28:36.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.441+0000 7fc047600640 1 -- 172.21.15.87:0/3155297593 shutdown_connections 2024-05-27T06:28:36.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.441+0000 7fc047600640 1 --2- 172.21.15.87:0/3155297593 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc02006f400 0x7fc020071910 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:36.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.441+0000 7fc047600640 1 --2- 172.21.15.87:0/3155297593 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc040163af0 0x7fc0400b53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:36.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.441+0000 7fc047600640 1 --2- 172.21.15.87:0/3155297593 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0400caa50 0x7fc04014f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:36.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.441+0000 7fc047600640 1 --2- 172.21.15.87:0/3155297593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc040070120 0x7fc04014ce10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:36.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.441+0000 7fc047600640 1 -- 172.21.15.87:0/3155297593 >> 172.21.15.87:0/3155297593 conn(0x7fc0400d2190 msgr2=0x7fc040072e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:36.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.441+0000 7fc047600640 1 -- 172.21.15.87:0/3155297593 shutdown_connections 2024-05-27T06:28:36.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.441+0000 7fc047600640 1 -- 172.21.15.87:0/3155297593 wait complete. 2024-05-27T06:28:36.459 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-27T06:28:36.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a19600640 1 Processor -- start 2024-05-27T06:28:36.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a19600640 1 -- start start 2024-05-27T06:28:36.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a19600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a14167cd0 0x7f8a141680e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:36.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a19600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8a1406c7b0 0x7f8a1406cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:36.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a19600640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a14073c70 con 0x7f8a140d08f0 2024-05-27T06:28:36.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a19600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f8a14070700 con 0x7f8a1406c7b0 2024-05-27T06:28:36.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a19600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8a14168620 con 0x7f8a14167cd0 2024-05-27T06:28:36.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a12a00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8a140d08f0 0x7f8a14073480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:47628/0 (socket says 172.21.15.87:47628) 2024-05-27T06:28:36.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a12a00640 1 -- 172.21.15.87:0/799394327 learned_addr learned my addr 172.21.15.87:0/799394327 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:36.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a13400640 1 --2- 172.21.15.87:0/799394327 >> v2:172.21.15.149:3300/0 conn(0x7f8a1406c7b0 0x7f8a1406cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:36.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a12000640 1 --2- 172.21.15.87:0/799394327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a14167cd0 0x7f8a141680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:36.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a11600640 1 -- 172.21.15.87:0/799394327 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1439411223 0 0) 0x7f8a04001120 con 0x7f8a140d08f0 2024-05-27T06:28:36.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a11600640 1 -- 172.21.15.87:0/799394327 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89f8003530 con 0x7f8a140d08f0 2024-05-27T06:28:36.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a11600640 1 -- 172.21.15.87:0/799394327 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3254720932 0 0) 0x7f89f8003530 con 0x7f8a140d08f0 2024-05-27T06:28:36.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a11600640 1 -- 172.21.15.87:0/799394327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a14167cd0 msgr2=0x7f8a141680e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:36.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a11600640 1 --2- 172.21.15.87:0/799394327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a14167cd0 0x7f8a141680e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:36.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a11600640 1 -- 172.21.15.87:0/799394327 >> v2:172.21.15.149:3300/0 conn(0x7f8a1406c7b0 msgr2=0x7f8a1406cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:36.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a11600640 1 --2- 172.21.15.87:0/799394327 >> v2:172.21.15.149:3300/0 conn(0x7f8a1406c7b0 0x7f8a1406cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:36.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a11600640 1 -- 172.21.15.87:0/799394327 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a1406fdd0 con 0x7f8a140d08f0 2024-05-27T06:28:36.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a11600640 1 -- 172.21.15.87:0/799394327 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7f8a040018d0 con 0x7f8a140d08f0 2024-05-27T06:28:36.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a11600640 1 -- 172.21.15.87:0/799394327 >> v1:172.21.15.87:6789/0 conn(0x7f8a140d08f0 legacy=0x7f8a14073480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:36.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a11600640 1 --2- 172.21.15.87:0/799394327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a14167cd0 0x7f89f8003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:36.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a11600640 1 --2- 172.21.15.87:0/799394327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89f8004030 0x7f89f8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:36.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a11600640 1 --2- 172.21.15.87:0/799394327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89f8004d50 0x7f89f8005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:36.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a11600640 1 -- 172.21.15.87:0/799394327 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8a14070700 con 0x7f89f8004030 2024-05-27T06:28:36.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a11600640 1 -- 172.21.15.87:0/799394327 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8a14168620 con 0x7f89f8004d50 2024-05-27T06:28:36.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a11600640 1 -- 172.21.15.87:0/799394327 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f89f800bb30 con 0x7f8a14167cd0 2024-05-27T06:28:36.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a12000640 1 --2- 172.21.15.87:0/799394327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89f8004030 0x7f89f8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:36.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a12a00640 1 --2- 172.21.15.87:0/799394327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a14167cd0 0x7f89f8003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:36.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a13400640 1 --2- 172.21.15.87:0/799394327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89f8004d50 0x7f89f8005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:36.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a12000640 1 -- 172.21.15.87:0/799394327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a14167cd0 msgr2=0x7f89f8003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:36.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a12000640 1 --2- 172.21.15.87:0/799394327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a14167cd0 0x7f89f8003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:36.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a12000640 1 -- 172.21.15.87:0/799394327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89f8004d50 msgr2=0x7f89f8005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:36.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a12000640 1 --2- 172.21.15.87:0/799394327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89f8004d50 0x7f89f8005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:36.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.661+0000 7f8a12000640 1 -- 172.21.15.87:0/799394327 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f8003530 con 0x7f89f8004030 2024-05-27T06:28:36.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.665+0000 7f8a12000640 1 --2- 172.21.15.87:0/799394327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89f8004030 0x7f89f8004810 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009ab0 tx=0x7f8a0001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ad788256d3663c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:36.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.665+0000 7f8a11600640 1 -- 172.21.15.87:0/799394327 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a000b2070 con 0x7f89f8004030 2024-05-27T06:28:36.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.665+0000 7f8a11600640 1 -- 172.21.15.87:0/799394327 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a000a5550 con 0x7f89f8004030 2024-05-27T06:28:36.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.665+0000 7f8a11600640 1 -- 172.21.15.87:0/799394327 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a000096b0 con 0x7f89f8004030 2024-05-27T06:28:36.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.665+0000 7f8a19600640 1 -- 172.21.15.87:0/799394327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89f8004030 msgr2=0x7f89f8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:36.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.665+0000 7f8a19600640 1 --2- 172.21.15.87:0/799394327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89f8004030 0x7f89f8004810 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009ab0 tx=0x7f8a0001ca70 comp rx=0 tx=0).stop 2024-05-27T06:28:36.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.665+0000 7f8a13400640 1 -- 172.21.15.87:0/799394327 reap_dead start 2024-05-27T06:28:36.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.665+0000 7f8a19600640 1 -- 172.21.15.87:0/799394327 shutdown_connections 2024-05-27T06:28:36.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.665+0000 7f8a19600640 1 -- 172.21.15.87:0/799394327 >> 172.21.15.87:0/799394327 conn(0x7f8a140b2fb0 msgr2=0x7f8a140b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:36.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.665+0000 7f8a19600640 1 -- 172.21.15.87:0/799394327 shutdown_connections 2024-05-27T06:28:36.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.665+0000 7f8a19600640 1 -- 172.21.15.87:0/799394327 wait complete. 2024-05-27T06:28:36.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.669+0000 7f8a19600640 1 Processor -- start 2024-05-27T06:28:36.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.669+0000 7f8a19600640 1 -- start start 2024-05-27T06:28:36.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.669+0000 7f8a19600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89f8004030 0x7f8a1414e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:36.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.669+0000 7f8a19600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a1415d1d0 0x7f8a1415d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:36.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.669+0000 7f8a19600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a14162c40 0x7f8a14163050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:36.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.669+0000 7f8a19600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8a141680e0 con 0x7f89f8004030 2024-05-27T06:28:36.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.669+0000 7f8a19600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8a14070390 con 0x7f8a1415d1d0 2024-05-27T06:28:36.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.669+0000 7f8a19600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8a14168260 con 0x7f8a14162c40 2024-05-27T06:28:36.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.673+0000 7f8a12a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89f8004030 0x7f8a1414e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:36.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.673+0000 7f8a12a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89f8004030 0x7f8a1414e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33960/0 (socket says 172.21.15.87:33960) 2024-05-27T06:28:36.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.673+0000 7f8a12a00640 1 -- 172.21.15.87:0/1589157047 learned_addr learned my addr 172.21.15.87:0/1589157047 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:36.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.673+0000 7f8a13400640 1 --2- 172.21.15.87:0/1589157047 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a14162c40 0x7f8a14163050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:36.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.673+0000 7f8a12000640 1 --2- 172.21.15.87:0/1589157047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a1415d1d0 0x7f8a1415d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:36.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.673+0000 7f8a12a00640 1 -- 172.21.15.87:0/1589157047 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a14162c40 msgr2=0x7f8a14163050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:36.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.673+0000 7f8a12a00640 1 --2- 172.21.15.87:0/1589157047 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a14162c40 0x7f8a14163050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:36.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.673+0000 7f8a12a00640 1 -- 172.21.15.87:0/1589157047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a1415d1d0 msgr2=0x7f8a1415d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:36.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.673+0000 7f8a12a00640 1 --2- 172.21.15.87:0/1589157047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a1415d1d0 0x7f8a1415d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:36.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.673+0000 7f8a12a00640 1 -- 172.21.15.87:0/1589157047 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a14163590 con 0x7f89f8004030 2024-05-27T06:28:36.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.673+0000 7f8a12a00640 1 --2- 172.21.15.87:0/1589157047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89f8004030 0x7f8a1414e8c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8a040057a0 tx=0x7f8a04012630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:36.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.673+0000 7f8a0aa00640 1 -- 172.21.15.87:0/1589157047 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0401c070 con 0x7f89f8004030 2024-05-27T06:28:36.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.673+0000 7f8a0aa00640 1 -- 172.21.15.87:0/1589157047 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a040155e0 con 0x7f89f8004030 2024-05-27T06:28:36.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.673+0000 7f8a0aa00640 1 -- 172.21.15.87:0/1589157047 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a04015990 con 0x7f89f8004030 2024-05-27T06:28:36.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.673+0000 7f8a19600640 1 -- 172.21.15.87:0/1589157047 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a141fed10 con 0x7f89f8004030 2024-05-27T06:28:36.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.673+0000 7f8a19600640 1 -- 172.21.15.87:0/1589157047 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a141ff2d0 con 0x7f89f8004030 2024-05-27T06:28:36.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.673+0000 7f8a19600640 1 -- 172.21.15.87:0/1589157047 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a1406aa30 con 0x7f89f8004030 2024-05-27T06:28:36.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.677+0000 7f8a0aa00640 1 -- 172.21.15.87:0/1589157047 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8a04015b30 con 0x7f89f8004030 2024-05-27T06:28:36.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.677+0000 7f8a0aa00640 1 --2- 172.21.15.87:0/1589157047 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f89f406f400 0x7f89f4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:36.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.677+0000 7f8a0aa00640 1 -- 172.21.15.87:0/1589157047 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f8a04091cb0 con 0x7f89f8004030 2024-05-27T06:28:36.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.677+0000 7f8a12000640 1 --2- 172.21.15.87:0/1589157047 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f89f406f400 0x7f89f4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:36.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.677+0000 7f8a12000640 1 --2- 172.21.15.87:0/1589157047 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f89f406f400 0x7f89f4071910 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8a000af000 tx=0x7f8a000046d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:36.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.681+0000 7f8a0aa00640 1 -- 172.21.15.87:0/1589157047 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f8a14163590 con 0x7f89f8004030 2024-05-27T06:28:36.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.889+0000 7f8a19600640 1 -- 172.21.15.87:0/1589157047 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f8a1415b1d0 con 0x7f89f8004030 2024-05-27T06:28:36.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.893+0000 7f8a0aa00640 1 -- 172.21.15.87:0/1589157047 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f8a14073c70 con 0x7f89f8004030 2024-05-27T06:28:36.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.897+0000 7f8a19600640 1 -- 172.21.15.87:0/1589157047 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f89f406f400 msgr2=0x7f89f4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:36.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.897+0000 7f8a19600640 1 --2- 172.21.15.87:0/1589157047 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f89f406f400 0x7f89f4071910 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8a000af000 tx=0x7f8a000046d0 comp rx=0 tx=0).stop 2024-05-27T06:28:36.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.897+0000 7f8a19600640 1 -- 172.21.15.87:0/1589157047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89f8004030 msgr2=0x7f8a1414e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:36.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.897+0000 7f8a19600640 1 --2- 172.21.15.87:0/1589157047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89f8004030 0x7f8a1414e8c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8a040057a0 tx=0x7f8a04012630 comp rx=0 tx=0).stop 2024-05-27T06:28:36.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.897+0000 7f8a19600640 1 -- 172.21.15.87:0/1589157047 shutdown_connections 2024-05-27T06:28:36.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.897+0000 7f8a19600640 1 --2- 172.21.15.87:0/1589157047 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f89f406f400 0x7f89f4071910 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:36.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.897+0000 7f8a19600640 1 --2- 172.21.15.87:0/1589157047 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a14162c40 0x7f8a14163050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:36.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.897+0000 7f8a19600640 1 --2- 172.21.15.87:0/1589157047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a1415d1d0 0x7f8a1415d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:36.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.897+0000 7f8a19600640 1 --2- 172.21.15.87:0/1589157047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89f8004030 0x7f8a1414e8c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:36.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.897+0000 7f8a19600640 1 -- 172.21.15.87:0/1589157047 >> 172.21.15.87:0/1589157047 conn(0x7f8a140b2fb0 msgr2=0x7f8a14160200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:36.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.897+0000 7f8a19600640 1 -- 172.21.15.87:0/1589157047 shutdown_connections 2024-05-27T06:28:36.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:36.897+0000 7f8a19600640 1 -- 172.21.15.87:0/1589157047 wait complete. 2024-05-27T06:28:36.915 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-27T06:28:37.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.065+0000 7f8576800640 1 Processor -- start 2024-05-27T06:28:37.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.065+0000 7f8576800640 1 -- start start 2024-05-27T06:28:37.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.065+0000 7f8576800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8570074330 0x7f8570074740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:37.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.065+0000 7f8576800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f857006ebd0 0x7f857006efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:37.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.065+0000 7f8576800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8570074c80 con 0x7f857015cbc0 2024-05-27T06:28:37.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.065+0000 7f8576800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f857015cfd0 con 0x7f857006ebd0 2024-05-27T06:28:37.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.065+0000 7f8576800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f857006c9b0 con 0x7f8570074330 2024-05-27T06:28:37.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.065+0000 7f856fe00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f857006ebd0 0x7f857006efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:37.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.065+0000 7f856fe00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f857006ebd0 0x7f857006efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33962/0 (socket says 172.21.15.87:33962) 2024-05-27T06:28:37.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.065+0000 7f856fe00640 1 -- 172.21.15.87:0/282697871 learned_addr learned my addr 172.21.15.87:0/282697871 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:37.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.065+0000 7f8566a00640 1 --2- 172.21.15.87:0/282697871 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8570074330 0x7f8570074740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:37.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.065+0000 7f856fe00640 1 -- 172.21.15.87:0/282697871 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8570074330 msgr2=0x7f8570074740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:37.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.065+0000 7f856fe00640 1 --2- 172.21.15.87:0/282697871 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8570074330 0x7f8570074740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:37.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.065+0000 7f856fe00640 1 -- 172.21.15.87:0/282697871 >> v1:172.21.15.149:6789/0 conn(0x7f857015cbc0 legacy=0x7f85700af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:37.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.069+0000 7f856fe00640 1 -- 172.21.15.87:0/282697871 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85700afd40 con 0x7f857006ebd0 2024-05-27T06:28:37.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.069+0000 7f856fe00640 1 --2- 172.21.15.87:0/282697871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f857006ebd0 0x7f857006efe0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8568009870 tx=0x7f856801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90741c85ac2aeece server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:37.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.069+0000 7f856ea00640 1 -- 172.21.15.87:0/282697871 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85680b1070 con 0x7f857006ebd0 2024-05-27T06:28:37.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.069+0000 7f856ea00640 1 -- 172.21.15.87:0/282697871 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85680ac620 con 0x7f857006ebd0 2024-05-27T06:28:37.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.069+0000 7f856ea00640 1 -- 172.21.15.87:0/282697871 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85680ac9f0 con 0x7f857006ebd0 2024-05-27T06:28:37.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.069+0000 7f8576800640 1 -- 172.21.15.87:0/282697871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f857006ebd0 msgr2=0x7f857006efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:37.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.069+0000 7f8576800640 1 --2- 172.21.15.87:0/282697871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f857006ebd0 0x7f857006efe0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8568009870 tx=0x7f856801c4d0 comp rx=0 tx=0).stop 2024-05-27T06:28:37.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.069+0000 7f8576800640 1 -- 172.21.15.87:0/282697871 shutdown_connections 2024-05-27T06:28:37.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.073+0000 7f8576800640 1 --2- 172.21.15.87:0/282697871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f857006ebd0 0x7f857006efe0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:37.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.073+0000 7f8576800640 1 --2- 172.21.15.87:0/282697871 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8570074330 0x7f8570074740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:37.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.073+0000 7f8576800640 1 -- 172.21.15.87:0/282697871 >> 172.21.15.87:0/282697871 conn(0x7f85700b2fb0 msgr2=0x7f85700b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:37.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.073+0000 7f8576800640 1 -- 172.21.15.87:0/282697871 shutdown_connections 2024-05-27T06:28:37.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.073+0000 7f8576800640 1 -- 172.21.15.87:0/282697871 wait complete. 2024-05-27T06:28:37.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.073+0000 7f8576800640 1 Processor -- start 2024-05-27T06:28:37.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.073+0000 7f8576800640 1 -- start start 2024-05-27T06:28:37.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.073+0000 7f8576800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f857006ebd0 0x7f85700d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:37.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.073+0000 7f8576800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8570074330 0x7f85701534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:37.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.073+0000 7f8576800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f857015cbc0 0x7f857014f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:37.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.073+0000 7f8576800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8570169c00 con 0x7f857006ebd0 2024-05-27T06:28:37.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.073+0000 7f8576800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8570169a80 con 0x7f8570074330 2024-05-27T06:28:37.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.073+0000 7f8576800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8570169d80 con 0x7f857015cbc0 2024-05-27T06:28:37.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.077+0000 7f856f400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f857006ebd0 0x7f85700d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:37.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.077+0000 7f856f400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f857006ebd0 0x7f85700d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33976/0 (socket says 172.21.15.87:33976) 2024-05-27T06:28:37.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.077+0000 7f856f400640 1 -- 172.21.15.87:0/263664460 learned_addr learned my addr 172.21.15.87:0/263664460 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:37.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.077+0000 7f8566a00640 1 --2- 172.21.15.87:0/263664460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8570074330 0x7f85701534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:37.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.077+0000 7f856fe00640 1 --2- 172.21.15.87:0/263664460 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f857015cbc0 0x7f857014f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:37.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.077+0000 7f856f400640 1 -- 172.21.15.87:0/263664460 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f857015cbc0 msgr2=0x7f857014f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:37.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.077+0000 7f856f400640 1 --2- 172.21.15.87:0/263664460 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f857015cbc0 0x7f857014f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:37.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.077+0000 7f856f400640 1 -- 172.21.15.87:0/263664460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8570074330 msgr2=0x7f85701534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:37.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.077+0000 7f856f400640 1 --2- 172.21.15.87:0/263664460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8570074330 0x7f85701534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:37.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.077+0000 7f856f400640 1 -- 172.21.15.87:0/263664460 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8570155c80 con 0x7f857006ebd0 2024-05-27T06:28:37.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.077+0000 7f8566a00640 1 --2- 172.21.15.87:0/263664460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8570074330 0x7f85701534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:37.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.077+0000 7f856f400640 1 --2- 172.21.15.87:0/263664460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f857006ebd0 0x7f85700d14d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f856000c740 tx=0x7f856000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:37.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.077+0000 7f8567e00640 1 -- 172.21.15.87:0/263664460 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560003b80 con 0x7f857006ebd0 2024-05-27T06:28:37.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.077+0000 7f8567e00640 1 -- 172.21.15.87:0/263664460 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f856000ce50 con 0x7f857006ebd0 2024-05-27T06:28:37.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.077+0000 7f8576800640 1 -- 172.21.15.87:0/263664460 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8570155f60 con 0x7f857006ebd0 2024-05-27T06:28:37.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.077+0000 7f8567e00640 1 -- 172.21.15.87:0/263664460 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856000a850 con 0x7f857006ebd0 2024-05-27T06:28:37.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.077+0000 7f8576800640 1 -- 172.21.15.87:0/263664460 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85700cdf80 con 0x7f857006ebd0 2024-05-27T06:28:37.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.077+0000 7f8576800640 1 -- 172.21.15.87:0/263664460 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f857006aa30 con 0x7f857006ebd0 2024-05-27T06:28:37.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.077+0000 7f8567e00640 1 -- 172.21.15.87:0/263664460 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f856000a9f0 con 0x7f857006ebd0 2024-05-27T06:28:37.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.081+0000 7f8567e00640 1 --2- 172.21.15.87:0/263664460 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f854c06f400 0x7f854c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:37.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.081+0000 7f8567e00640 1 -- 172.21.15.87:0/263664460 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f856008eff0 con 0x7f857006ebd0 2024-05-27T06:28:37.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.081+0000 7f8566a00640 1 --2- 172.21.15.87:0/263664460 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f854c06f400 0x7f854c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:37.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.081+0000 7f8566a00640 1 --2- 172.21.15.87:0/263664460 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f854c06f400 0x7f854c071910 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8570069290 tx=0x7f8558008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:37.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.085+0000 7f8567e00640 1 -- 172.21.15.87:0/263664460 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f8570074c80 con 0x7f857006ebd0 2024-05-27T06:28:37.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.297+0000 7f8576800640 1 -- 172.21.15.87:0/263664460 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f8570073aa0 con 0x7f857006ebd0 2024-05-27T06:28:37.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.301+0000 7f8567e00640 1 -- 172.21.15.87:0/263664460 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f856005c0a0 con 0x7f857006ebd0 2024-05-27T06:28:37.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.301+0000 7f8576800640 1 -- 172.21.15.87:0/263664460 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f854c06f400 msgr2=0x7f854c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:37.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.301+0000 7f8576800640 1 --2- 172.21.15.87:0/263664460 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f854c06f400 0x7f854c071910 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8570069290 tx=0x7f8558008040 comp rx=0 tx=0).stop 2024-05-27T06:28:37.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.301+0000 7f8576800640 1 -- 172.21.15.87:0/263664460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f857006ebd0 msgr2=0x7f85700d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:37.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.301+0000 7f8576800640 1 --2- 172.21.15.87:0/263664460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f857006ebd0 0x7f85700d14d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f856000c740 tx=0x7f856000cc00 comp rx=0 tx=0).stop 2024-05-27T06:28:37.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.301+0000 7f8576800640 1 -- 172.21.15.87:0/263664460 shutdown_connections 2024-05-27T06:28:37.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.301+0000 7f8576800640 1 --2- 172.21.15.87:0/263664460 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f854c06f400 0x7f854c071910 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:37.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.301+0000 7f8576800640 1 --2- 172.21.15.87:0/263664460 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f857015cbc0 0x7f857014f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:37.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.301+0000 7f8576800640 1 --2- 172.21.15.87:0/263664460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8570074330 0x7f85701534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:37.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.301+0000 7f8576800640 1 --2- 172.21.15.87:0/263664460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f857006ebd0 0x7f85700d14d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:37.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.301+0000 7f8576800640 1 -- 172.21.15.87:0/263664460 >> 172.21.15.87:0/263664460 conn(0x7f85700b2fb0 msgr2=0x7f85700686b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:37.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.301+0000 7f8576800640 1 -- 172.21.15.87:0/263664460 shutdown_connections 2024-05-27T06:28:37.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.301+0000 7f8576800640 1 -- 172.21.15.87:0/263664460 wait complete. 2024-05-27T06:28:37.322 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-27T06:28:37.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.469+0000 7f95d1000640 1 Processor -- start 2024-05-27T06:28:37.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.469+0000 7f95d1000640 1 -- start start 2024-05-27T06:28:37.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.473+0000 7f95d1000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95cc0cddb0 0x7f95cc0b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:37.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.473+0000 7f95d1000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95cc071d60 con 0x7f95cc0b0a20 2024-05-27T06:28:37.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.473+0000 7f95d1000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95cc0b0e30 con 0x7f95cc0ce1c0 2024-05-27T06:28:37.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.473+0000 7f95d1000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f95cc141080 con 0x7f95cc0cddb0 2024-05-27T06:28:37.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.473+0000 7f95ca800640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f95cc0b0a20 0x7f95cc161f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:47636/0 (socket says 172.21.15.87:47636) 2024-05-27T06:28:37.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.473+0000 7f95ca800640 1 -- 172.21.15.87:0/2620710585 learned_addr learned my addr 172.21.15.87:0/2620710585 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:37.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.473+0000 7f95c9e00640 1 --2- 172.21.15.87:0/2620710585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95cc0cddb0 0x7f95cc0b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:37.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.473+0000 7f95c9400640 1 -- 172.21.15.87:0/2620710585 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1651457179 0 0) 0x7f95cc071d60 con 0x7f95cc0b0a20 2024-05-27T06:28:37.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.473+0000 7f95c9400640 1 -- 172.21.15.87:0/2620710585 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95b0003530 con 0x7f95cc0b0a20 2024-05-27T06:28:37.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.473+0000 7f95c9400640 1 -- 172.21.15.87:0/2620710585 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 400703832 0 0) 0x7f95b4001120 con 0x7f95cc0ce1c0 2024-05-27T06:28:37.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.473+0000 7f95c9400640 1 -- 172.21.15.87:0/2620710585 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95cc071d60 con 0x7f95cc0ce1c0 2024-05-27T06:28:37.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.473+0000 7f95c9e00640 1 -- 172.21.15.87:0/2620710585 >> v1:172.21.15.149:6789/0 conn(0x7f95cc0ce1c0 legacy=0x7f95cc161860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:37.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.473+0000 7f95c9e00640 1 -- 172.21.15.87:0/2620710585 >> v1:172.21.15.87:6789/0 conn(0x7f95cc0b0a20 legacy=0x7f95cc161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:37.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.473+0000 7f95c9e00640 1 -- 172.21.15.87:0/2620710585 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95cc162680 con 0x7f95cc0cddb0 2024-05-27T06:28:37.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.477+0000 7f95c9e00640 1 --2- 172.21.15.87:0/2620710585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95cc0cddb0 0x7f95cc0b04e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0097f0 tx=0x7f95bc01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ae08564892a4ff4 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:37.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.477+0000 7f95c9400640 1 -- 172.21.15.87:0/2620710585 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc0b0070 con 0x7f95cc0cddb0 2024-05-27T06:28:37.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.477+0000 7f95c9400640 1 -- 172.21.15.87:0/2620710585 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95bc0ab600 con 0x7f95cc0cddb0 2024-05-27T06:28:37.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.477+0000 7f95c9400640 1 -- 172.21.15.87:0/2620710585 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc0ab9d0 con 0x7f95cc0cddb0 2024-05-27T06:28:37.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.477+0000 7f95d1000640 1 -- 172.21.15.87:0/2620710585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95cc0cddb0 msgr2=0x7f95cc0b04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:37.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.477+0000 7f95d1000640 1 --2- 172.21.15.87:0/2620710585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95cc0cddb0 0x7f95cc0b04e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0097f0 tx=0x7f95bc01c4e0 comp rx=0 tx=0).stop 2024-05-27T06:28:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.477+0000 7f95d1000640 1 -- 172.21.15.87:0/2620710585 shutdown_connections 2024-05-27T06:28:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.477+0000 7f95d1000640 1 --2- 172.21.15.87:0/2620710585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95cc0cddb0 0x7f95cc0b04e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.477+0000 7f95d1000640 1 -- 172.21.15.87:0/2620710585 >> 172.21.15.87:0/2620710585 conn(0x7f95cc0ce610 msgr2=0x7f95cc0cea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.477+0000 7f95d1000640 1 -- 172.21.15.87:0/2620710585 shutdown_connections 2024-05-27T06:28:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.477+0000 7f95d1000640 1 -- 172.21.15.87:0/2620710585 wait complete. 2024-05-27T06:28:37.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.481+0000 7f95d1000640 1 Processor -- start 2024-05-27T06:28:37.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.481+0000 7f95d1000640 1 -- start start 2024-05-27T06:28:37.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.481+0000 7f95d1000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95cc0b0a20 0x7f95cc13d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:37.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.481+0000 7f95d1000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95cc0cddb0 0x7f95cc0b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:37.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.481+0000 7f95d1000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95cc0ce1c0 0x7f95cc0b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:37.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.481+0000 7f95d1000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f95cc15f0c0 con 0x7f95cc0ce1c0 2024-05-27T06:28:37.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.481+0000 7f95d1000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f95cc06e6d0 con 0x7f95cc0cddb0 2024-05-27T06:28:37.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.481+0000 7f95d1000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f95cc15f240 con 0x7f95cc0b0a20 2024-05-27T06:28:37.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.481+0000 7f95ca800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95cc0ce1c0 0x7f95cc0b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:37.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.481+0000 7f95ca800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95cc0ce1c0 0x7f95cc0b6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33982/0 (socket says 172.21.15.87:33982) 2024-05-27T06:28:37.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.481+0000 7f95ca800640 1 -- 172.21.15.87:0/3585485428 learned_addr learned my addr 172.21.15.87:0/3585485428 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:37.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.481+0000 7f95ca800640 1 -- 172.21.15.87:0/3585485428 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95cc0b0a20 msgr2=0x7f95cc13d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:37.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.481+0000 7f95c9e00640 1 --2- 172.21.15.87:0/3585485428 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95cc0b0a20 0x7f95cc13d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:37.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.481+0000 7f95c1400640 1 --2- 172.21.15.87:0/3585485428 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95cc0cddb0 0x7f95cc0b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:37.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.481+0000 7f95ca800640 1 --2- 172.21.15.87:0/3585485428 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95cc0b0a20 0x7f95cc13d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:37.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.481+0000 7f95ca800640 1 -- 172.21.15.87:0/3585485428 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95cc0cddb0 msgr2=0x7f95cc0b5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:37.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.481+0000 7f95ca800640 1 --2- 172.21.15.87:0/3585485428 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95cc0cddb0 0x7f95cc0b5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:37.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.481+0000 7f95ca800640 1 -- 172.21.15.87:0/3585485428 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95cc160680 con 0x7f95cc0ce1c0 2024-05-27T06:28:37.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.481+0000 7f95c9e00640 1 --2- 172.21.15.87:0/3585485428 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95cc0b0a20 0x7f95cc13d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:37.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.481+0000 7f95c1400640 1 --2- 172.21.15.87:0/3585485428 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95cc0cddb0 0x7f95cc0b5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:37.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.481+0000 7f95ca800640 1 --2- 172.21.15.87:0/3585485428 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95cc0ce1c0 0x7f95cc0b6290 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f95c400cad0 tx=0x7f95c400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:37.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.481+0000 7f95c2a00640 1 -- 172.21.15.87:0/3585485428 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c400ac30 con 0x7f95cc0ce1c0 2024-05-27T06:28:37.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.481+0000 7f95c2a00640 1 -- 172.21.15.87:0/3585485428 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95c400add0 con 0x7f95cc0ce1c0 2024-05-27T06:28:37.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.481+0000 7f95d1000640 1 -- 172.21.15.87:0/3585485428 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95cc160960 con 0x7f95cc0ce1c0 2024-05-27T06:28:37.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.481+0000 7f95c2a00640 1 -- 172.21.15.87:0/3585485428 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c4012600 con 0x7f95cc0ce1c0 2024-05-27T06:28:37.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.485+0000 7f95d1000640 1 -- 172.21.15.87:0/3585485428 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95cc160f20 con 0x7f95cc0ce1c0 2024-05-27T06:28:37.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.485+0000 7f95d1000640 1 -- 172.21.15.87:0/3585485428 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95cc169400 con 0x7f95cc0ce1c0 2024-05-27T06:28:37.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.485+0000 7f95c2a00640 1 -- 172.21.15.87:0/3585485428 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f95c40127a0 con 0x7f95cc0ce1c0 2024-05-27T06:28:37.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.485+0000 7f95c2a00640 1 --2- 172.21.15.87:0/3585485428 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f95a806f400 0x7f95a8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:37.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.485+0000 7f95c2a00640 1 -- 172.21.15.87:0/3585485428 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f95c408f730 con 0x7f95cc0ce1c0 2024-05-27T06:28:37.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.485+0000 7f95c9e00640 1 --2- 172.21.15.87:0/3585485428 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f95a806f400 0x7f95a8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:37.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.489+0000 7f95c9e00640 1 --2- 172.21.15.87:0/3585485428 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f95a806f400 0x7f95a8071910 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0ad000 tx=0x7f95bc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:37.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.489+0000 7f95c2a00640 1 -- 172.21.15.87:0/3585485428 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f95c405c7e0 con 0x7f95cc0ce1c0 2024-05-27T06:28:37.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.705+0000 7f95d1000640 1 -- 172.21.15.87:0/3585485428 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f95cc06aa30 con 0x7f95cc0ce1c0 2024-05-27T06:28:37.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.709+0000 7f95c2a00640 1 -- 172.21.15.87:0/3585485428 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f95c405c0e0 con 0x7f95cc0ce1c0 2024-05-27T06:28:37.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.709+0000 7f95d1000640 1 -- 172.21.15.87:0/3585485428 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f95a806f400 msgr2=0x7f95a8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:37.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.709+0000 7f95d1000640 1 --2- 172.21.15.87:0/3585485428 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f95a806f400 0x7f95a8071910 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0ad000 tx=0x7f95bc008040 comp rx=0 tx=0).stop 2024-05-27T06:28:37.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.709+0000 7f95d1000640 1 -- 172.21.15.87:0/3585485428 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95cc0ce1c0 msgr2=0x7f95cc0b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:37.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.709+0000 7f95d1000640 1 --2- 172.21.15.87:0/3585485428 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95cc0ce1c0 0x7f95cc0b6290 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f95c400cad0 tx=0x7f95c400cf90 comp rx=0 tx=0).stop 2024-05-27T06:28:37.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.709+0000 7f95d1000640 1 -- 172.21.15.87:0/3585485428 shutdown_connections 2024-05-27T06:28:37.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.709+0000 7f95d1000640 1 --2- 172.21.15.87:0/3585485428 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f95a806f400 0x7f95a8071910 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:37.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.709+0000 7f95d1000640 1 --2- 172.21.15.87:0/3585485428 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95cc0ce1c0 0x7f95cc0b6290 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:37.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.709+0000 7f95d1000640 1 --2- 172.21.15.87:0/3585485428 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95cc0cddb0 0x7f95cc0b5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:37.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.709+0000 7f95d1000640 1 --2- 172.21.15.87:0/3585485428 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95cc0b0a20 0x7f95cc13d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:37.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.709+0000 7f95d1000640 1 -- 172.21.15.87:0/3585485428 >> 172.21.15.87:0/3585485428 conn(0x7f95cc0ce610 msgr2=0x7f95cc13aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:37.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.709+0000 7f95d1000640 1 -- 172.21.15.87:0/3585485428 shutdown_connections 2024-05-27T06:28:37.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.709+0000 7f95d1000640 1 -- 172.21.15.87:0/3585485428 wait complete. 2024-05-27T06:28:37.729 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-27T06:28:37.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.877+0000 7f4e0ce00640 1 Processor -- start 2024-05-27T06:28:37.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.877+0000 7f4e0ce00640 1 -- start start 2024-05-27T06:28:37.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.881+0000 7f4e0ce00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e08160370 0x7f4e08160780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:37.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.881+0000 7f4e0ce00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4e0806fcf0 0x7f4e08070100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:37.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.881+0000 7f4e0ce00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e08070640 con 0x7f4e08073f30 2024-05-27T06:28:37.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.881+0000 7f4e0ce00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f4e0815d720 con 0x7f4e0806fcf0 2024-05-27T06:28:37.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.881+0000 7f4e0ce00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4e0815fee0 con 0x7f4e08160370 2024-05-27T06:28:37.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.881+0000 7f4e05e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f4e08073f30 0x7f4e08072a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:47648/0 (socket says 172.21.15.87:47648) 2024-05-27T06:28:37.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.881+0000 7f4e05e00640 1 -- 172.21.15.87:0/3720563887 learned_addr learned my addr 172.21.15.87:0/3720563887 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:37.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.881+0000 7f4e06800640 1 --2- 172.21.15.87:0/3720563887 >> v2:172.21.15.87:3300/0 conn(0x7f4e0806fcf0 0x7f4e08070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:37.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.881+0000 7f4dfd400640 1 --2- 172.21.15.87:0/3720563887 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e08160370 0x7f4e08160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:37.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.881+0000 7f4e05400640 1 -- 172.21.15.87:0/3720563887 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1852589299 0 0) 0x7f4df8001120 con 0x7f4e08073f30 2024-05-27T06:28:37.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.881+0000 7f4e05400640 1 -- 172.21.15.87:0/3720563887 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4dec003530 con 0x7f4e08073f30 2024-05-27T06:28:37.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.881+0000 7f4e06800640 1 -- 172.21.15.87:0/3720563887 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e08160370 msgr2=0x7f4e08160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:37.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.881+0000 7f4e06800640 1 --2- 172.21.15.87:0/3720563887 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e08160370 0x7f4e08160780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:37.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.881+0000 7f4e06800640 1 -- 172.21.15.87:0/3720563887 >> v1:172.21.15.87:6789/0 conn(0x7f4e08073f30 legacy=0x7f4e08072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:37.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.881+0000 7f4e06800640 1 -- 172.21.15.87:0/3720563887 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0815ce80 con 0x7f4e0806fcf0 2024-05-27T06:28:37.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.885+0000 7f4e06800640 1 --2- 172.21.15.87:0/3720563887 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e0806fcf0 0x7f4e08070100 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4e00009d90 tx=0x7f4e0001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4afd271938306bbe server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:37.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.885+0000 7f4e05400640 1 -- 172.21.15.87:0/3720563887 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e000b2070 con 0x7f4e0806fcf0 2024-05-27T06:28:37.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.885+0000 7f4e05400640 1 -- 172.21.15.87:0/3720563887 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e000a5810 con 0x7f4e0806fcf0 2024-05-27T06:28:37.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.885+0000 7f4e05400640 1 -- 172.21.15.87:0/3720563887 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e000a5be0 con 0x7f4e0806fcf0 2024-05-27T06:28:37.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.885+0000 7f4e0ce00640 1 -- 172.21.15.87:0/3720563887 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e0806fcf0 msgr2=0x7f4e08070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:37.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.885+0000 7f4e0ce00640 1 --2- 172.21.15.87:0/3720563887 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e0806fcf0 0x7f4e08070100 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4e00009d90 tx=0x7f4e0001c8e0 comp rx=0 tx=0).stop 2024-05-27T06:28:37.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.885+0000 7f4e0ce00640 1 -- 172.21.15.87:0/3720563887 shutdown_connections 2024-05-27T06:28:37.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.885+0000 7f4e0ce00640 1 --2- 172.21.15.87:0/3720563887 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e0806fcf0 0x7f4e08070100 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:37.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.885+0000 7f4e0ce00640 1 --2- 172.21.15.87:0/3720563887 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e08160370 0x7f4e08160780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:37.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.885+0000 7f4e0ce00640 1 -- 172.21.15.87:0/3720563887 >> 172.21.15.87:0/3720563887 conn(0x7f4e080b2fb0 msgr2=0x7f4e080b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:37.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.885+0000 7f4e0ce00640 1 -- 172.21.15.87:0/3720563887 shutdown_connections 2024-05-27T06:28:37.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.885+0000 7f4e0ce00640 1 -- 172.21.15.87:0/3720563887 wait complete. 2024-05-27T06:28:37.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.885+0000 7f4e0ce00640 1 Processor -- start 2024-05-27T06:28:37.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.889+0000 7f4e0ce00640 1 -- start start 2024-05-27T06:28:37.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.889+0000 7f4e0ce00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e0806fcf0 0x7f4e08150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:37.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.889+0000 7f4e0ce00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e08073f30 0x7f4e08150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:37.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.889+0000 7f4e0ce00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e08160370 0x7f4e080cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:37.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.889+0000 7f4e0ce00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4e08073180 con 0x7f4e08073f30 2024-05-27T06:28:37.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.889+0000 7f4e0ce00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4e08156a40 con 0x7f4e0806fcf0 2024-05-27T06:28:37.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.889+0000 7f4e0ce00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4e08151520 con 0x7f4e08160370 2024-05-27T06:28:37.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.889+0000 7f4dfd400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e08073f30 0x7f4e08150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:37.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.889+0000 7f4dfd400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e08073f30 0x7f4e08150c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34014/0 (socket says 172.21.15.87:34014) 2024-05-27T06:28:37.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.889+0000 7f4dfd400640 1 -- 172.21.15.87:0/2159006371 learned_addr learned my addr 172.21.15.87:0/2159006371 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:37.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.889+0000 7f4e05e00640 1 --2- 172.21.15.87:0/2159006371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e0806fcf0 0x7f4e08150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:37.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.889+0000 7f4e06800640 1 --2- 172.21.15.87:0/2159006371 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e08160370 0x7f4e080cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:37.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.889+0000 7f4dfd400640 1 -- 172.21.15.87:0/2159006371 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e08160370 msgr2=0x7f4e080cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:37.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.889+0000 7f4dfd400640 1 --2- 172.21.15.87:0/2159006371 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e08160370 0x7f4e080cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:37.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.889+0000 7f4dfd400640 1 -- 172.21.15.87:0/2159006371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e0806fcf0 msgr2=0x7f4e08150720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:37.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.889+0000 7f4dfd400640 1 --2- 172.21.15.87:0/2159006371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e0806fcf0 0x7f4e08150720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:37.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.889+0000 7f4dfd400640 1 -- 172.21.15.87:0/2159006371 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e080d2210 con 0x7f4e08073f30 2024-05-27T06:28:37.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.889+0000 7f4dfd400640 1 --2- 172.21.15.87:0/2159006371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e08073f30 0x7f4e08150c60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4df000d620 tx=0x7f4df000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:37.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.889+0000 7f4dfea00640 1 -- 172.21.15.87:0/2159006371 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df000b620 con 0x7f4e08073f30 2024-05-27T06:28:37.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.889+0000 7f4dfea00640 1 -- 172.21.15.87:0/2159006371 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df0019070 con 0x7f4e08073f30 2024-05-27T06:28:37.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.889+0000 7f4dfea00640 1 -- 172.21.15.87:0/2159006371 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df000b9e0 con 0x7f4e08073f30 2024-05-27T06:28:37.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.889+0000 7f4e0ce00640 1 -- 172.21.15.87:0/2159006371 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e08072fb0 con 0x7f4e08073f30 2024-05-27T06:28:37.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.889+0000 7f4e0ce00640 1 -- 172.21.15.87:0/2159006371 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e080ce150 con 0x7f4e08073f30 2024-05-27T06:28:37.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.889+0000 7f4e0ce00640 1 -- 172.21.15.87:0/2159006371 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e080ce350 con 0x7f4e08073f30 2024-05-27T06:28:37.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.893+0000 7f4dfea00640 1 -- 172.21.15.87:0/2159006371 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4df000bb80 con 0x7f4e08073f30 2024-05-27T06:28:37.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.893+0000 7f4dfea00640 1 --2- 172.21.15.87:0/2159006371 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f4de406f430 0x7f4de4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:37.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.893+0000 7f4dfea00640 1 -- 172.21.15.87:0/2159006371 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f4df008f540 con 0x7f4e08073f30 2024-05-27T06:28:37.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.893+0000 7f4e05e00640 1 --2- 172.21.15.87:0/2159006371 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f4de406f430 0x7f4de4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:37.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.893+0000 7f4e05e00640 1 --2- 172.21.15.87:0/2159006371 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f4de406f430 0x7f4de4071940 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4df8007fd0 tx=0x7f4df8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:37.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:37.897+0000 7f4dfea00640 1 -- 172.21.15.87:0/2159006371 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f4df005c5e0 con 0x7f4e08073f30 2024-05-27T06:28:38.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.109+0000 7f4e0ce00640 1 -- 172.21.15.87:0/2159006371 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f4e080d05e0 con 0x7f4e08073f30 2024-05-27T06:28:38.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.113+0000 7f4dfea00640 1 -- 172.21.15.87:0/2159006371 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7f4df005bee0 con 0x7f4e08073f30 2024-05-27T06:28:38.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.117+0000 7f4e0ce00640 1 -- 172.21.15.87:0/2159006371 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f4de406f430 msgr2=0x7f4de4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:38.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.117+0000 7f4e0ce00640 1 --2- 172.21.15.87:0/2159006371 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f4de406f430 0x7f4de4071940 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4df8007fd0 tx=0x7f4df8009040 comp rx=0 tx=0).stop 2024-05-27T06:28:38.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.117+0000 7f4e0ce00640 1 -- 172.21.15.87:0/2159006371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e08073f30 msgr2=0x7f4e08150c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:38.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.117+0000 7f4e0ce00640 1 --2- 172.21.15.87:0/2159006371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e08073f30 0x7f4e08150c60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4df000d620 tx=0x7f4df000dae0 comp rx=0 tx=0).stop 2024-05-27T06:28:38.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.117+0000 7f4e0ce00640 1 -- 172.21.15.87:0/2159006371 shutdown_connections 2024-05-27T06:28:38.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.117+0000 7f4e0ce00640 1 --2- 172.21.15.87:0/2159006371 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f4de406f430 0x7f4de4071940 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:38.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.117+0000 7f4e0ce00640 1 --2- 172.21.15.87:0/2159006371 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e08160370 0x7f4e080cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:38.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.117+0000 7f4e0ce00640 1 --2- 172.21.15.87:0/2159006371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e08073f30 0x7f4e08150c60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:38.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.117+0000 7f4e0ce00640 1 --2- 172.21.15.87:0/2159006371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e0806fcf0 0x7f4e08150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:38.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.117+0000 7f4e0ce00640 1 -- 172.21.15.87:0/2159006371 >> 172.21.15.87:0/2159006371 conn(0x7f4e080b2fb0 msgr2=0x7f4e080d1360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:38.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.117+0000 7f4e0ce00640 1 -- 172.21.15.87:0/2159006371 shutdown_connections 2024-05-27T06:28:38.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.117+0000 7f4e0ce00640 1 -- 172.21.15.87:0/2159006371 wait complete. 2024-05-27T06:28:38.135 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-27T06:28:38.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.281+0000 7ff156a00640 1 Processor -- start 2024-05-27T06:28:38.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.285+0000 7ff156a00640 1 -- start start 2024-05-27T06:28:38.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.285+0000 7ff156a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1500aec30 0x7ff1500702b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:38.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.285+0000 7ff156a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff15006c720 0x7ff15006cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:38.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.285+0000 7ff156a00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff15006fe20 con 0x7ff15006efc0 2024-05-27T06:28:38.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.285+0000 7ff156a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7ff1500b0ba0 con 0x7ff15006c720 2024-05-27T06:28:38.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.285+0000 7ff156a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff15015ef50 con 0x7ff1500aec30 2024-05-27T06:28:38.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.285+0000 7ff147400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff15006efc0 0x7ff15006f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:47660/0 (socket says 172.21.15.87:47660) 2024-05-27T06:28:38.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.285+0000 7ff147400640 1 -- 172.21.15.87:0/3354606017 learned_addr learned my addr 172.21.15.87:0/3354606017 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:38.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.285+0000 7ff14fe00640 1 --2- 172.21.15.87:0/3354606017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1500aec30 0x7ff1500702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:38.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.285+0000 7ff154a00640 1 --2- 172.21.15.87:0/3354606017 >> v2:172.21.15.149:3300/0 conn(0x7ff15006c720 0x7ff15006cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:38.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.285+0000 7ff14f400640 1 -- 172.21.15.87:0/3354606017 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2688716536 0 0) 0x7ff15006fe20 con 0x7ff15006efc0 2024-05-27T06:28:38.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.285+0000 7ff14f400640 1 -- 172.21.15.87:0/3354606017 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff134003530 con 0x7ff15006efc0 2024-05-27T06:28:38.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.285+0000 7ff14fe00640 1 -- 172.21.15.87:0/3354606017 >> v2:172.21.15.149:3300/0 conn(0x7ff15006c720 msgr2=0x7ff15006cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:38.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.285+0000 7ff14fe00640 1 --2- 172.21.15.87:0/3354606017 >> v2:172.21.15.149:3300/0 conn(0x7ff15006c720 0x7ff15006cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:38.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.285+0000 7ff14fe00640 1 -- 172.21.15.87:0/3354606017 >> v1:172.21.15.87:6789/0 conn(0x7ff15006efc0 legacy=0x7ff15006f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:38.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.285+0000 7ff14fe00640 1 -- 172.21.15.87:0/3354606017 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1500b08c0 con 0x7ff1500aec30 2024-05-27T06:28:38.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.289+0000 7ff14fe00640 1 --2- 172.21.15.87:0/3354606017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1500aec30 0x7ff1500702b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff1400097c0 tx=0x7ff14001c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7191b01c613d3a7a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:38.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.289+0000 7ff14f400640 1 -- 172.21.15.87:0/3354606017 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1400b0070 con 0x7ff1500aec30 2024-05-27T06:28:38.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.289+0000 7ff14f400640 1 -- 172.21.15.87:0/3354606017 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1400ab600 con 0x7ff1500aec30 2024-05-27T06:28:38.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.289+0000 7ff14f400640 1 -- 172.21.15.87:0/3354606017 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1400ab9d0 con 0x7ff1500aec30 2024-05-27T06:28:38.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.289+0000 7ff156a00640 1 -- 172.21.15.87:0/3354606017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1500aec30 msgr2=0x7ff1500702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:38.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.289+0000 7ff156a00640 1 --2- 172.21.15.87:0/3354606017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1500aec30 0x7ff1500702b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff1400097c0 tx=0x7ff14001c380 comp rx=0 tx=0).stop 2024-05-27T06:28:38.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.289+0000 7ff156a00640 1 -- 172.21.15.87:0/3354606017 shutdown_connections 2024-05-27T06:28:38.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.289+0000 7ff156a00640 1 --2- 172.21.15.87:0/3354606017 >> v2:172.21.15.149:3300/0 conn(0x7ff15006c720 0x7ff15006cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:38.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.289+0000 7ff156a00640 1 --2- 172.21.15.87:0/3354606017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1500aec30 0x7ff1500702b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:38.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.289+0000 7ff156a00640 1 -- 172.21.15.87:0/3354606017 >> 172.21.15.87:0/3354606017 conn(0x7ff1500b2fb0 msgr2=0x7ff1500b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:38.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.289+0000 7ff156a00640 1 -- 172.21.15.87:0/3354606017 shutdown_connections 2024-05-27T06:28:38.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.289+0000 7ff156a00640 1 -- 172.21.15.87:0/3354606017 wait complete. 2024-05-27T06:28:38.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.293+0000 7ff156a00640 1 Processor -- start 2024-05-27T06:28:38.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.293+0000 7ff156a00640 1 -- start start 2024-05-27T06:28:38.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.293+0000 7ff156a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff15006c720 0x7ff150149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:38.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.293+0000 7ff156a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff15006efc0 0x7ff15014ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:38.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.293+0000 7ff156a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1500aec30 0x7ff15014cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:38.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.293+0000 7ff156a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff15006e0c0 con 0x7ff15006c720 2024-05-27T06:28:38.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.293+0000 7ff156a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff15006df40 con 0x7ff15006efc0 2024-05-27T06:28:38.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.293+0000 7ff156a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff15006d070 con 0x7ff1500aec30 2024-05-27T06:28:38.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.293+0000 7ff14fe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff15006c720 0x7ff150149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:38.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.293+0000 7ff14fe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff15006c720 0x7ff150149730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34024/0 (socket says 172.21.15.87:34024) 2024-05-27T06:28:38.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.293+0000 7ff14fe00640 1 -- 172.21.15.87:0/2052259934 learned_addr learned my addr 172.21.15.87:0/2052259934 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:38.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.293+0000 7ff154a00640 1 --2- 172.21.15.87:0/2052259934 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1500aec30 0x7ff15014cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:38.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.293+0000 7ff147400640 1 --2- 172.21.15.87:0/2052259934 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff15006efc0 0x7ff15014ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:38.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.293+0000 7ff14fe00640 1 -- 172.21.15.87:0/2052259934 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1500aec30 msgr2=0x7ff15014cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:38.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.293+0000 7ff14fe00640 1 --2- 172.21.15.87:0/2052259934 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1500aec30 0x7ff15014cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:38.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.293+0000 7ff14fe00640 1 -- 172.21.15.87:0/2052259934 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff15006efc0 msgr2=0x7ff15014ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:38.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.293+0000 7ff14fe00640 1 --2- 172.21.15.87:0/2052259934 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff15006efc0 0x7ff15014ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:38.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.293+0000 7ff14fe00640 1 -- 172.21.15.87:0/2052259934 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff150152040 con 0x7ff15006c720 2024-05-27T06:28:38.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.293+0000 7ff154a00640 1 --2- 172.21.15.87:0/2052259934 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1500aec30 0x7ff15014cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:38.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.293+0000 7ff147400640 1 --2- 172.21.15.87:0/2052259934 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff15006efc0 0x7ff15014ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:38.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.293+0000 7ff14fe00640 1 --2- 172.21.15.87:0/2052259934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff15006c720 0x7ff150149730 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff14001aa30 tx=0x7ff140019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:38.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.293+0000 7ff14cc00640 1 -- 172.21.15.87:0/2052259934 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1400ba020 con 0x7ff15006c720 2024-05-27T06:28:38.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.293+0000 7ff14cc00640 1 -- 172.21.15.87:0/2052259934 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1400b5460 con 0x7ff15006c720 2024-05-27T06:28:38.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.293+0000 7ff156a00640 1 -- 172.21.15.87:0/2052259934 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff150152320 con 0x7ff15006c720 2024-05-27T06:28:38.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.293+0000 7ff14cc00640 1 -- 172.21.15.87:0/2052259934 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1400b0040 con 0x7ff15006c720 2024-05-27T06:28:38.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.293+0000 7ff156a00640 1 -- 172.21.15.87:0/2052259934 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1501528e0 con 0x7ff15006c720 2024-05-27T06:28:38.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.297+0000 7ff156a00640 1 -- 172.21.15.87:0/2052259934 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff15006aa30 con 0x7ff15006c720 2024-05-27T06:28:38.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.297+0000 7ff14cc00640 1 -- 172.21.15.87:0/2052259934 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff1400bd020 con 0x7ff15006c720 2024-05-27T06:28:38.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.297+0000 7ff14cc00640 1 --2- 172.21.15.87:0/2052259934 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff12c06f400 0x7ff12c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:38.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.297+0000 7ff14cc00640 1 -- 172.21.15.87:0/2052259934 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7ff140129340 con 0x7ff15006c720 2024-05-27T06:28:38.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.297+0000 7ff147400640 1 --2- 172.21.15.87:0/2052259934 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff12c06f400 0x7ff12c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:38.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.297+0000 7ff147400640 1 --2- 172.21.15.87:0/2052259934 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff12c06f400 0x7ff12c071910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff15014fc70 tx=0x7ff138009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:38.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.301+0000 7ff14cc00640 1 -- 172.21.15.87:0/2052259934 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff1400c4030 con 0x7ff15006c720 2024-05-27T06:28:38.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.513+0000 7ff156a00640 1 -- 172.21.15.87:0/2052259934 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7ff1500b2d50 con 0x7ff15006c720 2024-05-27T06:28:38.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.517+0000 7ff14cc00640 1 -- 172.21.15.87:0/2052259934 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7ff140016090 con 0x7ff15006c720 2024-05-27T06:28:38.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.517+0000 7ff156a00640 1 -- 172.21.15.87:0/2052259934 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff12c06f400 msgr2=0x7ff12c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:38.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.517+0000 7ff156a00640 1 --2- 172.21.15.87:0/2052259934 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff12c06f400 0x7ff12c071910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff15014fc70 tx=0x7ff138009040 comp rx=0 tx=0).stop 2024-05-27T06:28:38.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.517+0000 7ff156a00640 1 -- 172.21.15.87:0/2052259934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff15006c720 msgr2=0x7ff150149730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:38.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.517+0000 7ff156a00640 1 --2- 172.21.15.87:0/2052259934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff15006c720 0x7ff150149730 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff14001aa30 tx=0x7ff140019120 comp rx=0 tx=0).stop 2024-05-27T06:28:38.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.517+0000 7ff156a00640 1 -- 172.21.15.87:0/2052259934 shutdown_connections 2024-05-27T06:28:38.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.517+0000 7ff156a00640 1 --2- 172.21.15.87:0/2052259934 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff12c06f400 0x7ff12c071910 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:38.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.517+0000 7ff156a00640 1 --2- 172.21.15.87:0/2052259934 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1500aec30 0x7ff15014cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:38.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.517+0000 7ff156a00640 1 --2- 172.21.15.87:0/2052259934 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff15006efc0 0x7ff15014ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:38.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.517+0000 7ff156a00640 1 --2- 172.21.15.87:0/2052259934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff15006c720 0x7ff150149730 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:38.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.517+0000 7ff156a00640 1 -- 172.21.15.87:0/2052259934 >> 172.21.15.87:0/2052259934 conn(0x7ff1500b2fb0 msgr2=0x7ff15006f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:38.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.517+0000 7ff156a00640 1 -- 172.21.15.87:0/2052259934 shutdown_connections 2024-05-27T06:28:38.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.517+0000 7ff156a00640 1 -- 172.21.15.87:0/2052259934 wait complete. 2024-05-27T06:28:38.537 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-27T06:28:38.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.689+0000 7fe76fa00640 1 Processor -- start 2024-05-27T06:28:38.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.689+0000 7fe76fa00640 1 -- start start 2024-05-27T06:28:38.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.689+0000 7fe76fa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7680d2010 0x7fe7680d2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:38.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.689+0000 7fe76fa00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe7680b2fb0 0x7fe7680b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:38.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.689+0000 7fe76fa00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7680d2960 con 0x7fe7680cea40 2024-05-27T06:28:38.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.689+0000 7fe76fa00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fe7680ce5b0 con 0x7fe7680b2fb0 2024-05-27T06:28:38.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.689+0000 7fe76fa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe7680b2cd0 con 0x7fe7680d2010 2024-05-27T06:28:38.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.689+0000 7fe76da00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe7680b2fb0 0x7fe7680b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:38.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.689+0000 7fe76da00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe7680b2fb0 0x7fe7680b33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34030/0 (socket says 172.21.15.87:34030) 2024-05-27T06:28:38.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.689+0000 7fe76da00640 1 -- 172.21.15.87:0/3431681665 learned_addr learned my addr 172.21.15.87:0/3431681665 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:38.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.689+0000 7fe76da00640 1 -- 172.21.15.87:0/3431681665 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7680d2010 msgr2=0x7fe7680d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:38.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.689+0000 7fe75fe00640 1 --2- 172.21.15.87:0/3431681665 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7680d2010 0x7fe7680d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:38.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.689+0000 7fe76da00640 1 --2- 172.21.15.87:0/3431681665 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7680d2010 0x7fe7680d2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:38.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.689+0000 7fe76da00640 1 -- 172.21.15.87:0/3431681665 >> v1:172.21.15.149:6789/0 conn(0x7fe7680cea40 legacy=0x7fe768158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:38.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.689+0000 7fe76da00640 1 -- 172.21.15.87:0/3431681665 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7680cdc80 con 0x7fe7680b2fb0 2024-05-27T06:28:38.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.689+0000 7fe75fe00640 1 --2- 172.21.15.87:0/3431681665 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7680d2010 0x7fe7680d2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:38.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.693+0000 7fe76da00640 1 --2- 172.21.15.87:0/3431681665 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7680b2fb0 0x7fe7680b33c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe760009e50 tx=0x7fe76001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91dd9b9490eadca server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:38.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.693+0000 7fe767e00640 1 -- 172.21.15.87:0/3431681665 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7600a58d0 con 0x7fe7680b2fb0 2024-05-27T06:28:38.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.693+0000 7fe767e00640 1 -- 172.21.15.87:0/3431681665 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7600a5a70 con 0x7fe7680b2fb0 2024-05-27T06:28:38.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.693+0000 7fe767e00640 1 -- 172.21.15.87:0/3431681665 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7600a5e40 con 0x7fe7680b2fb0 2024-05-27T06:28:38.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.693+0000 7fe76fa00640 1 -- 172.21.15.87:0/3431681665 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7680b2fb0 msgr2=0x7fe7680b33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:38.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.693+0000 7fe76fa00640 1 --2- 172.21.15.87:0/3431681665 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7680b2fb0 0x7fe7680b33c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe760009e50 tx=0x7fe76001ca00 comp rx=0 tx=0).stop 2024-05-27T06:28:38.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.693+0000 7fe76fa00640 1 -- 172.21.15.87:0/3431681665 shutdown_connections 2024-05-27T06:28:38.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.693+0000 7fe76fa00640 1 --2- 172.21.15.87:0/3431681665 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7680b2fb0 0x7fe7680b33c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:38.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.693+0000 7fe76fa00640 1 --2- 172.21.15.87:0/3431681665 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7680d2010 0x7fe7680d2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:38.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.693+0000 7fe76fa00640 1 -- 172.21.15.87:0/3431681665 >> 172.21.15.87:0/3431681665 conn(0x7fe7680d3590 msgr2=0x7fe7680d39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:38.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.693+0000 7fe76fa00640 1 -- 172.21.15.87:0/3431681665 shutdown_connections 2024-05-27T06:28:38.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.693+0000 7fe76fa00640 1 -- 172.21.15.87:0/3431681665 wait complete. 2024-05-27T06:28:38.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.697+0000 7fe76fa00640 1 Processor -- start 2024-05-27T06:28:38.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.697+0000 7fe76fa00640 1 -- start start 2024-05-27T06:28:38.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.697+0000 7fe76fa00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7680b2fb0 0x7fe768161f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:38.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.697+0000 7fe76fa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7680cea40 0x7fe7680c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:38.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.697+0000 7fe76fa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7680d2010 0x7fe7681520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:38.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.697+0000 7fe76fa00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe7680d2ee0 con 0x7fe7680b2fb0 2024-05-27T06:28:38.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.697+0000 7fe76fa00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe7680d2d60 con 0x7fe7680d2010 2024-05-27T06:28:38.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.697+0000 7fe76fa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe7680cee50 con 0x7fe7680cea40 2024-05-27T06:28:38.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.697+0000 7fe76d000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7680b2fb0 0x7fe768161f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:38.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.697+0000 7fe76d000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7680b2fb0 0x7fe768161f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34044/0 (socket says 172.21.15.87:34044) 2024-05-27T06:28:38.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.697+0000 7fe76d000640 1 -- 172.21.15.87:0/184359796 learned_addr learned my addr 172.21.15.87:0/184359796 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:38.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.697+0000 7fe75fe00640 1 --2- 172.21.15.87:0/184359796 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7680cea40 0x7fe7680c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:38.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.697+0000 7fe76da00640 1 --2- 172.21.15.87:0/184359796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7680d2010 0x7fe7681520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:38.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.697+0000 7fe76d000640 1 -- 172.21.15.87:0/184359796 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7680cea40 msgr2=0x7fe7680c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:38.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.697+0000 7fe76d000640 1 --2- 172.21.15.87:0/184359796 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7680cea40 0x7fe7680c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:38.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.697+0000 7fe76d000640 1 -- 172.21.15.87:0/184359796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7680d2010 msgr2=0x7fe7681520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:38.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.697+0000 7fe76d000640 1 --2- 172.21.15.87:0/184359796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7680d2010 0x7fe7681520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:38.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.697+0000 7fe76d000640 1 -- 172.21.15.87:0/184359796 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe768152920 con 0x7fe7680b2fb0 2024-05-27T06:28:38.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.697+0000 7fe76da00640 1 --2- 172.21.15.87:0/184359796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7680d2010 0x7fe7681520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:38.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.697+0000 7fe75fe00640 1 --2- 172.21.15.87:0/184359796 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7680cea40 0x7fe7680c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:38.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.697+0000 7fe76d000640 1 --2- 172.21.15.87:0/184359796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7680b2fb0 0x7fe768161f80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe75800c3f0 tx=0x7fe75800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:38.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.697+0000 7fe765600640 1 -- 172.21.15.87:0/184359796 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe758017070 con 0x7fe7680b2fb0 2024-05-27T06:28:38.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.701+0000 7fe765600640 1 -- 172.21.15.87:0/184359796 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7580052d0 con 0x7fe7680b2fb0 2024-05-27T06:28:38.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.701+0000 7fe76fa00640 1 -- 172.21.15.87:0/184359796 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe76815ae30 con 0x7fe7680b2fb0 2024-05-27T06:28:38.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.701+0000 7fe765600640 1 -- 172.21.15.87:0/184359796 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe758003840 con 0x7fe7680b2fb0 2024-05-27T06:28:38.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.701+0000 7fe76fa00640 1 -- 172.21.15.87:0/184359796 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7680c4180 con 0x7fe7680b2fb0 2024-05-27T06:28:38.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.701+0000 7fe76fa00640 1 -- 172.21.15.87:0/184359796 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe76806aa30 con 0x7fe7680b2fb0 2024-05-27T06:28:38.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.701+0000 7fe765600640 1 -- 172.21.15.87:0/184359796 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe75801a070 con 0x7fe7680b2fb0 2024-05-27T06:28:38.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.701+0000 7fe765600640 1 --2- 172.21.15.87:0/184359796 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe74406f430 0x7fe744071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:38.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.701+0000 7fe765600640 1 -- 172.21.15.87:0/184359796 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fe75808e4e0 con 0x7fe7680b2fb0 2024-05-27T06:28:38.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.701+0000 7fe75fe00640 1 --2- 172.21.15.87:0/184359796 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe74406f430 0x7fe744071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:38.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.701+0000 7fe75fe00640 1 --2- 172.21.15.87:0/184359796 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe74406f430 0x7fe744071940 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe7680c3b10 tx=0x7fe750008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:38.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.705+0000 7fe765600640 1 -- 172.21.15.87:0/184359796 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe7680d2960 con 0x7fe7680b2fb0 2024-05-27T06:28:38.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.865+0000 7fe76fa00640 1 -- 172.21.15.87:0/184359796 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe768169c20 con 0x7fe7680b2fb0 2024-05-27T06:28:38.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.869+0000 7fe765600640 1 -- 172.21.15.87:0/184359796 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) ==== 84+0+65 (secure 0 0 0) 0x7fe758005480 con 0x7fe7680b2fb0 2024-05-27T06:28:38.866 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:38.866 INFO:teuthology.orchestra.run.smithi087.stdout:[ 2024-05-27T06:28:38.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:28:38.866 INFO:teuthology.orchestra.run.smithi087.stdout: "poolnum": 1, 2024-05-27T06:28:38.866 INFO:teuthology.orchestra.run.smithi087.stdout: "poolname": ".mgr" 2024-05-27T06:28:38.867 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:38.867 INFO:teuthology.orchestra.run.smithi087.stdout:] 2024-05-27T06:28:38.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.869+0000 7fe76fa00640 1 -- 172.21.15.87:0/184359796 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe74406f430 msgr2=0x7fe744071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:38.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.869+0000 7fe76fa00640 1 --2- 172.21.15.87:0/184359796 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe74406f430 0x7fe744071940 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe7680c3b10 tx=0x7fe750008040 comp rx=0 tx=0).stop 2024-05-27T06:28:38.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.869+0000 7fe76fa00640 1 -- 172.21.15.87:0/184359796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7680b2fb0 msgr2=0x7fe768161f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:38.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.869+0000 7fe76fa00640 1 --2- 172.21.15.87:0/184359796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7680b2fb0 0x7fe768161f80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe75800c3f0 tx=0x7fe75800c8b0 comp rx=0 tx=0).stop 2024-05-27T06:28:38.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.869+0000 7fe76fa00640 1 -- 172.21.15.87:0/184359796 shutdown_connections 2024-05-27T06:28:38.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.869+0000 7fe76fa00640 1 --2- 172.21.15.87:0/184359796 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe74406f430 0x7fe744071940 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:38.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.869+0000 7fe76fa00640 1 --2- 172.21.15.87:0/184359796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7680d2010 0x7fe7681520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:38.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.869+0000 7fe76fa00640 1 --2- 172.21.15.87:0/184359796 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7680cea40 0x7fe7680c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:38.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.869+0000 7fe76fa00640 1 --2- 172.21.15.87:0/184359796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7680b2fb0 0x7fe768161f80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:38.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.869+0000 7fe76fa00640 1 -- 172.21.15.87:0/184359796 >> 172.21.15.87:0/184359796 conn(0x7fe7680d3590 msgr2=0x7fe7680b7110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:38.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.869+0000 7fe76fa00640 1 -- 172.21.15.87:0/184359796 shutdown_connections 2024-05-27T06:28:38.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:38.869+0000 7fe76fa00640 1 -- 172.21.15.87:0/184359796 wait complete. 2024-05-27T06:28:38.888 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-27T06:28:38.888 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-27T06:28:39.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61c1800640 1 Processor -- start 2024-05-27T06:28:39.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61c1800640 1 -- start start 2024-05-27T06:28:39.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61c1800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f61bc0d1700 0x7f61bc0d1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:39.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61c1800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61bc06c940 0x7f61bc06cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:39.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61c1800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61bc0d2050 con 0x7f61bc157310 2024-05-27T06:28:39.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61c1800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f61bc0d0140 con 0x7f61bc0d1700 2024-05-27T06:28:39.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61c1800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f61bc0cf530 con 0x7f61bc06c940 2024-05-27T06:28:39.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61baa00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f61bc157310 0x7f61bc15dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:47670/0 (socket says 172.21.15.87:47670) 2024-05-27T06:28:39.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61baa00640 1 -- 172.21.15.87:0/2826358221 learned_addr learned my addr 172.21.15.87:0/2826358221 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:39.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61ba000640 1 -- 172.21.15.87:0/2826358221 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2364243622 0 0) 0x7f61ac001120 con 0x7f61bc157310 2024-05-27T06:28:39.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61bb400640 1 --2- 172.21.15.87:0/2826358221 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61bc06c940 0x7f61bc06cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:39.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61b2000640 1 --2- 172.21.15.87:0/2826358221 >> v2:172.21.15.149:3300/0 conn(0x7f61bc0d1700 0x7f61bc0d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:39.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61ba000640 1 -- 172.21.15.87:0/2826358221 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61a0003530 con 0x7f61bc157310 2024-05-27T06:28:39.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61ba000640 1 -- 172.21.15.87:0/2826358221 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3989159269 0 0) 0x7f61a0003530 con 0x7f61bc157310 2024-05-27T06:28:39.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61ba000640 1 -- 172.21.15.87:0/2826358221 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61bc06c940 msgr2=0x7f61bc06cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:39.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61ba000640 1 --2- 172.21.15.87:0/2826358221 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61bc06c940 0x7f61bc06cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:39.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61ba000640 1 -- 172.21.15.87:0/2826358221 >> v2:172.21.15.149:3300/0 conn(0x7f61bc0d1700 msgr2=0x7f61bc0d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:39.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61ba000640 1 --2- 172.21.15.87:0/2826358221 >> v2:172.21.15.149:3300/0 conn(0x7f61bc0d1700 0x7f61bc0d1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:39.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61ba000640 1 -- 172.21.15.87:0/2826358221 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61bc0cf810 con 0x7f61bc157310 2024-05-27T06:28:39.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61ba000640 1 -- 172.21.15.87:0/2826358221 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7f61ac0018d0 con 0x7f61bc157310 2024-05-27T06:28:39.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61ba000640 1 -- 172.21.15.87:0/2826358221 >> v1:172.21.15.87:6789/0 conn(0x7f61bc157310 legacy=0x7f61bc15dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:39.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61ba000640 1 --2- 172.21.15.87:0/2826358221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61a0003a10 0x7f61a0003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:39.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61ba000640 1 --2- 172.21.15.87:0/2826358221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61a0004810 0x7f61a0004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:39.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61ba000640 1 --2- 172.21.15.87:0/2826358221 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61bc06c940 0x7f61a0005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:39.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61ba000640 1 -- 172.21.15.87:0/2826358221 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc0d0140 con 0x7f61a0003a10 2024-05-27T06:28:39.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61ba000640 1 -- 172.21.15.87:0/2826358221 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc0cf530 con 0x7f61a0004810 2024-05-27T06:28:39.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61ba000640 1 -- 172.21.15.87:0/2826358221 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f61a000ba80 con 0x7f61bc06c940 2024-05-27T06:28:39.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61baa00640 1 --2- 172.21.15.87:0/2826358221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61a0003a10 0x7f61a0003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:39.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61b2000640 1 --2- 172.21.15.87:0/2826358221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61a0004810 0x7f61a0004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:39.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61bb400640 1 --2- 172.21.15.87:0/2826358221 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61bc06c940 0x7f61a0005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:39.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61baa00640 1 -- 172.21.15.87:0/2826358221 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61bc06c940 msgr2=0x7f61a0005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:39.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61baa00640 1 --2- 172.21.15.87:0/2826358221 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61bc06c940 0x7f61a0005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:39.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61baa00640 1 -- 172.21.15.87:0/2826358221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61a0004810 msgr2=0x7f61a0004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:39.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61baa00640 1 --2- 172.21.15.87:0/2826358221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61a0004810 0x7f61a0004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:39.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.041+0000 7f61baa00640 1 -- 172.21.15.87:0/2826358221 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a0003530 con 0x7f61a0003a10 2024-05-27T06:28:39.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.045+0000 7f61baa00640 1 --2- 172.21.15.87:0/2826358221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61a0003a10 0x7f61a0003e80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f61bc071fb0 tx=0x7f61ac01cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60983b15d23ec00a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:39.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.045+0000 7f61ba000640 1 -- 172.21.15.87:0/2826358221 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac00c0e0 con 0x7f61a0003a10 2024-05-27T06:28:39.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.045+0000 7f61ba000640 1 -- 172.21.15.87:0/2826358221 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61ac0ac070 con 0x7f61a0003a10 2024-05-27T06:28:39.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.045+0000 7f61ba000640 1 -- 172.21.15.87:0/2826358221 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac005d20 con 0x7f61a0003a10 2024-05-27T06:28:39.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.045+0000 7f61c1800640 1 -- 172.21.15.87:0/2826358221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61a0003a10 msgr2=0x7f61a0003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:39.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.045+0000 7f61c1800640 1 --2- 172.21.15.87:0/2826358221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61a0003a10 0x7f61a0003e80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f61bc071fb0 tx=0x7f61ac01cbc0 comp rx=0 tx=0).stop 2024-05-27T06:28:39.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.045+0000 7f61bb400640 1 -- 172.21.15.87:0/2826358221 reap_dead start 2024-05-27T06:28:39.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.045+0000 7f61c1800640 1 -- 172.21.15.87:0/2826358221 shutdown_connections 2024-05-27T06:28:39.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.045+0000 7f61c1800640 1 -- 172.21.15.87:0/2826358221 >> 172.21.15.87:0/2826358221 conn(0x7f61bc0b46b0 msgr2=0x7f61bc0b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:39.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.045+0000 7f61c1800640 1 -- 172.21.15.87:0/2826358221 shutdown_connections 2024-05-27T06:28:39.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.045+0000 7f61c1800640 1 -- 172.21.15.87:0/2826358221 wait complete. 2024-05-27T06:28:39.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.049+0000 7f61c1800640 1 Processor -- start 2024-05-27T06:28:39.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.049+0000 7f61c1800640 1 -- start start 2024-05-27T06:28:39.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.049+0000 7f61c1800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61a0003a10 0x7f61bc1f9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:39.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.049+0000 7f61c1800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61bc09a330 0x7f61bc0b0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:39.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.049+0000 7f61c1800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61bc0b05c0 0x7f61bc15f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:39.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.049+0000 7f61c1800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc0707c0 con 0x7f61bc09a330 2024-05-27T06:28:39.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.049+0000 7f61c1800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc070640 con 0x7f61bc0b05c0 2024-05-27T06:28:39.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.049+0000 7f61c1800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f61bc1678a0 con 0x7f61a0003a10 2024-05-27T06:28:39.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.053+0000 7f61b2000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61bc09a330 0x7f61bc0b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:39.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.053+0000 7f61b2000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61bc09a330 0x7f61bc0b0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34064/0 (socket says 172.21.15.87:34064) 2024-05-27T06:28:39.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.053+0000 7f61b2000640 1 -- 172.21.15.87:0/3567470076 learned_addr learned my addr 172.21.15.87:0/3567470076 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:39.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.053+0000 7f61bb400640 1 --2- 172.21.15.87:0/3567470076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61bc0b05c0 0x7f61bc15f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:39.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.053+0000 7f61b2000640 1 -- 172.21.15.87:0/3567470076 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61a0003a10 msgr2=0x7f61bc1f9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:39.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.053+0000 7f61baa00640 1 --2- 172.21.15.87:0/3567470076 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61a0003a10 0x7f61bc1f9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:39.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.053+0000 7f61b2000640 1 --2- 172.21.15.87:0/3567470076 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61a0003a10 0x7f61bc1f9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:39.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.053+0000 7f61b2000640 1 -- 172.21.15.87:0/3567470076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61bc0b05c0 msgr2=0x7f61bc15f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:39.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.053+0000 7f61b2000640 1 --2- 172.21.15.87:0/3567470076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61bc0b05c0 0x7f61bc15f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:39.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.053+0000 7f61b2000640 1 -- 172.21.15.87:0/3567470076 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61bc0b09d0 con 0x7f61bc09a330 2024-05-27T06:28:39.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.053+0000 7f61bb400640 1 --2- 172.21.15.87:0/3567470076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61bc0b05c0 0x7f61bc15f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:39.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.053+0000 7f61baa00640 1 --2- 172.21.15.87:0/3567470076 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61a0003a10 0x7f61bc1f9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:39.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.053+0000 7f61b2000640 1 --2- 172.21.15.87:0/3567470076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61bc09a330 0x7f61bc0b0080 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f61a4011930 tx=0x7f61a4011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:39.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.053+0000 7f61b3400640 1 -- 172.21.15.87:0/3567470076 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a400faf0 con 0x7f61bc09a330 2024-05-27T06:28:39.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.053+0000 7f61b3400640 1 -- 172.21.15.87:0/3567470076 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a400fc90 con 0x7f61bc09a330 2024-05-27T06:28:39.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.053+0000 7f61b3400640 1 -- 172.21.15.87:0/3567470076 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a4014440 con 0x7f61bc09a330 2024-05-27T06:28:39.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.053+0000 7f61c1800640 1 -- 172.21.15.87:0/3567470076 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61bc15e3c0 con 0x7f61bc09a330 2024-05-27T06:28:39.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.053+0000 7f61c1800640 1 -- 172.21.15.87:0/3567470076 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61bc15e980 con 0x7f61bc09a330 2024-05-27T06:28:39.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.053+0000 7f61c1800640 1 -- 172.21.15.87:0/3567470076 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61bc06aa30 con 0x7f61bc09a330 2024-05-27T06:28:39.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.053+0000 7f61b3400640 1 -- 172.21.15.87:0/3567470076 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f61a4012040 con 0x7f61bc09a330 2024-05-27T06:28:39.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.057+0000 7f61b3400640 1 --2- 172.21.15.87:0/3567470076 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f619806f400 0x7f6198071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:39.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.057+0000 7f61b3400640 1 -- 172.21.15.87:0/3567470076 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f61a408f670 con 0x7f61bc09a330 2024-05-27T06:28:39.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.057+0000 7f61baa00640 1 --2- 172.21.15.87:0/3567470076 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f619806f400 0x7f6198071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:39.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.057+0000 7f61baa00640 1 --2- 172.21.15.87:0/3567470076 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f619806f400 0x7f6198071910 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0ab000 tx=0x7f61ac0a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:39.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.061+0000 7f61b3400640 1 -- 172.21.15.87:0/3567470076 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f61bc0b09d0 con 0x7f61bc09a330 2024-05-27T06:28:39.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.217+0000 7f61c1800640 1 -- 172.21.15.87:0/3567470076 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f61bc1564b0 con 0x7f61bc09a330 2024-05-27T06:28:39.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.641+0000 7f61b3400640 1 -- 172.21.15.87:0/3567470076 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) ==== 138+0+0 (secure 0 0 0) 0x7f61a4019030 con 0x7f61bc09a330 2024-05-27T06:28:39.639 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_metadata' created 2024-05-27T06:28:39.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.645+0000 7f61c1800640 1 -- 172.21.15.87:0/3567470076 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f619806f400 msgr2=0x7f6198071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:39.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.645+0000 7f61c1800640 1 --2- 172.21.15.87:0/3567470076 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f619806f400 0x7f6198071910 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0ab000 tx=0x7f61ac0a7000 comp rx=0 tx=0).stop 2024-05-27T06:28:39.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.645+0000 7f61c1800640 1 -- 172.21.15.87:0/3567470076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61bc09a330 msgr2=0x7f61bc0b0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:39.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.645+0000 7f61c1800640 1 --2- 172.21.15.87:0/3567470076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61bc09a330 0x7f61bc0b0080 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f61a4011930 tx=0x7f61a4011df0 comp rx=0 tx=0).stop 2024-05-27T06:28:39.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.645+0000 7f61c1800640 1 -- 172.21.15.87:0/3567470076 shutdown_connections 2024-05-27T06:28:39.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.645+0000 7f61c1800640 1 --2- 172.21.15.87:0/3567470076 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f619806f400 0x7f6198071910 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:39.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.645+0000 7f61c1800640 1 --2- 172.21.15.87:0/3567470076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61bc0b05c0 0x7f61bc15f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:39.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.645+0000 7f61c1800640 1 --2- 172.21.15.87:0/3567470076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61bc09a330 0x7f61bc0b0080 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:39.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.645+0000 7f61c1800640 1 --2- 172.21.15.87:0/3567470076 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61a0003a10 0x7f61bc1f9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:39.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.645+0000 7f61c1800640 1 -- 172.21.15.87:0/3567470076 >> 172.21.15.87:0/3567470076 conn(0x7f61bc0b46b0 msgr2=0x7f61bc074880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:39.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.645+0000 7f61c1800640 1 -- 172.21.15.87:0/3567470076 shutdown_connections 2024-05-27T06:28:39.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.645+0000 7f61c1800640 1 -- 172.21.15.87:0/3567470076 wait complete. 2024-05-27T06:28:39.668 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-27T06:28:39.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.821+0000 7f693d800640 1 Processor -- start 2024-05-27T06:28:39.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.821+0000 7f693d800640 1 -- start start 2024-05-27T06:28:39.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.825+0000 7f693d800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6938163600 0x7f6938163a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:39.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.825+0000 7f693d800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f693815ffc0 0x7f69381603d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:39.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.825+0000 7f693d800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6938163f50 con 0x7f6938160910 2024-05-27T06:28:39.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.825+0000 7f693d800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f69380cf390 con 0x7f693815ffc0 2024-05-27T06:28:39.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.825+0000 7f693d800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f69380cf670 con 0x7f6938163600 2024-05-27T06:28:39.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.825+0000 7f692f400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f693815ffc0 0x7f69381603d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:39.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.825+0000 7f692f400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f693815ffc0 0x7f69381603d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34080/0 (socket says 172.21.15.87:34080) 2024-05-27T06:28:39.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.825+0000 7f692f400640 1 -- 172.21.15.87:0/932273916 learned_addr learned my addr 172.21.15.87:0/932273916 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:39.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.825+0000 7f6937e00640 1 --2- 172.21.15.87:0/932273916 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6938163600 0x7f6938163a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:39.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.825+0000 7f692f400640 1 -- 172.21.15.87:0/932273916 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6938163600 msgr2=0x7f6938163a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:39.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.825+0000 7f692f400640 1 --2- 172.21.15.87:0/932273916 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6938163600 0x7f6938163a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:39.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.825+0000 7f692f400640 1 -- 172.21.15.87:0/932273916 >> v1:172.21.15.149:6789/0 conn(0x7f6938160910 legacy=0x7f69380b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:39.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.825+0000 7f692f400640 1 -- 172.21.15.87:0/932273916 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69380cf950 con 0x7f693815ffc0 2024-05-27T06:28:39.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.829+0000 7f692f400640 1 --2- 172.21.15.87:0/932273916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f693815ffc0 0x7f69381603d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6920009870 tx=0x7f692001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8dfaf40c759648e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:39.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.829+0000 7f6937400640 1 -- 172.21.15.87:0/932273916 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69200a9620 con 0x7f693815ffc0 2024-05-27T06:28:39.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.829+0000 7f6937400640 1 -- 172.21.15.87:0/932273916 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69200a97c0 con 0x7f693815ffc0 2024-05-27T06:28:39.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.829+0000 7f6937400640 1 -- 172.21.15.87:0/932273916 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69200a9b90 con 0x7f693815ffc0 2024-05-27T06:28:39.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.829+0000 7f693d800640 1 -- 172.21.15.87:0/932273916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f693815ffc0 msgr2=0x7f69381603d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:39.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.829+0000 7f693d800640 1 --2- 172.21.15.87:0/932273916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f693815ffc0 0x7f69381603d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6920009870 tx=0x7f692001c560 comp rx=0 tx=0).stop 2024-05-27T06:28:39.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.829+0000 7f693d800640 1 -- 172.21.15.87:0/932273916 shutdown_connections 2024-05-27T06:28:39.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.829+0000 7f693d800640 1 --2- 172.21.15.87:0/932273916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f693815ffc0 0x7f69381603d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:39.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.829+0000 7f693d800640 1 --2- 172.21.15.87:0/932273916 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6938163600 0x7f6938163a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:39.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.829+0000 7f693d800640 1 -- 172.21.15.87:0/932273916 >> 172.21.15.87:0/932273916 conn(0x7f69380d2610 msgr2=0x7f69380d2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:39.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.829+0000 7f693d800640 1 -- 172.21.15.87:0/932273916 shutdown_connections 2024-05-27T06:28:39.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.829+0000 7f693d800640 1 -- 172.21.15.87:0/932273916 wait complete. 2024-05-27T06:28:39.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.833+0000 7f693d800640 1 Processor -- start 2024-05-27T06:28:39.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.833+0000 7f693d800640 1 -- start start 2024-05-27T06:28:39.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.833+0000 7f693d800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f693815ffc0 0x7f693806cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:39.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.833+0000 7f693d800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6938160910 0x7f6938143d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:39.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.833+0000 7f693d800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6938163600 0x7f69380af9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:39.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.833+0000 7f693d800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f69380ceac0 con 0x7f6938163600 2024-05-27T06:28:39.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.833+0000 7f693d800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f69380ce940 con 0x7f6938160910 2024-05-27T06:28:39.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.833+0000 7f693d800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f69380d0b60 con 0x7f693815ffc0 2024-05-27T06:28:39.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.833+0000 7f693ce00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6938163600 0x7f69380af9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:39.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.833+0000 7f6937e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f693815ffc0 0x7f693806cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:39.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.833+0000 7f693ce00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6938163600 0x7f69380af9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34092/0 (socket says 172.21.15.87:34092) 2024-05-27T06:28:39.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.833+0000 7f693ce00640 1 -- 172.21.15.87:0/299731620 learned_addr learned my addr 172.21.15.87:0/299731620 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:39.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.833+0000 7f692f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6938160910 0x7f6938143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:39.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.833+0000 7f6937e00640 1 -- 172.21.15.87:0/299731620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6938160910 msgr2=0x7f6938143d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:39.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.833+0000 7f6937e00640 1 --2- 172.21.15.87:0/299731620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6938160910 0x7f6938143d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:39.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.833+0000 7f6937e00640 1 -- 172.21.15.87:0/299731620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6938163600 msgr2=0x7f69380af9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:39.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.833+0000 7f6937e00640 1 --2- 172.21.15.87:0/299731620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6938163600 0x7f69380af9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:39.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.833+0000 7f6937e00640 1 -- 172.21.15.87:0/299731620 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6938070870 con 0x7f693815ffc0 2024-05-27T06:28:39.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.833+0000 7f693ce00640 1 --2- 172.21.15.87:0/299731620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6938163600 0x7f69380af9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:28:39.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.833+0000 7f6937e00640 1 --2- 172.21.15.87:0/299731620 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f693815ffc0 0x7f693806cfb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f692800e870 tx=0x7f692800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:39.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.833+0000 7f6934c00640 1 -- 172.21.15.87:0/299731620 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6928017070 con 0x7f693815ffc0 2024-05-27T06:28:39.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.833+0000 7f6934c00640 1 -- 172.21.15.87:0/299731620 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f692800ee60 con 0x7f693815ffc0 2024-05-27T06:28:39.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.833+0000 7f693d800640 1 -- 172.21.15.87:0/299731620 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f693806d940 con 0x7f693815ffc0 2024-05-27T06:28:39.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.833+0000 7f6934c00640 1 -- 172.21.15.87:0/299731620 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692800cb60 con 0x7f693815ffc0 2024-05-27T06:28:39.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.837+0000 7f693d800640 1 -- 172.21.15.87:0/299731620 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6938070220 con 0x7f693815ffc0 2024-05-27T06:28:39.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.837+0000 7f693d800640 1 -- 172.21.15.87:0/299731620 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69380508e0 con 0x7f693815ffc0 2024-05-27T06:28:39.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.837+0000 7f6934c00640 1 -- 172.21.15.87:0/299731620 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f692801a070 con 0x7f693815ffc0 2024-05-27T06:28:39.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.837+0000 7f6934c00640 1 --2- 172.21.15.87:0/299731620 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f691406f400 0x7f6914071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:39.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.837+0000 7f6934c00640 1 -- 172.21.15.87:0/299731620 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 5619+0+0 (secure 0 0 0) 0x7f692808f8e0 con 0x7f693815ffc0 2024-05-27T06:28:39.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.837+0000 7f692f400640 1 --2- 172.21.15.87:0/299731620 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f691406f400 0x7f6914071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:39.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.841+0000 7f692f400640 1 --2- 172.21.15.87:0/299731620 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f691406f400 0x7f6914071910 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f69200ae000 tx=0x7f69200b3040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:39.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.841+0000 7f6934c00640 1 -- 172.21.15.87:0/299731620 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f692805c130 con 0x7f693815ffc0 2024-05-27T06:28:39.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:39.997+0000 7f693d800640 1 -- 172.21.15.87:0/299731620 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f69380b8030 con 0x7f693815ffc0 2024-05-27T06:28:40.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.653+0000 7f6934c00640 1 -- 172.21.15.87:0/299731620 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) ==== 170+0+0 (secure 0 0 0) 0x7f6928060430 con 0x7f693815ffc0 2024-05-27T06:28:40.654 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_data' created 2024-05-27T06:28:40.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.657+0000 7f693d800640 1 -- 172.21.15.87:0/299731620 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f691406f400 msgr2=0x7f6914071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:40.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.657+0000 7f693d800640 1 --2- 172.21.15.87:0/299731620 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f691406f400 0x7f6914071910 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f69200ae000 tx=0x7f69200b3040 comp rx=0 tx=0).stop 2024-05-27T06:28:40.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.657+0000 7f693d800640 1 -- 172.21.15.87:0/299731620 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f693815ffc0 msgr2=0x7f693806cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:40.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.657+0000 7f693d800640 1 --2- 172.21.15.87:0/299731620 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f693815ffc0 0x7f693806cfb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f692800e870 tx=0x7f692800ed30 comp rx=0 tx=0).stop 2024-05-27T06:28:40.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.665+0000 7f693d800640 1 -- 172.21.15.87:0/299731620 shutdown_connections 2024-05-27T06:28:40.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.665+0000 7f693d800640 1 --2- 172.21.15.87:0/299731620 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f691406f400 0x7f6914071910 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:40.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.665+0000 7f693d800640 1 --2- 172.21.15.87:0/299731620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6938163600 0x7f69380af9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:40.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.665+0000 7f693d800640 1 --2- 172.21.15.87:0/299731620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6938160910 0x7f6938143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:40.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.665+0000 7f693d800640 1 --2- 172.21.15.87:0/299731620 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f693815ffc0 0x7f693806cfb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:40.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.665+0000 7f693d800640 1 -- 172.21.15.87:0/299731620 >> 172.21.15.87:0/299731620 conn(0x7f69380d2610 msgr2=0x7f69380b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:40.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.665+0000 7f693d800640 1 -- 172.21.15.87:0/299731620 shutdown_connections 2024-05-27T06:28:40.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.665+0000 7f693d800640 1 -- 172.21.15.87:0/299731620 wait complete. 2024-05-27T06:28:40.694 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-27T06:28:40.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.845+0000 7f80fb200640 1 Processor -- start 2024-05-27T06:28:40.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.845+0000 7f80fb200640 1 -- start start 2024-05-27T06:28:40.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.849+0000 7f80fb200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f80f406eb20 0x7f80f406ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:40.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.849+0000 7f80fb200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80f40d1130 con 0x7f80f40d1700 2024-05-27T06:28:40.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.849+0000 7f80fb200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80f40d0e50 con 0x7f80f41610c0 2024-05-27T06:28:40.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.849+0000 7f80fb200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f80f4161a00 con 0x7f80f406eb20 2024-05-27T06:28:40.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.849+0000 7f80eb400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f80f40d1700 0x7f80f40d1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:47672/0 (socket says 172.21.15.87:47672) 2024-05-27T06:28:40.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.849+0000 7f80eb400640 1 -- 172.21.15.87:0/1583032843 learned_addr learned my addr 172.21.15.87:0/1583032843 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:40.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.849+0000 7f80f9200640 1 --2- 172.21.15.87:0/1583032843 >> v2:172.21.15.87:3300/0 conn(0x7f80f406eb20 0x7f80f406ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:40.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.849+0000 7f80f9200640 1 -- 172.21.15.87:0/1583032843 >> v1:172.21.15.149:6789/0 conn(0x7f80f41610c0 legacy=0x7f80f40d02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:40.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.849+0000 7f80f9200640 1 -- 172.21.15.87:0/1583032843 >> v1:172.21.15.87:6789/0 conn(0x7f80f40d1700 legacy=0x7f80f40d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:40.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.849+0000 7f80f9200640 1 -- 172.21.15.87:0/1583032843 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f4161ce0 con 0x7f80f406eb20 2024-05-27T06:28:40.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.853+0000 7f80f9200640 1 --2- 172.21.15.87:0/1583032843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80f406eb20 0x7f80f406ef30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f80ec009d90 tx=0x7f80ec01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793c0e3e46a7de2b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:40.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.853+0000 7f80f3400640 1 -- 172.21.15.87:0/1583032843 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ec0b2070 con 0x7f80f406eb20 2024-05-27T06:28:40.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.853+0000 7f80f3400640 1 -- 172.21.15.87:0/1583032843 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80ec0a5a30 con 0x7f80f406eb20 2024-05-27T06:28:40.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.853+0000 7f80f3400640 1 -- 172.21.15.87:0/1583032843 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ec0a5e00 con 0x7f80f406eb20 2024-05-27T06:28:40.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.853+0000 7f80fb200640 1 -- 172.21.15.87:0/1583032843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80f406eb20 msgr2=0x7f80f406ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:40.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.853+0000 7f80fb200640 1 --2- 172.21.15.87:0/1583032843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80f406eb20 0x7f80f406ef30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f80ec009d90 tx=0x7f80ec01c970 comp rx=0 tx=0).stop 2024-05-27T06:28:40.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.853+0000 7f80fb200640 1 -- 172.21.15.87:0/1583032843 shutdown_connections 2024-05-27T06:28:40.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.853+0000 7f80fb200640 1 --2- 172.21.15.87:0/1583032843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80f406eb20 0x7f80f406ef30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:40.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.853+0000 7f80fb200640 1 -- 172.21.15.87:0/1583032843 >> 172.21.15.87:0/1583032843 conn(0x7f80f40b46b0 msgr2=0x7f80f40b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:40.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.853+0000 7f80fb200640 1 -- 172.21.15.87:0/1583032843 shutdown_connections 2024-05-27T06:28:40.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.853+0000 7f80fb200640 1 -- 172.21.15.87:0/1583032843 wait complete. 2024-05-27T06:28:40.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.853+0000 7f80fb200640 1 Processor -- start 2024-05-27T06:28:40.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.853+0000 7f80fb200640 1 -- start start 2024-05-27T06:28:40.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.857+0000 7f80fb200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80f406eb20 0x7f80f409a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:40.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.857+0000 7f80fb200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80f40d1700 0x7f80f41682e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:40.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.857+0000 7f80fb200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80f41610c0 0x7f80f4159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:40.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.857+0000 7f80fb200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f80f4161650 con 0x7f80f406eb20 2024-05-27T06:28:40.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.857+0000 7f80fb200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f80f41614d0 con 0x7f80f41610c0 2024-05-27T06:28:40.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.857+0000 7f80fb200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f80f40d09e0 con 0x7f80f40d1700 2024-05-27T06:28:40.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.857+0000 7f80f3e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80f406eb20 0x7f80f409a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:40.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.857+0000 7f80f3e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80f406eb20 0x7f80f409a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34118/0 (socket says 172.21.15.87:34118) 2024-05-27T06:28:40.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.857+0000 7f80f3e00640 1 -- 172.21.15.87:0/2512920577 learned_addr learned my addr 172.21.15.87:0/2512920577 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:40.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.857+0000 7f80f9200640 1 --2- 172.21.15.87:0/2512920577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80f41610c0 0x7f80f4159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:40.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.857+0000 7f80eb400640 1 --2- 172.21.15.87:0/2512920577 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80f40d1700 0x7f80f41682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:40.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.857+0000 7f80f3e00640 1 -- 172.21.15.87:0/2512920577 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80f40d1700 msgr2=0x7f80f41682e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:40.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.857+0000 7f80f3e00640 1 --2- 172.21.15.87:0/2512920577 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80f40d1700 0x7f80f41682e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:40.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.857+0000 7f80f3e00640 1 -- 172.21.15.87:0/2512920577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80f41610c0 msgr2=0x7f80f4159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:40.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.857+0000 7f80f3e00640 1 --2- 172.21.15.87:0/2512920577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80f41610c0 0x7f80f4159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:40.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.857+0000 7f80f3e00640 1 -- 172.21.15.87:0/2512920577 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f406d840 con 0x7f80f406eb20 2024-05-27T06:28:40.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.857+0000 7f80f3e00640 1 --2- 172.21.15.87:0/2512920577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80f406eb20 0x7f80f409a9d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f80e400b3e0 tx=0x7f80e400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:40.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.857+0000 7f80f0c00640 1 -- 172.21.15.87:0/2512920577 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e4015020 con 0x7f80f406eb20 2024-05-27T06:28:40.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.857+0000 7f80f0c00640 1 -- 172.21.15.87:0/2512920577 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80e4011830 con 0x7f80f406eb20 2024-05-27T06:28:40.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.857+0000 7f80fb200640 1 -- 172.21.15.87:0/2512920577 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80f415d7d0 con 0x7f80f406eb20 2024-05-27T06:28:40.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.857+0000 7f80f0c00640 1 -- 172.21.15.87:0/2512920577 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e4011c60 con 0x7f80f406eb20 2024-05-27T06:28:40.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.857+0000 7f80fb200640 1 -- 172.21.15.87:0/2512920577 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80f4169130 con 0x7f80f406eb20 2024-05-27T06:28:40.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.857+0000 7f80fb200640 1 -- 172.21.15.87:0/2512920577 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80f406aa30 con 0x7f80f406eb20 2024-05-27T06:28:40.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.861+0000 7f80f0c00640 1 -- 172.21.15.87:0/2512920577 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f80e4018020 con 0x7f80f406eb20 2024-05-27T06:28:40.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.861+0000 7f80f0c00640 1 --2- 172.21.15.87:0/2512920577 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f80d006f400 0x7f80d0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:40.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.861+0000 7f80f0c00640 1 -- 172.21.15.87:0/2512920577 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6001+0+0 (secure 0 0 0) 0x7f80e408ef60 con 0x7f80f406eb20 2024-05-27T06:28:40.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.861+0000 7f80eb400640 1 --2- 172.21.15.87:0/2512920577 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f80d006f400 0x7f80d0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:40.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.861+0000 7f80eb400640 1 --2- 172.21.15.87:0/2512920577 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f80d006f400 0x7f80d0071910 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f80f415e690 tx=0x7f80dc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:40.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:40.865+0000 7f80f0c00640 1 -- 172.21.15.87:0/2512920577 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f80e401f030 con 0x7f80f406eb20 2024-05-27T06:28:41.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.061+0000 7f80fb200640 1 -- 172.21.15.87:0/2512920577 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f80f40b4030 con 0x7f80f406eb20 2024-05-27T06:28:41.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.649+0000 7f80f0c00640 1 -- 172.21.15.87:0/2512920577 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7f80e405b6d0 con 0x7f80f406eb20 2024-05-27T06:28:41.648 INFO:teuthology.orchestra.run.smithi087.stderr:new fs with metadata pool 5 and data pool 6 2024-05-27T06:28:41.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.653+0000 7f80fb200640 1 -- 172.21.15.87:0/2512920577 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f80d006f400 msgr2=0x7f80d0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:41.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.653+0000 7f80fb200640 1 --2- 172.21.15.87:0/2512920577 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f80d006f400 0x7f80d0071910 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f80f415e690 tx=0x7f80dc009040 comp rx=0 tx=0).stop 2024-05-27T06:28:41.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.653+0000 7f80fb200640 1 -- 172.21.15.87:0/2512920577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80f406eb20 msgr2=0x7f80f409a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:41.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.653+0000 7f80fb200640 1 --2- 172.21.15.87:0/2512920577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80f406eb20 0x7f80f409a9d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f80e400b3e0 tx=0x7f80e400b8a0 comp rx=0 tx=0).stop 2024-05-27T06:28:41.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.653+0000 7f80fb200640 1 -- 172.21.15.87:0/2512920577 shutdown_connections 2024-05-27T06:28:41.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.653+0000 7f80fb200640 1 --2- 172.21.15.87:0/2512920577 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f80d006f400 0x7f80d0071910 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:41.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.653+0000 7f80fb200640 1 --2- 172.21.15.87:0/2512920577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80f41610c0 0x7f80f4159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:41.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.653+0000 7f80fb200640 1 --2- 172.21.15.87:0/2512920577 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80f40d1700 0x7f80f41682e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:41.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.653+0000 7f80fb200640 1 --2- 172.21.15.87:0/2512920577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80f406eb20 0x7f80f409a9d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:41.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.653+0000 7f80fb200640 1 -- 172.21.15.87:0/2512920577 >> 172.21.15.87:0/2512920577 conn(0x7f80f40b46b0 msgr2=0x7f80f4146880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:41.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.653+0000 7f80fb200640 1 -- 172.21.15.87:0/2512920577 shutdown_connections 2024-05-27T06:28:41.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.653+0000 7f80fb200640 1 -- 172.21.15.87:0/2512920577 wait complete. 2024-05-27T06:28:41.701 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T06:28:41.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.849+0000 7ff0a4000640 1 Processor -- start 2024-05-27T06:28:41.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.849+0000 7ff0a4000640 1 -- start start 2024-05-27T06:28:41.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.849+0000 7ff0a4000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff09c0b03c0 0x7ff09c0cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:41.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.849+0000 7ff0a4000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09c0d10f0 con 0x7ff09c0af350 2024-05-27T06:28:41.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.853+0000 7ff0a4000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09c160b90 con 0x7ff09c0b07d0 2024-05-27T06:28:41.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.853+0000 7ff0a4000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7ff09c06d610 con 0x7ff09c0b03c0 2024-05-27T06:28:41.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.853+0000 7ff0a1600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff09c0b03c0 0x7ff09c0cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:41.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.853+0000 7ff0a2000640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff09c0af350 0x7ff09c160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:47676/0 (socket says 172.21.15.87:47676) 2024-05-27T06:28:41.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.853+0000 7ff0a2000640 1 -- 172.21.15.87:0/2555496956 learned_addr learned my addr 172.21.15.87:0/2555496956 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:41.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.853+0000 7ff09be00640 1 -- 172.21.15.87:0/2555496956 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2007482650 0 0) 0x7ff0940014a0 con 0x7ff09c0af350 2024-05-27T06:28:41.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.853+0000 7ff09be00640 1 -- 172.21.15.87:0/2555496956 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff084003530 con 0x7ff09c0af350 2024-05-27T06:28:41.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.853+0000 7ff0a1600640 1 -- 172.21.15.87:0/2555496956 >> v1:172.21.15.149:6789/0 conn(0x7ff09c0b07d0 legacy=0x7ff09c15fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:41.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.853+0000 7ff0a1600640 1 -- 172.21.15.87:0/2555496956 >> v1:172.21.15.87:6789/0 conn(0x7ff09c0af350 legacy=0x7ff09c160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:41.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.853+0000 7ff0a1600640 1 -- 172.21.15.87:0/2555496956 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09c06c720 con 0x7ff09c0b03c0 2024-05-27T06:28:41.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.853+0000 7ff0a1600640 1 --2- 172.21.15.87:0/2555496956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff09c0b03c0 0x7ff09c0cdd30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff0900097c0 tx=0x7ff09001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508514bde016921d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:41.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.853+0000 7ff09be00640 1 -- 172.21.15.87:0/2555496956 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0900b0070 con 0x7ff09c0b03c0 2024-05-27T06:28:41.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.853+0000 7ff09be00640 1 -- 172.21.15.87:0/2555496956 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0900ab600 con 0x7ff09c0b03c0 2024-05-27T06:28:41.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.857+0000 7ff09be00640 1 -- 172.21.15.87:0/2555496956 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0900ab9d0 con 0x7ff09c0b03c0 2024-05-27T06:28:41.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.857+0000 7ff0a4000640 1 -- 172.21.15.87:0/2555496956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff09c0b03c0 msgr2=0x7ff09c0cdd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:41.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.857+0000 7ff0a4000640 1 --2- 172.21.15.87:0/2555496956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff09c0b03c0 0x7ff09c0cdd30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff0900097c0 tx=0x7ff09001c470 comp rx=0 tx=0).stop 2024-05-27T06:28:41.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.857+0000 7ff0a4000640 1 -- 172.21.15.87:0/2555496956 shutdown_connections 2024-05-27T06:28:41.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.857+0000 7ff0a4000640 1 --2- 172.21.15.87:0/2555496956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff09c0b03c0 0x7ff09c0cdd30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:41.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.857+0000 7ff0a4000640 1 -- 172.21.15.87:0/2555496956 >> 172.21.15.87:0/2555496956 conn(0x7ff09c0b46b0 msgr2=0x7ff09c0b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:41.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.857+0000 7ff0a4000640 1 -- 172.21.15.87:0/2555496956 shutdown_connections 2024-05-27T06:28:41.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.857+0000 7ff0a4000640 1 -- 172.21.15.87:0/2555496956 wait complete. 2024-05-27T06:28:41.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.857+0000 7ff0a4000640 1 Processor -- start 2024-05-27T06:28:41.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.857+0000 7ff0a4000640 1 -- start start 2024-05-27T06:28:41.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.861+0000 7ff0a4000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff09c0af350 0x7ff09c0ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:41.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.861+0000 7ff0a4000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff09c0b03c0 0x7ff09c06fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:41.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.861+0000 7ff0a4000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff09c0b07d0 0x7ff09c0b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:41.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.861+0000 7ff0a4000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff09c15c620 con 0x7ff09c0b07d0 2024-05-27T06:28:41.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.861+0000 7ff0a4000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff09c06d2a0 con 0x7ff09c0af350 2024-05-27T06:28:41.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.861+0000 7ff0a4000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff09c16a130 con 0x7ff09c0b03c0 2024-05-27T06:28:41.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.861+0000 7ff0a2000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff09c0b07d0 0x7ff09c0b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:41.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.861+0000 7ff0a2000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff09c0b07d0 0x7ff09c0b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34134/0 (socket says 172.21.15.87:34134) 2024-05-27T06:28:41.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.861+0000 7ff0a2000640 1 -- 172.21.15.87:0/2734121900 learned_addr learned my addr 172.21.15.87:0/2734121900 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:41.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.861+0000 7ff0a1600640 1 --2- 172.21.15.87:0/2734121900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff09c0af350 0x7ff09c0ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:41.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.861+0000 7ff0a0c00640 1 --2- 172.21.15.87:0/2734121900 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff09c0b03c0 0x7ff09c06fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:41.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.861+0000 7ff0a2000640 1 -- 172.21.15.87:0/2734121900 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff09c0b03c0 msgr2=0x7ff09c06fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:41.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.861+0000 7ff0a2000640 1 --2- 172.21.15.87:0/2734121900 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff09c0b03c0 0x7ff09c06fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:41.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.861+0000 7ff0a2000640 1 -- 172.21.15.87:0/2734121900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff09c0af350 msgr2=0x7ff09c0ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:41.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.861+0000 7ff0a2000640 1 --2- 172.21.15.87:0/2734121900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff09c0af350 0x7ff09c0ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:41.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.861+0000 7ff0a2000640 1 -- 172.21.15.87:0/2734121900 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09c0b0fa0 con 0x7ff09c0b07d0 2024-05-27T06:28:41.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.861+0000 7ff0a2000640 1 --2- 172.21.15.87:0/2734121900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff09c0b07d0 0x7ff09c0b1d60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff09400cad0 tx=0x7ff09400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:41.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.861+0000 7ff099600640 1 -- 172.21.15.87:0/2734121900 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09400ac30 con 0x7ff09c0b07d0 2024-05-27T06:28:41.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.861+0000 7ff099600640 1 -- 172.21.15.87:0/2734121900 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff09400add0 con 0x7ff09c0b07d0 2024-05-27T06:28:41.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.861+0000 7ff099600640 1 -- 172.21.15.87:0/2734121900 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff094012620 con 0x7ff09c0b07d0 2024-05-27T06:28:41.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.861+0000 7ff0a4000640 1 -- 172.21.15.87:0/2734121900 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff09c0b1280 con 0x7ff09c0b07d0 2024-05-27T06:28:41.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.861+0000 7ff0a4000640 1 -- 172.21.15.87:0/2734121900 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff09c147ab0 con 0x7ff09c0b07d0 2024-05-27T06:28:41.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.861+0000 7ff0a4000640 1 -- 172.21.15.87:0/2734121900 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff09c147d10 con 0x7ff09c0b07d0 2024-05-27T06:28:41.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.865+0000 7ff099600640 1 -- 172.21.15.87:0/2734121900 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff0940127c0 con 0x7ff09c0b07d0 2024-05-27T06:28:41.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.865+0000 7ff099600640 1 --2- 172.21.15.87:0/2734121900 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff07c06f400 0x7ff07c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:41.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.865+0000 7ff099600640 1 -- 172.21.15.87:0/2734121900 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7ff09408fa50 con 0x7ff09c0b07d0 2024-05-27T06:28:41.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.865+0000 7ff0a1600640 1 --2- 172.21.15.87:0/2734121900 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff07c06f400 0x7ff07c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:41.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.865+0000 7ff0a1600640 1 --2- 172.21.15.87:0/2734121900 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff07c06f400 0x7ff07c071910 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff0900ad000 tx=0x7ff0900a4f90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:41.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:41.869+0000 7ff099600640 1 -- 172.21.15.87:0/2734121900 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff09c0d10f0 con 0x7ff09c0b07d0 2024-05-27T06:28:42.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.025+0000 7ff0a4000640 1 -- 172.21.15.87:0/2734121900 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff09c06aa30 con 0x7ff09c0b07d0 2024-05-27T06:28:42.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.025+0000 7ff099600640 1 -- 172.21.15.87:0/2734121900 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16943 (secure 0 0 0) 0x7ff09405c7a0 con 0x7ff09c0b07d0 2024-05-27T06:28:42.026 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:42.026 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":37,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:28:41.065944+0000","last_up_change":"2024-05-27T06:27:25.988592+0000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T06:27:26.590191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-27T06:28:39.228886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-27T06:28:40.012993+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6801","nonce":3674824716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6803","nonce":3674824716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6807","nonce":3674824716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6805","nonce":3674824716}]},"public_addr":"172.21.15.87:6801/3674824716","cluster_addr":"172.21.15.87:6803/3674824716","heartbeat_back_addr":"172.21.15.87:6807/3674824716","heartbeat_front_addr":"172.21.15.87:6805/3674824716","state":["exists","up"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6809","nonce":2443981288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6811","nonce":2443981288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6815","nonce":2443981288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6813","nonce":2443981288}]},"public_addr":"172.21.15.87:6809/2443981288","cluster_addr":"172.21.15.87:6811/2443981288","heartbeat_back_addr":"172.21.15.87:6815/2443981288","heartbeat_front_addr":"172.21.15.87:6813/2443981288","state":["exists","up"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6819","nonce":1441249238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6823","nonce":1441249238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6831","nonce":1441249238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6825","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6827","nonce":1441249238}]},"public_addr":"172.21.15.87:6819/1441249238","cluster_addr":"172.21.15.87:6823/1441249238","heartbeat_back_addr":"172.21.15.87:6831/1441249238","heartbeat_front_addr":"172.21.15.87:6827/1441249238","state":["exists","up"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6818","nonce":1173805234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6822","nonce":1173805234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6829","nonce":1173805234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6826","nonce":1173805234}]},"public_addr":"172.21.15.87:6818/1173805234","cluster_addr":"172.21.15.87:6822/1173805234","heartbeat_back_addr":"172.21.15.87:6829/1173805234","heartbeat_front_addr":"172.21.15.87:6826/1173805234","state":["exists","up"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6819","nonce":1551871079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6823","nonce":1551871079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6831","nonce":1551871079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6827","nonce":1551871079}]},"public_addr":"172.21.15.149:6819/1551871079","cluster_addr":"172.21.15.149:6823/1551871079","heartbeat_back_addr":"172.21.15.149:6831/1551871079","heartbeat_front_addr":"172.21.15.149:6827/1551871079","state":["exists","up"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6818","nonce":582864816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6822","nonce":582864816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6830","nonce":582864816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6826","nonce":582864816}]},"public_addr":"172.21.15.149:6818/582864816","cluster_addr":"172.21.15.149:6822/582864816","heartbeat_back_addr":"172.21.15.149:6830/582864816","heartbeat_front_addr":"172.21.15.149:6826/582864816","state":["exists","up"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6801","nonce":531351314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6803","nonce":531351314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6807","nonce":531351314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6805","nonce":531351314}]},"public_addr":"172.21.15.149:6801/531351314","cluster_addr":"172.21.15.149:6803/531351314","heartbeat_back_addr":"172.21.15.149:6807/531351314","heartbeat_front_addr":"172.21.15.149:6805/531351314","state":["exists","up"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6809","nonce":1171039913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6811","nonce":1171039913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6815","nonce":1171039913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6813","nonce":1171039913}]},"public_addr":"172.21.15.149:6809/1171039913","cluster_addr":"172.21.15.149:6811/1171039913","heartbeat_back_addr":"172.21.15.149:6815/1171039913","heartbeat_front_addr":"172.21.15.149:6813/1171039913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.589776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.819787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.767566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.683842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.038885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.120319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.687007+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.812832+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:28:42.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.029+0000 7ff0a4000640 1 -- 172.21.15.87:0/2734121900 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff07c06f400 msgr2=0x7ff07c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:42.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.029+0000 7ff0a4000640 1 --2- 172.21.15.87:0/2734121900 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff07c06f400 0x7ff07c071910 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff0900ad000 tx=0x7ff0900a4f90 comp rx=0 tx=0).stop 2024-05-27T06:28:42.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.029+0000 7ff0a4000640 1 -- 172.21.15.87:0/2734121900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff09c0b07d0 msgr2=0x7ff09c0b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:42.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.029+0000 7ff0a4000640 1 --2- 172.21.15.87:0/2734121900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff09c0b07d0 0x7ff09c0b1d60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff09400cad0 tx=0x7ff09400cf90 comp rx=0 tx=0).stop 2024-05-27T06:28:42.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.029+0000 7ff0a4000640 1 -- 172.21.15.87:0/2734121900 shutdown_connections 2024-05-27T06:28:42.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.029+0000 7ff0a4000640 1 --2- 172.21.15.87:0/2734121900 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff07c06f400 0x7ff07c071910 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:42.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.029+0000 7ff0a4000640 1 --2- 172.21.15.87:0/2734121900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff09c0b07d0 0x7ff09c0b1d60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:42.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.029+0000 7ff0a4000640 1 --2- 172.21.15.87:0/2734121900 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff09c0b03c0 0x7ff09c06fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:42.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.029+0000 7ff0a4000640 1 --2- 172.21.15.87:0/2734121900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff09c0af350 0x7ff09c0ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:42.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.029+0000 7ff0a4000640 1 -- 172.21.15.87:0/2734121900 >> 172.21.15.87:0/2734121900 conn(0x7ff09c0b46b0 msgr2=0x7ff09c0cc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:42.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.029+0000 7ff0a4000640 1 -- 172.21.15.87:0/2734121900 shutdown_connections 2024-05-27T06:28:42.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.029+0000 7ff0a4000640 1 -- 172.21.15.87:0/2734121900 wait complete. 2024-05-27T06:28:42.048 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T06:28:42.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.197+0000 7f4d0ea00640 1 Processor -- start 2024-05-27T06:28:42.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.197+0000 7f4d0ea00640 1 -- start start 2024-05-27T06:28:42.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.197+0000 7f4d0ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d080cbf90 0x7f4d0806cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:42.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.197+0000 7f4d0ea00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4d0806d500 0x7f4d0815cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:42.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.197+0000 7f4d0ea00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d0815d930 con 0x7f4d0815d520 2024-05-27T06:28:42.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.197+0000 7f4d0ea00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f4d0806d910 con 0x7f4d0806d500 2024-05-27T06:28:42.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.197+0000 7f4d0ea00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4d0815dbb0 con 0x7f4d080cbf90 2024-05-27T06:28:42.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.197+0000 7f4d07400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4d0806d500 0x7f4d0815cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:42.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.197+0000 7f4d07400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4d0806d500 0x7f4d0815cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34140/0 (socket says 172.21.15.87:34140) 2024-05-27T06:28:42.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.197+0000 7f4d07400640 1 -- 172.21.15.87:0/2241691607 learned_addr learned my addr 172.21.15.87:0/2241691607 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:42.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.197+0000 7f4d07e00640 1 --2- 172.21.15.87:0/2241691607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d080cbf90 0x7f4d0806cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:42.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.197+0000 7f4d07400640 1 -- 172.21.15.87:0/2241691607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d080cbf90 msgr2=0x7f4d0806cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:42.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.197+0000 7f4d07400640 1 --2- 172.21.15.87:0/2241691607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d080cbf90 0x7f4d0806cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:42.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.197+0000 7f4d07400640 1 -- 172.21.15.87:0/2241691607 >> v1:172.21.15.149:6789/0 conn(0x7f4d0815d520 legacy=0x7f4d080d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:42.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.197+0000 7f4d07400640 1 -- 172.21.15.87:0/2241691607 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0815de90 con 0x7f4d0806d500 2024-05-27T06:28:42.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.197+0000 7f4d07e00640 1 --2- 172.21.15.87:0/2241691607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d080cbf90 0x7f4d0806cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:42.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.201+0000 7f4d07400640 1 --2- 172.21.15.87:0/2241691607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d0806d500 0x7f4d0815cfe0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4009870 tx=0x7f4cf401ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77fd9972f4d5f791 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:42.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.201+0000 7f4d06a00640 1 -- 172.21.15.87:0/2241691607 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf40b5070 con 0x7f4d0806d500 2024-05-27T06:28:42.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.201+0000 7f4d06a00640 1 -- 172.21.15.87:0/2241691607 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf40a8a50 con 0x7f4d0806d500 2024-05-27T06:28:42.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.201+0000 7f4d06a00640 1 -- 172.21.15.87:0/2241691607 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf40a8e20 con 0x7f4d0806d500 2024-05-27T06:28:42.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.201+0000 7f4d0ea00640 1 -- 172.21.15.87:0/2241691607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d0806d500 msgr2=0x7f4d0815cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:42.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.201+0000 7f4d0ea00640 1 --2- 172.21.15.87:0/2241691607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d0806d500 0x7f4d0815cfe0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4009870 tx=0x7f4cf401ed50 comp rx=0 tx=0).stop 2024-05-27T06:28:42.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.201+0000 7f4d0ea00640 1 -- 172.21.15.87:0/2241691607 shutdown_connections 2024-05-27T06:28:42.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.201+0000 7f4d0ea00640 1 --2- 172.21.15.87:0/2241691607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d0806d500 0x7f4d0815cfe0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:42.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.201+0000 7f4d0ea00640 1 --2- 172.21.15.87:0/2241691607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d080cbf90 0x7f4d0806cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:42.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.201+0000 7f4d0ea00640 1 -- 172.21.15.87:0/2241691607 >> 172.21.15.87:0/2241691607 conn(0x7f4d080b46b0 msgr2=0x7f4d080b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:42.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.201+0000 7f4d0ea00640 1 -- 172.21.15.87:0/2241691607 shutdown_connections 2024-05-27T06:28:42.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.201+0000 7f4d0ea00640 1 -- 172.21.15.87:0/2241691607 wait complete. 2024-05-27T06:28:42.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.205+0000 7f4d0ea00640 1 Processor -- start 2024-05-27T06:28:42.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.205+0000 7f4d0ea00640 1 -- start start 2024-05-27T06:28:42.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.205+0000 7f4d0ea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d0806d500 0x7f4d080c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:42.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.205+0000 7f4d0ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d080cbf90 0x7f4d080cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:42.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.205+0000 7f4d0ea00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d0815d520 0x7f4d0814fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:42.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.205+0000 7f4d0ea00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0815e170 con 0x7f4d0815d520 2024-05-27T06:28:42.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.205+0000 7f4d0ea00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0806caa0 con 0x7f4d0806d500 2024-05-27T06:28:42.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.205+0000 7f4d0ea00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4d080cc3a0 con 0x7f4d080cbf90 2024-05-27T06:28:42.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.205+0000 7f4d0ca00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d0815d520 0x7f4d0814fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:42.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.205+0000 7f4d0ca00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d0815d520 0x7f4d0814fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34146/0 (socket says 172.21.15.87:34146) 2024-05-27T06:28:42.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.205+0000 7f4d07e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d0806d500 0x7f4d080c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:42.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.205+0000 7f4d0ca00640 1 -- 172.21.15.87:0/4036091685 learned_addr learned my addr 172.21.15.87:0/4036091685 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:42.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.205+0000 7f4d07400640 1 --2- 172.21.15.87:0/4036091685 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d080cbf90 0x7f4d080cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:42.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.205+0000 7f4d0ca00640 1 -- 172.21.15.87:0/4036091685 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d080cbf90 msgr2=0x7f4d080cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:42.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.205+0000 7f4d0ca00640 1 --2- 172.21.15.87:0/4036091685 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d080cbf90 0x7f4d080cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:42.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.205+0000 7f4d0ca00640 1 -- 172.21.15.87:0/4036091685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d0806d500 msgr2=0x7f4d080c6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:42.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.205+0000 7f4d0ca00640 1 --2- 172.21.15.87:0/4036091685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d0806d500 0x7f4d080c6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:42.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.205+0000 7f4d0ca00640 1 -- 172.21.15.87:0/4036091685 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d080c4e70 con 0x7f4d0815d520 2024-05-27T06:28:42.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.205+0000 7f4d0ca00640 1 --2- 172.21.15.87:0/4036091685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d0815d520 0x7f4d0814fbf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000c760 tx=0x7f4d0000cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:42.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.205+0000 7f4cffe00640 1 -- 172.21.15.87:0/4036091685 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d00003ba0 con 0x7f4d0815d520 2024-05-27T06:28:42.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.205+0000 7f4cffe00640 1 -- 172.21.15.87:0/4036091685 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d00003d60 con 0x7f4d0815d520 2024-05-27T06:28:42.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.205+0000 7f4d0ea00640 1 -- 172.21.15.87:0/4036091685 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d080c5370 con 0x7f4d0815d520 2024-05-27T06:28:42.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.205+0000 7f4cffe00640 1 -- 172.21.15.87:0/4036091685 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d00005310 con 0x7f4d0815d520 2024-05-27T06:28:42.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.209+0000 7f4d0ea00640 1 -- 172.21.15.87:0/4036091685 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d080c5930 con 0x7f4d0815d520 2024-05-27T06:28:42.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.209+0000 7f4d0ea00640 1 -- 172.21.15.87:0/4036091685 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d0806aa30 con 0x7f4d0815d520 2024-05-27T06:28:42.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.209+0000 7f4cffe00640 1 -- 172.21.15.87:0/4036091685 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4d000054b0 con 0x7f4d0815d520 2024-05-27T06:28:42.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.209+0000 7f4cffe00640 1 --2- 172.21.15.87:0/4036091685 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f4ce806f400 0x7f4ce8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:42.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.209+0000 7f4cffe00640 1 -- 172.21.15.87:0/4036091685 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f4d0008f110 con 0x7f4d0815d520 2024-05-27T06:28:42.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.209+0000 7f4d07e00640 1 --2- 172.21.15.87:0/4036091685 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f4ce806f400 0x7f4ce8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:42.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.209+0000 7f4d07e00640 1 --2- 172.21.15.87:0/4036091685 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f4ce806f400 0x7f4ce8071910 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4cf80045f0 tx=0x7f4cf8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:42.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.213+0000 7f4cffe00640 1 -- 172.21.15.87:0/4036091685 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f4d0815d930 con 0x7f4d0815d520 2024-05-27T06:28:42.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.373+0000 7f4d0ea00640 1 -- 172.21.15.87:0/4036091685 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4d080c5100 con 0x7f4d0815d520 2024-05-27T06:28:42.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.373+0000 7f4cffe00640 1 -- 172.21.15.87:0/4036091685 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16943 (secure 0 0 0) 0x7f4d0005b810 con 0x7f4d0815d520 2024-05-27T06:28:42.373 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:42.373 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":37,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:28:41.065944+0000","last_up_change":"2024-05-27T06:27:25.988592+0000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T06:27:26.590191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-27T06:28:39.228886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-27T06:28:40.012993+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6801","nonce":3674824716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6803","nonce":3674824716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6807","nonce":3674824716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6805","nonce":3674824716}]},"public_addr":"172.21.15.87:6801/3674824716","cluster_addr":"172.21.15.87:6803/3674824716","heartbeat_back_addr":"172.21.15.87:6807/3674824716","heartbeat_front_addr":"172.21.15.87:6805/3674824716","state":["exists","up"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6809","nonce":2443981288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6811","nonce":2443981288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6815","nonce":2443981288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6813","nonce":2443981288}]},"public_addr":"172.21.15.87:6809/2443981288","cluster_addr":"172.21.15.87:6811/2443981288","heartbeat_back_addr":"172.21.15.87:6815/2443981288","heartbeat_front_addr":"172.21.15.87:6813/2443981288","state":["exists","up"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6819","nonce":1441249238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6823","nonce":1441249238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6831","nonce":1441249238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6825","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6827","nonce":1441249238}]},"public_addr":"172.21.15.87:6819/1441249238","cluster_addr":"172.21.15.87:6823/1441249238","heartbeat_back_addr":"172.21.15.87:6831/1441249238","heartbeat_front_addr":"172.21.15.87:6827/1441249238","state":["exists","up"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6818","nonce":1173805234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6822","nonce":1173805234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6829","nonce":1173805234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6826","nonce":1173805234}]},"public_addr":"172.21.15.87:6818/1173805234","cluster_addr":"172.21.15.87:6822/1173805234","heartbeat_back_addr":"172.21.15.87:6829/1173805234","heartbeat_front_addr":"172.21.15.87:6826/1173805234","state":["exists","up"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6819","nonce":1551871079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6823","nonce":1551871079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6831","nonce":1551871079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6827","nonce":1551871079}]},"public_addr":"172.21.15.149:6819/1551871079","cluster_addr":"172.21.15.149:6823/1551871079","heartbeat_back_addr":"172.21.15.149:6831/1551871079","heartbeat_front_addr":"172.21.15.149:6827/1551871079","state":["exists","up"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6818","nonce":582864816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6822","nonce":582864816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6830","nonce":582864816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6826","nonce":582864816}]},"public_addr":"172.21.15.149:6818/582864816","cluster_addr":"172.21.15.149:6822/582864816","heartbeat_back_addr":"172.21.15.149:6830/582864816","heartbeat_front_addr":"172.21.15.149:6826/582864816","state":["exists","up"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6801","nonce":531351314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6803","nonce":531351314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6807","nonce":531351314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6805","nonce":531351314}]},"public_addr":"172.21.15.149:6801/531351314","cluster_addr":"172.21.15.149:6803/531351314","heartbeat_back_addr":"172.21.15.149:6807/531351314","heartbeat_front_addr":"172.21.15.149:6805/531351314","state":["exists","up"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6809","nonce":1171039913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6811","nonce":1171039913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6815","nonce":1171039913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6813","nonce":1171039913}]},"public_addr":"172.21.15.149:6809/1171039913","cluster_addr":"172.21.15.149:6811/1171039913","heartbeat_back_addr":"172.21.15.149:6815/1171039913","heartbeat_front_addr":"172.21.15.149:6813/1171039913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.589776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.819787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.767566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.683842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.038885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.120319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.687007+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.812832+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:28:42.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.377+0000 7f4d0ea00640 1 -- 172.21.15.87:0/4036091685 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f4ce806f400 msgr2=0x7f4ce8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:42.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.377+0000 7f4d0ea00640 1 --2- 172.21.15.87:0/4036091685 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f4ce806f400 0x7f4ce8071910 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4cf80045f0 tx=0x7f4cf8008040 comp rx=0 tx=0).stop 2024-05-27T06:28:42.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.377+0000 7f4d0ea00640 1 -- 172.21.15.87:0/4036091685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d0815d520 msgr2=0x7f4d0814fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:42.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.377+0000 7f4d0ea00640 1 --2- 172.21.15.87:0/4036091685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d0815d520 0x7f4d0814fbf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000c760 tx=0x7f4d0000cb60 comp rx=0 tx=0).stop 2024-05-27T06:28:42.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.377+0000 7f4d0ea00640 1 -- 172.21.15.87:0/4036091685 shutdown_connections 2024-05-27T06:28:42.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.377+0000 7f4d0ea00640 1 --2- 172.21.15.87:0/4036091685 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f4ce806f400 0x7f4ce8071910 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:42.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.377+0000 7f4d0ea00640 1 --2- 172.21.15.87:0/4036091685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d0815d520 0x7f4d0814fbf0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:42.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.377+0000 7f4d0ea00640 1 --2- 172.21.15.87:0/4036091685 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d080cbf90 0x7f4d080cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:42.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.377+0000 7f4d0ea00640 1 --2- 172.21.15.87:0/4036091685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d0806d500 0x7f4d080c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:42.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.377+0000 7f4d0ea00640 1 -- 172.21.15.87:0/4036091685 >> 172.21.15.87:0/4036091685 conn(0x7f4d080b46b0 msgr2=0x7f4d080733e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:42.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.377+0000 7f4d0ea00640 1 -- 172.21.15.87:0/4036091685 shutdown_connections 2024-05-27T06:28:42.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.377+0000 7f4d0ea00640 1 -- 172.21.15.87:0/4036091685 wait complete. 2024-05-27T06:28:42.395 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-27T06:28:42.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.545+0000 7f6ffe200640 1 Processor -- start 2024-05-27T06:28:42.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.545+0000 7f6ffe200640 1 -- start start 2024-05-27T06:28:42.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.549+0000 7f6ffe200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ff8163bd0 0x7f6ff806c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:42.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.549+0000 7f6ffe200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6ff815d3b0 0x7f6ff80b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:42.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.549+0000 7f6ffe200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ff80d16e0 con 0x7f6ff806ce70 2024-05-27T06:28:42.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.549+0000 7f6ffe200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f6ff80b6d40 con 0x7f6ff815d3b0 2024-05-27T06:28:42.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.549+0000 7f6ffe200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff80d00c0 con 0x7f6ff8163bd0 2024-05-27T06:28:42.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.549+0000 7f6ffce00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ff8163bd0 0x7f6ff806c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:42.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.549+0000 7f6ffd800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6ff815d3b0 0x7f6ff80b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:42.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.549+0000 7f6ffce00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ff8163bd0 0x7f6ff806c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.87:52878/0 (socket says 172.21.15.87:52878) 2024-05-27T06:28:42.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.549+0000 7f6ff7e00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f6ff806ce70 0x7f6ff815cca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.87:40984/0 (socket says 172.21.15.87:40984) 2024-05-27T06:28:42.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.549+0000 7f6ffd800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6ff815d3b0 0x7f6ff80b4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:52220/0 (socket says 172.21.15.87:52220) 2024-05-27T06:28:42.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.549+0000 7f6ffce00640 1 -- 172.21.15.87:0/1473512734 learned_addr learned my addr 172.21.15.87:0/1473512734 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:42.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.549+0000 7f6ffce00640 1 -- 172.21.15.87:0/1473512734 >> v2:172.21.15.149:3300/0 conn(0x7f6ff815d3b0 msgr2=0x7f6ff80b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:42.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.549+0000 7f6ffce00640 1 --2- 172.21.15.87:0/1473512734 >> v2:172.21.15.149:3300/0 conn(0x7f6ff815d3b0 0x7f6ff80b4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:42.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.549+0000 7f6ffce00640 1 -- 172.21.15.87:0/1473512734 >> v1:172.21.15.149:6789/0 conn(0x7f6ff806ce70 legacy=0x7f6ff815cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:42.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.549+0000 7f6ffce00640 1 -- 172.21.15.87:0/1473512734 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff80d03a0 con 0x7f6ff8163bd0 2024-05-27T06:28:42.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.553+0000 7f6ffce00640 1 --2- 172.21.15.87:0/1473512734 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ff8163bd0 0x7f6ff806c930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009870 tx=0x7f6fec01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c585c5208c8df7fe server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:42.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.553+0000 7f6ff7400640 1 -- 172.21.15.87:0/1473512734 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec0b0070 con 0x7f6ff8163bd0 2024-05-27T06:28:42.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.553+0000 7f6ff7400640 1 -- 172.21.15.87:0/1473512734 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fec0ab600 con 0x7f6ff8163bd0 2024-05-27T06:28:42.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.553+0000 7f6ff7400640 1 -- 172.21.15.87:0/1473512734 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec0ab9d0 con 0x7f6ff8163bd0 2024-05-27T06:28:42.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.553+0000 7f6ffe200640 1 -- 172.21.15.87:0/1473512734 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ff8163bd0 msgr2=0x7f6ff806c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:42.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.553+0000 7f6ffe200640 1 --2- 172.21.15.87:0/1473512734 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ff8163bd0 0x7f6ff806c930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009870 tx=0x7f6fec01c4d0 comp rx=0 tx=0).stop 2024-05-27T06:28:42.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.553+0000 7f6ffe200640 1 -- 172.21.15.87:0/1473512734 shutdown_connections 2024-05-27T06:28:42.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.553+0000 7f6ffe200640 1 --2- 172.21.15.87:0/1473512734 >> v2:172.21.15.149:3300/0 conn(0x7f6ff815d3b0 0x7f6ff80b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:42.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.553+0000 7f6ffe200640 1 --2- 172.21.15.87:0/1473512734 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ff8163bd0 0x7f6ff806c930 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:42.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.553+0000 7f6ffe200640 1 -- 172.21.15.87:0/1473512734 >> 172.21.15.87:0/1473512734 conn(0x7f6ff80d19b0 msgr2=0x7f6ff80d1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:42.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.553+0000 7f6ffe200640 1 -- 172.21.15.87:0/1473512734 shutdown_connections 2024-05-27T06:28:42.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.553+0000 7f6ffe200640 1 -- 172.21.15.87:0/1473512734 wait complete. 2024-05-27T06:28:42.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.557+0000 7f6ffe200640 1 Processor -- start 2024-05-27T06:28:42.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.557+0000 7f6ffe200640 1 -- start start 2024-05-27T06:28:42.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.557+0000 7f6ffe200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ff806ce70 0x7f6ff80af160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:42.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.557+0000 7f6ffe200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ff815d3b0 0x7f6ff815e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:42.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.557+0000 7f6ffe200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ff8163bd0 0x7f6ff81484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:42.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.557+0000 7f6ffe200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff80b5dd0 con 0x7f6ff806ce70 2024-05-27T06:28:42.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.557+0000 7f6ffe200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff80b5c50 con 0x7f6ff8163bd0 2024-05-27T06:28:42.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.557+0000 7f6ffe200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff80b5f50 con 0x7f6ff815d3b0 2024-05-27T06:28:42.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.557+0000 7f6ffce00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ff806ce70 0x7f6ff80af160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:42.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.557+0000 7f6ffce00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ff806ce70 0x7f6ff80af160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34160/0 (socket says 172.21.15.87:34160) 2024-05-27T06:28:42.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.557+0000 7f6ffce00640 1 -- 172.21.15.87:0/1334325328 learned_addr learned my addr 172.21.15.87:0/1334325328 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:42.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.557+0000 7f6ffd800640 1 --2- 172.21.15.87:0/1334325328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ff8163bd0 0x7f6ff81484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:42.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.557+0000 7f6ff7e00640 1 --2- 172.21.15.87:0/1334325328 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ff815d3b0 0x7f6ff815e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:42.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.557+0000 7f6ffce00640 1 -- 172.21.15.87:0/1334325328 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ff815d3b0 msgr2=0x7f6ff815e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:42.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.557+0000 7f6ffce00640 1 --2- 172.21.15.87:0/1334325328 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ff815d3b0 0x7f6ff815e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:42.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.557+0000 7f6ffce00640 1 -- 172.21.15.87:0/1334325328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ff8163bd0 msgr2=0x7f6ff81484a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:42.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.557+0000 7f6ffce00640 1 --2- 172.21.15.87:0/1334325328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ff8163bd0 0x7f6ff81484a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:42.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.557+0000 7f6ffce00640 1 -- 172.21.15.87:0/1334325328 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff81489e0 con 0x7f6ff806ce70 2024-05-27T06:28:42.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.557+0000 7f6ffd800640 1 --2- 172.21.15.87:0/1334325328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ff8163bd0 0x7f6ff81484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:42.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.557+0000 7f6ffce00640 1 --2- 172.21.15.87:0/1334325328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ff806ce70 0x7f6ff80af160 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0ae040 tx=0x7f6fec019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:42.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.557+0000 7f6ff4c00640 1 -- 172.21.15.87:0/1334325328 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec0ba070 con 0x7f6ff806ce70 2024-05-27T06:28:42.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.557+0000 7f6ff4c00640 1 -- 172.21.15.87:0/1334325328 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fec0b4420 con 0x7f6ff806ce70 2024-05-27T06:28:42.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.557+0000 7f6ffe200640 1 -- 172.21.15.87:0/1334325328 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff80b2080 con 0x7f6ff806ce70 2024-05-27T06:28:42.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.557+0000 7f6ff4c00640 1 -- 172.21.15.87:0/1334325328 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec0b0040 con 0x7f6ff806ce70 2024-05-27T06:28:42.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.557+0000 7f6ffe200640 1 -- 172.21.15.87:0/1334325328 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff80b2640 con 0x7f6ff806ce70 2024-05-27T06:28:42.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.561+0000 7f6ffe200640 1 -- 172.21.15.87:0/1334325328 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ff80508e0 con 0x7f6ff806ce70 2024-05-27T06:28:42.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.561+0000 7f6ff4c00640 1 -- 172.21.15.87:0/1334325328 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6fec0b4810 con 0x7f6ff806ce70 2024-05-27T06:28:42.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.561+0000 7f6ff4c00640 1 --2- 172.21.15.87:0/1334325328 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f6fd806f400 0x7f6fd8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:42.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.561+0000 7f6ff4c00640 1 -- 172.21.15.87:0/1334325328 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f6fec1286c0 con 0x7f6ff806ce70 2024-05-27T06:28:42.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.561+0000 7f6ff7e00640 1 --2- 172.21.15.87:0/1334325328 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f6fd806f400 0x7f6fd8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:42.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.561+0000 7f6ff7e00640 1 --2- 172.21.15.87:0/1334325328 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f6fd806f400 0x7f6fd8071910 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80d2280 tx=0x7f6fe4007cd0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:42.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.565+0000 7f6ff4c00640 1 -- 172.21.15.87:0/1334325328 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f6fec0eef50 con 0x7f6ff806ce70 2024-05-27T06:28:42.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:42.765+0000 7f6ffe200640 1 -- 172.21.15.87:0/1334325328 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f6ff806f240 con 0x7f6ff806ce70 2024-05-27T06:28:43.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.681+0000 7f6ff4c00640 1 -- 172.21.15.87:0/1334325328 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f6fec016150 con 0x7f6ff806ce70 2024-05-27T06:28:43.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.685+0000 7f6ffe200640 1 -- 172.21.15.87:0/1334325328 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f6fd806f400 msgr2=0x7f6fd8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:43.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.685+0000 7f6ffe200640 1 --2- 172.21.15.87:0/1334325328 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f6fd806f400 0x7f6fd8071910 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80d2280 tx=0x7f6fe4007cd0 comp rx=0 tx=0).stop 2024-05-27T06:28:43.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.685+0000 7f6ffe200640 1 -- 172.21.15.87:0/1334325328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ff806ce70 msgr2=0x7f6ff80af160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:43.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.685+0000 7f6ffe200640 1 --2- 172.21.15.87:0/1334325328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ff806ce70 0x7f6ff80af160 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0ae040 tx=0x7f6fec019270 comp rx=0 tx=0).stop 2024-05-27T06:28:43.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.685+0000 7f6ffe200640 1 -- 172.21.15.87:0/1334325328 shutdown_connections 2024-05-27T06:28:43.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.685+0000 7f6ffe200640 1 --2- 172.21.15.87:0/1334325328 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f6fd806f400 0x7f6fd8071910 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:43.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.685+0000 7f6ffe200640 1 --2- 172.21.15.87:0/1334325328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ff8163bd0 0x7f6ff81484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:43.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.685+0000 7f6ffe200640 1 --2- 172.21.15.87:0/1334325328 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ff815d3b0 0x7f6ff815e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:43.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.685+0000 7f6ffe200640 1 --2- 172.21.15.87:0/1334325328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ff806ce70 0x7f6ff80af160 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:43.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.685+0000 7f6ffe200640 1 -- 172.21.15.87:0/1334325328 >> 172.21.15.87:0/1334325328 conn(0x7f6ff80d19b0 msgr2=0x7f6ff8162710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:43.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.685+0000 7f6ffe200640 1 -- 172.21.15.87:0/1334325328 shutdown_connections 2024-05-27T06:28:43.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.685+0000 7f6ffe200640 1 -- 172.21.15.87:0/1334325328 wait complete. 2024-05-27T06:28:43.707 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-27T06:28:43.707 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-27T06:28:43.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.861+0000 7f6251000640 1 Processor -- start 2024-05-27T06:28:43.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.861+0000 7f6251000640 1 -- start start 2024-05-27T06:28:43.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6251000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f624c15d350 0x7f624c0cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:43.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6251000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f624c0ce220 0x7f624c06c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:43.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6251000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f624c06db10 con 0x7f624c15c3f0 2024-05-27T06:28:43.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6251000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f624c0ce630 con 0x7f624c15d350 2024-05-27T06:28:43.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6251000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f624c15d760 con 0x7f624c0ce220 2024-05-27T06:28:43.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6249e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f624c15c3f0 0x7f624c160740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:47692/0 (socket says 172.21.15.87:47692) 2024-05-27T06:28:43.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6249e00640 1 -- 172.21.15.87:0/3396415398 learned_addr learned my addr 172.21.15.87:0/3396415398 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:43.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6241400640 1 --2- 172.21.15.87:0/3396415398 >> v2:172.21.15.149:3300/0 conn(0x7f624c15d350 0x7f624c0cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:43.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f624a800640 1 --2- 172.21.15.87:0/3396415398 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f624c0ce220 0x7f624c06c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:43.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6249400640 1 -- 172.21.15.87:0/3396415398 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 792703581 0 0) 0x7f623c0014a0 con 0x7f624c15c3f0 2024-05-27T06:28:43.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6249400640 1 -- 172.21.15.87:0/3396415398 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6230003530 con 0x7f624c15c3f0 2024-05-27T06:28:43.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6249400640 1 -- 172.21.15.87:0/3396415398 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3622908484 0 0) 0x7f6230003530 con 0x7f624c15c3f0 2024-05-27T06:28:43.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6249400640 1 -- 172.21.15.87:0/3396415398 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f624c0ce220 msgr2=0x7f624c06c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:43.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6249400640 1 --2- 172.21.15.87:0/3396415398 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f624c0ce220 0x7f624c06c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:43.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6249400640 1 -- 172.21.15.87:0/3396415398 >> v2:172.21.15.149:3300/0 conn(0x7f624c15d350 msgr2=0x7f624c0cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:43.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6249400640 1 --2- 172.21.15.87:0/3396415398 >> v2:172.21.15.149:3300/0 conn(0x7f624c15d350 0x7f624c0cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:43.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6249400640 1 -- 172.21.15.87:0/3396415398 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624c0cf2a0 con 0x7f624c15c3f0 2024-05-27T06:28:43.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6249400640 1 -- 172.21.15.87:0/3396415398 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7f623c001c50 con 0x7f624c15c3f0 2024-05-27T06:28:43.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6241400640 1 --2- 172.21.15.87:0/3396415398 >> v2:172.21.15.149:3300/0 conn(0x7f624c15d350 0x7f624c0cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:28:43.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6249400640 1 -- 172.21.15.87:0/3396415398 >> v1:172.21.15.87:6789/0 conn(0x7f624c15c3f0 legacy=0x7f624c160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:43.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6249400640 1 --2- 172.21.15.87:0/3396415398 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f624c0ce220 0x7f6230003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:43.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6249400640 1 --2- 172.21.15.87:0/3396415398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6230004030 0x7f6230004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:43.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6249400640 1 --2- 172.21.15.87:0/3396415398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6230004d50 0x7f6230005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:43.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6249400640 1 -- 172.21.15.87:0/3396415398 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f624c0ce630 con 0x7f6230004030 2024-05-27T06:28:43.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6249400640 1 -- 172.21.15.87:0/3396415398 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f624c15d760 con 0x7f6230004d50 2024-05-27T06:28:43.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6249400640 1 -- 172.21.15.87:0/3396415398 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f623000bb30 con 0x7f624c0ce220 2024-05-27T06:28:43.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6241400640 1 --2- 172.21.15.87:0/3396415398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6230004030 0x7f6230004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:43.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6249e00640 1 --2- 172.21.15.87:0/3396415398 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f624c0ce220 0x7f6230003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:43.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f624a800640 1 --2- 172.21.15.87:0/3396415398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6230004d50 0x7f6230005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:43.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6241400640 1 -- 172.21.15.87:0/3396415398 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f624c0ce220 msgr2=0x7f6230003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:43.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6241400640 1 --2- 172.21.15.87:0/3396415398 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f624c0ce220 0x7f6230003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:43.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6241400640 1 -- 172.21.15.87:0/3396415398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6230004d50 msgr2=0x7f6230005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:43.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6241400640 1 --2- 172.21.15.87:0/3396415398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6230004d50 0x7f6230005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:43.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.865+0000 7f6241400640 1 -- 172.21.15.87:0/3396415398 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6230003530 con 0x7f6230004030 2024-05-27T06:28:43.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.869+0000 7f6241400640 1 --2- 172.21.15.87:0/3396415398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6230004030 0x7f6230004810 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6234009c80 tx=0x7f623401cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b9c3e0e4f12209 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:43.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.869+0000 7f6249400640 1 -- 172.21.15.87:0/3396415398 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62340b2070 con 0x7f6230004030 2024-05-27T06:28:43.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.869+0000 7f6249400640 1 -- 172.21.15.87:0/3396415398 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62340a5910 con 0x7f6230004030 2024-05-27T06:28:43.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.869+0000 7f6249400640 1 -- 172.21.15.87:0/3396415398 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6234009880 con 0x7f6230004030 2024-05-27T06:28:43.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.869+0000 7f6251000640 1 -- 172.21.15.87:0/3396415398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6230004030 msgr2=0x7f6230004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:43.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.869+0000 7f6251000640 1 --2- 172.21.15.87:0/3396415398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6230004030 0x7f6230004810 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6234009c80 tx=0x7f623401cc50 comp rx=0 tx=0).stop 2024-05-27T06:28:43.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.869+0000 7f624a800640 1 -- 172.21.15.87:0/3396415398 reap_dead start 2024-05-27T06:28:43.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.869+0000 7f6251000640 1 -- 172.21.15.87:0/3396415398 shutdown_connections 2024-05-27T06:28:43.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.869+0000 7f6251000640 1 -- 172.21.15.87:0/3396415398 >> 172.21.15.87:0/3396415398 conn(0x7f624c0b46b0 msgr2=0x7f624c0b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:43.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.869+0000 7f6251000640 1 -- 172.21.15.87:0/3396415398 shutdown_connections 2024-05-27T06:28:43.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.869+0000 7f6251000640 1 -- 172.21.15.87:0/3396415398 wait complete. 2024-05-27T06:28:43.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.873+0000 7f6251000640 1 Processor -- start 2024-05-27T06:28:43.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.873+0000 7f6251000640 1 -- start start 2024-05-27T06:28:43.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.873+0000 7f6251000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6230004030 0x7f624c09eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:43.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.873+0000 7f6251000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f624c09bc50 0x7f624c151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:43.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.873+0000 7f6251000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f624c09a780 0x7f624c13fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:43.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.873+0000 7f6251000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f624c160220 con 0x7f624c09a780 2024-05-27T06:28:43.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.873+0000 7f6251000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f624c15ff40 con 0x7f6230004030 2024-05-27T06:28:43.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.873+0000 7f6251000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f624c0cf860 con 0x7f624c09bc50 2024-05-27T06:28:43.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.873+0000 7f624a800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f624c09a780 0x7f624c13fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:43.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.873+0000 7f624a800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f624c09a780 0x7f624c13fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34178/0 (socket says 172.21.15.87:34178) 2024-05-27T06:28:43.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.873+0000 7f624a800640 1 -- 172.21.15.87:0/3918566578 learned_addr learned my addr 172.21.15.87:0/3918566578 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:43.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.873+0000 7f6249e00640 1 --2- 172.21.15.87:0/3918566578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6230004030 0x7f624c09eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:43.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.873+0000 7f6241400640 1 --2- 172.21.15.87:0/3918566578 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f624c09bc50 0x7f624c151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:43.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.873+0000 7f624a800640 1 -- 172.21.15.87:0/3918566578 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f624c09bc50 msgr2=0x7f624c151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:43.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.873+0000 7f624a800640 1 --2- 172.21.15.87:0/3918566578 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f624c09bc50 0x7f624c151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:43.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.873+0000 7f624a800640 1 -- 172.21.15.87:0/3918566578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6230004030 msgr2=0x7f624c09eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:43.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.873+0000 7f624a800640 1 --2- 172.21.15.87:0/3918566578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6230004030 0x7f624c09eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:43.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.873+0000 7f624a800640 1 -- 172.21.15.87:0/3918566578 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624c152630 con 0x7f624c09a780 2024-05-27T06:28:43.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.877+0000 7f624a800640 1 --2- 172.21.15.87:0/3918566578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f624c09a780 0x7f624c13fe10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f624c072a70 tx=0x7f6244011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:43.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.877+0000 7f6242a00640 1 -- 172.21.15.87:0/3918566578 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6244004030 con 0x7f624c09a780 2024-05-27T06:28:43.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.877+0000 7f6242a00640 1 -- 172.21.15.87:0/3918566578 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f624401b070 con 0x7f624c09a780 2024-05-27T06:28:43.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.877+0000 7f6251000640 1 -- 172.21.15.87:0/3918566578 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f624c152910 con 0x7f624c09a780 2024-05-27T06:28:43.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.877+0000 7f6242a00640 1 -- 172.21.15.87:0/3918566578 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6244004430 con 0x7f624c09a780 2024-05-27T06:28:43.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.877+0000 7f6251000640 1 -- 172.21.15.87:0/3918566578 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f624c152ed0 con 0x7f624c09a780 2024-05-27T06:28:43.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.877+0000 7f6251000640 1 -- 172.21.15.87:0/3918566578 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f624c06aa30 con 0x7f624c09a780 2024-05-27T06:28:43.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.877+0000 7f6242a00640 1 -- 172.21.15.87:0/3918566578 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6244012040 con 0x7f624c09a780 2024-05-27T06:28:43.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.877+0000 7f6242a00640 1 --2- 172.21.15.87:0/3918566578 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f622806f400 0x7f6228071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:43.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.877+0000 7f6242a00640 1 -- 172.21.15.87:0/3918566578 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f624408f110 con 0x7f624c09a780 2024-05-27T06:28:43.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.877+0000 7f6249e00640 1 --2- 172.21.15.87:0/3918566578 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f622806f400 0x7f6228071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:43.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.881+0000 7f6249e00640 1 --2- 172.21.15.87:0/3918566578 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f622806f400 0x7f6228071910 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f623c0017a0 tx=0x7f623c00a210 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:43.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:43.885+0000 7f6242a00640 1 -- 172.21.15.87:0/3918566578 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f624405bdd0 con 0x7f624c09a780 2024-05-27T06:28:44.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.077+0000 7f6251000640 1 -- 172.21.15.87:0/3918566578 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f624c0d1d50 con 0x7f624c09a780 2024-05-27T06:28:44.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.689+0000 7f6242a00640 1 -- 172.21.15.87:0/3918566578 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f624405b6d0 con 0x7f624c09a780 2024-05-27T06:28:44.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.689+0000 7f6251000640 1 -- 172.21.15.87:0/3918566578 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f622806f400 msgr2=0x7f6228071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:44.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.689+0000 7f6251000640 1 --2- 172.21.15.87:0/3918566578 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f622806f400 0x7f6228071910 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f623c0017a0 tx=0x7f623c00a210 comp rx=0 tx=0).stop 2024-05-27T06:28:44.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.689+0000 7f6251000640 1 -- 172.21.15.87:0/3918566578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f624c09a780 msgr2=0x7f624c13fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:44.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.689+0000 7f6251000640 1 --2- 172.21.15.87:0/3918566578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f624c09a780 0x7f624c13fe10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f624c072a70 tx=0x7f6244011c30 comp rx=0 tx=0).stop 2024-05-27T06:28:44.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.689+0000 7f6251000640 1 -- 172.21.15.87:0/3918566578 shutdown_connections 2024-05-27T06:28:44.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.689+0000 7f6251000640 1 --2- 172.21.15.87:0/3918566578 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f622806f400 0x7f6228071910 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:44.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.689+0000 7f6251000640 1 --2- 172.21.15.87:0/3918566578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f624c09a780 0x7f624c13fe10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:44.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.689+0000 7f6251000640 1 --2- 172.21.15.87:0/3918566578 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f624c09bc50 0x7f624c151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:44.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.689+0000 7f6251000640 1 --2- 172.21.15.87:0/3918566578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6230004030 0x7f624c09eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:44.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.689+0000 7f6251000640 1 -- 172.21.15.87:0/3918566578 >> 172.21.15.87:0/3918566578 conn(0x7f624c0b46b0 msgr2=0x7f624c06eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:44.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.689+0000 7f6251000640 1 -- 172.21.15.87:0/3918566578 shutdown_connections 2024-05-27T06:28:44.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.689+0000 7f6251000640 1 -- 172.21.15.87:0/3918566578 wait complete. 2024-05-27T06:28:44.709 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-27T06:28:44.709 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T06:28:44.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.857+0000 7f3b1c200640 1 Processor -- start 2024-05-27T06:28:44.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.857+0000 7f3b1c200640 1 -- start start 2024-05-27T06:28:44.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.857+0000 7f3b1c200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3b140cea40 0x7f3b14158360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:44.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.857+0000 7f3b1c200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3b140b2fb0 0x7f3b140b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:44.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.857+0000 7f3b1c200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b140b2cd0 con 0x7f3b140d2010 2024-05-27T06:28:44.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.857+0000 7f3b1c200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f3b140ce5b0 con 0x7f3b140cea40 2024-05-27T06:28:44.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.857+0000 7f3b1c200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f3b140cdc80 con 0x7f3b140b2fb0 2024-05-27T06:28:44.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.857+0000 7f3b19800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3b140cea40 0x7f3b14158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:44.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.857+0000 7f3b19800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3b140cea40 0x7f3b14158360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39754/0 (socket says 172.21.15.87:39754) 2024-05-27T06:28:44.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.857+0000 7f3b19800640 1 -- 172.21.15.87:0/1226619354 learned_addr learned my addr 172.21.15.87:0/1226619354 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:44.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.857+0000 7f3b1a200640 1 --2- 172.21.15.87:0/1226619354 >> v2:172.21.15.149:3300/0 conn(0x7f3b140b2fb0 0x7f3b140b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:44.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.857+0000 7f3b19800640 1 -- 172.21.15.87:0/1226619354 >> v2:172.21.15.149:3300/0 conn(0x7f3b140b2fb0 msgr2=0x7f3b140b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:44.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.857+0000 7f3b19800640 1 --2- 172.21.15.87:0/1226619354 >> v2:172.21.15.149:3300/0 conn(0x7f3b140b2fb0 0x7f3b140b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:44.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.857+0000 7f3b19800640 1 -- 172.21.15.87:0/1226619354 >> v1:172.21.15.149:6789/0 conn(0x7f3b140d2010 legacy=0x7f3b140d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:44.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.857+0000 7f3b19800640 1 -- 172.21.15.87:0/1226619354 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b140cdf60 con 0x7f3b140cea40 2024-05-27T06:28:44.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.861+0000 7f3b1a200640 1 --2- 172.21.15.87:0/1226619354 >> v2:172.21.15.149:3300/0 conn(0x7f3b140b2fb0 0x7f3b140b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:44.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.861+0000 7f3b19800640 1 --2- 172.21.15.87:0/1226619354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b140cea40 0x7f3b14158360 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3b14074ab0 tx=0x7f3b0801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169c98f7ab8b7889 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:44.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.861+0000 7f3b13e00640 1 -- 172.21.15.87:0/1226619354 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b080aa610 con 0x7f3b140cea40 2024-05-27T06:28:44.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.861+0000 7f3b13e00640 1 -- 172.21.15.87:0/1226619354 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b080af070 con 0x7f3b140cea40 2024-05-27T06:28:44.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.861+0000 7f3b13e00640 1 -- 172.21.15.87:0/1226619354 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b080aa9d0 con 0x7f3b140cea40 2024-05-27T06:28:44.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.865+0000 7f3b1c200640 1 -- 172.21.15.87:0/1226619354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b140cea40 msgr2=0x7f3b14158360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:44.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.865+0000 7f3b1c200640 1 --2- 172.21.15.87:0/1226619354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b140cea40 0x7f3b14158360 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3b14074ab0 tx=0x7f3b0801c4f0 comp rx=0 tx=0).stop 2024-05-27T06:28:44.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.865+0000 7f3b1c200640 1 -- 172.21.15.87:0/1226619354 shutdown_connections 2024-05-27T06:28:44.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.865+0000 7f3b1c200640 1 --2- 172.21.15.87:0/1226619354 >> v2:172.21.15.149:3300/0 conn(0x7f3b140b2fb0 0x7f3b140b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:44.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.865+0000 7f3b1c200640 1 --2- 172.21.15.87:0/1226619354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b140cea40 0x7f3b14158360 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:44.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.865+0000 7f3b1c200640 1 -- 172.21.15.87:0/1226619354 >> 172.21.15.87:0/1226619354 conn(0x7f3b140d3590 msgr2=0x7f3b140d39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:44.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.865+0000 7f3b1c200640 1 -- 172.21.15.87:0/1226619354 shutdown_connections 2024-05-27T06:28:44.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.865+0000 7f3b1c200640 1 -- 172.21.15.87:0/1226619354 wait complete. 2024-05-27T06:28:44.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.865+0000 7f3b1c200640 1 Processor -- start 2024-05-27T06:28:44.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.865+0000 7f3b1c200640 1 -- start start 2024-05-27T06:28:44.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.869+0000 7f3b1c200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b140b2fb0 0x7f3b1414ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:44.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.869+0000 7f3b1c200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b140cea40 0x7f3b140b7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:44.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.869+0000 7f3b1c200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b140d2010 0x7f3b140b8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:44.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.869+0000 7f3b1c200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3b140d2ee0 con 0x7f3b140b2fb0 2024-05-27T06:28:44.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.869+0000 7f3b1c200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3b140d2d60 con 0x7f3b140cea40 2024-05-27T06:28:44.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.869+0000 7f3b1c200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3b140cee50 con 0x7f3b140d2010 2024-05-27T06:28:44.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.869+0000 7f3b19800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b140b2fb0 0x7f3b1414ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:44.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.869+0000 7f3b19800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b140b2fb0 0x7f3b1414ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39770/0 (socket says 172.21.15.87:39770) 2024-05-27T06:28:44.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.869+0000 7f3b19800640 1 -- 172.21.15.87:0/1934015763 learned_addr learned my addr 172.21.15.87:0/1934015763 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:44.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.869+0000 7f3b18e00640 1 --2- 172.21.15.87:0/1934015763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b140cea40 0x7f3b140b7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:44.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.869+0000 7f3b19800640 1 -- 172.21.15.87:0/1934015763 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b140d2010 msgr2=0x7f3b140b8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:44.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.869+0000 7f3b19800640 1 --2- 172.21.15.87:0/1934015763 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b140d2010 0x7f3b140b8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:44.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.869+0000 7f3b19800640 1 -- 172.21.15.87:0/1934015763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b140cea40 msgr2=0x7f3b140b7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:44.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.869+0000 7f3b19800640 1 --2- 172.21.15.87:0/1934015763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b140cea40 0x7f3b140b7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:44.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.869+0000 7f3b19800640 1 -- 172.21.15.87:0/1934015763 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b141f9cf0 con 0x7f3b140b2fb0 2024-05-27T06:28:44.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.869+0000 7f3b18e00640 1 --2- 172.21.15.87:0/1934015763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b140cea40 0x7f3b140b7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:44.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.869+0000 7f3b19800640 1 --2- 172.21.15.87:0/1934015763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b140b2fb0 0x7f3b1414ec40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3b0801aba0 tx=0x7f3b0801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:44.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.869+0000 7f3b11600640 1 -- 172.21.15.87:0/1934015763 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b080bd5f0 con 0x7f3b140b2fb0 2024-05-27T06:28:44.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.869+0000 7f3b11600640 1 -- 172.21.15.87:0/1934015763 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b080bd790 con 0x7f3b140b2fb0 2024-05-27T06:28:44.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.869+0000 7f3b1c200640 1 -- 172.21.15.87:0/1934015763 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b1415b800 con 0x7f3b140b2fb0 2024-05-27T06:28:44.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.869+0000 7f3b11600640 1 -- 172.21.15.87:0/1934015763 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b080bdb80 con 0x7f3b140b2fb0 2024-05-27T06:28:44.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.869+0000 7f3b1c200640 1 -- 172.21.15.87:0/1934015763 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b14160bc0 con 0x7f3b140b2fb0 2024-05-27T06:28:44.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.869+0000 7f3b1c200640 1 -- 172.21.15.87:0/1934015763 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b141f9ec0 con 0x7f3b140b2fb0 2024-05-27T06:28:44.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.869+0000 7f3b11600640 1 -- 172.21.15.87:0/1934015763 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3b080b33f0 con 0x7f3b140b2fb0 2024-05-27T06:28:44.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.873+0000 7f3b11600640 1 --2- 172.21.15.87:0/1934015763 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3af406f400 0x7f3af4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:44.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.873+0000 7f3b11600640 1 -- 172.21.15.87:0/1934015763 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f3b0812a180 con 0x7f3b140b2fb0 2024-05-27T06:28:44.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.873+0000 7f3b18e00640 1 --2- 172.21.15.87:0/1934015763 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3af406f400 0x7f3af4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:44.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.873+0000 7f3b18e00640 1 --2- 172.21.15.87:0/1934015763 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3af406f400 0x7f3af4071910 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3b140c6b40 tx=0x7f3b00008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:44.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:44.877+0000 7f3b11600640 1 -- 172.21.15.87:0/1934015763 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f3b080c3060 con 0x7f3b140b2fb0 2024-05-27T06:28:45.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.065+0000 7f3b1c200640 1 -- 172.21.15.87:0/1934015763 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b1406aa30 con 0x7f3b140b2fb0 2024-05-27T06:28:45.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.065+0000 7f3b11600640 1 -- 172.21.15.87:0/1934015763 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5178 (secure 0 0 0) 0x7f3b080a7070 con 0x7f3b140b2fb0 2024-05-27T06:28:45.064 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:45.064 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/662047769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":662047769},{"type":"v1","addr":"172.21.15.87:6837","nonce":662047769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4861,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/553113849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":553113849},{"type":"v1","addr":"172.21.15.149:6834","nonce":553113849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/381728425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":381728425},{"type":"v1","addr":"172.21.15.149:6835","nonce":381728425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T06:28:41.065900+0000","modified":"2024-05-27T06:28:44.080313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2661735568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2661735568},{"type":"v1","addr":"172.21.15.87:6835","nonce":2661735568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4920,"qdb_cluster":[4920]},"id":2}]} 2024-05-27T06:28:45.065 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 18 2024-05-27T06:28:45.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.069+0000 7f3b1c200640 1 -- 172.21.15.87:0/1934015763 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3af406f400 msgr2=0x7f3af4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:45.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.069+0000 7f3b1c200640 1 --2- 172.21.15.87:0/1934015763 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3af406f400 0x7f3af4071910 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3b140c6b40 tx=0x7f3b00008040 comp rx=0 tx=0).stop 2024-05-27T06:28:45.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.069+0000 7f3b1c200640 1 -- 172.21.15.87:0/1934015763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b140b2fb0 msgr2=0x7f3b1414ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:45.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.069+0000 7f3b1c200640 1 --2- 172.21.15.87:0/1934015763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b140b2fb0 0x7f3b1414ec40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3b0801aba0 tx=0x7f3b0801ad30 comp rx=0 tx=0).stop 2024-05-27T06:28:45.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.069+0000 7f3b1c200640 1 -- 172.21.15.87:0/1934015763 shutdown_connections 2024-05-27T06:28:45.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.069+0000 7f3b1c200640 1 --2- 172.21.15.87:0/1934015763 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3af406f400 0x7f3af4071910 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:45.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.069+0000 7f3b1c200640 1 --2- 172.21.15.87:0/1934015763 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b140d2010 0x7f3b140b8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:45.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.069+0000 7f3b1c200640 1 --2- 172.21.15.87:0/1934015763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b140cea40 0x7f3b140b7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:45.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.069+0000 7f3b1c200640 1 --2- 172.21.15.87:0/1934015763 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b140b2fb0 0x7f3b1414ec40 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:45.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.069+0000 7f3b1c200640 1 -- 172.21.15.87:0/1934015763 >> 172.21.15.87:0/1934015763 conn(0x7f3b140d3590 msgr2=0x7f3b14156ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:45.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.069+0000 7f3b1c200640 1 -- 172.21.15.87:0/1934015763 shutdown_connections 2024-05-27T06:28:45.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.069+0000 7f3b1c200640 1 -- 172.21.15.87:0/1934015763 wait complete. 2024-05-27T06:28:45.086 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T06:28:45.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.233+0000 7fa76ec00640 1 Processor -- start 2024-05-27T06:28:45.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.237+0000 7fa76ec00640 1 -- start start 2024-05-27T06:28:45.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.237+0000 7fa76ec00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7680cbf90 0x7fa76806cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:45.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.237+0000 7fa76ec00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa76806d500 0x7fa76815cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:45.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.237+0000 7fa76ec00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa76815d930 con 0x7fa76815d520 2024-05-27T06:28:45.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.237+0000 7fa76ec00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fa76806d910 con 0x7fa76806d500 2024-05-27T06:28:45.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.237+0000 7fa76ec00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa76815dbb0 con 0x7fa7680cbf90 2024-05-27T06:28:45.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.237+0000 7fa75f400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa76806d500 0x7fa76815cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:45.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.237+0000 7fa75f400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa76806d500 0x7fa76815cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39776/0 (socket says 172.21.15.87:39776) 2024-05-27T06:28:45.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.237+0000 7fa75f400640 1 -- 172.21.15.87:0/1511042889 learned_addr learned my addr 172.21.15.87:0/1511042889 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:45.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.237+0000 7fa767e00640 1 --2- 172.21.15.87:0/1511042889 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7680cbf90 0x7fa76806cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:45.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.237+0000 7fa75f400640 1 -- 172.21.15.87:0/1511042889 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7680cbf90 msgr2=0x7fa76806cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:45.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.237+0000 7fa75f400640 1 --2- 172.21.15.87:0/1511042889 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7680cbf90 0x7fa76806cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:45.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.237+0000 7fa75f400640 1 -- 172.21.15.87:0/1511042889 >> v1:172.21.15.149:6789/0 conn(0x7fa76815d520 legacy=0x7fa7680d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:45.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.237+0000 7fa75f400640 1 -- 172.21.15.87:0/1511042889 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa76815de90 con 0x7fa76806d500 2024-05-27T06:28:45.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.241+0000 7fa75f400640 1 --2- 172.21.15.87:0/1511042889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa76806d500 0x7fa76815cfe0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa750009870 tx=0x7fa75001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f56726dc38b7df19 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:45.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.241+0000 7fa767400640 1 -- 172.21.15.87:0/1511042889 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7500b5070 con 0x7fa76806d500 2024-05-27T06:28:45.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.241+0000 7fa767400640 1 -- 172.21.15.87:0/1511042889 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7500a8a50 con 0x7fa76806d500 2024-05-27T06:28:45.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.241+0000 7fa767400640 1 -- 172.21.15.87:0/1511042889 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7500a8e20 con 0x7fa76806d500 2024-05-27T06:28:45.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.241+0000 7fa76ec00640 1 -- 172.21.15.87:0/1511042889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa76806d500 msgr2=0x7fa76815cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:45.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.241+0000 7fa76ec00640 1 --2- 172.21.15.87:0/1511042889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa76806d500 0x7fa76815cfe0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa750009870 tx=0x7fa75001ed50 comp rx=0 tx=0).stop 2024-05-27T06:28:45.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.241+0000 7fa76ec00640 1 -- 172.21.15.87:0/1511042889 shutdown_connections 2024-05-27T06:28:45.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.241+0000 7fa76ec00640 1 --2- 172.21.15.87:0/1511042889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa76806d500 0x7fa76815cfe0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:45.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.241+0000 7fa76ec00640 1 --2- 172.21.15.87:0/1511042889 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7680cbf90 0x7fa76806cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:45.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.241+0000 7fa76ec00640 1 -- 172.21.15.87:0/1511042889 >> 172.21.15.87:0/1511042889 conn(0x7fa7680b46b0 msgr2=0x7fa7680b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:45.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.241+0000 7fa76ec00640 1 -- 172.21.15.87:0/1511042889 shutdown_connections 2024-05-27T06:28:45.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.241+0000 7fa76ec00640 1 -- 172.21.15.87:0/1511042889 wait complete. 2024-05-27T06:28:45.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.245+0000 7fa76ec00640 1 Processor -- start 2024-05-27T06:28:45.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.245+0000 7fa76ec00640 1 -- start start 2024-05-27T06:28:45.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.245+0000 7fa76ec00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa76806d500 0x7fa7680c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:45.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.245+0000 7fa76ec00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7680cbf90 0x7fa7680cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:45.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.245+0000 7fa76ec00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa76815d520 0x7fa76814fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:45.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.245+0000 7fa76ec00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa76815e170 con 0x7fa76815d520 2024-05-27T06:28:45.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.245+0000 7fa76ec00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa76806caa0 con 0x7fa7680cbf90 2024-05-27T06:28:45.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.245+0000 7fa76ec00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa7680cc3a0 con 0x7fa76806d500 2024-05-27T06:28:45.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.245+0000 7fa76cc00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa76815d520 0x7fa76814fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:45.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.245+0000 7fa76cc00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa76815d520 0x7fa76814fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39782/0 (socket says 172.21.15.87:39782) 2024-05-27T06:28:45.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.245+0000 7fa76cc00640 1 -- 172.21.15.87:0/3707722570 learned_addr learned my addr 172.21.15.87:0/3707722570 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:45.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.245+0000 7fa767e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa76806d500 0x7fa7680c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:45.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.245+0000 7fa75f400640 1 --2- 172.21.15.87:0/3707722570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7680cbf90 0x7fa7680cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:45.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.245+0000 7fa76cc00640 1 -- 172.21.15.87:0/3707722570 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa76806d500 msgr2=0x7fa7680c6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:45.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.245+0000 7fa76cc00640 1 --2- 172.21.15.87:0/3707722570 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa76806d500 0x7fa7680c6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:45.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.245+0000 7fa76cc00640 1 -- 172.21.15.87:0/3707722570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7680cbf90 msgr2=0x7fa7680cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:45.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.245+0000 7fa76cc00640 1 --2- 172.21.15.87:0/3707722570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7680cbf90 0x7fa7680cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:45.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.245+0000 7fa76cc00640 1 -- 172.21.15.87:0/3707722570 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7680c4e70 con 0x7fa76815d520 2024-05-27T06:28:45.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.245+0000 7fa76cc00640 1 --2- 172.21.15.87:0/3707722570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa76815d520 0x7fa76814fbf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa76000c760 tx=0x7fa76000cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:45.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.245+0000 7fa764c00640 1 -- 172.21.15.87:0/3707722570 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa760003ba0 con 0x7fa76815d520 2024-05-27T06:28:45.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.245+0000 7fa764c00640 1 -- 172.21.15.87:0/3707722570 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa760003d60 con 0x7fa76815d520 2024-05-27T06:28:45.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.245+0000 7fa76ec00640 1 -- 172.21.15.87:0/3707722570 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7680c5370 con 0x7fa76815d520 2024-05-27T06:28:45.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.245+0000 7fa764c00640 1 -- 172.21.15.87:0/3707722570 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa760005310 con 0x7fa76815d520 2024-05-27T06:28:45.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.245+0000 7fa76ec00640 1 -- 172.21.15.87:0/3707722570 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7680c5930 con 0x7fa76815d520 2024-05-27T06:28:45.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.249+0000 7fa76ec00640 1 -- 172.21.15.87:0/3707722570 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa76806aa30 con 0x7fa76815d520 2024-05-27T06:28:45.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.249+0000 7fa764c00640 1 -- 172.21.15.87:0/3707722570 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa7600054b0 con 0x7fa76815d520 2024-05-27T06:28:45.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.249+0000 7fa764c00640 1 --2- 172.21.15.87:0/3707722570 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa74406f400 0x7fa744071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:45.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.249+0000 7fa764c00640 1 -- 172.21.15.87:0/3707722570 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fa76008f110 con 0x7fa76815d520 2024-05-27T06:28:45.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.249+0000 7fa767e00640 1 --2- 172.21.15.87:0/3707722570 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa74406f400 0x7fa744071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:45.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.249+0000 7fa767e00640 1 --2- 172.21.15.87:0/3707722570 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa74406f400 0x7fa744071910 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa758009ac0 tx=0x7fa758009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:45.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.253+0000 7fa764c00640 1 -- 172.21.15.87:0/3707722570 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa76815d930 con 0x7fa76815d520 2024-05-27T06:28:45.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.413+0000 7fa76ec00640 1 -- 172.21.15.87:0/3707722570 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7680c5100 con 0x7fa76815d520 2024-05-27T06:28:45.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.413+0000 7fa764c00640 1 -- 172.21.15.87:0/3707722570 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16930 (secure 0 0 0) 0x7fa76005b810 con 0x7fa76815d520 2024-05-27T06:28:45.412 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:45.412 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":38,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:28:42.665081+0000","last_up_change":"2024-05-27T06:27:25.988592+0000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T06:27:26.590191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-27T06:28:39.228886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-27T06:28:40.012993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6801","nonce":3674824716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6803","nonce":3674824716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6807","nonce":3674824716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6805","nonce":3674824716}]},"public_addr":"172.21.15.87:6801/3674824716","cluster_addr":"172.21.15.87:6803/3674824716","heartbeat_back_addr":"172.21.15.87:6807/3674824716","heartbeat_front_addr":"172.21.15.87:6805/3674824716","state":["exists","up"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6809","nonce":2443981288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6811","nonce":2443981288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6815","nonce":2443981288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6813","nonce":2443981288}]},"public_addr":"172.21.15.87:6809/2443981288","cluster_addr":"172.21.15.87:6811/2443981288","heartbeat_back_addr":"172.21.15.87:6815/2443981288","heartbeat_front_addr":"172.21.15.87:6813/2443981288","state":["exists","up"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6819","nonce":1441249238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6823","nonce":1441249238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6831","nonce":1441249238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6825","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6827","nonce":1441249238}]},"public_addr":"172.21.15.87:6819/1441249238","cluster_addr":"172.21.15.87:6823/1441249238","heartbeat_back_addr":"172.21.15.87:6831/1441249238","heartbeat_front_addr":"172.21.15.87:6827/1441249238","state":["exists","up"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6818","nonce":1173805234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6822","nonce":1173805234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6829","nonce":1173805234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6826","nonce":1173805234}]},"public_addr":"172.21.15.87:6818/1173805234","cluster_addr":"172.21.15.87:6822/1173805234","heartbeat_back_addr":"172.21.15.87:6829/1173805234","heartbeat_front_addr":"172.21.15.87:6826/1173805234","state":["exists","up"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6819","nonce":1551871079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6823","nonce":1551871079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6831","nonce":1551871079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6827","nonce":1551871079}]},"public_addr":"172.21.15.149:6819/1551871079","cluster_addr":"172.21.15.149:6823/1551871079","heartbeat_back_addr":"172.21.15.149:6831/1551871079","heartbeat_front_addr":"172.21.15.149:6827/1551871079","state":["exists","up"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6818","nonce":582864816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6822","nonce":582864816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6830","nonce":582864816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6826","nonce":582864816}]},"public_addr":"172.21.15.149:6818/582864816","cluster_addr":"172.21.15.149:6822/582864816","heartbeat_back_addr":"172.21.15.149:6830/582864816","heartbeat_front_addr":"172.21.15.149:6826/582864816","state":["exists","up"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6801","nonce":531351314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6803","nonce":531351314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6807","nonce":531351314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6805","nonce":531351314}]},"public_addr":"172.21.15.149:6801/531351314","cluster_addr":"172.21.15.149:6803/531351314","heartbeat_back_addr":"172.21.15.149:6807/531351314","heartbeat_front_addr":"172.21.15.149:6805/531351314","state":["exists","up"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6809","nonce":1171039913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6811","nonce":1171039913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6815","nonce":1171039913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6813","nonce":1171039913}]},"public_addr":"172.21.15.149:6809/1171039913","cluster_addr":"172.21.15.149:6811/1171039913","heartbeat_back_addr":"172.21.15.149:6815/1171039913","heartbeat_front_addr":"172.21.15.149:6813/1171039913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.589776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.819787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.767566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.683842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.038885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.120319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.687007+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.812832+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:28:45.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.417+0000 7fa76ec00640 1 -- 172.21.15.87:0/3707722570 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa74406f400 msgr2=0x7fa744071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:45.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.417+0000 7fa76ec00640 1 --2- 172.21.15.87:0/3707722570 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa74406f400 0x7fa744071910 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa758009ac0 tx=0x7fa758009190 comp rx=0 tx=0).stop 2024-05-27T06:28:45.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.417+0000 7fa76ec00640 1 -- 172.21.15.87:0/3707722570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa76815d520 msgr2=0x7fa76814fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:45.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.417+0000 7fa76ec00640 1 --2- 172.21.15.87:0/3707722570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa76815d520 0x7fa76814fbf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa76000c760 tx=0x7fa76000cb60 comp rx=0 tx=0).stop 2024-05-27T06:28:45.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.417+0000 7fa76ec00640 1 -- 172.21.15.87:0/3707722570 shutdown_connections 2024-05-27T06:28:45.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.417+0000 7fa76ec00640 1 --2- 172.21.15.87:0/3707722570 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa74406f400 0x7fa744071910 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:45.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.417+0000 7fa76ec00640 1 --2- 172.21.15.87:0/3707722570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa76815d520 0x7fa76814fbf0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:45.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.417+0000 7fa76ec00640 1 --2- 172.21.15.87:0/3707722570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7680cbf90 0x7fa7680cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:45.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.417+0000 7fa76ec00640 1 --2- 172.21.15.87:0/3707722570 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa76806d500 0x7fa7680c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:45.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.417+0000 7fa76ec00640 1 -- 172.21.15.87:0/3707722570 >> 172.21.15.87:0/3707722570 conn(0x7fa7680b46b0 msgr2=0x7fa7680733e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:45.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.417+0000 7fa76ec00640 1 -- 172.21.15.87:0/3707722570 shutdown_connections 2024-05-27T06:28:45.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.417+0000 7fa76ec00640 1 -- 172.21.15.87:0/3707722570 wait complete. 2024-05-27T06:28:45.434 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-27T06:28:45.434 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T06:28:45.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.581+0000 7f01eb800640 1 Processor -- start 2024-05-27T06:28:45.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.581+0000 7f01eb800640 1 -- start start 2024-05-27T06:28:45.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.585+0000 7f01eb800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f01e40d1740 0x7f01e40d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:45.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.585+0000 7f01eb800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01e40d2090 con 0x7f01e40cbf90 2024-05-27T06:28:45.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.585+0000 7f01eb800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01e415dbb0 con 0x7f01e415cfe0 2024-05-27T06:28:45.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.585+0000 7f01eb800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f01e415de90 con 0x7f01e40d1740 2024-05-27T06:28:45.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.585+0000 7f01e8e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f01e40cbf90 0x7f01e406cfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:55110/0 (socket says 172.21.15.87:55110) 2024-05-27T06:28:45.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.585+0000 7f01e8e00640 1 -- 172.21.15.87:0/4030042712 learned_addr learned my addr 172.21.15.87:0/4030042712 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:45.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.585+0000 7f01e9800640 1 --2- 172.21.15.87:0/4030042712 >> v2:172.21.15.149:3300/0 conn(0x7f01e40d1740 0x7f01e40d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:45.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.585+0000 7f01e3400640 1 -- 172.21.15.87:0/4030042712 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4128736319 0 0) 0x7f01d8001120 con 0x7f01e40cbf90 2024-05-27T06:28:45.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.585+0000 7f01e3400640 1 -- 172.21.15.87:0/4030042712 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01cc003530 con 0x7f01e40cbf90 2024-05-27T06:28:45.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.585+0000 7f01e9800640 1 -- 172.21.15.87:0/4030042712 >> v1:172.21.15.149:6789/0 conn(0x7f01e415cfe0 legacy=0x7f01e415d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:45.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.585+0000 7f01e9800640 1 -- 172.21.15.87:0/4030042712 >> v1:172.21.15.87:6789/0 conn(0x7f01e40cbf90 legacy=0x7f01e406cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:45.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.585+0000 7f01e9800640 1 -- 172.21.15.87:0/4030042712 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e406c7c0 con 0x7f01e40d1740 2024-05-27T06:28:45.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.589+0000 7f01e9800640 1 --2- 172.21.15.87:0/4030042712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01e40d1740 0x7f01e40d1b50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f01dc009d90 tx=0x7f01dc01f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75039a5bab093138 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:45.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.589+0000 7f01e3400640 1 -- 172.21.15.87:0/4030042712 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01dc0b4070 con 0x7f01e40d1740 2024-05-27T06:28:45.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.589+0000 7f01e3400640 1 -- 172.21.15.87:0/4030042712 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01dc0af600 con 0x7f01e40d1740 2024-05-27T06:28:45.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.589+0000 7f01e3400640 1 -- 172.21.15.87:0/4030042712 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01dc0af9d0 con 0x7f01e40d1740 2024-05-27T06:28:45.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.589+0000 7f01eb800640 1 -- 172.21.15.87:0/4030042712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01e40d1740 msgr2=0x7f01e40d1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:45.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.589+0000 7f01eb800640 1 --2- 172.21.15.87:0/4030042712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01e40d1740 0x7f01e40d1b50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f01dc009d90 tx=0x7f01dc01f150 comp rx=0 tx=0).stop 2024-05-27T06:28:45.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.589+0000 7f01eb800640 1 -- 172.21.15.87:0/4030042712 shutdown_connections 2024-05-27T06:28:45.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.589+0000 7f01eb800640 1 --2- 172.21.15.87:0/4030042712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01e40d1740 0x7f01e40d1b50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:45.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.589+0000 7f01eb800640 1 -- 172.21.15.87:0/4030042712 >> 172.21.15.87:0/4030042712 conn(0x7f01e40b46b0 msgr2=0x7f01e40b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:45.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.589+0000 7f01eb800640 1 -- 172.21.15.87:0/4030042712 shutdown_connections 2024-05-27T06:28:45.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.589+0000 7f01eb800640 1 -- 172.21.15.87:0/4030042712 wait complete. 2024-05-27T06:28:45.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.593+0000 7f01eb800640 1 Processor -- start 2024-05-27T06:28:45.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.593+0000 7f01eb800640 1 -- start start 2024-05-27T06:28:45.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.593+0000 7f01eb800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01e40cbf90 0x7f01e41f6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:45.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.593+0000 7f01eb800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01e40d1740 0x7f01e40ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:45.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.593+0000 7f01eb800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01e415cfe0 0x7f01e40b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:45.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.593+0000 7f01eb800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f01e40cc3a0 con 0x7f01e40cbf90 2024-05-27T06:28:45.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.593+0000 7f01eb800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f01e415e170 con 0x7f01e415cfe0 2024-05-27T06:28:45.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.593+0000 7f01eb800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f01e406ec50 con 0x7f01e40d1740 2024-05-27T06:28:45.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.593+0000 7f01e8e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01e40cbf90 0x7f01e41f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:45.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.593+0000 7f01e8e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01e40cbf90 0x7f01e41f6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39798/0 (socket says 172.21.15.87:39798) 2024-05-27T06:28:45.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.593+0000 7f01e8e00640 1 -- 172.21.15.87:0/1226789215 learned_addr learned my addr 172.21.15.87:0/1226789215 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:45.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.593+0000 7f01e3e00640 1 --2- 172.21.15.87:0/1226789215 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01e40d1740 0x7f01e40ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:45.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.593+0000 7f01e9800640 1 --2- 172.21.15.87:0/1226789215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01e415cfe0 0x7f01e40b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:45.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.593+0000 7f01e8e00640 1 -- 172.21.15.87:0/1226789215 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01e40d1740 msgr2=0x7f01e40ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:45.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.593+0000 7f01e8e00640 1 --2- 172.21.15.87:0/1226789215 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01e40d1740 0x7f01e40ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:45.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.593+0000 7f01e8e00640 1 -- 172.21.15.87:0/1226789215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01e415cfe0 msgr2=0x7f01e40b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:45.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.593+0000 7f01e8e00640 1 --2- 172.21.15.87:0/1226789215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01e415cfe0 0x7f01e40b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:45.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.593+0000 7f01e8e00640 1 -- 172.21.15.87:0/1226789215 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e4154da0 con 0x7f01e40cbf90 2024-05-27T06:28:45.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.593+0000 7f01e8e00640 1 --2- 172.21.15.87:0/1226789215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01e40cbf90 0x7f01e41f6300 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f01d800c730 tx=0x7f01d800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:45.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.593+0000 7f01e0c00640 1 -- 172.21.15.87:0/1226789215 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d8017070 con 0x7f01e40cbf90 2024-05-27T06:28:45.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.593+0000 7f01e0c00640 1 -- 172.21.15.87:0/1226789215 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01d8001d40 con 0x7f01e40cbf90 2024-05-27T06:28:45.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.593+0000 7f01eb800640 1 -- 172.21.15.87:0/1226789215 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01e41578a0 con 0x7f01e40cbf90 2024-05-27T06:28:45.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.593+0000 7f01e0c00640 1 -- 172.21.15.87:0/1226789215 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d8005ce0 con 0x7f01e40cbf90 2024-05-27T06:28:45.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.597+0000 7f01eb800640 1 -- 172.21.15.87:0/1226789215 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01e4155360 con 0x7f01e40cbf90 2024-05-27T06:28:45.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.597+0000 7f01eb800640 1 -- 172.21.15.87:0/1226789215 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01e406aa30 con 0x7f01e40cbf90 2024-05-27T06:28:45.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.597+0000 7f01e0c00640 1 -- 172.21.15.87:0/1226789215 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f01d801a070 con 0x7f01e40cbf90 2024-05-27T06:28:45.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.597+0000 7f01e0c00640 1 --2- 172.21.15.87:0/1226789215 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f01c406f430 0x7f01c4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:45.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.597+0000 7f01e0c00640 1 -- 172.21.15.87:0/1226789215 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f01d808ead0 con 0x7f01e40cbf90 2024-05-27T06:28:45.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.597+0000 7f01e3e00640 1 --2- 172.21.15.87:0/1226789215 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f01c406f430 0x7f01c4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:45.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.601+0000 7f01e3e00640 1 --2- 172.21.15.87:0/1226789215 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f01c406f430 0x7f01c4071940 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f01e4157c90 tx=0x7f01d0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:45.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.601+0000 7f01e0c00640 1 -- 172.21.15.87:0/1226789215 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f01d8021020 con 0x7f01e40cbf90 2024-05-27T06:28:45.623 INFO:tasks.ceph.mds.a.smithi087.stderr:2024-05-27T06:28:45.625+0000 7ff3c6600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-27T06:28:45.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.757+0000 7f01eb800640 1 -- 172.21.15.87:0/1226789215 --> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f01e40cca70 con 0x7f01c406f430 2024-05-27T06:28:45.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.765+0000 7f01e0c00640 1 -- 172.21.15.87:0/1226789215 <== mgr.4111 v2:172.21.15.87:6832/2724754260 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246627 (secure 0 0 0) 0x7f01e40cca70 con 0x7f01c406f430 2024-05-27T06:28:45.764 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:45.766 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-27T06:28:45.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.765+0000 7f01eb800640 1 -- 172.21.15.87:0/1226789215 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f01c406f430 msgr2=0x7f01c4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:45.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.765+0000 7f01eb800640 1 --2- 172.21.15.87:0/1226789215 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f01c406f430 0x7f01c4071940 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f01e4157c90 tx=0x7f01d0009040 comp rx=0 tx=0).stop 2024-05-27T06:28:45.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.765+0000 7f01eb800640 1 -- 172.21.15.87:0/1226789215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01e40cbf90 msgr2=0x7f01e41f6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:45.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.765+0000 7f01eb800640 1 --2- 172.21.15.87:0/1226789215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01e40cbf90 0x7f01e41f6300 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f01d800c730 tx=0x7f01d800cbf0 comp rx=0 tx=0).stop 2024-05-27T06:28:45.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.765+0000 7f01eb800640 1 -- 172.21.15.87:0/1226789215 shutdown_connections 2024-05-27T06:28:45.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.765+0000 7f01eb800640 1 --2- 172.21.15.87:0/1226789215 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f01c406f430 0x7f01c4071940 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:45.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.765+0000 7f01eb800640 1 --2- 172.21.15.87:0/1226789215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01e415cfe0 0x7f01e40b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:45.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.765+0000 7f01eb800640 1 --2- 172.21.15.87:0/1226789215 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01e40d1740 0x7f01e40ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:45.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.765+0000 7f01eb800640 1 --2- 172.21.15.87:0/1226789215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01e40cbf90 0x7f01e41f6300 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:45.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.765+0000 7f01eb800640 1 -- 172.21.15.87:0/1226789215 >> 172.21.15.87:0/1226789215 conn(0x7f01e40b46b0 msgr2=0x7f01e40cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:45.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.769+0000 7f01eb800640 1 -- 172.21.15.87:0/1226789215 shutdown_connections 2024-05-27T06:28:45.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.769+0000 7f01eb800640 1 -- 172.21.15.87:0/1226789215 wait complete. 2024-05-27T06:28:45.784 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-05-27T06:28:44.582103+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220584,"kb_used_data":4392,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754136,"statfs":{"total":773094113280,"available":772868235264,"internally_reserved":0,"allocated":4497408,"data_stored":2591384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.937151"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666012+0000","last_change":"2024-05-27T06:28:40.666012+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666012+0000","last_undegraded":"2024-05-27T06:28:40.666012+0000","last_fullsized":"2024-05-27T06:28:40.666012+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.671554+0000","last_change":"2024-05-27T06:28:40.671554+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.671554+0000","last_undegraded":"2024-05-27T06:28:40.671554+0000","last_fullsized":"2024-05-27T06:28:40.671554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664525+0000","last_change":"2024-05-27T06:28:40.664525+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664525+0000","last_undegraded":"2024-05-27T06:28:40.664525+0000","last_fullsized":"2024-05-27T06:28:40.664525+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.659111+0000","last_change":"2024-05-27T06:28:40.659111+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.659111+0000","last_undegraded":"2024-05-27T06:28:40.659111+0000","last_fullsized":"2024-05-27T06:28:40.659111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.659584+0000","last_change":"2024-05-27T06:28:40.659584+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.659584+0000","last_undegraded":"2024-05-27T06:28:40.659584+0000","last_fullsized":"2024-05-27T06:28:40.659584+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.657488+0000","last_change":"2024-05-27T06:28:40.657488+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.657488+0000","last_undegraded":"2024-05-27T06:28:40.657488+0000","last_fullsized":"2024-05-27T06:28:40.657488+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.667129+0000","last_change":"2024-05-27T06:28:40.667129+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.667129+0000","last_undegraded":"2024-05-27T06:28:40.667129+0000","last_fullsized":"2024-05-27T06:28:40.667129+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.662161+0000","last_change":"2024-05-27T06:28:40.662161+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.662161+0000","last_undegraded":"2024-05-27T06:28:40.662161+0000","last_fullsized":"2024-05-27T06:28:40.662161+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664576+0000","last_change":"2024-05-27T06:28:40.664576+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664576+0000","last_undegraded":"2024-05-27T06:28:40.664576+0000","last_fullsized":"2024-05-27T06:28:40.664576+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.669507+0000","last_change":"2024-05-27T06:28:40.669507+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.669507+0000","last_undegraded":"2024-05-27T06:28:40.669507+0000","last_fullsized":"2024-05-27T06:28:40.669507+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.665538+0000","last_change":"2024-05-27T06:28:40.665538+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.665538+0000","last_undegraded":"2024-05-27T06:28:40.665538+0000","last_fullsized":"2024-05-27T06:28:40.665538+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664473+0000","last_change":"2024-05-27T06:28:40.664473+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664473+0000","last_undegraded":"2024-05-27T06:28:40.664473+0000","last_fullsized":"2024-05-27T06:28:40.664473+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.667541+0000","last_change":"2024-05-27T06:28:40.667541+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.667541+0000","last_undegraded":"2024-05-27T06:28:40.667541+0000","last_fullsized":"2024-05-27T06:28:40.667541+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.662387+0000","last_change":"2024-05-27T06:28:40.662387+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.662387+0000","last_undegraded":"2024-05-27T06:28:40.662387+0000","last_fullsized":"2024-05-27T06:28:40.662387+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666106+0000","last_change":"2024-05-27T06:28:40.666106+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666106+0000","last_undegraded":"2024-05-27T06:28:40.666106+0000","last_fullsized":"2024-05-27T06:28:40.666106+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664652+0000","last_change":"2024-05-27T06:28:40.664652+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664652+0000","last_undegraded":"2024-05-27T06:28:40.664652+0000","last_fullsized":"2024-05-27T06:28:40.664652+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.663563+0000","last_change":"2024-05-27T06:28:40.663563+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.663563+0000","last_undegraded":"2024-05-27T06:28:40.663563+0000","last_fullsized":"2024-05-27T06:28:40.663563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.656139+0000","last_change":"2024-05-27T06:28:40.656139+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.656139+0000","last_undegraded":"2024-05-27T06:28:40.656139+0000","last_fullsized":"2024-05-27T06:28:40.656139+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.658793+0000","last_change":"2024-05-27T06:28:40.658793+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.658793+0000","last_undegraded":"2024-05-27T06:28:40.658793+0000","last_fullsized":"2024-05-27T06:28:40.658793+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.655144+0000","last_change":"2024-05-27T06:28:40.655144+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.655144+0000","last_undegraded":"2024-05-27T06:28:40.655144+0000","last_fullsized":"2024-05-27T06:28:40.655144+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664913+0000","last_change":"2024-05-27T06:28:40.664913+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664913+0000","last_undegraded":"2024-05-27T06:28:40.664913+0000","last_fullsized":"2024-05-27T06:28:40.664913+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.660387+0000","last_change":"2024-05-27T06:28:40.660387+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.660387+0000","last_undegraded":"2024-05-27T06:28:40.660387+0000","last_fullsized":"2024-05-27T06:28:40.660387+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.662122+0000","last_change":"2024-05-27T06:28:40.662122+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.662122+0000","last_undegraded":"2024-05-27T06:28:40.662122+0000","last_fullsized":"2024-05-27T06:28:40.662122+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.657911+0000","last_change":"2024-05-27T06:28:40.657911+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.657911+0000","last_undegraded":"2024-05-27T06:28:40.657911+0000","last_fullsized":"2024-05-27T06:28:40.657911+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.656715+0000","last_change":"2024-05-27T06:28:40.656715+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.656715+0000","last_undegraded":"2024-05-27T06:28:40.656715+0000","last_fullsized":"2024-05-27T06:28:40.656715+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.660450+0000","last_change":"2024-05-27T06:28:40.660450+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.660450+0000","last_undegraded":"2024-05-27T06:28:40.660450+0000","last_fullsized":"2024-05-27T06:28:40.660450+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.655779+0000","last_change":"2024-05-27T06:28:40.655779+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.655779+0000","last_undegraded":"2024-05-27T06:28:40.655779+0000","last_fullsized":"2024-05-27T06:28:40.655779+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666097+0000","last_change":"2024-05-27T06:28:40.666097+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666097+0000","last_undegraded":"2024-05-27T06:28:40.666097+0000","last_fullsized":"2024-05-27T06:28:40.666097+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.655258+0000","last_change":"2024-05-27T06:28:40.655258+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.655258+0000","last_undegraded":"2024-05-27T06:28:40.655258+0000","last_fullsized":"2024-05-27T06:28:40.655258+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.655515+0000","last_change":"2024-05-27T06:28:40.655515+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.655515+0000","last_undegraded":"2024-05-27T06:28:40.655515+0000","last_fullsized":"2024-05-27T06:28:40.655515+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661353+0000","last_change":"2024-05-27T06:28:40.661353+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661353+0000","last_undegraded":"2024-05-27T06:28:40.661353+0000","last_fullsized":"2024-05-27T06:28:40.661353+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.657381+0000","last_change":"2024-05-27T06:28:40.657381+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.657381+0000","last_undegraded":"2024-05-27T06:28:40.657381+0000","last_fullsized":"2024-05-27T06:28:40.657381+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661094+0000","last_change":"2024-05-27T06:28:40.661094+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661094+0000","last_undegraded":"2024-05-27T06:28:40.661094+0000","last_fullsized":"2024-05-27T06:28:40.661094+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678349+0000","last_change":"2024-05-27T06:28:40.669695+0000","last_active":"2024-05-27T06:28:40.678349+0000","last_peered":"2024-05-27T06:28:40.678349+0000","last_clean":"2024-05-27T06:28:40.678349+0000","last_became_active":"2024-05-27T06:28:40.669333+0000","last_became_peered":"2024-05-27T06:28:40.669333+0000","last_unstale":"2024-05-27T06:28:40.678349+0000","last_undegraded":"2024-05-27T06:28:40.678349+0000","last_fullsized":"2024-05-27T06:28:40.678349+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:26:04.076545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.658480+0000","last_change":"2024-05-27T06:28:40.658480+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.658480+0000","last_undegraded":"2024-05-27T06:28:40.658480+0000","last_fullsized":"2024-05-27T06:28:40.658480+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678911+0000","last_change":"2024-05-27T06:28:40.673139+0000","last_active":"2024-05-27T06:28:40.678911+0000","last_peered":"2024-05-27T06:28:40.678911+0000","last_clean":"2024-05-27T06:28:40.678911+0000","last_became_active":"2024-05-27T06:28:40.672841+0000","last_became_peered":"2024-05-27T06:28:40.672841+0000","last_unstale":"2024-05-27T06:28:40.678911+0000","last_undegraded":"2024-05-27T06:28:40.678911+0000","last_fullsized":"2024-05-27T06:28:40.678911+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T06:56:04.095609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.658308+0000","last_change":"2024-05-27T06:28:40.658308+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.658308+0000","last_undegraded":"2024-05-27T06:28:40.658308+0000","last_fullsized":"2024-05-27T06:28:40.658308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678553+0000","last_change":"2024-05-27T06:28:40.672478+0000","last_active":"2024-05-27T06:28:40.678553+0000","last_peered":"2024-05-27T06:28:40.678553+0000","last_clean":"2024-05-27T06:28:40.678553+0000","last_became_active":"2024-05-27T06:28:40.672172+0000","last_became_peered":"2024-05-27T06:28:40.672172+0000","last_unstale":"2024-05-27T06:28:40.678553+0000","last_undegraded":"2024-05-27T06:28:40.678553+0000","last_fullsized":"2024-05-27T06:28:40.678553+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:13:59.179683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666498+0000","last_change":"2024-05-27T06:28:40.666498+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666498+0000","last_undegraded":"2024-05-27T06:28:40.666498+0000","last_fullsized":"2024-05-27T06:28:40.666498+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.685173+0000","last_change":"2024-05-27T06:28:40.677480+0000","last_active":"2024-05-27T06:28:40.685173+0000","last_peered":"2024-05-27T06:28:40.685173+0000","last_clean":"2024-05-27T06:28:40.685173+0000","last_became_active":"2024-05-27T06:28:40.677186+0000","last_became_peered":"2024-05-27T06:28:40.677186+0000","last_unstale":"2024-05-27T06:28:40.685173+0000","last_undegraded":"2024-05-27T06:28:40.685173+0000","last_fullsized":"2024-05-27T06:28:40.685173+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:16:49.937382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664434+0000","last_change":"2024-05-27T06:28:40.664434+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664434+0000","last_undegraded":"2024-05-27T06:28:40.664434+0000","last_fullsized":"2024-05-27T06:28:40.664434+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.682962+0000","last_change":"2024-05-27T06:28:40.676566+0000","last_active":"2024-05-27T06:28:40.682962+0000","last_peered":"2024-05-27T06:28:40.682962+0000","last_clean":"2024-05-27T06:28:40.682962+0000","last_became_active":"2024-05-27T06:28:40.676114+0000","last_became_peered":"2024-05-27T06:28:40.676114+0000","last_unstale":"2024-05-27T06:28:40.682962+0000","last_undegraded":"2024-05-27T06:28:40.682962+0000","last_fullsized":"2024-05-27T06:28:40.682962+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:04:39.297606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.665726+0000","last_change":"2024-05-27T06:28:40.665726+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.665726+0000","last_undegraded":"2024-05-27T06:28:40.665726+0000","last_fullsized":"2024-05-27T06:28:40.665726+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.685518+0000","last_change":"2024-05-27T06:28:40.681743+0000","last_active":"2024-05-27T06:28:40.685518+0000","last_peered":"2024-05-27T06:28:40.685518+0000","last_clean":"2024-05-27T06:28:40.685518+0000","last_became_active":"2024-05-27T06:28:40.681385+0000","last_became_peered":"2024-05-27T06:28:40.681385+0000","last_unstale":"2024-05-27T06:28:40.685518+0000","last_undegraded":"2024-05-27T06:28:40.685518+0000","last_fullsized":"2024-05-27T06:28:40.685518+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:04:39.297606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661324+0000","last_change":"2024-05-27T06:28:40.661324+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661324+0000","last_undegraded":"2024-05-27T06:28:40.661324+0000","last_fullsized":"2024-05-27T06:28:40.661324+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678962+0000","last_change":"2024-05-27T06:28:40.673602+0000","last_active":"2024-05-27T06:28:40.678962+0000","last_peered":"2024-05-27T06:28:40.678962+0000","last_clean":"2024-05-27T06:28:40.678962+0000","last_became_active":"2024-05-27T06:28:40.673279+0000","last_became_peered":"2024-05-27T06:28:40.673279+0000","last_unstale":"2024-05-27T06:28:40.678962+0000","last_undegraded":"2024-05-27T06:28:40.678962+0000","last_fullsized":"2024-05-27T06:28:40.678962+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:18:47.874305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.665064+0000","last_change":"2024-05-27T06:28:40.665064+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.665064+0000","last_undegraded":"2024-05-27T06:28:40.665064+0000","last_fullsized":"2024-05-27T06:28:40.665064+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.669177+0000","last_change":"2024-05-27T06:28:40.667506+0000","last_active":"2024-05-27T06:28:40.669177+0000","last_peered":"2024-05-27T06:28:40.669177+0000","last_clean":"2024-05-27T06:28:40.669177+0000","last_became_active":"2024-05-27T06:28:40.666805+0000","last_became_peered":"2024-05-27T06:28:40.666805+0000","last_unstale":"2024-05-27T06:28:40.669177+0000","last_undegraded":"2024-05-27T06:28:40.669177+0000","last_fullsized":"2024-05-27T06:28:40.669177+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:17:08.471701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.657337+0000","last_change":"2024-05-27T06:28:40.657337+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.657337+0000","last_undegraded":"2024-05-27T06:28:40.657337+0000","last_fullsized":"2024-05-27T06:28:40.657337+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.681300+0000","last_change":"2024-05-27T06:28:40.679319+0000","last_active":"2024-05-27T06:28:40.681300+0000","last_peered":"2024-05-27T06:28:40.681300+0000","last_clean":"2024-05-27T06:28:40.681300+0000","last_became_active":"2024-05-27T06:28:40.678970+0000","last_became_peered":"2024-05-27T06:28:40.678970+0000","last_unstale":"2024-05-27T06:28:40.681300+0000","last_undegraded":"2024-05-27T06:28:40.681300+0000","last_fullsized":"2024-05-27T06:28:40.681300+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:59:06.313098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.662678+0000","last_change":"2024-05-27T06:28:40.662678+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.662678+0000","last_undegraded":"2024-05-27T06:28:40.662678+0000","last_fullsized":"2024-05-27T06:28:40.662678+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.685252+0000","last_change":"2024-05-27T06:28:40.680595+0000","last_active":"2024-05-27T06:28:40.685252+0000","last_peered":"2024-05-27T06:28:40.685252+0000","last_clean":"2024-05-27T06:28:40.685252+0000","last_became_active":"2024-05-27T06:28:40.680213+0000","last_became_peered":"2024-05-27T06:28:40.680213+0000","last_unstale":"2024-05-27T06:28:40.685252+0000","last_undegraded":"2024-05-27T06:28:40.685252+0000","last_fullsized":"2024-05-27T06:28:40.685252+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:12:15.418800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.659359+0000","last_change":"2024-05-27T06:28:40.659359+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.659359+0000","last_undegraded":"2024-05-27T06:28:40.659359+0000","last_fullsized":"2024-05-27T06:28:40.659359+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.676705+0000","last_change":"2024-05-27T06:28:40.674198+0000","last_active":"2024-05-27T06:28:40.676705+0000","last_peered":"2024-05-27T06:28:40.676705+0000","last_clean":"2024-05-27T06:28:40.676705+0000","last_became_active":"2024-05-27T06:28:40.673825+0000","last_became_peered":"2024-05-27T06:28:40.673825+0000","last_unstale":"2024-05-27T06:28:40.676705+0000","last_undegraded":"2024-05-27T06:28:40.676705+0000","last_fullsized":"2024-05-27T06:28:40.676705+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T06:56:04.095609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.658786+0000","last_change":"2024-05-27T06:28:40.658786+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.658786+0000","last_undegraded":"2024-05-27T06:28:40.658786+0000","last_fullsized":"2024-05-27T06:28:40.658786+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.680398+0000","last_change":"2024-05-27T06:28:40.677467+0000","last_active":"2024-05-27T06:28:40.680398+0000","last_peered":"2024-05-27T06:28:40.680398+0000","last_clean":"2024-05-27T06:28:40.680398+0000","last_became_active":"2024-05-27T06:28:40.677128+0000","last_became_peered":"2024-05-27T06:28:40.677128+0000","last_unstale":"2024-05-27T06:28:40.680398+0000","last_undegraded":"2024-05-27T06:28:40.680398+0000","last_fullsized":"2024-05-27T06:28:40.680398+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:52:37.091584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.663954+0000","last_change":"2024-05-27T06:28:40.663954+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.663954+0000","last_undegraded":"2024-05-27T06:28:40.663954+0000","last_fullsized":"2024-05-27T06:28:40.663954+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.682084+0000","last_change":"2024-05-27T06:28:40.681038+0000","last_active":"2024-05-27T06:28:40.682084+0000","last_peered":"2024-05-27T06:28:40.682084+0000","last_clean":"2024-05-27T06:28:40.682084+0000","last_became_active":"2024-05-27T06:28:40.680758+0000","last_became_peered":"2024-05-27T06:28:40.680758+0000","last_unstale":"2024-05-27T06:28:40.682084+0000","last_undegraded":"2024-05-27T06:28:40.682084+0000","last_fullsized":"2024-05-27T06:28:40.682084+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T06:54:59.433478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.663479+0000","last_change":"2024-05-27T06:28:40.663479+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.663479+0000","last_undegraded":"2024-05-27T06:28:40.663479+0000","last_fullsized":"2024-05-27T06:28:40.663479+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678818+0000","last_change":"2024-05-27T06:28:40.673610+0000","last_active":"2024-05-27T06:28:40.678818+0000","last_peered":"2024-05-27T06:28:40.678818+0000","last_clean":"2024-05-27T06:28:40.678818+0000","last_became_active":"2024-05-27T06:28:40.673294+0000","last_became_peered":"2024-05-27T06:28:40.673294+0000","last_unstale":"2024-05-27T06:28:40.678818+0000","last_undegraded":"2024-05-27T06:28:40.678818+0000","last_fullsized":"2024-05-27T06:28:40.678818+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T06:56:04.095609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.662436+0000","last_change":"2024-05-27T06:28:40.662436+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.662436+0000","last_undegraded":"2024-05-27T06:28:40.662436+0000","last_fullsized":"2024-05-27T06:28:40.662436+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678457+0000","last_change":"2024-05-27T06:28:40.672146+0000","last_active":"2024-05-27T06:28:40.678457+0000","last_peered":"2024-05-27T06:28:40.678457+0000","last_clean":"2024-05-27T06:28:40.678457+0000","last_became_active":"2024-05-27T06:28:40.671021+0000","last_became_peered":"2024-05-27T06:28:40.671021+0000","last_unstale":"2024-05-27T06:28:40.678457+0000","last_undegraded":"2024-05-27T06:28:40.678457+0000","last_fullsized":"2024-05-27T06:28:40.678457+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:00:20.482241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664559+0000","last_change":"2024-05-27T06:28:40.664559+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664559+0000","last_undegraded":"2024-05-27T06:28:40.664559+0000","last_fullsized":"2024-05-27T06:28:40.664559+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.685487+0000","last_change":"2024-05-27T06:28:40.681584+0000","last_active":"2024-05-27T06:28:40.685487+0000","last_peered":"2024-05-27T06:28:40.685487+0000","last_clean":"2024-05-27T06:28:40.685487+0000","last_became_active":"2024-05-27T06:28:40.681279+0000","last_became_peered":"2024-05-27T06:28:40.681279+0000","last_unstale":"2024-05-27T06:28:40.685487+0000","last_undegraded":"2024-05-27T06:28:40.685487+0000","last_fullsized":"2024-05-27T06:28:40.685487+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T06:56:04.095609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.667742+0000","last_change":"2024-05-27T06:28:40.667742+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.667742+0000","last_undegraded":"2024-05-27T06:28:40.667742+0000","last_fullsized":"2024-05-27T06:28:40.667742+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.682990+0000","last_change":"2024-05-27T06:28:40.679172+0000","last_active":"2024-05-27T06:28:40.682990+0000","last_peered":"2024-05-27T06:28:40.682990+0000","last_clean":"2024-05-27T06:28:40.682990+0000","last_became_active":"2024-05-27T06:28:40.678786+0000","last_became_peered":"2024-05-27T06:28:40.678786+0000","last_unstale":"2024-05-27T06:28:40.682990+0000","last_undegraded":"2024-05-27T06:28:40.682990+0000","last_fullsized":"2024-05-27T06:28:40.682990+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:55:20.077082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664987+0000","last_change":"2024-05-27T06:28:40.664987+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664987+0000","last_undegraded":"2024-05-27T06:28:40.664987+0000","last_fullsized":"2024-05-27T06:28:40.664987+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.685154+0000","last_change":"2024-05-27T06:28:40.677177+0000","last_active":"2024-05-27T06:28:40.685154+0000","last_peered":"2024-05-27T06:28:40.685154+0000","last_clean":"2024-05-27T06:28:40.685154+0000","last_became_active":"2024-05-27T06:28:40.676640+0000","last_became_peered":"2024-05-27T06:28:40.676640+0000","last_unstale":"2024-05-27T06:28:40.685154+0000","last_undegraded":"2024-05-27T06:28:40.685154+0000","last_fullsized":"2024-05-27T06:28:40.685154+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:00:20.482241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.658945+0000","last_change":"2024-05-27T06:28:40.658945+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.658945+0000","last_undegraded":"2024-05-27T06:28:40.658945+0000","last_fullsized":"2024-05-27T06:28:40.658945+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.680529+0000","last_change":"2024-05-27T06:28:40.675405+0000","last_active":"2024-05-27T06:28:40.680529+0000","last_peered":"2024-05-27T06:28:40.680529+0000","last_clean":"2024-05-27T06:28:40.680529+0000","last_became_active":"2024-05-27T06:28:40.675004+0000","last_became_peered":"2024-05-27T06:28:40.675004+0000","last_unstale":"2024-05-27T06:28:40.680529+0000","last_undegraded":"2024-05-27T06:28:40.680529+0000","last_fullsized":"2024-05-27T06:28:40.680529+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:01:06.950501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.657363+0000","last_change":"2024-05-27T06:28:40.657363+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.657363+0000","last_undegraded":"2024-05-27T06:28:40.657363+0000","last_fullsized":"2024-05-27T06:28:40.657363+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.677993+0000","last_change":"2024-05-27T06:28:40.670977+0000","last_active":"2024-05-27T06:28:40.677993+0000","last_peered":"2024-05-27T06:28:40.677993+0000","last_clean":"2024-05-27T06:28:40.677993+0000","last_became_active":"2024-05-27T06:28:40.670723+0000","last_became_peered":"2024-05-27T06:28:40.670723+0000","last_unstale":"2024-05-27T06:28:40.677993+0000","last_undegraded":"2024-05-27T06:28:40.677993+0000","last_fullsized":"2024-05-27T06:28:40.677993+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:58:11.217383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661895+0000","last_change":"2024-05-27T06:28:40.661895+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661895+0000","last_undegraded":"2024-05-27T06:28:40.661895+0000","last_fullsized":"2024-05-27T06:28:40.661895+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.662351+0000","last_change":"2024-05-27T06:28:40.661275+0000","last_active":"2024-05-27T06:28:40.662351+0000","last_peered":"2024-05-27T06:28:40.662351+0000","last_clean":"2024-05-27T06:28:40.662351+0000","last_became_active":"2024-05-27T06:28:40.661013+0000","last_became_peered":"2024-05-27T06:28:40.661013+0000","last_unstale":"2024-05-27T06:28:40.662351+0000","last_undegraded":"2024-05-27T06:28:40.662351+0000","last_fullsized":"2024-05-27T06:28:40.662351+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:22:56.239970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661597+0000","last_change":"2024-05-27T06:28:40.661597+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661597+0000","last_undegraded":"2024-05-27T06:28:40.661597+0000","last_fullsized":"2024-05-27T06:28:40.661597+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.675384+0000","last_change":"2024-05-27T06:28:40.672102+0000","last_active":"2024-05-27T06:28:40.675384+0000","last_peered":"2024-05-27T06:28:40.675384+0000","last_clean":"2024-05-27T06:28:40.675384+0000","last_became_active":"2024-05-27T06:28:40.671774+0000","last_became_peered":"2024-05-27T06:28:40.671774+0000","last_unstale":"2024-05-27T06:28:40.675384+0000","last_undegraded":"2024-05-27T06:28:40.675384+0000","last_fullsized":"2024-05-27T06:28:40.675384+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:40:43.723380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666694+0000","last_change":"2024-05-27T06:28:40.666694+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666694+0000","last_undegraded":"2024-05-27T06:28:40.666694+0000","last_fullsized":"2024-05-27T06:28:40.666694+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.682769+0000","last_change":"2024-05-27T06:28:40.679403+0000","last_active":"2024-05-27T06:28:40.682769+0000","last_peered":"2024-05-27T06:28:40.682769+0000","last_clean":"2024-05-27T06:28:40.682769+0000","last_became_active":"2024-05-27T06:28:40.679101+0000","last_became_peered":"2024-05-27T06:28:40.679101+0000","last_unstale":"2024-05-27T06:28:40.682769+0000","last_undegraded":"2024-05-27T06:28:40.682769+0000","last_fullsized":"2024-05-27T06:28:40.682769+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:18:47.874305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664021+0000","last_change":"2024-05-27T06:28:40.664021+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664021+0000","last_undegraded":"2024-05-27T06:28:40.664021+0000","last_fullsized":"2024-05-27T06:28:40.664021+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.668814+0000","last_change":"2024-05-27T06:28:40.667132+0000","last_active":"2024-05-27T06:28:40.668814+0000","last_peered":"2024-05-27T06:28:40.668814+0000","last_clean":"2024-05-27T06:28:40.668814+0000","last_became_active":"2024-05-27T06:28:40.666811+0000","last_became_peered":"2024-05-27T06:28:40.666811+0000","last_unstale":"2024-05-27T06:28:40.668814+0000","last_undegraded":"2024-05-27T06:28:40.668814+0000","last_fullsized":"2024-05-27T06:28:40.668814+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:30:24.675813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.658112+0000","last_change":"2024-05-27T06:28:40.658112+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.658112+0000","last_undegraded":"2024-05-27T06:28:40.658112+0000","last_fullsized":"2024-05-27T06:28:40.658112+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.676796+0000","last_change":"2024-05-27T06:28:40.674354+0000","last_active":"2024-05-27T06:28:40.676796+0000","last_peered":"2024-05-27T06:28:40.676796+0000","last_clean":"2024-05-27T06:28:40.676796+0000","last_became_active":"2024-05-27T06:28:40.673991+0000","last_became_peered":"2024-05-27T06:28:40.673991+0000","last_unstale":"2024-05-27T06:28:40.676796+0000","last_undegraded":"2024-05-27T06:28:40.676796+0000","last_fullsized":"2024-05-27T06:28:40.676796+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:26.993778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.662200+0000","last_change":"2024-05-27T06:28:40.662200+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.662200+0000","last_undegraded":"2024-05-27T06:28:40.662200+0000","last_fullsized":"2024-05-27T06:28:40.662200+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.680630+0000","last_change":"2024-05-27T06:28:40.676434+0000","last_active":"2024-05-27T06:28:40.680630+0000","last_peered":"2024-05-27T06:28:40.680630+0000","last_clean":"2024-05-27T06:28:40.680630+0000","last_became_active":"2024-05-27T06:28:40.676154+0000","last_became_peered":"2024-05-27T06:28:40.676154+0000","last_unstale":"2024-05-27T06:28:40.680630+0000","last_undegraded":"2024-05-27T06:28:40.680630+0000","last_fullsized":"2024-05-27T06:28:40.680630+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:29:20.698358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666027+0000","last_change":"2024-05-27T06:28:40.666027+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666027+0000","last_undegraded":"2024-05-27T06:28:40.666027+0000","last_fullsized":"2024-05-27T06:28:40.666027+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.668201+0000","last_change":"2024-05-27T06:28:40.666405+0000","last_active":"2024-05-27T06:28:40.668201+0000","last_peered":"2024-05-27T06:28:40.668201+0000","last_clean":"2024-05-27T06:28:40.668201+0000","last_became_active":"2024-05-27T06:28:40.666146+0000","last_became_peered":"2024-05-27T06:28:40.666146+0000","last_unstale":"2024-05-27T06:28:40.668201+0000","last_undegraded":"2024-05-27T06:28:40.668201+0000","last_fullsized":"2024-05-27T06:28:40.668201+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:18:47.874305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.663494+0000","last_change":"2024-05-27T06:28:40.663494+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.663494+0000","last_undegraded":"2024-05-27T06:28:40.663494+0000","last_fullsized":"2024-05-27T06:28:40.663494+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.680403+0000","last_change":"2024-05-27T06:28:40.677362+0000","last_active":"2024-05-27T06:28:40.680403+0000","last_peered":"2024-05-27T06:28:40.680403+0000","last_clean":"2024-05-27T06:28:40.680403+0000","last_became_active":"2024-05-27T06:28:40.677080+0000","last_became_peered":"2024-05-27T06:28:40.677080+0000","last_unstale":"2024-05-27T06:28:40.680403+0000","last_undegraded":"2024-05-27T06:28:40.680403+0000","last_fullsized":"2024-05-27T06:28:40.680403+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:26.993778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.657732+0000","last_change":"2024-05-27T06:28:40.657732+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.657732+0000","last_undegraded":"2024-05-27T06:28:40.657732+0000","last_fullsized":"2024-05-27T06:28:40.657732+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.680428+0000","last_change":"2024-05-27T06:28:40.675180+0000","last_active":"2024-05-27T06:28:40.680428+0000","last_peered":"2024-05-27T06:28:40.680428+0000","last_clean":"2024-05-27T06:28:40.680428+0000","last_became_active":"2024-05-27T06:28:40.674872+0000","last_became_peered":"2024-05-27T06:28:40.674872+0000","last_unstale":"2024-05-27T06:28:40.680428+0000","last_undegraded":"2024-05-27T06:28:40.680428+0000","last_fullsized":"2024-05-27T06:28:40.680428+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:16:49.937382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661851+0000","last_change":"2024-05-27T06:28:40.661851+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661851+0000","last_undegraded":"2024-05-27T06:28:40.661851+0000","last_fullsized":"2024-05-27T06:28:40.661851+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.680773+0000","last_change":"2024-05-27T06:28:40.672373+0000","last_active":"2024-05-27T06:28:40.680773+0000","last_peered":"2024-05-27T06:28:40.680773+0000","last_clean":"2024-05-27T06:28:40.680773+0000","last_became_active":"2024-05-27T06:28:40.672028+0000","last_became_peered":"2024-05-27T06:28:40.672028+0000","last_unstale":"2024-05-27T06:28:40.680773+0000","last_undegraded":"2024-05-27T06:28:40.680773+0000","last_fullsized":"2024-05-27T06:28:40.680773+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:26:04.076545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661227+0000","last_change":"2024-05-27T06:28:40.661227+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661227+0000","last_undegraded":"2024-05-27T06:28:40.661227+0000","last_fullsized":"2024-05-27T06:28:40.661227+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678483+0000","last_change":"2024-05-27T06:28:40.674194+0000","last_active":"2024-05-27T06:28:40.678483+0000","last_peered":"2024-05-27T06:28:40.678483+0000","last_clean":"2024-05-27T06:28:40.678483+0000","last_became_active":"2024-05-27T06:28:40.673676+0000","last_became_peered":"2024-05-27T06:28:40.673676+0000","last_unstale":"2024-05-27T06:28:40.678483+0000","last_undegraded":"2024-05-27T06:28:40.678483+0000","last_fullsized":"2024-05-27T06:28:40.678483+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:12:15.418800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666390+0000","last_change":"2024-05-27T06:28:40.666390+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666390+0000","last_undegraded":"2024-05-27T06:28:40.666390+0000","last_fullsized":"2024-05-27T06:28:40.666390+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.685492+0000","last_change":"2024-05-27T06:28:40.681617+0000","last_active":"2024-05-27T06:28:40.685492+0000","last_peered":"2024-05-27T06:28:40.685492+0000","last_clean":"2024-05-27T06:28:40.685492+0000","last_became_active":"2024-05-27T06:28:40.681325+0000","last_became_peered":"2024-05-27T06:28:40.681325+0000","last_unstale":"2024-05-27T06:28:40.685492+0000","last_undegraded":"2024-05-27T06:28:40.685492+0000","last_fullsized":"2024-05-27T06:28:40.685492+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:26.993778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":138,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.667859+0000","last_change":"2024-05-27T06:27:28.692457+0000","last_active":"2024-05-27T06:28:40.667859+0000","last_peered":"2024-05-27T06:28:40.667859+0000","last_clean":"2024-05-27T06:28:40.667859+0000","last_became_active":"2024-05-27T06:27:28.691290+0000","last_became_peered":"2024-05-27T06:27:28.691290+0000","last_unstale":"2024-05-27T06:28:40.667859+0000","last_undegraded":"2024-05-27T06:28:40.667859+0000","last_fullsized":"2024-05-27T06:28:40.667859+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_clean_scrub_stamp":"2024-05-27T06:27:26.991915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:45.563728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":766699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":766699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T06:28:45.788 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T06:28:45.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.973+0000 7f9099000640 1 Processor -- start 2024-05-27T06:28:45.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.973+0000 7f9099000640 1 -- start start 2024-05-27T06:28:45.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.973+0000 7f9099000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90940d1b30 0x7f909415c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:45.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.973+0000 7f9099000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90940b5680 con 0x7f909406e5b0 2024-05-27T06:28:45.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.973+0000 7f9099000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90940b5960 con 0x7f90940718e0 2024-05-27T06:28:45.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.973+0000 7f9099000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f90940b6290 con 0x7f90940d1b30 2024-05-27T06:28:45.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.973+0000 7f9093e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f909406e5b0 0x7f909406e9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:55114/0 (socket says 172.21.15.87:55114) 2024-05-27T06:28:45.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.973+0000 7f9093e00640 1 -- 172.21.15.87:0/2322936003 learned_addr learned my addr 172.21.15.87:0/2322936003 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:45.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.973+0000 7f9093400640 1 --2- 172.21.15.87:0/2322936003 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90940d1b30 0x7f909415c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:45.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.977+0000 7f9092a00640 1 -- 172.21.15.87:0/2322936003 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1353819755 0 0) 0x7f90940b5680 con 0x7f909406e5b0 2024-05-27T06:28:45.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.977+0000 7f9092a00640 1 -- 172.21.15.87:0/2322936003 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9078003530 con 0x7f909406e5b0 2024-05-27T06:28:45.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.977+0000 7f9092a00640 1 -- 172.21.15.87:0/2322936003 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 34646338 0 0) 0x7f90940b5960 con 0x7f90940718e0 2024-05-27T06:28:45.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.977+0000 7f9092a00640 1 -- 172.21.15.87:0/2322936003 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90940b5680 con 0x7f90940718e0 2024-05-27T06:28:45.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.977+0000 7f9093400640 1 -- 172.21.15.87:0/2322936003 >> v1:172.21.15.149:6789/0 conn(0x7f90940718e0 legacy=0x7f9094071cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:45.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.977+0000 7f9093400640 1 -- 172.21.15.87:0/2322936003 >> v1:172.21.15.87:6789/0 conn(0x7f909406e5b0 legacy=0x7f909406e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:45.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.977+0000 7f9093400640 1 -- 172.21.15.87:0/2322936003 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90940b5c40 con 0x7f90940d1b30 2024-05-27T06:28:45.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.977+0000 7f9093400640 1 --2- 172.21.15.87:0/2322936003 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90940d1b30 0x7f909415c830 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f90840097f0 tx=0x7f908401c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8922e277fdfb36e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:45.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.977+0000 7f9092a00640 1 -- 172.21.15.87:0/2322936003 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90840aa430 con 0x7f90940d1b30 2024-05-27T06:28:45.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.977+0000 7f9092a00640 1 -- 172.21.15.87:0/2322936003 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90840af070 con 0x7f90940d1b30 2024-05-27T06:28:45.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.977+0000 7f9092a00640 1 -- 172.21.15.87:0/2322936003 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90840aa7f0 con 0x7f90940d1b30 2024-05-27T06:28:45.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.981+0000 7f9099000640 1 -- 172.21.15.87:0/2322936003 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90940d1b30 msgr2=0x7f909415c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:45.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.981+0000 7f9099000640 1 --2- 172.21.15.87:0/2322936003 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90940d1b30 0x7f909415c830 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f90840097f0 tx=0x7f908401c4b0 comp rx=0 tx=0).stop 2024-05-27T06:28:45.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.981+0000 7f9099000640 1 -- 172.21.15.87:0/2322936003 shutdown_connections 2024-05-27T06:28:45.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.981+0000 7f9099000640 1 --2- 172.21.15.87:0/2322936003 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90940d1b30 0x7f909415c830 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:45.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.981+0000 7f9099000640 1 -- 172.21.15.87:0/2322936003 >> 172.21.15.87:0/2322936003 conn(0x7f90940d2e90 msgr2=0x7f90940711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:45.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.981+0000 7f9099000640 1 -- 172.21.15.87:0/2322936003 shutdown_connections 2024-05-27T06:28:45.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.981+0000 7f9099000640 1 -- 172.21.15.87:0/2322936003 wait complete. 2024-05-27T06:28:45.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.981+0000 7f9099000640 1 Processor -- start 2024-05-27T06:28:45.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.981+0000 7f9099000640 1 -- start start 2024-05-27T06:28:45.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.985+0000 7f9099000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f909406e5b0 0x7f909415ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:45.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.985+0000 7f9099000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90940718e0 0x7f90941561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:45.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.985+0000 7f9099000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90940d1b30 0x7f909414f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:45.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.985+0000 7f9099000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f90940d04d0 con 0x7f90940718e0 2024-05-27T06:28:45.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.985+0000 7f9099000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f90940d0350 con 0x7f909406e5b0 2024-05-27T06:28:45.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.985+0000 7f9099000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f909416af90 con 0x7f90940d1b30 2024-05-27T06:28:45.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.985+0000 7f908be00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90940718e0 0x7f90941561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:45.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.985+0000 7f908be00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90940718e0 0x7f90941561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39806/0 (socket says 172.21.15.87:39806) 2024-05-27T06:28:45.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.985+0000 7f908be00640 1 -- 172.21.15.87:0/1542841822 learned_addr learned my addr 172.21.15.87:0/1542841822 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:45.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.985+0000 7f9093400640 1 --2- 172.21.15.87:0/1542841822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f909406e5b0 0x7f909415ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:45.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.985+0000 7f9093e00640 1 --2- 172.21.15.87:0/1542841822 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90940d1b30 0x7f909414f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:45.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.985+0000 7f908be00640 1 -- 172.21.15.87:0/1542841822 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90940d1b30 msgr2=0x7f909414f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:45.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.985+0000 7f908be00640 1 --2- 172.21.15.87:0/1542841822 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90940d1b30 0x7f909414f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:45.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.985+0000 7f908be00640 1 -- 172.21.15.87:0/1542841822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f909406e5b0 msgr2=0x7f909415ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:45.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.985+0000 7f908be00640 1 --2- 172.21.15.87:0/1542841822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f909406e5b0 0x7f909415ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:45.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.985+0000 7f908be00640 1 -- 172.21.15.87:0/1542841822 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f909414f6b0 con 0x7f90940718e0 2024-05-27T06:28:45.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.985+0000 7f9093e00640 1 --2- 172.21.15.87:0/1542841822 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90940d1b30 0x7f909414f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:45.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.985+0000 7f908be00640 1 --2- 172.21.15.87:0/1542841822 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90940718e0 0x7f90941561d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f907c00c3f0 tx=0x7f907c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:45.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.985+0000 7f908b400640 1 -- 172.21.15.87:0/1542841822 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c017070 con 0x7f90940718e0 2024-05-27T06:28:45.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.985+0000 7f908b400640 1 -- 172.21.15.87:0/1542841822 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f907c0052d0 con 0x7f90940718e0 2024-05-27T06:28:45.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.985+0000 7f9099000640 1 -- 172.21.15.87:0/1542841822 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f909415d650 con 0x7f90940718e0 2024-05-27T06:28:45.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.985+0000 7f908b400640 1 -- 172.21.15.87:0/1542841822 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c003840 con 0x7f90940718e0 2024-05-27T06:28:45.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.985+0000 7f9099000640 1 -- 172.21.15.87:0/1542841822 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f909415dc10 con 0x7f90940718e0 2024-05-27T06:28:45.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.985+0000 7f9099000640 1 -- 172.21.15.87:0/1542841822 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f909406aa30 con 0x7f90940718e0 2024-05-27T06:28:45.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.989+0000 7f908b400640 1 -- 172.21.15.87:0/1542841822 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f907c01a070 con 0x7f90940718e0 2024-05-27T06:28:45.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.989+0000 7f908b400640 1 --2- 172.21.15.87:0/1542841822 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f907006f400 0x7f9070071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:45.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.989+0000 7f908b400640 1 -- 172.21.15.87:0/1542841822 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f907c08e730 con 0x7f90940718e0 2024-05-27T06:28:45.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.989+0000 7f9093400640 1 --2- 172.21.15.87:0/1542841822 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f907006f400 0x7f9070071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:45.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.989+0000 7f9093400640 1 --2- 172.21.15.87:0/1542841822 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f907006f400 0x7f9070071910 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f90840ae000 tx=0x7f90840a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:45.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:45.993+0000 7f908b400640 1 -- 172.21.15.87:0/1542841822 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f909414f6b0 con 0x7f90940718e0 2024-05-27T06:28:46.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.149+0000 7f9099000640 1 -- 172.21.15.87:0/1542841822 --> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f90940b3df0 con 0x7f907006f400 2024-05-27T06:28:46.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.153+0000 7f908b400640 1 -- 172.21.15.87:0/1542841822 <== mgr.4111 v2:172.21.15.87:6832/2724754260 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246627 (secure 0 0 0) 0x7f90940b3df0 con 0x7f907006f400 2024-05-27T06:28:46.155 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:46.156 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-27T06:28:46.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.157+0000 7f9099000640 1 -- 172.21.15.87:0/1542841822 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f907006f400 msgr2=0x7f9070071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:46.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.157+0000 7f9099000640 1 --2- 172.21.15.87:0/1542841822 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f907006f400 0x7f9070071910 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f90840ae000 tx=0x7f90840a7000 comp rx=0 tx=0).stop 2024-05-27T06:28:46.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.157+0000 7f9099000640 1 -- 172.21.15.87:0/1542841822 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90940718e0 msgr2=0x7f90941561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:46.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.157+0000 7f9099000640 1 --2- 172.21.15.87:0/1542841822 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90940718e0 0x7f90941561d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f907c00c3f0 tx=0x7f907c00c8b0 comp rx=0 tx=0).stop 2024-05-27T06:28:46.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.157+0000 7f9099000640 1 -- 172.21.15.87:0/1542841822 shutdown_connections 2024-05-27T06:28:46.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.157+0000 7f9099000640 1 --2- 172.21.15.87:0/1542841822 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f907006f400 0x7f9070071910 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:46.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.157+0000 7f9099000640 1 --2- 172.21.15.87:0/1542841822 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90940d1b30 0x7f909414f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:46.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.157+0000 7f9099000640 1 --2- 172.21.15.87:0/1542841822 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90940718e0 0x7f90941561d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:46.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.157+0000 7f9099000640 1 --2- 172.21.15.87:0/1542841822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f909406e5b0 0x7f909415ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:46.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.157+0000 7f9099000640 1 -- 172.21.15.87:0/1542841822 >> 172.21.15.87:0/1542841822 conn(0x7f90940d2e90 msgr2=0x7f90940711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:46.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.157+0000 7f9099000640 1 -- 172.21.15.87:0/1542841822 shutdown_connections 2024-05-27T06:28:46.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.157+0000 7f9099000640 1 -- 172.21.15.87:0/1542841822 wait complete. 2024-05-27T06:28:46.175 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-05-27T06:28:44.582103+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220584,"kb_used_data":4392,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754136,"statfs":{"total":773094113280,"available":772868235264,"internally_reserved":0,"allocated":4497408,"data_stored":2591384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.937151"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666012+0000","last_change":"2024-05-27T06:28:40.666012+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666012+0000","last_undegraded":"2024-05-27T06:28:40.666012+0000","last_fullsized":"2024-05-27T06:28:40.666012+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.671554+0000","last_change":"2024-05-27T06:28:40.671554+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.671554+0000","last_undegraded":"2024-05-27T06:28:40.671554+0000","last_fullsized":"2024-05-27T06:28:40.671554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664525+0000","last_change":"2024-05-27T06:28:40.664525+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664525+0000","last_undegraded":"2024-05-27T06:28:40.664525+0000","last_fullsized":"2024-05-27T06:28:40.664525+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.659111+0000","last_change":"2024-05-27T06:28:40.659111+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.659111+0000","last_undegraded":"2024-05-27T06:28:40.659111+0000","last_fullsized":"2024-05-27T06:28:40.659111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.659584+0000","last_change":"2024-05-27T06:28:40.659584+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.659584+0000","last_undegraded":"2024-05-27T06:28:40.659584+0000","last_fullsized":"2024-05-27T06:28:40.659584+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.657488+0000","last_change":"2024-05-27T06:28:40.657488+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.657488+0000","last_undegraded":"2024-05-27T06:28:40.657488+0000","last_fullsized":"2024-05-27T06:28:40.657488+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.667129+0000","last_change":"2024-05-27T06:28:40.667129+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.667129+0000","last_undegraded":"2024-05-27T06:28:40.667129+0000","last_fullsized":"2024-05-27T06:28:40.667129+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.662161+0000","last_change":"2024-05-27T06:28:40.662161+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.662161+0000","last_undegraded":"2024-05-27T06:28:40.662161+0000","last_fullsized":"2024-05-27T06:28:40.662161+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664576+0000","last_change":"2024-05-27T06:28:40.664576+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664576+0000","last_undegraded":"2024-05-27T06:28:40.664576+0000","last_fullsized":"2024-05-27T06:28:40.664576+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.669507+0000","last_change":"2024-05-27T06:28:40.669507+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.669507+0000","last_undegraded":"2024-05-27T06:28:40.669507+0000","last_fullsized":"2024-05-27T06:28:40.669507+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.665538+0000","last_change":"2024-05-27T06:28:40.665538+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.665538+0000","last_undegraded":"2024-05-27T06:28:40.665538+0000","last_fullsized":"2024-05-27T06:28:40.665538+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664473+0000","last_change":"2024-05-27T06:28:40.664473+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664473+0000","last_undegraded":"2024-05-27T06:28:40.664473+0000","last_fullsized":"2024-05-27T06:28:40.664473+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.667541+0000","last_change":"2024-05-27T06:28:40.667541+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.667541+0000","last_undegraded":"2024-05-27T06:28:40.667541+0000","last_fullsized":"2024-05-27T06:28:40.667541+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.662387+0000","last_change":"2024-05-27T06:28:40.662387+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.662387+0000","last_undegraded":"2024-05-27T06:28:40.662387+0000","last_fullsized":"2024-05-27T06:28:40.662387+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666106+0000","last_change":"2024-05-27T06:28:40.666106+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666106+0000","last_undegraded":"2024-05-27T06:28:40.666106+0000","last_fullsized":"2024-05-27T06:28:40.666106+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664652+0000","last_change":"2024-05-27T06:28:40.664652+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664652+0000","last_undegraded":"2024-05-27T06:28:40.664652+0000","last_fullsized":"2024-05-27T06:28:40.664652+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.663563+0000","last_change":"2024-05-27T06:28:40.663563+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.663563+0000","last_undegraded":"2024-05-27T06:28:40.663563+0000","last_fullsized":"2024-05-27T06:28:40.663563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.656139+0000","last_change":"2024-05-27T06:28:40.656139+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.656139+0000","last_undegraded":"2024-05-27T06:28:40.656139+0000","last_fullsized":"2024-05-27T06:28:40.656139+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.658793+0000","last_change":"2024-05-27T06:28:40.658793+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.658793+0000","last_undegraded":"2024-05-27T06:28:40.658793+0000","last_fullsized":"2024-05-27T06:28:40.658793+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.655144+0000","last_change":"2024-05-27T06:28:40.655144+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.655144+0000","last_undegraded":"2024-05-27T06:28:40.655144+0000","last_fullsized":"2024-05-27T06:28:40.655144+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664913+0000","last_change":"2024-05-27T06:28:40.664913+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664913+0000","last_undegraded":"2024-05-27T06:28:40.664913+0000","last_fullsized":"2024-05-27T06:28:40.664913+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.660387+0000","last_change":"2024-05-27T06:28:40.660387+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.660387+0000","last_undegraded":"2024-05-27T06:28:40.660387+0000","last_fullsized":"2024-05-27T06:28:40.660387+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.662122+0000","last_change":"2024-05-27T06:28:40.662122+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.662122+0000","last_undegraded":"2024-05-27T06:28:40.662122+0000","last_fullsized":"2024-05-27T06:28:40.662122+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.657911+0000","last_change":"2024-05-27T06:28:40.657911+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.657911+0000","last_undegraded":"2024-05-27T06:28:40.657911+0000","last_fullsized":"2024-05-27T06:28:40.657911+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.656715+0000","last_change":"2024-05-27T06:28:40.656715+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.656715+0000","last_undegraded":"2024-05-27T06:28:40.656715+0000","last_fullsized":"2024-05-27T06:28:40.656715+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.660450+0000","last_change":"2024-05-27T06:28:40.660450+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.660450+0000","last_undegraded":"2024-05-27T06:28:40.660450+0000","last_fullsized":"2024-05-27T06:28:40.660450+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.655779+0000","last_change":"2024-05-27T06:28:40.655779+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.655779+0000","last_undegraded":"2024-05-27T06:28:40.655779+0000","last_fullsized":"2024-05-27T06:28:40.655779+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666097+0000","last_change":"2024-05-27T06:28:40.666097+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666097+0000","last_undegraded":"2024-05-27T06:28:40.666097+0000","last_fullsized":"2024-05-27T06:28:40.666097+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.655258+0000","last_change":"2024-05-27T06:28:40.655258+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.655258+0000","last_undegraded":"2024-05-27T06:28:40.655258+0000","last_fullsized":"2024-05-27T06:28:40.655258+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.655515+0000","last_change":"2024-05-27T06:28:40.655515+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.655515+0000","last_undegraded":"2024-05-27T06:28:40.655515+0000","last_fullsized":"2024-05-27T06:28:40.655515+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661353+0000","last_change":"2024-05-27T06:28:40.661353+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661353+0000","last_undegraded":"2024-05-27T06:28:40.661353+0000","last_fullsized":"2024-05-27T06:28:40.661353+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.657381+0000","last_change":"2024-05-27T06:28:40.657381+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.657381+0000","last_undegraded":"2024-05-27T06:28:40.657381+0000","last_fullsized":"2024-05-27T06:28:40.657381+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661094+0000","last_change":"2024-05-27T06:28:40.661094+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661094+0000","last_undegraded":"2024-05-27T06:28:40.661094+0000","last_fullsized":"2024-05-27T06:28:40.661094+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678349+0000","last_change":"2024-05-27T06:28:40.669695+0000","last_active":"2024-05-27T06:28:40.678349+0000","last_peered":"2024-05-27T06:28:40.678349+0000","last_clean":"2024-05-27T06:28:40.678349+0000","last_became_active":"2024-05-27T06:28:40.669333+0000","last_became_peered":"2024-05-27T06:28:40.669333+0000","last_unstale":"2024-05-27T06:28:40.678349+0000","last_undegraded":"2024-05-27T06:28:40.678349+0000","last_fullsized":"2024-05-27T06:28:40.678349+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:26:04.076545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.658480+0000","last_change":"2024-05-27T06:28:40.658480+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.658480+0000","last_undegraded":"2024-05-27T06:28:40.658480+0000","last_fullsized":"2024-05-27T06:28:40.658480+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678911+0000","last_change":"2024-05-27T06:28:40.673139+0000","last_active":"2024-05-27T06:28:40.678911+0000","last_peered":"2024-05-27T06:28:40.678911+0000","last_clean":"2024-05-27T06:28:40.678911+0000","last_became_active":"2024-05-27T06:28:40.672841+0000","last_became_peered":"2024-05-27T06:28:40.672841+0000","last_unstale":"2024-05-27T06:28:40.678911+0000","last_undegraded":"2024-05-27T06:28:40.678911+0000","last_fullsized":"2024-05-27T06:28:40.678911+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T06:56:04.095609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.658308+0000","last_change":"2024-05-27T06:28:40.658308+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.658308+0000","last_undegraded":"2024-05-27T06:28:40.658308+0000","last_fullsized":"2024-05-27T06:28:40.658308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678553+0000","last_change":"2024-05-27T06:28:40.672478+0000","last_active":"2024-05-27T06:28:40.678553+0000","last_peered":"2024-05-27T06:28:40.678553+0000","last_clean":"2024-05-27T06:28:40.678553+0000","last_became_active":"2024-05-27T06:28:40.672172+0000","last_became_peered":"2024-05-27T06:28:40.672172+0000","last_unstale":"2024-05-27T06:28:40.678553+0000","last_undegraded":"2024-05-27T06:28:40.678553+0000","last_fullsized":"2024-05-27T06:28:40.678553+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:13:59.179683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666498+0000","last_change":"2024-05-27T06:28:40.666498+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666498+0000","last_undegraded":"2024-05-27T06:28:40.666498+0000","last_fullsized":"2024-05-27T06:28:40.666498+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.685173+0000","last_change":"2024-05-27T06:28:40.677480+0000","last_active":"2024-05-27T06:28:40.685173+0000","last_peered":"2024-05-27T06:28:40.685173+0000","last_clean":"2024-05-27T06:28:40.685173+0000","last_became_active":"2024-05-27T06:28:40.677186+0000","last_became_peered":"2024-05-27T06:28:40.677186+0000","last_unstale":"2024-05-27T06:28:40.685173+0000","last_undegraded":"2024-05-27T06:28:40.685173+0000","last_fullsized":"2024-05-27T06:28:40.685173+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:16:49.937382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664434+0000","last_change":"2024-05-27T06:28:40.664434+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664434+0000","last_undegraded":"2024-05-27T06:28:40.664434+0000","last_fullsized":"2024-05-27T06:28:40.664434+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.682962+0000","last_change":"2024-05-27T06:28:40.676566+0000","last_active":"2024-05-27T06:28:40.682962+0000","last_peered":"2024-05-27T06:28:40.682962+0000","last_clean":"2024-05-27T06:28:40.682962+0000","last_became_active":"2024-05-27T06:28:40.676114+0000","last_became_peered":"2024-05-27T06:28:40.676114+0000","last_unstale":"2024-05-27T06:28:40.682962+0000","last_undegraded":"2024-05-27T06:28:40.682962+0000","last_fullsized":"2024-05-27T06:28:40.682962+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:04:39.297606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.665726+0000","last_change":"2024-05-27T06:28:40.665726+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.665726+0000","last_undegraded":"2024-05-27T06:28:40.665726+0000","last_fullsized":"2024-05-27T06:28:40.665726+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.685518+0000","last_change":"2024-05-27T06:28:40.681743+0000","last_active":"2024-05-27T06:28:40.685518+0000","last_peered":"2024-05-27T06:28:40.685518+0000","last_clean":"2024-05-27T06:28:40.685518+0000","last_became_active":"2024-05-27T06:28:40.681385+0000","last_became_peered":"2024-05-27T06:28:40.681385+0000","last_unstale":"2024-05-27T06:28:40.685518+0000","last_undegraded":"2024-05-27T06:28:40.685518+0000","last_fullsized":"2024-05-27T06:28:40.685518+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:04:39.297606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661324+0000","last_change":"2024-05-27T06:28:40.661324+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661324+0000","last_undegraded":"2024-05-27T06:28:40.661324+0000","last_fullsized":"2024-05-27T06:28:40.661324+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678962+0000","last_change":"2024-05-27T06:28:40.673602+0000","last_active":"2024-05-27T06:28:40.678962+0000","last_peered":"2024-05-27T06:28:40.678962+0000","last_clean":"2024-05-27T06:28:40.678962+0000","last_became_active":"2024-05-27T06:28:40.673279+0000","last_became_peered":"2024-05-27T06:28:40.673279+0000","last_unstale":"2024-05-27T06:28:40.678962+0000","last_undegraded":"2024-05-27T06:28:40.678962+0000","last_fullsized":"2024-05-27T06:28:40.678962+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:18:47.874305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.665064+0000","last_change":"2024-05-27T06:28:40.665064+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.665064+0000","last_undegraded":"2024-05-27T06:28:40.665064+0000","last_fullsized":"2024-05-27T06:28:40.665064+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.669177+0000","last_change":"2024-05-27T06:28:40.667506+0000","last_active":"2024-05-27T06:28:40.669177+0000","last_peered":"2024-05-27T06:28:40.669177+0000","last_clean":"2024-05-27T06:28:40.669177+0000","last_became_active":"2024-05-27T06:28:40.666805+0000","last_became_peered":"2024-05-27T06:28:40.666805+0000","last_unstale":"2024-05-27T06:28:40.669177+0000","last_undegraded":"2024-05-27T06:28:40.669177+0000","last_fullsized":"2024-05-27T06:28:40.669177+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:17:08.471701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.657337+0000","last_change":"2024-05-27T06:28:40.657337+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.657337+0000","last_undegraded":"2024-05-27T06:28:40.657337+0000","last_fullsized":"2024-05-27T06:28:40.657337+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.681300+0000","last_change":"2024-05-27T06:28:40.679319+0000","last_active":"2024-05-27T06:28:40.681300+0000","last_peered":"2024-05-27T06:28:40.681300+0000","last_clean":"2024-05-27T06:28:40.681300+0000","last_became_active":"2024-05-27T06:28:40.678970+0000","last_became_peered":"2024-05-27T06:28:40.678970+0000","last_unstale":"2024-05-27T06:28:40.681300+0000","last_undegraded":"2024-05-27T06:28:40.681300+0000","last_fullsized":"2024-05-27T06:28:40.681300+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:59:06.313098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.662678+0000","last_change":"2024-05-27T06:28:40.662678+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.662678+0000","last_undegraded":"2024-05-27T06:28:40.662678+0000","last_fullsized":"2024-05-27T06:28:40.662678+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.685252+0000","last_change":"2024-05-27T06:28:40.680595+0000","last_active":"2024-05-27T06:28:40.685252+0000","last_peered":"2024-05-27T06:28:40.685252+0000","last_clean":"2024-05-27T06:28:40.685252+0000","last_became_active":"2024-05-27T06:28:40.680213+0000","last_became_peered":"2024-05-27T06:28:40.680213+0000","last_unstale":"2024-05-27T06:28:40.685252+0000","last_undegraded":"2024-05-27T06:28:40.685252+0000","last_fullsized":"2024-05-27T06:28:40.685252+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:12:15.418800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.659359+0000","last_change":"2024-05-27T06:28:40.659359+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.659359+0000","last_undegraded":"2024-05-27T06:28:40.659359+0000","last_fullsized":"2024-05-27T06:28:40.659359+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.676705+0000","last_change":"2024-05-27T06:28:40.674198+0000","last_active":"2024-05-27T06:28:40.676705+0000","last_peered":"2024-05-27T06:28:40.676705+0000","last_clean":"2024-05-27T06:28:40.676705+0000","last_became_active":"2024-05-27T06:28:40.673825+0000","last_became_peered":"2024-05-27T06:28:40.673825+0000","last_unstale":"2024-05-27T06:28:40.676705+0000","last_undegraded":"2024-05-27T06:28:40.676705+0000","last_fullsized":"2024-05-27T06:28:40.676705+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T06:56:04.095609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.658786+0000","last_change":"2024-05-27T06:28:40.658786+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.658786+0000","last_undegraded":"2024-05-27T06:28:40.658786+0000","last_fullsized":"2024-05-27T06:28:40.658786+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.680398+0000","last_change":"2024-05-27T06:28:40.677467+0000","last_active":"2024-05-27T06:28:40.680398+0000","last_peered":"2024-05-27T06:28:40.680398+0000","last_clean":"2024-05-27T06:28:40.680398+0000","last_became_active":"2024-05-27T06:28:40.677128+0000","last_became_peered":"2024-05-27T06:28:40.677128+0000","last_unstale":"2024-05-27T06:28:40.680398+0000","last_undegraded":"2024-05-27T06:28:40.680398+0000","last_fullsized":"2024-05-27T06:28:40.680398+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:52:37.091584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.663954+0000","last_change":"2024-05-27T06:28:40.663954+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.663954+0000","last_undegraded":"2024-05-27T06:28:40.663954+0000","last_fullsized":"2024-05-27T06:28:40.663954+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.682084+0000","last_change":"2024-05-27T06:28:40.681038+0000","last_active":"2024-05-27T06:28:40.682084+0000","last_peered":"2024-05-27T06:28:40.682084+0000","last_clean":"2024-05-27T06:28:40.682084+0000","last_became_active":"2024-05-27T06:28:40.680758+0000","last_became_peered":"2024-05-27T06:28:40.680758+0000","last_unstale":"2024-05-27T06:28:40.682084+0000","last_undegraded":"2024-05-27T06:28:40.682084+0000","last_fullsized":"2024-05-27T06:28:40.682084+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T06:54:59.433478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.663479+0000","last_change":"2024-05-27T06:28:40.663479+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.663479+0000","last_undegraded":"2024-05-27T06:28:40.663479+0000","last_fullsized":"2024-05-27T06:28:40.663479+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678818+0000","last_change":"2024-05-27T06:28:40.673610+0000","last_active":"2024-05-27T06:28:40.678818+0000","last_peered":"2024-05-27T06:28:40.678818+0000","last_clean":"2024-05-27T06:28:40.678818+0000","last_became_active":"2024-05-27T06:28:40.673294+0000","last_became_peered":"2024-05-27T06:28:40.673294+0000","last_unstale":"2024-05-27T06:28:40.678818+0000","last_undegraded":"2024-05-27T06:28:40.678818+0000","last_fullsized":"2024-05-27T06:28:40.678818+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T06:56:04.095609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.662436+0000","last_change":"2024-05-27T06:28:40.662436+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.662436+0000","last_undegraded":"2024-05-27T06:28:40.662436+0000","last_fullsized":"2024-05-27T06:28:40.662436+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678457+0000","last_change":"2024-05-27T06:28:40.672146+0000","last_active":"2024-05-27T06:28:40.678457+0000","last_peered":"2024-05-27T06:28:40.678457+0000","last_clean":"2024-05-27T06:28:40.678457+0000","last_became_active":"2024-05-27T06:28:40.671021+0000","last_became_peered":"2024-05-27T06:28:40.671021+0000","last_unstale":"2024-05-27T06:28:40.678457+0000","last_undegraded":"2024-05-27T06:28:40.678457+0000","last_fullsized":"2024-05-27T06:28:40.678457+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:00:20.482241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664559+0000","last_change":"2024-05-27T06:28:40.664559+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664559+0000","last_undegraded":"2024-05-27T06:28:40.664559+0000","last_fullsized":"2024-05-27T06:28:40.664559+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.685487+0000","last_change":"2024-05-27T06:28:40.681584+0000","last_active":"2024-05-27T06:28:40.685487+0000","last_peered":"2024-05-27T06:28:40.685487+0000","last_clean":"2024-05-27T06:28:40.685487+0000","last_became_active":"2024-05-27T06:28:40.681279+0000","last_became_peered":"2024-05-27T06:28:40.681279+0000","last_unstale":"2024-05-27T06:28:40.685487+0000","last_undegraded":"2024-05-27T06:28:40.685487+0000","last_fullsized":"2024-05-27T06:28:40.685487+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T06:56:04.095609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.667742+0000","last_change":"2024-05-27T06:28:40.667742+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.667742+0000","last_undegraded":"2024-05-27T06:28:40.667742+0000","last_fullsized":"2024-05-27T06:28:40.667742+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.682990+0000","last_change":"2024-05-27T06:28:40.679172+0000","last_active":"2024-05-27T06:28:40.682990+0000","last_peered":"2024-05-27T06:28:40.682990+0000","last_clean":"2024-05-27T06:28:40.682990+0000","last_became_active":"2024-05-27T06:28:40.678786+0000","last_became_peered":"2024-05-27T06:28:40.678786+0000","last_unstale":"2024-05-27T06:28:40.682990+0000","last_undegraded":"2024-05-27T06:28:40.682990+0000","last_fullsized":"2024-05-27T06:28:40.682990+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:55:20.077082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664987+0000","last_change":"2024-05-27T06:28:40.664987+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664987+0000","last_undegraded":"2024-05-27T06:28:40.664987+0000","last_fullsized":"2024-05-27T06:28:40.664987+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.685154+0000","last_change":"2024-05-27T06:28:40.677177+0000","last_active":"2024-05-27T06:28:40.685154+0000","last_peered":"2024-05-27T06:28:40.685154+0000","last_clean":"2024-05-27T06:28:40.685154+0000","last_became_active":"2024-05-27T06:28:40.676640+0000","last_became_peered":"2024-05-27T06:28:40.676640+0000","last_unstale":"2024-05-27T06:28:40.685154+0000","last_undegraded":"2024-05-27T06:28:40.685154+0000","last_fullsized":"2024-05-27T06:28:40.685154+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:00:20.482241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.658945+0000","last_change":"2024-05-27T06:28:40.658945+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.658945+0000","last_undegraded":"2024-05-27T06:28:40.658945+0000","last_fullsized":"2024-05-27T06:28:40.658945+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.680529+0000","last_change":"2024-05-27T06:28:40.675405+0000","last_active":"2024-05-27T06:28:40.680529+0000","last_peered":"2024-05-27T06:28:40.680529+0000","last_clean":"2024-05-27T06:28:40.680529+0000","last_became_active":"2024-05-27T06:28:40.675004+0000","last_became_peered":"2024-05-27T06:28:40.675004+0000","last_unstale":"2024-05-27T06:28:40.680529+0000","last_undegraded":"2024-05-27T06:28:40.680529+0000","last_fullsized":"2024-05-27T06:28:40.680529+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:01:06.950501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.657363+0000","last_change":"2024-05-27T06:28:40.657363+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.657363+0000","last_undegraded":"2024-05-27T06:28:40.657363+0000","last_fullsized":"2024-05-27T06:28:40.657363+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.677993+0000","last_change":"2024-05-27T06:28:40.670977+0000","last_active":"2024-05-27T06:28:40.677993+0000","last_peered":"2024-05-27T06:28:40.677993+0000","last_clean":"2024-05-27T06:28:40.677993+0000","last_became_active":"2024-05-27T06:28:40.670723+0000","last_became_peered":"2024-05-27T06:28:40.670723+0000","last_unstale":"2024-05-27T06:28:40.677993+0000","last_undegraded":"2024-05-27T06:28:40.677993+0000","last_fullsized":"2024-05-27T06:28:40.677993+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:58:11.217383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661895+0000","last_change":"2024-05-27T06:28:40.661895+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661895+0000","last_undegraded":"2024-05-27T06:28:40.661895+0000","last_fullsized":"2024-05-27T06:28:40.661895+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.662351+0000","last_change":"2024-05-27T06:28:40.661275+0000","last_active":"2024-05-27T06:28:40.662351+0000","last_peered":"2024-05-27T06:28:40.662351+0000","last_clean":"2024-05-27T06:28:40.662351+0000","last_became_active":"2024-05-27T06:28:40.661013+0000","last_became_peered":"2024-05-27T06:28:40.661013+0000","last_unstale":"2024-05-27T06:28:40.662351+0000","last_undegraded":"2024-05-27T06:28:40.662351+0000","last_fullsized":"2024-05-27T06:28:40.662351+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:22:56.239970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661597+0000","last_change":"2024-05-27T06:28:40.661597+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661597+0000","last_undegraded":"2024-05-27T06:28:40.661597+0000","last_fullsized":"2024-05-27T06:28:40.661597+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.675384+0000","last_change":"2024-05-27T06:28:40.672102+0000","last_active":"2024-05-27T06:28:40.675384+0000","last_peered":"2024-05-27T06:28:40.675384+0000","last_clean":"2024-05-27T06:28:40.675384+0000","last_became_active":"2024-05-27T06:28:40.671774+0000","last_became_peered":"2024-05-27T06:28:40.671774+0000","last_unstale":"2024-05-27T06:28:40.675384+0000","last_undegraded":"2024-05-27T06:28:40.675384+0000","last_fullsized":"2024-05-27T06:28:40.675384+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:40:43.723380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666694+0000","last_change":"2024-05-27T06:28:40.666694+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666694+0000","last_undegraded":"2024-05-27T06:28:40.666694+0000","last_fullsized":"2024-05-27T06:28:40.666694+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.682769+0000","last_change":"2024-05-27T06:28:40.679403+0000","last_active":"2024-05-27T06:28:40.682769+0000","last_peered":"2024-05-27T06:28:40.682769+0000","last_clean":"2024-05-27T06:28:40.682769+0000","last_became_active":"2024-05-27T06:28:40.679101+0000","last_became_peered":"2024-05-27T06:28:40.679101+0000","last_unstale":"2024-05-27T06:28:40.682769+0000","last_undegraded":"2024-05-27T06:28:40.682769+0000","last_fullsized":"2024-05-27T06:28:40.682769+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:18:47.874305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664021+0000","last_change":"2024-05-27T06:28:40.664021+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664021+0000","last_undegraded":"2024-05-27T06:28:40.664021+0000","last_fullsized":"2024-05-27T06:28:40.664021+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.668814+0000","last_change":"2024-05-27T06:28:40.667132+0000","last_active":"2024-05-27T06:28:40.668814+0000","last_peered":"2024-05-27T06:28:40.668814+0000","last_clean":"2024-05-27T06:28:40.668814+0000","last_became_active":"2024-05-27T06:28:40.666811+0000","last_became_peered":"2024-05-27T06:28:40.666811+0000","last_unstale":"2024-05-27T06:28:40.668814+0000","last_undegraded":"2024-05-27T06:28:40.668814+0000","last_fullsized":"2024-05-27T06:28:40.668814+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:30:24.675813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.658112+0000","last_change":"2024-05-27T06:28:40.658112+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.658112+0000","last_undegraded":"2024-05-27T06:28:40.658112+0000","last_fullsized":"2024-05-27T06:28:40.658112+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.676796+0000","last_change":"2024-05-27T06:28:40.674354+0000","last_active":"2024-05-27T06:28:40.676796+0000","last_peered":"2024-05-27T06:28:40.676796+0000","last_clean":"2024-05-27T06:28:40.676796+0000","last_became_active":"2024-05-27T06:28:40.673991+0000","last_became_peered":"2024-05-27T06:28:40.673991+0000","last_unstale":"2024-05-27T06:28:40.676796+0000","last_undegraded":"2024-05-27T06:28:40.676796+0000","last_fullsized":"2024-05-27T06:28:40.676796+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:26.993778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.662200+0000","last_change":"2024-05-27T06:28:40.662200+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.662200+0000","last_undegraded":"2024-05-27T06:28:40.662200+0000","last_fullsized":"2024-05-27T06:28:40.662200+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.680630+0000","last_change":"2024-05-27T06:28:40.676434+0000","last_active":"2024-05-27T06:28:40.680630+0000","last_peered":"2024-05-27T06:28:40.680630+0000","last_clean":"2024-05-27T06:28:40.680630+0000","last_became_active":"2024-05-27T06:28:40.676154+0000","last_became_peered":"2024-05-27T06:28:40.676154+0000","last_unstale":"2024-05-27T06:28:40.680630+0000","last_undegraded":"2024-05-27T06:28:40.680630+0000","last_fullsized":"2024-05-27T06:28:40.680630+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:29:20.698358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666027+0000","last_change":"2024-05-27T06:28:40.666027+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666027+0000","last_undegraded":"2024-05-27T06:28:40.666027+0000","last_fullsized":"2024-05-27T06:28:40.666027+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.668201+0000","last_change":"2024-05-27T06:28:40.666405+0000","last_active":"2024-05-27T06:28:40.668201+0000","last_peered":"2024-05-27T06:28:40.668201+0000","last_clean":"2024-05-27T06:28:40.668201+0000","last_became_active":"2024-05-27T06:28:40.666146+0000","last_became_peered":"2024-05-27T06:28:40.666146+0000","last_unstale":"2024-05-27T06:28:40.668201+0000","last_undegraded":"2024-05-27T06:28:40.668201+0000","last_fullsized":"2024-05-27T06:28:40.668201+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:18:47.874305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.663494+0000","last_change":"2024-05-27T06:28:40.663494+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.663494+0000","last_undegraded":"2024-05-27T06:28:40.663494+0000","last_fullsized":"2024-05-27T06:28:40.663494+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.680403+0000","last_change":"2024-05-27T06:28:40.677362+0000","last_active":"2024-05-27T06:28:40.680403+0000","last_peered":"2024-05-27T06:28:40.680403+0000","last_clean":"2024-05-27T06:28:40.680403+0000","last_became_active":"2024-05-27T06:28:40.677080+0000","last_became_peered":"2024-05-27T06:28:40.677080+0000","last_unstale":"2024-05-27T06:28:40.680403+0000","last_undegraded":"2024-05-27T06:28:40.680403+0000","last_fullsized":"2024-05-27T06:28:40.680403+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:26.993778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.657732+0000","last_change":"2024-05-27T06:28:40.657732+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.657732+0000","last_undegraded":"2024-05-27T06:28:40.657732+0000","last_fullsized":"2024-05-27T06:28:40.657732+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.680428+0000","last_change":"2024-05-27T06:28:40.675180+0000","last_active":"2024-05-27T06:28:40.680428+0000","last_peered":"2024-05-27T06:28:40.680428+0000","last_clean":"2024-05-27T06:28:40.680428+0000","last_became_active":"2024-05-27T06:28:40.674872+0000","last_became_peered":"2024-05-27T06:28:40.674872+0000","last_unstale":"2024-05-27T06:28:40.680428+0000","last_undegraded":"2024-05-27T06:28:40.680428+0000","last_fullsized":"2024-05-27T06:28:40.680428+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:16:49.937382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661851+0000","last_change":"2024-05-27T06:28:40.661851+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661851+0000","last_undegraded":"2024-05-27T06:28:40.661851+0000","last_fullsized":"2024-05-27T06:28:40.661851+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.680773+0000","last_change":"2024-05-27T06:28:40.672373+0000","last_active":"2024-05-27T06:28:40.680773+0000","last_peered":"2024-05-27T06:28:40.680773+0000","last_clean":"2024-05-27T06:28:40.680773+0000","last_became_active":"2024-05-27T06:28:40.672028+0000","last_became_peered":"2024-05-27T06:28:40.672028+0000","last_unstale":"2024-05-27T06:28:40.680773+0000","last_undegraded":"2024-05-27T06:28:40.680773+0000","last_fullsized":"2024-05-27T06:28:40.680773+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:26:04.076545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661227+0000","last_change":"2024-05-27T06:28:40.661227+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661227+0000","last_undegraded":"2024-05-27T06:28:40.661227+0000","last_fullsized":"2024-05-27T06:28:40.661227+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678483+0000","last_change":"2024-05-27T06:28:40.674194+0000","last_active":"2024-05-27T06:28:40.678483+0000","last_peered":"2024-05-27T06:28:40.678483+0000","last_clean":"2024-05-27T06:28:40.678483+0000","last_became_active":"2024-05-27T06:28:40.673676+0000","last_became_peered":"2024-05-27T06:28:40.673676+0000","last_unstale":"2024-05-27T06:28:40.678483+0000","last_undegraded":"2024-05-27T06:28:40.678483+0000","last_fullsized":"2024-05-27T06:28:40.678483+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:12:15.418800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666390+0000","last_change":"2024-05-27T06:28:40.666390+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666390+0000","last_undegraded":"2024-05-27T06:28:40.666390+0000","last_fullsized":"2024-05-27T06:28:40.666390+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.685492+0000","last_change":"2024-05-27T06:28:40.681617+0000","last_active":"2024-05-27T06:28:40.685492+0000","last_peered":"2024-05-27T06:28:40.685492+0000","last_clean":"2024-05-27T06:28:40.685492+0000","last_became_active":"2024-05-27T06:28:40.681325+0000","last_became_peered":"2024-05-27T06:28:40.681325+0000","last_unstale":"2024-05-27T06:28:40.685492+0000","last_undegraded":"2024-05-27T06:28:40.685492+0000","last_fullsized":"2024-05-27T06:28:40.685492+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:26.993778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":138,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.667859+0000","last_change":"2024-05-27T06:27:28.692457+0000","last_active":"2024-05-27T06:28:40.667859+0000","last_peered":"2024-05-27T06:28:40.667859+0000","last_clean":"2024-05-27T06:28:40.667859+0000","last_became_active":"2024-05-27T06:27:28.691290+0000","last_became_peered":"2024-05-27T06:27:28.691290+0000","last_unstale":"2024-05-27T06:28:40.667859+0000","last_undegraded":"2024-05-27T06:28:40.667859+0000","last_fullsized":"2024-05-27T06:28:40.667859+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_clean_scrub_stamp":"2024-05-27T06:27:26.991915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:45.563728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":766699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":766699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T06:28:46.179 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T06:28:46.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.365+0000 7f7aa5600640 1 Processor -- start 2024-05-27T06:28:46.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.365+0000 7f7aa5600640 1 -- start start 2024-05-27T06:28:46.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.365+0000 7f7aa5600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7aa006cfb0 0x7f7aa015e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:46.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.365+0000 7f7aa5600640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aa0161c90 con 0x7f7aa006d3c0 2024-05-27T06:28:46.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.365+0000 7f7aa5600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aa0161f70 con 0x7f7aa0074130 2024-05-27T06:28:46.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.365+0000 7f7aa5600640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f7aa0162250 con 0x7f7aa006cfb0 2024-05-27T06:28:46.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.365+0000 7f7a9f400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f7aa006d3c0 0x7f7aa00d17c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:55130/0 (socket says 172.21.15.87:55130) 2024-05-27T06:28:46.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.365+0000 7f7a9f400640 1 -- 172.21.15.87:0/2602110776 learned_addr learned my addr 172.21.15.87:0/2602110776 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:46.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.365+0000 7f7a96000640 1 --2- 172.21.15.87:0/2602110776 >> v2:172.21.15.87:3300/0 conn(0x7f7aa006cfb0 0x7f7aa015e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:46.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.369+0000 7f7a96000640 1 -- 172.21.15.87:0/2602110776 >> v1:172.21.15.149:6789/0 conn(0x7f7aa0074130 legacy=0x7f7aa00cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:46.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.369+0000 7f7a96000640 1 -- 172.21.15.87:0/2602110776 >> v1:172.21.15.87:6789/0 conn(0x7f7aa006d3c0 legacy=0x7f7aa00d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:46.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.369+0000 7f7a9e000640 1 -- 172.21.15.87:0/2602110776 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 705910796 0 0) 0x7f7aa0161f70 con 0x7f7aa0074130 2024-05-27T06:28:46.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.369+0000 7f7a96000640 1 -- 172.21.15.87:0/2602110776 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa0162530 con 0x7f7aa006cfb0 2024-05-27T06:28:46.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.369+0000 7f7a96000640 1 --2- 172.21.15.87:0/2602110776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7aa006cfb0 0x7f7aa015e680 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7a880097c0 tx=0x7f7a8801c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ef97cabff28af5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:46.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.369+0000 7f7a9e000640 1 -- 172.21.15.87:0/2602110776 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a880b0070 con 0x7f7aa006cfb0 2024-05-27T06:28:46.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.369+0000 7f7a9e000640 1 -- 172.21.15.87:0/2602110776 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a880ab600 con 0x7f7aa006cfb0 2024-05-27T06:28:46.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.369+0000 7f7a9e000640 1 -- 172.21.15.87:0/2602110776 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a880ab9d0 con 0x7f7aa006cfb0 2024-05-27T06:28:46.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.373+0000 7f7aa5600640 1 -- 172.21.15.87:0/2602110776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7aa006cfb0 msgr2=0x7f7aa015e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:46.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.373+0000 7f7aa5600640 1 --2- 172.21.15.87:0/2602110776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7aa006cfb0 0x7f7aa015e680 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7a880097c0 tx=0x7f7a8801c330 comp rx=0 tx=0).stop 2024-05-27T06:28:46.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.373+0000 7f7aa5600640 1 -- 172.21.15.87:0/2602110776 shutdown_connections 2024-05-27T06:28:46.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.373+0000 7f7aa5600640 1 --2- 172.21.15.87:0/2602110776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7aa006cfb0 0x7f7aa015e680 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:46.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.373+0000 7f7aa5600640 1 -- 172.21.15.87:0/2602110776 >> 172.21.15.87:0/2602110776 conn(0x7f7aa00700d0 msgr2=0x7f7aa00704e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:46.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.373+0000 7f7aa5600640 1 -- 172.21.15.87:0/2602110776 shutdown_connections 2024-05-27T06:28:46.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.373+0000 7f7aa5600640 1 -- 172.21.15.87:0/2602110776 wait complete. 2024-05-27T06:28:46.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.373+0000 7f7aa5600640 1 Processor -- start 2024-05-27T06:28:46.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.373+0000 7f7aa5600640 1 -- start start 2024-05-27T06:28:46.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.377+0000 7f7aa5600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7aa006cfb0 0x7f7aa01467d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:46.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.377+0000 7f7aa5600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7aa006d3c0 0x7f7aa0137980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:46.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.377+0000 7f7aa5600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7aa0074130 0x7f7aa0137ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:46.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.377+0000 7f7aa5600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa00d2050 con 0x7f7aa006d3c0 2024-05-27T06:28:46.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.377+0000 7f7aa5600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa00d1ed0 con 0x7f7aa006cfb0 2024-05-27T06:28:46.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.377+0000 7f7aa5600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7aa00d21d0 con 0x7f7aa0074130 2024-05-27T06:28:46.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.377+0000 7f7a96000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7aa006d3c0 0x7f7aa0137980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:46.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.377+0000 7f7a96000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7aa006d3c0 0x7f7aa0137980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39820/0 (socket says 172.21.15.87:39820) 2024-05-27T06:28:46.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.377+0000 7f7a96000640 1 -- 172.21.15.87:0/1242206169 learned_addr learned my addr 172.21.15.87:0/1242206169 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:46.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.377+0000 7f7a9ea00640 1 --2- 172.21.15.87:0/1242206169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7aa006cfb0 0x7f7aa01467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:46.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.377+0000 7f7a9f400640 1 --2- 172.21.15.87:0/1242206169 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7aa0074130 0x7f7aa0137ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:46.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.377+0000 7f7a96000640 1 -- 172.21.15.87:0/1242206169 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7aa0074130 msgr2=0x7f7aa0137ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:46.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.377+0000 7f7a96000640 1 --2- 172.21.15.87:0/1242206169 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7aa0074130 0x7f7aa0137ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:46.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.377+0000 7f7a96000640 1 -- 172.21.15.87:0/1242206169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7aa006cfb0 msgr2=0x7f7aa01467d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:46.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.377+0000 7f7a96000640 1 --2- 172.21.15.87:0/1242206169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7aa006cfb0 0x7f7aa01467d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:46.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.377+0000 7f7a96000640 1 -- 172.21.15.87:0/1242206169 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa01e92a0 con 0x7f7aa006d3c0 2024-05-27T06:28:46.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.377+0000 7f7a96000640 1 --2- 172.21.15.87:0/1242206169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7aa006d3c0 0x7f7aa0137980 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7a880ae040 tx=0x7f7a8801ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:46.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.377+0000 7f7a97400640 1 -- 172.21.15.87:0/1242206169 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a880b0050 con 0x7f7aa006d3c0 2024-05-27T06:28:46.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.377+0000 7f7a97400640 1 -- 172.21.15.87:0/1242206169 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a880bc070 con 0x7f7aa006d3c0 2024-05-27T06:28:46.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.377+0000 7f7a97400640 1 -- 172.21.15.87:0/1242206169 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a880aac20 con 0x7f7aa006d3c0 2024-05-27T06:28:46.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.377+0000 7f7aa5600640 1 -- 172.21.15.87:0/1242206169 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aa01e9580 con 0x7f7aa006d3c0 2024-05-27T06:28:46.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.377+0000 7f7aa5600640 1 -- 172.21.15.87:0/1242206169 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aa01e9b40 con 0x7f7aa006d3c0 2024-05-27T06:28:46.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.377+0000 7f7aa5600640 1 -- 172.21.15.87:0/1242206169 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aa01e9010 con 0x7f7aa006d3c0 2024-05-27T06:28:46.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.381+0000 7f7a97400640 1 -- 172.21.15.87:0/1242206169 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7a880c1460 con 0x7f7aa006d3c0 2024-05-27T06:28:46.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.381+0000 7f7a97400640 1 --2- 172.21.15.87:0/1242206169 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7a7c06f400 0x7f7a7c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:46.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.381+0000 7f7a97400640 1 -- 172.21.15.87:0/1242206169 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f7a8812a0a0 con 0x7f7aa006d3c0 2024-05-27T06:28:46.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.381+0000 7f7a9ea00640 1 --2- 172.21.15.87:0/1242206169 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7a7c06f400 0x7f7a7c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:46.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.381+0000 7f7a9ea00640 1 --2- 172.21.15.87:0/1242206169 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7a7c06f400 0x7f7a7c071910 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7a90007fd0 tx=0x7f7a90009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:46.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.385+0000 7f7a97400640 1 -- 172.21.15.87:0/1242206169 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7a88015fb0 con 0x7f7aa006d3c0 2024-05-27T06:28:46.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.541+0000 7f7aa5600640 1 -- 172.21.15.87:0/1242206169 --> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7aa006aa30 con 0x7f7a7c06f400 2024-05-27T06:28:46.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.549+0000 7f7a97400640 1 -- 172.21.15.87:0/1242206169 <== mgr.4111 v2:172.21.15.87:6832/2724754260 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246627 (secure 0 0 0) 0x7f7aa006aa30 con 0x7f7a7c06f400 2024-05-27T06:28:46.550 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:46.551 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-27T06:28:46.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.553+0000 7f7aa5600640 1 -- 172.21.15.87:0/1242206169 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7a7c06f400 msgr2=0x7f7a7c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:46.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.553+0000 7f7aa5600640 1 --2- 172.21.15.87:0/1242206169 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7a7c06f400 0x7f7a7c071910 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7a90007fd0 tx=0x7f7a90009040 comp rx=0 tx=0).stop 2024-05-27T06:28:46.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.553+0000 7f7aa5600640 1 -- 172.21.15.87:0/1242206169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7aa006d3c0 msgr2=0x7f7aa0137980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:46.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.553+0000 7f7aa5600640 1 --2- 172.21.15.87:0/1242206169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7aa006d3c0 0x7f7aa0137980 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7a880ae040 tx=0x7f7a8801ab70 comp rx=0 tx=0).stop 2024-05-27T06:28:46.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.553+0000 7f7aa5600640 1 -- 172.21.15.87:0/1242206169 shutdown_connections 2024-05-27T06:28:46.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.553+0000 7f7aa5600640 1 --2- 172.21.15.87:0/1242206169 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7a7c06f400 0x7f7a7c071910 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:46.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.553+0000 7f7aa5600640 1 --2- 172.21.15.87:0/1242206169 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7aa0074130 0x7f7aa0137ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:46.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.553+0000 7f7aa5600640 1 --2- 172.21.15.87:0/1242206169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7aa006d3c0 0x7f7aa0137980 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:46.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.553+0000 7f7aa5600640 1 --2- 172.21.15.87:0/1242206169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7aa006cfb0 0x7f7aa01467d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:46.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.553+0000 7f7aa5600640 1 -- 172.21.15.87:0/1242206169 >> 172.21.15.87:0/1242206169 conn(0x7f7aa00700d0 msgr2=0x7f7aa015d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:46.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.553+0000 7f7aa5600640 1 -- 172.21.15.87:0/1242206169 shutdown_connections 2024-05-27T06:28:46.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.553+0000 7f7aa5600640 1 -- 172.21.15.87:0/1242206169 wait complete. 2024-05-27T06:28:46.570 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-05-27T06:28:44.582103+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220584,"kb_used_data":4392,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754136,"statfs":{"total":773094113280,"available":772868235264,"internally_reserved":0,"allocated":4497408,"data_stored":2591384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.937151"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666012+0000","last_change":"2024-05-27T06:28:40.666012+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666012+0000","last_undegraded":"2024-05-27T06:28:40.666012+0000","last_fullsized":"2024-05-27T06:28:40.666012+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.671554+0000","last_change":"2024-05-27T06:28:40.671554+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.671554+0000","last_undegraded":"2024-05-27T06:28:40.671554+0000","last_fullsized":"2024-05-27T06:28:40.671554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664525+0000","last_change":"2024-05-27T06:28:40.664525+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664525+0000","last_undegraded":"2024-05-27T06:28:40.664525+0000","last_fullsized":"2024-05-27T06:28:40.664525+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.659111+0000","last_change":"2024-05-27T06:28:40.659111+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.659111+0000","last_undegraded":"2024-05-27T06:28:40.659111+0000","last_fullsized":"2024-05-27T06:28:40.659111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.659584+0000","last_change":"2024-05-27T06:28:40.659584+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.659584+0000","last_undegraded":"2024-05-27T06:28:40.659584+0000","last_fullsized":"2024-05-27T06:28:40.659584+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.657488+0000","last_change":"2024-05-27T06:28:40.657488+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.657488+0000","last_undegraded":"2024-05-27T06:28:40.657488+0000","last_fullsized":"2024-05-27T06:28:40.657488+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.667129+0000","last_change":"2024-05-27T06:28:40.667129+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.667129+0000","last_undegraded":"2024-05-27T06:28:40.667129+0000","last_fullsized":"2024-05-27T06:28:40.667129+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.662161+0000","last_change":"2024-05-27T06:28:40.662161+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.662161+0000","last_undegraded":"2024-05-27T06:28:40.662161+0000","last_fullsized":"2024-05-27T06:28:40.662161+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664576+0000","last_change":"2024-05-27T06:28:40.664576+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664576+0000","last_undegraded":"2024-05-27T06:28:40.664576+0000","last_fullsized":"2024-05-27T06:28:40.664576+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.669507+0000","last_change":"2024-05-27T06:28:40.669507+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.669507+0000","last_undegraded":"2024-05-27T06:28:40.669507+0000","last_fullsized":"2024-05-27T06:28:40.669507+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.665538+0000","last_change":"2024-05-27T06:28:40.665538+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.665538+0000","last_undegraded":"2024-05-27T06:28:40.665538+0000","last_fullsized":"2024-05-27T06:28:40.665538+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664473+0000","last_change":"2024-05-27T06:28:40.664473+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664473+0000","last_undegraded":"2024-05-27T06:28:40.664473+0000","last_fullsized":"2024-05-27T06:28:40.664473+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.667541+0000","last_change":"2024-05-27T06:28:40.667541+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.667541+0000","last_undegraded":"2024-05-27T06:28:40.667541+0000","last_fullsized":"2024-05-27T06:28:40.667541+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.662387+0000","last_change":"2024-05-27T06:28:40.662387+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.662387+0000","last_undegraded":"2024-05-27T06:28:40.662387+0000","last_fullsized":"2024-05-27T06:28:40.662387+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666106+0000","last_change":"2024-05-27T06:28:40.666106+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666106+0000","last_undegraded":"2024-05-27T06:28:40.666106+0000","last_fullsized":"2024-05-27T06:28:40.666106+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664652+0000","last_change":"2024-05-27T06:28:40.664652+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664652+0000","last_undegraded":"2024-05-27T06:28:40.664652+0000","last_fullsized":"2024-05-27T06:28:40.664652+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.663563+0000","last_change":"2024-05-27T06:28:40.663563+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.663563+0000","last_undegraded":"2024-05-27T06:28:40.663563+0000","last_fullsized":"2024-05-27T06:28:40.663563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.656139+0000","last_change":"2024-05-27T06:28:40.656139+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.656139+0000","last_undegraded":"2024-05-27T06:28:40.656139+0000","last_fullsized":"2024-05-27T06:28:40.656139+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.658793+0000","last_change":"2024-05-27T06:28:40.658793+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.658793+0000","last_undegraded":"2024-05-27T06:28:40.658793+0000","last_fullsized":"2024-05-27T06:28:40.658793+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.655144+0000","last_change":"2024-05-27T06:28:40.655144+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.655144+0000","last_undegraded":"2024-05-27T06:28:40.655144+0000","last_fullsized":"2024-05-27T06:28:40.655144+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664913+0000","last_change":"2024-05-27T06:28:40.664913+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664913+0000","last_undegraded":"2024-05-27T06:28:40.664913+0000","last_fullsized":"2024-05-27T06:28:40.664913+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.660387+0000","last_change":"2024-05-27T06:28:40.660387+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.660387+0000","last_undegraded":"2024-05-27T06:28:40.660387+0000","last_fullsized":"2024-05-27T06:28:40.660387+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.662122+0000","last_change":"2024-05-27T06:28:40.662122+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.662122+0000","last_undegraded":"2024-05-27T06:28:40.662122+0000","last_fullsized":"2024-05-27T06:28:40.662122+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.657911+0000","last_change":"2024-05-27T06:28:40.657911+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.657911+0000","last_undegraded":"2024-05-27T06:28:40.657911+0000","last_fullsized":"2024-05-27T06:28:40.657911+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.656715+0000","last_change":"2024-05-27T06:28:40.656715+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.656715+0000","last_undegraded":"2024-05-27T06:28:40.656715+0000","last_fullsized":"2024-05-27T06:28:40.656715+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.660450+0000","last_change":"2024-05-27T06:28:40.660450+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.660450+0000","last_undegraded":"2024-05-27T06:28:40.660450+0000","last_fullsized":"2024-05-27T06:28:40.660450+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.655779+0000","last_change":"2024-05-27T06:28:40.655779+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.655779+0000","last_undegraded":"2024-05-27T06:28:40.655779+0000","last_fullsized":"2024-05-27T06:28:40.655779+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666097+0000","last_change":"2024-05-27T06:28:40.666097+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666097+0000","last_undegraded":"2024-05-27T06:28:40.666097+0000","last_fullsized":"2024-05-27T06:28:40.666097+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.655258+0000","last_change":"2024-05-27T06:28:40.655258+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.655258+0000","last_undegraded":"2024-05-27T06:28:40.655258+0000","last_fullsized":"2024-05-27T06:28:40.655258+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.655515+0000","last_change":"2024-05-27T06:28:40.655515+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.655515+0000","last_undegraded":"2024-05-27T06:28:40.655515+0000","last_fullsized":"2024-05-27T06:28:40.655515+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661353+0000","last_change":"2024-05-27T06:28:40.661353+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661353+0000","last_undegraded":"2024-05-27T06:28:40.661353+0000","last_fullsized":"2024-05-27T06:28:40.661353+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.657381+0000","last_change":"2024-05-27T06:28:40.657381+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.657381+0000","last_undegraded":"2024-05-27T06:28:40.657381+0000","last_fullsized":"2024-05-27T06:28:40.657381+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661094+0000","last_change":"2024-05-27T06:28:40.661094+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661094+0000","last_undegraded":"2024-05-27T06:28:40.661094+0000","last_fullsized":"2024-05-27T06:28:40.661094+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678349+0000","last_change":"2024-05-27T06:28:40.669695+0000","last_active":"2024-05-27T06:28:40.678349+0000","last_peered":"2024-05-27T06:28:40.678349+0000","last_clean":"2024-05-27T06:28:40.678349+0000","last_became_active":"2024-05-27T06:28:40.669333+0000","last_became_peered":"2024-05-27T06:28:40.669333+0000","last_unstale":"2024-05-27T06:28:40.678349+0000","last_undegraded":"2024-05-27T06:28:40.678349+0000","last_fullsized":"2024-05-27T06:28:40.678349+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:26:04.076545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.658480+0000","last_change":"2024-05-27T06:28:40.658480+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.658480+0000","last_undegraded":"2024-05-27T06:28:40.658480+0000","last_fullsized":"2024-05-27T06:28:40.658480+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678911+0000","last_change":"2024-05-27T06:28:40.673139+0000","last_active":"2024-05-27T06:28:40.678911+0000","last_peered":"2024-05-27T06:28:40.678911+0000","last_clean":"2024-05-27T06:28:40.678911+0000","last_became_active":"2024-05-27T06:28:40.672841+0000","last_became_peered":"2024-05-27T06:28:40.672841+0000","last_unstale":"2024-05-27T06:28:40.678911+0000","last_undegraded":"2024-05-27T06:28:40.678911+0000","last_fullsized":"2024-05-27T06:28:40.678911+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T06:56:04.095609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.658308+0000","last_change":"2024-05-27T06:28:40.658308+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.658308+0000","last_undegraded":"2024-05-27T06:28:40.658308+0000","last_fullsized":"2024-05-27T06:28:40.658308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678553+0000","last_change":"2024-05-27T06:28:40.672478+0000","last_active":"2024-05-27T06:28:40.678553+0000","last_peered":"2024-05-27T06:28:40.678553+0000","last_clean":"2024-05-27T06:28:40.678553+0000","last_became_active":"2024-05-27T06:28:40.672172+0000","last_became_peered":"2024-05-27T06:28:40.672172+0000","last_unstale":"2024-05-27T06:28:40.678553+0000","last_undegraded":"2024-05-27T06:28:40.678553+0000","last_fullsized":"2024-05-27T06:28:40.678553+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:13:59.179683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666498+0000","last_change":"2024-05-27T06:28:40.666498+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666498+0000","last_undegraded":"2024-05-27T06:28:40.666498+0000","last_fullsized":"2024-05-27T06:28:40.666498+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.685173+0000","last_change":"2024-05-27T06:28:40.677480+0000","last_active":"2024-05-27T06:28:40.685173+0000","last_peered":"2024-05-27T06:28:40.685173+0000","last_clean":"2024-05-27T06:28:40.685173+0000","last_became_active":"2024-05-27T06:28:40.677186+0000","last_became_peered":"2024-05-27T06:28:40.677186+0000","last_unstale":"2024-05-27T06:28:40.685173+0000","last_undegraded":"2024-05-27T06:28:40.685173+0000","last_fullsized":"2024-05-27T06:28:40.685173+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:16:49.937382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664434+0000","last_change":"2024-05-27T06:28:40.664434+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664434+0000","last_undegraded":"2024-05-27T06:28:40.664434+0000","last_fullsized":"2024-05-27T06:28:40.664434+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.682962+0000","last_change":"2024-05-27T06:28:40.676566+0000","last_active":"2024-05-27T06:28:40.682962+0000","last_peered":"2024-05-27T06:28:40.682962+0000","last_clean":"2024-05-27T06:28:40.682962+0000","last_became_active":"2024-05-27T06:28:40.676114+0000","last_became_peered":"2024-05-27T06:28:40.676114+0000","last_unstale":"2024-05-27T06:28:40.682962+0000","last_undegraded":"2024-05-27T06:28:40.682962+0000","last_fullsized":"2024-05-27T06:28:40.682962+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:04:39.297606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.665726+0000","last_change":"2024-05-27T06:28:40.665726+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.665726+0000","last_undegraded":"2024-05-27T06:28:40.665726+0000","last_fullsized":"2024-05-27T06:28:40.665726+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.685518+0000","last_change":"2024-05-27T06:28:40.681743+0000","last_active":"2024-05-27T06:28:40.685518+0000","last_peered":"2024-05-27T06:28:40.685518+0000","last_clean":"2024-05-27T06:28:40.685518+0000","last_became_active":"2024-05-27T06:28:40.681385+0000","last_became_peered":"2024-05-27T06:28:40.681385+0000","last_unstale":"2024-05-27T06:28:40.685518+0000","last_undegraded":"2024-05-27T06:28:40.685518+0000","last_fullsized":"2024-05-27T06:28:40.685518+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:04:39.297606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661324+0000","last_change":"2024-05-27T06:28:40.661324+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661324+0000","last_undegraded":"2024-05-27T06:28:40.661324+0000","last_fullsized":"2024-05-27T06:28:40.661324+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678962+0000","last_change":"2024-05-27T06:28:40.673602+0000","last_active":"2024-05-27T06:28:40.678962+0000","last_peered":"2024-05-27T06:28:40.678962+0000","last_clean":"2024-05-27T06:28:40.678962+0000","last_became_active":"2024-05-27T06:28:40.673279+0000","last_became_peered":"2024-05-27T06:28:40.673279+0000","last_unstale":"2024-05-27T06:28:40.678962+0000","last_undegraded":"2024-05-27T06:28:40.678962+0000","last_fullsized":"2024-05-27T06:28:40.678962+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:18:47.874305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.665064+0000","last_change":"2024-05-27T06:28:40.665064+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.665064+0000","last_undegraded":"2024-05-27T06:28:40.665064+0000","last_fullsized":"2024-05-27T06:28:40.665064+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.669177+0000","last_change":"2024-05-27T06:28:40.667506+0000","last_active":"2024-05-27T06:28:40.669177+0000","last_peered":"2024-05-27T06:28:40.669177+0000","last_clean":"2024-05-27T06:28:40.669177+0000","last_became_active":"2024-05-27T06:28:40.666805+0000","last_became_peered":"2024-05-27T06:28:40.666805+0000","last_unstale":"2024-05-27T06:28:40.669177+0000","last_undegraded":"2024-05-27T06:28:40.669177+0000","last_fullsized":"2024-05-27T06:28:40.669177+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:17:08.471701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.657337+0000","last_change":"2024-05-27T06:28:40.657337+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.657337+0000","last_undegraded":"2024-05-27T06:28:40.657337+0000","last_fullsized":"2024-05-27T06:28:40.657337+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.681300+0000","last_change":"2024-05-27T06:28:40.679319+0000","last_active":"2024-05-27T06:28:40.681300+0000","last_peered":"2024-05-27T06:28:40.681300+0000","last_clean":"2024-05-27T06:28:40.681300+0000","last_became_active":"2024-05-27T06:28:40.678970+0000","last_became_peered":"2024-05-27T06:28:40.678970+0000","last_unstale":"2024-05-27T06:28:40.681300+0000","last_undegraded":"2024-05-27T06:28:40.681300+0000","last_fullsized":"2024-05-27T06:28:40.681300+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:59:06.313098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.662678+0000","last_change":"2024-05-27T06:28:40.662678+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.662678+0000","last_undegraded":"2024-05-27T06:28:40.662678+0000","last_fullsized":"2024-05-27T06:28:40.662678+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.685252+0000","last_change":"2024-05-27T06:28:40.680595+0000","last_active":"2024-05-27T06:28:40.685252+0000","last_peered":"2024-05-27T06:28:40.685252+0000","last_clean":"2024-05-27T06:28:40.685252+0000","last_became_active":"2024-05-27T06:28:40.680213+0000","last_became_peered":"2024-05-27T06:28:40.680213+0000","last_unstale":"2024-05-27T06:28:40.685252+0000","last_undegraded":"2024-05-27T06:28:40.685252+0000","last_fullsized":"2024-05-27T06:28:40.685252+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:12:15.418800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.659359+0000","last_change":"2024-05-27T06:28:40.659359+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.659359+0000","last_undegraded":"2024-05-27T06:28:40.659359+0000","last_fullsized":"2024-05-27T06:28:40.659359+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.676705+0000","last_change":"2024-05-27T06:28:40.674198+0000","last_active":"2024-05-27T06:28:40.676705+0000","last_peered":"2024-05-27T06:28:40.676705+0000","last_clean":"2024-05-27T06:28:40.676705+0000","last_became_active":"2024-05-27T06:28:40.673825+0000","last_became_peered":"2024-05-27T06:28:40.673825+0000","last_unstale":"2024-05-27T06:28:40.676705+0000","last_undegraded":"2024-05-27T06:28:40.676705+0000","last_fullsized":"2024-05-27T06:28:40.676705+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T06:56:04.095609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.658786+0000","last_change":"2024-05-27T06:28:40.658786+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.658786+0000","last_undegraded":"2024-05-27T06:28:40.658786+0000","last_fullsized":"2024-05-27T06:28:40.658786+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.680398+0000","last_change":"2024-05-27T06:28:40.677467+0000","last_active":"2024-05-27T06:28:40.680398+0000","last_peered":"2024-05-27T06:28:40.680398+0000","last_clean":"2024-05-27T06:28:40.680398+0000","last_became_active":"2024-05-27T06:28:40.677128+0000","last_became_peered":"2024-05-27T06:28:40.677128+0000","last_unstale":"2024-05-27T06:28:40.680398+0000","last_undegraded":"2024-05-27T06:28:40.680398+0000","last_fullsized":"2024-05-27T06:28:40.680398+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:52:37.091584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.663954+0000","last_change":"2024-05-27T06:28:40.663954+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.663954+0000","last_undegraded":"2024-05-27T06:28:40.663954+0000","last_fullsized":"2024-05-27T06:28:40.663954+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.682084+0000","last_change":"2024-05-27T06:28:40.681038+0000","last_active":"2024-05-27T06:28:40.682084+0000","last_peered":"2024-05-27T06:28:40.682084+0000","last_clean":"2024-05-27T06:28:40.682084+0000","last_became_active":"2024-05-27T06:28:40.680758+0000","last_became_peered":"2024-05-27T06:28:40.680758+0000","last_unstale":"2024-05-27T06:28:40.682084+0000","last_undegraded":"2024-05-27T06:28:40.682084+0000","last_fullsized":"2024-05-27T06:28:40.682084+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T06:54:59.433478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.663479+0000","last_change":"2024-05-27T06:28:40.663479+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.663479+0000","last_undegraded":"2024-05-27T06:28:40.663479+0000","last_fullsized":"2024-05-27T06:28:40.663479+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678818+0000","last_change":"2024-05-27T06:28:40.673610+0000","last_active":"2024-05-27T06:28:40.678818+0000","last_peered":"2024-05-27T06:28:40.678818+0000","last_clean":"2024-05-27T06:28:40.678818+0000","last_became_active":"2024-05-27T06:28:40.673294+0000","last_became_peered":"2024-05-27T06:28:40.673294+0000","last_unstale":"2024-05-27T06:28:40.678818+0000","last_undegraded":"2024-05-27T06:28:40.678818+0000","last_fullsized":"2024-05-27T06:28:40.678818+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T06:56:04.095609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.662436+0000","last_change":"2024-05-27T06:28:40.662436+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.662436+0000","last_undegraded":"2024-05-27T06:28:40.662436+0000","last_fullsized":"2024-05-27T06:28:40.662436+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678457+0000","last_change":"2024-05-27T06:28:40.672146+0000","last_active":"2024-05-27T06:28:40.678457+0000","last_peered":"2024-05-27T06:28:40.678457+0000","last_clean":"2024-05-27T06:28:40.678457+0000","last_became_active":"2024-05-27T06:28:40.671021+0000","last_became_peered":"2024-05-27T06:28:40.671021+0000","last_unstale":"2024-05-27T06:28:40.678457+0000","last_undegraded":"2024-05-27T06:28:40.678457+0000","last_fullsized":"2024-05-27T06:28:40.678457+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:00:20.482241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664559+0000","last_change":"2024-05-27T06:28:40.664559+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664559+0000","last_undegraded":"2024-05-27T06:28:40.664559+0000","last_fullsized":"2024-05-27T06:28:40.664559+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.685487+0000","last_change":"2024-05-27T06:28:40.681584+0000","last_active":"2024-05-27T06:28:40.685487+0000","last_peered":"2024-05-27T06:28:40.685487+0000","last_clean":"2024-05-27T06:28:40.685487+0000","last_became_active":"2024-05-27T06:28:40.681279+0000","last_became_peered":"2024-05-27T06:28:40.681279+0000","last_unstale":"2024-05-27T06:28:40.685487+0000","last_undegraded":"2024-05-27T06:28:40.685487+0000","last_fullsized":"2024-05-27T06:28:40.685487+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T06:56:04.095609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.667742+0000","last_change":"2024-05-27T06:28:40.667742+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.667742+0000","last_undegraded":"2024-05-27T06:28:40.667742+0000","last_fullsized":"2024-05-27T06:28:40.667742+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.682990+0000","last_change":"2024-05-27T06:28:40.679172+0000","last_active":"2024-05-27T06:28:40.682990+0000","last_peered":"2024-05-27T06:28:40.682990+0000","last_clean":"2024-05-27T06:28:40.682990+0000","last_became_active":"2024-05-27T06:28:40.678786+0000","last_became_peered":"2024-05-27T06:28:40.678786+0000","last_unstale":"2024-05-27T06:28:40.682990+0000","last_undegraded":"2024-05-27T06:28:40.682990+0000","last_fullsized":"2024-05-27T06:28:40.682990+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:55:20.077082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664987+0000","last_change":"2024-05-27T06:28:40.664987+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664987+0000","last_undegraded":"2024-05-27T06:28:40.664987+0000","last_fullsized":"2024-05-27T06:28:40.664987+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.685154+0000","last_change":"2024-05-27T06:28:40.677177+0000","last_active":"2024-05-27T06:28:40.685154+0000","last_peered":"2024-05-27T06:28:40.685154+0000","last_clean":"2024-05-27T06:28:40.685154+0000","last_became_active":"2024-05-27T06:28:40.676640+0000","last_became_peered":"2024-05-27T06:28:40.676640+0000","last_unstale":"2024-05-27T06:28:40.685154+0000","last_undegraded":"2024-05-27T06:28:40.685154+0000","last_fullsized":"2024-05-27T06:28:40.685154+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:00:20.482241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.658945+0000","last_change":"2024-05-27T06:28:40.658945+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.658945+0000","last_undegraded":"2024-05-27T06:28:40.658945+0000","last_fullsized":"2024-05-27T06:28:40.658945+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.680529+0000","last_change":"2024-05-27T06:28:40.675405+0000","last_active":"2024-05-27T06:28:40.680529+0000","last_peered":"2024-05-27T06:28:40.680529+0000","last_clean":"2024-05-27T06:28:40.680529+0000","last_became_active":"2024-05-27T06:28:40.675004+0000","last_became_peered":"2024-05-27T06:28:40.675004+0000","last_unstale":"2024-05-27T06:28:40.680529+0000","last_undegraded":"2024-05-27T06:28:40.680529+0000","last_fullsized":"2024-05-27T06:28:40.680529+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:01:06.950501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.657363+0000","last_change":"2024-05-27T06:28:40.657363+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.657363+0000","last_undegraded":"2024-05-27T06:28:40.657363+0000","last_fullsized":"2024-05-27T06:28:40.657363+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.677993+0000","last_change":"2024-05-27T06:28:40.670977+0000","last_active":"2024-05-27T06:28:40.677993+0000","last_peered":"2024-05-27T06:28:40.677993+0000","last_clean":"2024-05-27T06:28:40.677993+0000","last_became_active":"2024-05-27T06:28:40.670723+0000","last_became_peered":"2024-05-27T06:28:40.670723+0000","last_unstale":"2024-05-27T06:28:40.677993+0000","last_undegraded":"2024-05-27T06:28:40.677993+0000","last_fullsized":"2024-05-27T06:28:40.677993+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:58:11.217383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661895+0000","last_change":"2024-05-27T06:28:40.661895+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661895+0000","last_undegraded":"2024-05-27T06:28:40.661895+0000","last_fullsized":"2024-05-27T06:28:40.661895+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.662351+0000","last_change":"2024-05-27T06:28:40.661275+0000","last_active":"2024-05-27T06:28:40.662351+0000","last_peered":"2024-05-27T06:28:40.662351+0000","last_clean":"2024-05-27T06:28:40.662351+0000","last_became_active":"2024-05-27T06:28:40.661013+0000","last_became_peered":"2024-05-27T06:28:40.661013+0000","last_unstale":"2024-05-27T06:28:40.662351+0000","last_undegraded":"2024-05-27T06:28:40.662351+0000","last_fullsized":"2024-05-27T06:28:40.662351+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:22:56.239970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661597+0000","last_change":"2024-05-27T06:28:40.661597+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661597+0000","last_undegraded":"2024-05-27T06:28:40.661597+0000","last_fullsized":"2024-05-27T06:28:40.661597+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.675384+0000","last_change":"2024-05-27T06:28:40.672102+0000","last_active":"2024-05-27T06:28:40.675384+0000","last_peered":"2024-05-27T06:28:40.675384+0000","last_clean":"2024-05-27T06:28:40.675384+0000","last_became_active":"2024-05-27T06:28:40.671774+0000","last_became_peered":"2024-05-27T06:28:40.671774+0000","last_unstale":"2024-05-27T06:28:40.675384+0000","last_undegraded":"2024-05-27T06:28:40.675384+0000","last_fullsized":"2024-05-27T06:28:40.675384+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:40:43.723380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666694+0000","last_change":"2024-05-27T06:28:40.666694+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666694+0000","last_undegraded":"2024-05-27T06:28:40.666694+0000","last_fullsized":"2024-05-27T06:28:40.666694+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.682769+0000","last_change":"2024-05-27T06:28:40.679403+0000","last_active":"2024-05-27T06:28:40.682769+0000","last_peered":"2024-05-27T06:28:40.682769+0000","last_clean":"2024-05-27T06:28:40.682769+0000","last_became_active":"2024-05-27T06:28:40.679101+0000","last_became_peered":"2024-05-27T06:28:40.679101+0000","last_unstale":"2024-05-27T06:28:40.682769+0000","last_undegraded":"2024-05-27T06:28:40.682769+0000","last_fullsized":"2024-05-27T06:28:40.682769+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:18:47.874305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664021+0000","last_change":"2024-05-27T06:28:40.664021+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664021+0000","last_undegraded":"2024-05-27T06:28:40.664021+0000","last_fullsized":"2024-05-27T06:28:40.664021+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.668814+0000","last_change":"2024-05-27T06:28:40.667132+0000","last_active":"2024-05-27T06:28:40.668814+0000","last_peered":"2024-05-27T06:28:40.668814+0000","last_clean":"2024-05-27T06:28:40.668814+0000","last_became_active":"2024-05-27T06:28:40.666811+0000","last_became_peered":"2024-05-27T06:28:40.666811+0000","last_unstale":"2024-05-27T06:28:40.668814+0000","last_undegraded":"2024-05-27T06:28:40.668814+0000","last_fullsized":"2024-05-27T06:28:40.668814+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:30:24.675813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.658112+0000","last_change":"2024-05-27T06:28:40.658112+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.658112+0000","last_undegraded":"2024-05-27T06:28:40.658112+0000","last_fullsized":"2024-05-27T06:28:40.658112+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.676796+0000","last_change":"2024-05-27T06:28:40.674354+0000","last_active":"2024-05-27T06:28:40.676796+0000","last_peered":"2024-05-27T06:28:40.676796+0000","last_clean":"2024-05-27T06:28:40.676796+0000","last_became_active":"2024-05-27T06:28:40.673991+0000","last_became_peered":"2024-05-27T06:28:40.673991+0000","last_unstale":"2024-05-27T06:28:40.676796+0000","last_undegraded":"2024-05-27T06:28:40.676796+0000","last_fullsized":"2024-05-27T06:28:40.676796+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:26.993778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.662200+0000","last_change":"2024-05-27T06:28:40.662200+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.662200+0000","last_undegraded":"2024-05-27T06:28:40.662200+0000","last_fullsized":"2024-05-27T06:28:40.662200+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.680630+0000","last_change":"2024-05-27T06:28:40.676434+0000","last_active":"2024-05-27T06:28:40.680630+0000","last_peered":"2024-05-27T06:28:40.680630+0000","last_clean":"2024-05-27T06:28:40.680630+0000","last_became_active":"2024-05-27T06:28:40.676154+0000","last_became_peered":"2024-05-27T06:28:40.676154+0000","last_unstale":"2024-05-27T06:28:40.680630+0000","last_undegraded":"2024-05-27T06:28:40.680630+0000","last_fullsized":"2024-05-27T06:28:40.680630+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:29:20.698358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666027+0000","last_change":"2024-05-27T06:28:40.666027+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666027+0000","last_undegraded":"2024-05-27T06:28:40.666027+0000","last_fullsized":"2024-05-27T06:28:40.666027+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.668201+0000","last_change":"2024-05-27T06:28:40.666405+0000","last_active":"2024-05-27T06:28:40.668201+0000","last_peered":"2024-05-27T06:28:40.668201+0000","last_clean":"2024-05-27T06:28:40.668201+0000","last_became_active":"2024-05-27T06:28:40.666146+0000","last_became_peered":"2024-05-27T06:28:40.666146+0000","last_unstale":"2024-05-27T06:28:40.668201+0000","last_undegraded":"2024-05-27T06:28:40.668201+0000","last_fullsized":"2024-05-27T06:28:40.668201+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:18:47.874305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.663494+0000","last_change":"2024-05-27T06:28:40.663494+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.663494+0000","last_undegraded":"2024-05-27T06:28:40.663494+0000","last_fullsized":"2024-05-27T06:28:40.663494+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.680403+0000","last_change":"2024-05-27T06:28:40.677362+0000","last_active":"2024-05-27T06:28:40.680403+0000","last_peered":"2024-05-27T06:28:40.680403+0000","last_clean":"2024-05-27T06:28:40.680403+0000","last_became_active":"2024-05-27T06:28:40.677080+0000","last_became_peered":"2024-05-27T06:28:40.677080+0000","last_unstale":"2024-05-27T06:28:40.680403+0000","last_undegraded":"2024-05-27T06:28:40.680403+0000","last_fullsized":"2024-05-27T06:28:40.680403+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:26.993778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.657732+0000","last_change":"2024-05-27T06:28:40.657732+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.657732+0000","last_undegraded":"2024-05-27T06:28:40.657732+0000","last_fullsized":"2024-05-27T06:28:40.657732+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.680428+0000","last_change":"2024-05-27T06:28:40.675180+0000","last_active":"2024-05-27T06:28:40.680428+0000","last_peered":"2024-05-27T06:28:40.680428+0000","last_clean":"2024-05-27T06:28:40.680428+0000","last_became_active":"2024-05-27T06:28:40.674872+0000","last_became_peered":"2024-05-27T06:28:40.674872+0000","last_unstale":"2024-05-27T06:28:40.680428+0000","last_undegraded":"2024-05-27T06:28:40.680428+0000","last_fullsized":"2024-05-27T06:28:40.680428+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:16:49.937382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661851+0000","last_change":"2024-05-27T06:28:40.661851+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661851+0000","last_undegraded":"2024-05-27T06:28:40.661851+0000","last_fullsized":"2024-05-27T06:28:40.661851+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.680773+0000","last_change":"2024-05-27T06:28:40.672373+0000","last_active":"2024-05-27T06:28:40.680773+0000","last_peered":"2024-05-27T06:28:40.680773+0000","last_clean":"2024-05-27T06:28:40.680773+0000","last_became_active":"2024-05-27T06:28:40.672028+0000","last_became_peered":"2024-05-27T06:28:40.672028+0000","last_unstale":"2024-05-27T06:28:40.680773+0000","last_undegraded":"2024-05-27T06:28:40.680773+0000","last_fullsized":"2024-05-27T06:28:40.680773+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:26:04.076545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661227+0000","last_change":"2024-05-27T06:28:40.661227+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661227+0000","last_undegraded":"2024-05-27T06:28:40.661227+0000","last_fullsized":"2024-05-27T06:28:40.661227+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678483+0000","last_change":"2024-05-27T06:28:40.674194+0000","last_active":"2024-05-27T06:28:40.678483+0000","last_peered":"2024-05-27T06:28:40.678483+0000","last_clean":"2024-05-27T06:28:40.678483+0000","last_became_active":"2024-05-27T06:28:40.673676+0000","last_became_peered":"2024-05-27T06:28:40.673676+0000","last_unstale":"2024-05-27T06:28:40.678483+0000","last_undegraded":"2024-05-27T06:28:40.678483+0000","last_fullsized":"2024-05-27T06:28:40.678483+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:12:15.418800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666390+0000","last_change":"2024-05-27T06:28:40.666390+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666390+0000","last_undegraded":"2024-05-27T06:28:40.666390+0000","last_fullsized":"2024-05-27T06:28:40.666390+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.685492+0000","last_change":"2024-05-27T06:28:40.681617+0000","last_active":"2024-05-27T06:28:40.685492+0000","last_peered":"2024-05-27T06:28:40.685492+0000","last_clean":"2024-05-27T06:28:40.685492+0000","last_became_active":"2024-05-27T06:28:40.681325+0000","last_became_peered":"2024-05-27T06:28:40.681325+0000","last_unstale":"2024-05-27T06:28:40.685492+0000","last_undegraded":"2024-05-27T06:28:40.685492+0000","last_fullsized":"2024-05-27T06:28:40.685492+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:26.993778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":138,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.667859+0000","last_change":"2024-05-27T06:27:28.692457+0000","last_active":"2024-05-27T06:28:40.667859+0000","last_peered":"2024-05-27T06:28:40.667859+0000","last_clean":"2024-05-27T06:28:40.667859+0000","last_became_active":"2024-05-27T06:27:28.691290+0000","last_became_peered":"2024-05-27T06:27:28.691290+0000","last_unstale":"2024-05-27T06:28:40.667859+0000","last_undegraded":"2024-05-27T06:28:40.667859+0000","last_fullsized":"2024-05-27T06:28:40.667859+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_clean_scrub_stamp":"2024-05-27T06:27:26.991915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:45.563728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":766699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":766699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T06:28:46.574 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3f is not active+clean 2024-05-27T06:28:46.574 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.666012+0000', 'last_change': '2024-05-27T06:28:40.666012+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.666012+0000', 'last_undegraded': '2024-05-27T06:28:40.666012+0000', 'last_fullsized': '2024-05-27T06:28:40.666012+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-27T06:28:46.574 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3e is not active+clean 2024-05-27T06:28:46.574 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.671554+0000', 'last_change': '2024-05-27T06:28:40.671554+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.671554+0000', 'last_undegraded': '2024-05-27T06:28:40.671554+0000', 'last_fullsized': '2024-05-27T06:28:40.671554+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-27T06:28:46.575 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3d is not active+clean 2024-05-27T06:28:46.575 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.664525+0000', 'last_change': '2024-05-27T06:28:40.664525+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.664525+0000', 'last_undegraded': '2024-05-27T06:28:40.664525+0000', 'last_fullsized': '2024-05-27T06:28:40.664525+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T06:28:46.575 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3c is not active+clean 2024-05-27T06:28:46.575 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.659111+0000', 'last_change': '2024-05-27T06:28:40.659111+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.659111+0000', 'last_undegraded': '2024-05-27T06:28:40.659111+0000', 'last_fullsized': '2024-05-27T06:28:40.659111+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-27T06:28:46.575 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3b is not active+clean 2024-05-27T06:28:46.575 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.659584+0000', 'last_change': '2024-05-27T06:28:40.659584+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.659584+0000', 'last_undegraded': '2024-05-27T06:28:40.659584+0000', 'last_fullsized': '2024-05-27T06:28:40.659584+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-27T06:28:46.575 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3a is not active+clean 2024-05-27T06:28:46.575 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.657488+0000', 'last_change': '2024-05-27T06:28:40.657488+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.657488+0000', 'last_undegraded': '2024-05-27T06:28:40.657488+0000', 'last_fullsized': '2024-05-27T06:28:40.657488+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-27T06:28:46.576 INFO:tasks.ceph.ceph_manager.ceph:PG 6.39 is not active+clean 2024-05-27T06:28:46.576 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.667129+0000', 'last_change': '2024-05-27T06:28:40.667129+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.667129+0000', 'last_undegraded': '2024-05-27T06:28:40.667129+0000', 'last_fullsized': '2024-05-27T06:28:40.667129+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-27T06:28:46.576 INFO:tasks.ceph.ceph_manager.ceph:PG 6.38 is not active+clean 2024-05-27T06:28:46.576 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.662161+0000', 'last_change': '2024-05-27T06:28:40.662161+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.662161+0000', 'last_undegraded': '2024-05-27T06:28:40.662161+0000', 'last_fullsized': '2024-05-27T06:28:40.662161+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-27T06:28:46.576 INFO:tasks.ceph.ceph_manager.ceph:PG 6.37 is not active+clean 2024-05-27T06:28:46.576 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.664576+0000', 'last_change': '2024-05-27T06:28:40.664576+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.664576+0000', 'last_undegraded': '2024-05-27T06:28:40.664576+0000', 'last_fullsized': '2024-05-27T06:28:40.664576+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T06:28:46.576 INFO:tasks.ceph.ceph_manager.ceph:PG 6.36 is not active+clean 2024-05-27T06:28:46.576 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.669507+0000', 'last_change': '2024-05-27T06:28:40.669507+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.669507+0000', 'last_undegraded': '2024-05-27T06:28:40.669507+0000', 'last_fullsized': '2024-05-27T06:28:40.669507+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-27T06:28:46.576 INFO:tasks.ceph.ceph_manager.ceph:PG 6.35 is not active+clean 2024-05-27T06:28:46.576 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.665538+0000', 'last_change': '2024-05-27T06:28:40.665538+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.665538+0000', 'last_undegraded': '2024-05-27T06:28:40.665538+0000', 'last_fullsized': '2024-05-27T06:28:40.665538+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-27T06:28:46.576 INFO:tasks.ceph.ceph_manager.ceph:PG 6.34 is not active+clean 2024-05-27T06:28:46.577 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.664473+0000', 'last_change': '2024-05-27T06:28:40.664473+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.664473+0000', 'last_undegraded': '2024-05-27T06:28:40.664473+0000', 'last_fullsized': '2024-05-27T06:28:40.664473+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T06:28:46.577 INFO:tasks.ceph.ceph_manager.ceph:PG 6.33 is not active+clean 2024-05-27T06:28:46.577 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.667541+0000', 'last_change': '2024-05-27T06:28:40.667541+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.667541+0000', 'last_undegraded': '2024-05-27T06:28:40.667541+0000', 'last_fullsized': '2024-05-27T06:28:40.667541+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-27T06:28:46.577 INFO:tasks.ceph.ceph_manager.ceph:PG 6.32 is not active+clean 2024-05-27T06:28:46.577 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.662387+0000', 'last_change': '2024-05-27T06:28:40.662387+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.662387+0000', 'last_undegraded': '2024-05-27T06:28:40.662387+0000', 'last_fullsized': '2024-05-27T06:28:40.662387+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-27T06:28:46.577 INFO:tasks.ceph.ceph_manager.ceph:PG 6.31 is not active+clean 2024-05-27T06:28:46.577 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.666106+0000', 'last_change': '2024-05-27T06:28:40.666106+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.666106+0000', 'last_undegraded': '2024-05-27T06:28:40.666106+0000', 'last_fullsized': '2024-05-27T06:28:40.666106+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-27T06:28:46.577 INFO:tasks.ceph.ceph_manager.ceph:PG 6.30 is not active+clean 2024-05-27T06:28:46.577 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.664652+0000', 'last_change': '2024-05-27T06:28:40.664652+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.664652+0000', 'last_undegraded': '2024-05-27T06:28:40.664652+0000', 'last_fullsized': '2024-05-27T06:28:40.664652+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-27T06:28:46.577 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2f is not active+clean 2024-05-27T06:28:46.577 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.663563+0000', 'last_change': '2024-05-27T06:28:40.663563+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.663563+0000', 'last_undegraded': '2024-05-27T06:28:40.663563+0000', 'last_fullsized': '2024-05-27T06:28:40.663563+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-27T06:28:46.577 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2e is not active+clean 2024-05-27T06:28:46.578 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.656139+0000', 'last_change': '2024-05-27T06:28:40.656139+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.656139+0000', 'last_undegraded': '2024-05-27T06:28:40.656139+0000', 'last_fullsized': '2024-05-27T06:28:40.656139+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-27T06:28:46.578 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2d is not active+clean 2024-05-27T06:28:46.578 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.658793+0000', 'last_change': '2024-05-27T06:28:40.658793+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.658793+0000', 'last_undegraded': '2024-05-27T06:28:40.658793+0000', 'last_fullsized': '2024-05-27T06:28:40.658793+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-27T06:28:46.578 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2c is not active+clean 2024-05-27T06:28:46.578 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.655144+0000', 'last_change': '2024-05-27T06:28:40.655144+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.655144+0000', 'last_undegraded': '2024-05-27T06:28:40.655144+0000', 'last_fullsized': '2024-05-27T06:28:40.655144+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-27T06:28:46.578 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2b is not active+clean 2024-05-27T06:28:46.578 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.664913+0000', 'last_change': '2024-05-27T06:28:40.664913+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.664913+0000', 'last_undegraded': '2024-05-27T06:28:40.664913+0000', 'last_fullsized': '2024-05-27T06:28:40.664913+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-27T06:28:46.578 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2a is not active+clean 2024-05-27T06:28:46.578 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.660387+0000', 'last_change': '2024-05-27T06:28:40.660387+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.660387+0000', 'last_undegraded': '2024-05-27T06:28:40.660387+0000', 'last_fullsized': '2024-05-27T06:28:40.660387+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-27T06:28:46.578 INFO:tasks.ceph.ceph_manager.ceph:PG 6.29 is not active+clean 2024-05-27T06:28:46.578 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.662122+0000', 'last_change': '2024-05-27T06:28:40.662122+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.662122+0000', 'last_undegraded': '2024-05-27T06:28:40.662122+0000', 'last_fullsized': '2024-05-27T06:28:40.662122+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-27T06:28:46.579 INFO:tasks.ceph.ceph_manager.ceph:PG 6.28 is not active+clean 2024-05-27T06:28:46.579 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.657911+0000', 'last_change': '2024-05-27T06:28:40.657911+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.657911+0000', 'last_undegraded': '2024-05-27T06:28:40.657911+0000', 'last_fullsized': '2024-05-27T06:28:40.657911+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-27T06:28:46.579 INFO:tasks.ceph.ceph_manager.ceph:PG 6.27 is not active+clean 2024-05-27T06:28:46.579 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.656715+0000', 'last_change': '2024-05-27T06:28:40.656715+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.656715+0000', 'last_undegraded': '2024-05-27T06:28:40.656715+0000', 'last_fullsized': '2024-05-27T06:28:40.656715+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-27T06:28:46.579 INFO:tasks.ceph.ceph_manager.ceph:PG 6.26 is not active+clean 2024-05-27T06:28:46.579 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.660450+0000', 'last_change': '2024-05-27T06:28:40.660450+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.660450+0000', 'last_undegraded': '2024-05-27T06:28:40.660450+0000', 'last_fullsized': '2024-05-27T06:28:40.660450+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-27T06:28:46.579 INFO:tasks.ceph.ceph_manager.ceph:PG 6.25 is not active+clean 2024-05-27T06:28:46.579 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.655779+0000', 'last_change': '2024-05-27T06:28:40.655779+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.655779+0000', 'last_undegraded': '2024-05-27T06:28:40.655779+0000', 'last_fullsized': '2024-05-27T06:28:40.655779+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-27T06:28:46.579 INFO:tasks.ceph.ceph_manager.ceph:PG 6.24 is not active+clean 2024-05-27T06:28:46.579 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.666097+0000', 'last_change': '2024-05-27T06:28:40.666097+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.666097+0000', 'last_undegraded': '2024-05-27T06:28:40.666097+0000', 'last_fullsized': '2024-05-27T06:28:40.666097+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-27T06:28:46.579 INFO:tasks.ceph.ceph_manager.ceph:PG 6.23 is not active+clean 2024-05-27T06:28:46.579 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.655258+0000', 'last_change': '2024-05-27T06:28:40.655258+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.655258+0000', 'last_undegraded': '2024-05-27T06:28:40.655258+0000', 'last_fullsized': '2024-05-27T06:28:40.655258+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-27T06:28:46.580 INFO:tasks.ceph.ceph_manager.ceph:PG 6.22 is not active+clean 2024-05-27T06:28:46.580 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.655515+0000', 'last_change': '2024-05-27T06:28:40.655515+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.655515+0000', 'last_undegraded': '2024-05-27T06:28:40.655515+0000', 'last_fullsized': '2024-05-27T06:28:40.655515+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-27T06:28:46.580 INFO:tasks.ceph.ceph_manager.ceph:PG 6.21 is not active+clean 2024-05-27T06:28:46.580 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.661353+0000', 'last_change': '2024-05-27T06:28:40.661353+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.661353+0000', 'last_undegraded': '2024-05-27T06:28:40.661353+0000', 'last_fullsized': '2024-05-27T06:28:40.661353+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-27T06:28:46.580 INFO:tasks.ceph.ceph_manager.ceph:PG 6.20 is not active+clean 2024-05-27T06:28:46.580 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.657381+0000', 'last_change': '2024-05-27T06:28:40.657381+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.657381+0000', 'last_undegraded': '2024-05-27T06:28:40.657381+0000', 'last_fullsized': '2024-05-27T06:28:40.657381+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-27T06:28:46.580 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1c is not active+clean 2024-05-27T06:28:46.580 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.661094+0000', 'last_change': '2024-05-27T06:28:40.661094+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.661094+0000', 'last_undegraded': '2024-05-27T06:28:40.661094+0000', 'last_fullsized': '2024-05-27T06:28:40.661094+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-27T06:28:46.580 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1d is not active+clean 2024-05-27T06:28:46.580 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.658480+0000', 'last_change': '2024-05-27T06:28:40.658480+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.658480+0000', 'last_undegraded': '2024-05-27T06:28:40.658480+0000', 'last_fullsized': '2024-05-27T06:28:40.658480+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-27T06:28:46.581 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1e is not active+clean 2024-05-27T06:28:46.581 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.658308+0000', 'last_change': '2024-05-27T06:28:40.658308+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.658308+0000', 'last_undegraded': '2024-05-27T06:28:40.658308+0000', 'last_fullsized': '2024-05-27T06:28:40.658308+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-27T06:28:46.581 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1f is not active+clean 2024-05-27T06:28:46.581 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.666498+0000', 'last_change': '2024-05-27T06:28:40.666498+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.666498+0000', 'last_undegraded': '2024-05-27T06:28:40.666498+0000', 'last_fullsized': '2024-05-27T06:28:40.666498+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-27T06:28:46.581 INFO:tasks.ceph.ceph_manager.ceph:PG 6.18 is not active+clean 2024-05-27T06:28:46.581 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.664434+0000', 'last_change': '2024-05-27T06:28:40.664434+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.664434+0000', 'last_undegraded': '2024-05-27T06:28:40.664434+0000', 'last_fullsized': '2024-05-27T06:28:40.664434+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T06:28:46.581 INFO:tasks.ceph.ceph_manager.ceph:PG 6.19 is not active+clean 2024-05-27T06:28:46.581 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.665726+0000', 'last_change': '2024-05-27T06:28:40.665726+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.665726+0000', 'last_undegraded': '2024-05-27T06:28:40.665726+0000', 'last_fullsized': '2024-05-27T06:28:40.665726+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-27T06:28:46.581 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1a is not active+clean 2024-05-27T06:28:46.581 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.661324+0000', 'last_change': '2024-05-27T06:28:40.661324+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.661324+0000', 'last_undegraded': '2024-05-27T06:28:40.661324+0000', 'last_fullsized': '2024-05-27T06:28:40.661324+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-27T06:28:46.582 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1b is not active+clean 2024-05-27T06:28:46.582 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.665064+0000', 'last_change': '2024-05-27T06:28:40.665064+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.665064+0000', 'last_undegraded': '2024-05-27T06:28:40.665064+0000', 'last_fullsized': '2024-05-27T06:28:40.665064+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-27T06:28:46.582 INFO:tasks.ceph.ceph_manager.ceph:PG 6.14 is not active+clean 2024-05-27T06:28:46.582 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.657337+0000', 'last_change': '2024-05-27T06:28:40.657337+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.657337+0000', 'last_undegraded': '2024-05-27T06:28:40.657337+0000', 'last_fullsized': '2024-05-27T06:28:40.657337+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-27T06:28:46.582 INFO:tasks.ceph.ceph_manager.ceph:PG 6.15 is not active+clean 2024-05-27T06:28:46.582 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.662678+0000', 'last_change': '2024-05-27T06:28:40.662678+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.662678+0000', 'last_undegraded': '2024-05-27T06:28:40.662678+0000', 'last_fullsized': '2024-05-27T06:28:40.662678+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-27T06:28:46.582 INFO:tasks.ceph.ceph_manager.ceph:PG 6.16 is not active+clean 2024-05-27T06:28:46.582 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.659359+0000', 'last_change': '2024-05-27T06:28:40.659359+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.659359+0000', 'last_undegraded': '2024-05-27T06:28:40.659359+0000', 'last_fullsized': '2024-05-27T06:28:40.659359+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T06:28:46.582 INFO:tasks.ceph.ceph_manager.ceph:PG 6.17 is not active+clean 2024-05-27T06:28:46.582 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.658786+0000', 'last_change': '2024-05-27T06:28:40.658786+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.658786+0000', 'last_undegraded': '2024-05-27T06:28:40.658786+0000', 'last_fullsized': '2024-05-27T06:28:40.658786+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-27T06:28:46.582 INFO:tasks.ceph.ceph_manager.ceph:PG 6.10 is not active+clean 2024-05-27T06:28:46.583 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.663954+0000', 'last_change': '2024-05-27T06:28:40.663954+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.663954+0000', 'last_undegraded': '2024-05-27T06:28:40.663954+0000', 'last_fullsized': '2024-05-27T06:28:40.663954+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T06:28:46.583 INFO:tasks.ceph.ceph_manager.ceph:PG 6.11 is not active+clean 2024-05-27T06:28:46.583 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.663479+0000', 'last_change': '2024-05-27T06:28:40.663479+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.663479+0000', 'last_undegraded': '2024-05-27T06:28:40.663479+0000', 'last_fullsized': '2024-05-27T06:28:40.663479+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-27T06:28:46.583 INFO:tasks.ceph.ceph_manager.ceph:PG 6.12 is not active+clean 2024-05-27T06:28:46.583 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.662436+0000', 'last_change': '2024-05-27T06:28:40.662436+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.662436+0000', 'last_undegraded': '2024-05-27T06:28:40.662436+0000', 'last_fullsized': '2024-05-27T06:28:40.662436+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-27T06:28:46.583 INFO:tasks.ceph.ceph_manager.ceph:PG 6.13 is not active+clean 2024-05-27T06:28:46.583 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.664559+0000', 'last_change': '2024-05-27T06:28:40.664559+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.664559+0000', 'last_undegraded': '2024-05-27T06:28:40.664559+0000', 'last_fullsized': '2024-05-27T06:28:40.664559+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-27T06:28:46.583 INFO:tasks.ceph.ceph_manager.ceph:PG 6.c is not active+clean 2024-05-27T06:28:46.583 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.667742+0000', 'last_change': '2024-05-27T06:28:40.667742+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.667742+0000', 'last_undegraded': '2024-05-27T06:28:40.667742+0000', 'last_fullsized': '2024-05-27T06:28:40.667742+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-27T06:28:46.583 INFO:tasks.ceph.ceph_manager.ceph:PG 6.d is not active+clean 2024-05-27T06:28:46.583 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.664987+0000', 'last_change': '2024-05-27T06:28:40.664987+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.664987+0000', 'last_undegraded': '2024-05-27T06:28:40.664987+0000', 'last_fullsized': '2024-05-27T06:28:40.664987+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-27T06:28:46.584 INFO:tasks.ceph.ceph_manager.ceph:PG 6.e is not active+clean 2024-05-27T06:28:46.584 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.658945+0000', 'last_change': '2024-05-27T06:28:40.658945+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.658945+0000', 'last_undegraded': '2024-05-27T06:28:40.658945+0000', 'last_fullsized': '2024-05-27T06:28:40.658945+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-27T06:28:46.584 INFO:tasks.ceph.ceph_manager.ceph:PG 6.f is not active+clean 2024-05-27T06:28:46.584 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.657363+0000', 'last_change': '2024-05-27T06:28:40.657363+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.657363+0000', 'last_undegraded': '2024-05-27T06:28:40.657363+0000', 'last_fullsized': '2024-05-27T06:28:40.657363+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-27T06:28:46.584 INFO:tasks.ceph.ceph_manager.ceph:PG 6.8 is not active+clean 2024-05-27T06:28:46.584 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.661895+0000', 'last_change': '2024-05-27T06:28:40.661895+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.661895+0000', 'last_undegraded': '2024-05-27T06:28:40.661895+0000', 'last_fullsized': '2024-05-27T06:28:40.661895+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-27T06:28:46.584 INFO:tasks.ceph.ceph_manager.ceph:PG 6.9 is not active+clean 2024-05-27T06:28:46.584 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.661597+0000', 'last_change': '2024-05-27T06:28:40.661597+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.661597+0000', 'last_undegraded': '2024-05-27T06:28:40.661597+0000', 'last_fullsized': '2024-05-27T06:28:40.661597+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T06:28:46.584 INFO:tasks.ceph.ceph_manager.ceph:PG 6.a is not active+clean 2024-05-27T06:28:46.584 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.666694+0000', 'last_change': '2024-05-27T06:28:40.666694+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.666694+0000', 'last_undegraded': '2024-05-27T06:28:40.666694+0000', 'last_fullsized': '2024-05-27T06:28:40.666694+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-27T06:28:46.584 INFO:tasks.ceph.ceph_manager.ceph:PG 6.b is not active+clean 2024-05-27T06:28:46.585 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.664021+0000', 'last_change': '2024-05-27T06:28:40.664021+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.664021+0000', 'last_undegraded': '2024-05-27T06:28:40.664021+0000', 'last_fullsized': '2024-05-27T06:28:40.664021+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-27T06:28:46.585 INFO:tasks.ceph.ceph_manager.ceph:PG 6.4 is not active+clean 2024-05-27T06:28:46.585 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.658112+0000', 'last_change': '2024-05-27T06:28:40.658112+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.658112+0000', 'last_undegraded': '2024-05-27T06:28:40.658112+0000', 'last_fullsized': '2024-05-27T06:28:40.658112+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-27T06:28:46.585 INFO:tasks.ceph.ceph_manager.ceph:PG 6.5 is not active+clean 2024-05-27T06:28:46.585 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.662200+0000', 'last_change': '2024-05-27T06:28:40.662200+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.662200+0000', 'last_undegraded': '2024-05-27T06:28:40.662200+0000', 'last_fullsized': '2024-05-27T06:28:40.662200+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-27T06:28:46.585 INFO:tasks.ceph.ceph_manager.ceph:PG 6.6 is not active+clean 2024-05-27T06:28:46.585 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.666027+0000', 'last_change': '2024-05-27T06:28:40.666027+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.666027+0000', 'last_undegraded': '2024-05-27T06:28:40.666027+0000', 'last_fullsized': '2024-05-27T06:28:40.666027+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-27T06:28:46.585 INFO:tasks.ceph.ceph_manager.ceph:PG 6.0 is not active+clean 2024-05-27T06:28:46.585 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.663494+0000', 'last_change': '2024-05-27T06:28:40.663494+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.663494+0000', 'last_undegraded': '2024-05-27T06:28:40.663494+0000', 'last_fullsized': '2024-05-27T06:28:40.663494+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T06:28:46.585 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1 is not active+clean 2024-05-27T06:28:46.585 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.657732+0000', 'last_change': '2024-05-27T06:28:40.657732+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.657732+0000', 'last_undegraded': '2024-05-27T06:28:40.657732+0000', 'last_fullsized': '2024-05-27T06:28:40.657732+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-27T06:28:46.586 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2 is not active+clean 2024-05-27T06:28:46.586 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.661851+0000', 'last_change': '2024-05-27T06:28:40.661851+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.661851+0000', 'last_undegraded': '2024-05-27T06:28:40.661851+0000', 'last_fullsized': '2024-05-27T06:28:40.661851+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-27T06:28:46.586 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3 is not active+clean 2024-05-27T06:28:46.586 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.661227+0000', 'last_change': '2024-05-27T06:28:40.661227+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.661227+0000', 'last_undegraded': '2024-05-27T06:28:40.661227+0000', 'last_fullsized': '2024-05-27T06:28:40.661227+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-27T06:28:46.586 INFO:tasks.ceph.ceph_manager.ceph:PG 6.7 is not active+clean 2024-05-27T06:28:46.586 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:28:40.666390+0000', 'last_change': '2024-05-27T06:28:40.666390+0000', 'last_active': '2024-05-27T06:28:40.644994+0000', 'last_peered': '2024-05-27T06:28:40.644994+0000', 'last_clean': '2024-05-27T06:28:40.644994+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:28:40.666390+0000', 'last_undegraded': '2024-05-27T06:28:40.666390+0000', 'last_fullsized': '2024-05-27T06:28:40.666390+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'last_clean_scrub_stamp': '2024-05-27T06:28:40.644994+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-27T06:28:46.587 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-27T06:28:46.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.761+0000 7f391f000640 1 Processor -- start 2024-05-27T06:28:46.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.761+0000 7f391f000640 1 -- start start 2024-05-27T06:28:46.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.761+0000 7f391f000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f39180d1740 0x7f39180d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:46.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.761+0000 7f391f000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39180d2090 con 0x7f39180cbf90 2024-05-27T06:28:46.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.761+0000 7f391f000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f391815dbb0 con 0x7f391815cfe0 2024-05-27T06:28:46.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.761+0000 7f391f000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f391815de90 con 0x7f39180d1740 2024-05-27T06:28:46.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.765+0000 7f3917e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f39180cbf90 0x7f391806cfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:55138/0 (socket says 172.21.15.87:55138) 2024-05-27T06:28:46.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.765+0000 7f3917e00640 1 -- 172.21.15.87:0/25744440 learned_addr learned my addr 172.21.15.87:0/25744440 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:46.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.765+0000 7f391d000640 1 --2- 172.21.15.87:0/25744440 >> v2:172.21.15.149:3300/0 conn(0x7f39180d1740 0x7f39180d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:46.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.765+0000 7f3916a00640 1 -- 172.21.15.87:0/25744440 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 238193125 0 0) 0x7f3908001120 con 0x7f39180cbf90 2024-05-27T06:28:46.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.765+0000 7f3916a00640 1 -- 172.21.15.87:0/25744440 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38fc005740 con 0x7f39180cbf90 2024-05-27T06:28:46.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.765+0000 7f3916a00640 1 -- 172.21.15.87:0/25744440 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3837653565 0 0) 0x7f38fc005740 con 0x7f39180cbf90 2024-05-27T06:28:46.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.765+0000 7f3916a00640 1 -- 172.21.15.87:0/25744440 >> v2:172.21.15.149:3300/0 conn(0x7f39180d1740 msgr2=0x7f39180d1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:46.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.765+0000 7f3916a00640 1 --2- 172.21.15.87:0/25744440 >> v2:172.21.15.149:3300/0 conn(0x7f39180d1740 0x7f39180d1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:46.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.765+0000 7f3916a00640 1 -- 172.21.15.87:0/25744440 >> v1:172.21.15.149:6789/0 conn(0x7f391815cfe0 legacy=0x7f391815d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:46.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.765+0000 7f3916a00640 1 -- 172.21.15.87:0/25744440 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f391806c7c0 con 0x7f39180cbf90 2024-05-27T06:28:46.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.765+0000 7f3916a00640 1 -- 172.21.15.87:0/25744440 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7f39080018f0 con 0x7f39180cbf90 2024-05-27T06:28:46.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.765+0000 7f3916a00640 1 -- 172.21.15.87:0/25744440 >> v1:172.21.15.87:6789/0 conn(0x7f39180cbf90 legacy=0x7f391806cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:46.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.765+0000 7f3916a00640 1 --2- 172.21.15.87:0/25744440 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38fc005ce0 0x7f38fc006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:46.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.765+0000 7f3916a00640 1 --2- 172.21.15.87:0/25744440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38fc006a20 0x7f38fc006e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:46.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.765+0000 7f3916a00640 1 --2- 172.21.15.87:0/25744440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38fc007570 0x7f38fc00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:46.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.765+0000 7f3916a00640 1 -- 172.21.15.87:0/25744440 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f391815de90 con 0x7f38fc007570 2024-05-27T06:28:46.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.765+0000 7f3916a00640 1 -- 172.21.15.87:0/25744440 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc00e460 con 0x7f38fc006a20 2024-05-27T06:28:46.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.765+0000 7f3916a00640 1 -- 172.21.15.87:0/25744440 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f38fc00e660 con 0x7f38fc005ce0 2024-05-27T06:28:46.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.765+0000 7f391d000640 1 --2- 172.21.15.87:0/25744440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38fc007570 0x7f38fc00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:46.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.765+0000 7f3917e00640 1 --2- 172.21.15.87:0/25744440 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38fc005ce0 0x7f38fc006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:46.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.765+0000 7f3917400640 1 --2- 172.21.15.87:0/25744440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38fc006a20 0x7f38fc006e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:46.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.765+0000 7f391d000640 1 -- 172.21.15.87:0/25744440 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38fc005ce0 msgr2=0x7f38fc006150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:46.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.765+0000 7f391d000640 1 --2- 172.21.15.87:0/25744440 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38fc005ce0 0x7f38fc006150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:46.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.765+0000 7f391d000640 1 -- 172.21.15.87:0/25744440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38fc006a20 msgr2=0x7f38fc006e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:46.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.765+0000 7f391d000640 1 --2- 172.21.15.87:0/25744440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38fc006a20 0x7f38fc006e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:46.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.765+0000 7f391d000640 1 -- 172.21.15.87:0/25744440 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38fc005740 con 0x7f38fc007570 2024-05-27T06:28:46.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.769+0000 7f391d000640 1 -- 172.21.15.87:0/25744440 reap_dead start 2024-05-27T06:28:46.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.769+0000 7f391d000640 1 --2- 172.21.15.87:0/25744440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38fc007570 0x7f38fc00dbe0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f39180c83c0 tx=0x7f391001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95593a09d48049a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:46.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.769+0000 7f3916a00640 1 -- 172.21.15.87:0/25744440 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39100b2070 con 0x7f38fc007570 2024-05-27T06:28:46.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.769+0000 7f3916a00640 1 -- 172.21.15.87:0/25744440 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39100a5c70 con 0x7f38fc007570 2024-05-27T06:28:46.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.769+0000 7f3916a00640 1 -- 172.21.15.87:0/25744440 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3910009c10 con 0x7f38fc007570 2024-05-27T06:28:46.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.769+0000 7f391f000640 1 -- 172.21.15.87:0/25744440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38fc007570 msgr2=0x7f38fc00dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:46.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.769+0000 7f391f000640 1 --2- 172.21.15.87:0/25744440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38fc007570 0x7f38fc00dbe0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f39180c83c0 tx=0x7f391001cc60 comp rx=0 tx=0).stop 2024-05-27T06:28:46.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.769+0000 7f391f000640 1 -- 172.21.15.87:0/25744440 shutdown_connections 2024-05-27T06:28:46.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.769+0000 7f391f000640 1 --2- 172.21.15.87:0/25744440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38fc007570 0x7f38fc00dbe0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:46.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.769+0000 7f391f000640 1 -- 172.21.15.87:0/25744440 >> 172.21.15.87:0/25744440 conn(0x7f39180b46b0 msgr2=0x7f39180b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:46.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.769+0000 7f391f000640 1 -- 172.21.15.87:0/25744440 shutdown_connections 2024-05-27T06:28:46.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.769+0000 7f391f000640 1 -- 172.21.15.87:0/25744440 wait complete. 2024-05-27T06:28:46.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.773+0000 7f391f000640 1 Processor -- start 2024-05-27T06:28:46.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.773+0000 7f391f000640 1 -- start start 2024-05-27T06:28:46.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.773+0000 7f391f000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38fc007570 0x7f39181f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:46.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.773+0000 7f391f000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39181598e0 0x7f39180c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:46.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.773+0000 7f391f000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39180c8a90 0x7f39180ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:46.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.773+0000 7f391f000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f39180cc3a0 con 0x7f39181598e0 2024-05-27T06:28:46.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.773+0000 7f391f000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f391815e170 con 0x7f39180c8a90 2024-05-27T06:28:46.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.773+0000 7f391f000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f391806ec50 con 0x7f38fc007570 2024-05-27T06:28:46.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.773+0000 7f3917400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39181598e0 0x7f39180c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:46.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.773+0000 7f3917400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39181598e0 0x7f39180c9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39838/0 (socket says 172.21.15.87:39838) 2024-05-27T06:28:46.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.773+0000 7f3917400640 1 -- 172.21.15.87:0/2893302074 learned_addr learned my addr 172.21.15.87:0/2893302074 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:46.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.773+0000 7f3917e00640 1 --2- 172.21.15.87:0/2893302074 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38fc007570 0x7f39181f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:46.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.773+0000 7f391d000640 1 --2- 172.21.15.87:0/2893302074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39180c8a90 0x7f39180ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:46.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.773+0000 7f3917400640 1 -- 172.21.15.87:0/2893302074 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38fc007570 msgr2=0x7f39181f1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:46.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.773+0000 7f3917400640 1 --2- 172.21.15.87:0/2893302074 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38fc007570 0x7f39181f1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:46.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.773+0000 7f3917400640 1 -- 172.21.15.87:0/2893302074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39180c8a90 msgr2=0x7f39180ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:46.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.773+0000 7f3917400640 1 --2- 172.21.15.87:0/2893302074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39180c8a90 0x7f39180ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:46.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.773+0000 7f3917400640 1 -- 172.21.15.87:0/2893302074 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39181f2290 con 0x7f39181598e0 2024-05-27T06:28:46.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.773+0000 7f3917400640 1 --2- 172.21.15.87:0/2893302074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39181598e0 0x7f39180c9b00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f390400f7f0 tx=0x7f390400fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:46.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.773+0000 7f390fe00640 1 -- 172.21.15.87:0/2893302074 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390401a070 con 0x7f39181598e0 2024-05-27T06:28:46.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.773+0000 7f390fe00640 1 -- 172.21.15.87:0/2893302074 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3904005110 con 0x7f39181598e0 2024-05-27T06:28:46.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.773+0000 7f390fe00640 1 -- 172.21.15.87:0/2893302074 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39040067e0 con 0x7f39181598e0 2024-05-27T06:28:46.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.773+0000 7f391f000640 1 -- 172.21.15.87:0/2893302074 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39180c6060 con 0x7f39181598e0 2024-05-27T06:28:46.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.773+0000 7f391f000640 1 -- 172.21.15.87:0/2893302074 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39180c6620 con 0x7f39181598e0 2024-05-27T06:28:46.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.777+0000 7f391f000640 1 -- 172.21.15.87:0/2893302074 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f391806aa30 con 0x7f39181598e0 2024-05-27T06:28:46.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.777+0000 7f390fe00640 1 -- 172.21.15.87:0/2893302074 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3904006980 con 0x7f39181598e0 2024-05-27T06:28:46.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.777+0000 7f390fe00640 1 --2- 172.21.15.87:0/2893302074 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f38f806f430 0x7f38f8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:46.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.777+0000 7f390fe00640 1 -- 172.21.15.87:0/2893302074 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f390408ea60 con 0x7f39181598e0 2024-05-27T06:28:46.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.777+0000 7f3917e00640 1 --2- 172.21.15.87:0/2893302074 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f38f806f430 0x7f38f8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:46.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.777+0000 7f3917e00640 1 --2- 172.21.15.87:0/2893302074 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f38f806f430 0x7f38f8071940 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3908001ec0 tx=0x7f3908007b30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:46.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.781+0000 7f390fe00640 1 -- 172.21.15.87:0/2893302074 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f39181f2290 con 0x7f39181598e0 2024-05-27T06:28:46.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.993+0000 7f391f000640 1 -- 172.21.15.87:0/2893302074 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f39180b29d0 con 0x7f39181598e0 2024-05-27T06:28:46.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.993+0000 7f390fe00640 1 -- 172.21.15.87:0/2893302074 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1194 (secure 0 0 0) 0x7f390405b160 con 0x7f39181598e0 2024-05-27T06:28:46.993 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:46.993 INFO:teuthology.orchestra.run.smithi087.stdout:{"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":93,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":38,"num_osds":8,"num_up_osds":8,"osd_up_since":1716791245,"num_in_osds":8,"osd_in_since":1716791236,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225878016,"bytes_avail":772868235264,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":18,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4920}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-05-27T06:28:34.580166+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-05-27T06:28:46.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.997+0000 7f391f000640 1 -- 172.21.15.87:0/2893302074 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f38f806f430 msgr2=0x7f38f8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:46.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.997+0000 7f391f000640 1 --2- 172.21.15.87:0/2893302074 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f38f806f430 0x7f38f8071940 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3908001ec0 tx=0x7f3908007b30 comp rx=0 tx=0).stop 2024-05-27T06:28:46.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.997+0000 7f391f000640 1 -- 172.21.15.87:0/2893302074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39181598e0 msgr2=0x7f39180c9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:46.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.997+0000 7f391f000640 1 --2- 172.21.15.87:0/2893302074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39181598e0 0x7f39180c9b00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f390400f7f0 tx=0x7f390400fbf0 comp rx=0 tx=0).stop 2024-05-27T06:28:46.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.997+0000 7f391f000640 1 -- 172.21.15.87:0/2893302074 shutdown_connections 2024-05-27T06:28:46.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.997+0000 7f391f000640 1 --2- 172.21.15.87:0/2893302074 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f38f806f430 0x7f38f8071940 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:46.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.997+0000 7f391f000640 1 --2- 172.21.15.87:0/2893302074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39180c8a90 0x7f39180ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:46.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.997+0000 7f391f000640 1 --2- 172.21.15.87:0/2893302074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39181598e0 0x7f39180c9b00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:46.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.997+0000 7f391f000640 1 --2- 172.21.15.87:0/2893302074 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f38fc007570 0x7f39181f1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:46.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.997+0000 7f391f000640 1 -- 172.21.15.87:0/2893302074 >> 172.21.15.87:0/2893302074 conn(0x7f39180b46b0 msgr2=0x7f3918072a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:46.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.997+0000 7f391f000640 1 -- 172.21.15.87:0/2893302074 shutdown_connections 2024-05-27T06:28:46.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:46.997+0000 7f391f000640 1 -- 172.21.15.87:0/2893302074 wait complete. 2024-05-27T06:28:47.015 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-27T06:28:47.015 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T06:28:47.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b8ec00640 1 Processor -- start 2024-05-27T06:28:47.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b8ec00640 1 -- start start 2024-05-27T06:28:47.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b8ec00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b881405f0 0x7f1b880718e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:47.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b8ec00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b880cf940 con 0x7f1b88140a00 2024-05-27T06:28:47.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b8ec00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b88161700 con 0x7f1b880cf440 2024-05-27T06:28:47.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b8ec00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1b881619e0 con 0x7f1b881405f0 2024-05-27T06:28:47.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b8ce00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f1b88140a00 0x7f1b880ced30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:55148/0 (socket says 172.21.15.87:55148) 2024-05-27T06:28:47.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b8ce00640 1 -- 172.21.15.87:0/3285393077 learned_addr learned my addr 172.21.15.87:0/3285393077 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:47.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b8d800640 1 --2- 172.21.15.87:0/3285393077 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b881405f0 0x7f1b880718e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:47.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b87e00640 1 -- 172.21.15.87:0/3285393077 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4209848688 0 0) 0x7f1b880cf940 con 0x7f1b88140a00 2024-05-27T06:28:47.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b87e00640 1 -- 172.21.15.87:0/3285393077 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b70003530 con 0x7f1b88140a00 2024-05-27T06:28:47.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b87e00640 1 -- 172.21.15.87:0/3285393077 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1065438796 0 0) 0x7f1b88161700 con 0x7f1b880cf440 2024-05-27T06:28:47.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b87e00640 1 -- 172.21.15.87:0/3285393077 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b880cf940 con 0x7f1b880cf440 2024-05-27T06:28:47.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b87e00640 1 -- 172.21.15.87:0/3285393077 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1758707631 0 0) 0x7f1b70003530 con 0x7f1b88140a00 2024-05-27T06:28:47.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b87e00640 1 -- 172.21.15.87:0/3285393077 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b881405f0 msgr2=0x7f1b880718e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:47.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b87e00640 1 --2- 172.21.15.87:0/3285393077 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b881405f0 0x7f1b880718e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:47.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b87e00640 1 -- 172.21.15.87:0/3285393077 >> v1:172.21.15.149:6789/0 conn(0x7f1b880cf440 legacy=0x7f1b8806fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:47.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b87e00640 1 -- 172.21.15.87:0/3285393077 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b88161cc0 con 0x7f1b88140a00 2024-05-27T06:28:47.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b87e00640 1 -- 172.21.15.87:0/3285393077 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7f1b74001700 con 0x7f1b88140a00 2024-05-27T06:28:47.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b87e00640 1 -- 172.21.15.87:0/3285393077 >> v1:172.21.15.87:6789/0 conn(0x7f1b88140a00 legacy=0x7f1b880ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:47.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b87e00640 1 --2- 172.21.15.87:0/3285393077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b70003c20 0x7f1b70004070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:47.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b87e00640 1 --2- 172.21.15.87:0/3285393077 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b881405f0 0x7f1b70004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:47.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b87e00640 1 --2- 172.21.15.87:0/3285393077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b70004da0 0x7f1b70005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:47.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b87e00640 1 -- 172.21.15.87:0/3285393077 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1b881619e0 con 0x7f1b70004da0 2024-05-27T06:28:47.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b87e00640 1 -- 172.21.15.87:0/3285393077 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7000bc70 con 0x7f1b70003c20 2024-05-27T06:28:47.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b87e00640 1 -- 172.21.15.87:0/3285393077 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7000be70 con 0x7f1b881405f0 2024-05-27T06:28:47.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b8e200640 1 --2- 172.21.15.87:0/3285393077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b70004da0 0x7f1b70005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:47.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b8d800640 1 --2- 172.21.15.87:0/3285393077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b70003c20 0x7f1b70004070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:47.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.165+0000 7f1b8ce00640 1 --2- 172.21.15.87:0/3285393077 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b881405f0 0x7f1b70004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:47.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.169+0000 7f1b8e200640 1 -- 172.21.15.87:0/3285393077 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b881405f0 msgr2=0x7f1b70004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:47.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.169+0000 7f1b8e200640 1 --2- 172.21.15.87:0/3285393077 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b881405f0 0x7f1b70004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:47.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.169+0000 7f1b8e200640 1 -- 172.21.15.87:0/3285393077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b70003c20 msgr2=0x7f1b70004070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:47.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.169+0000 7f1b8e200640 1 --2- 172.21.15.87:0/3285393077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b70003c20 0x7f1b70004070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:47.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.169+0000 7f1b8e200640 1 -- 172.21.15.87:0/3285393077 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b70003530 con 0x7f1b70004da0 2024-05-27T06:28:47.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.169+0000 7f1b8e200640 1 --2- 172.21.15.87:0/3285393077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b70004da0 0x7f1b70005230 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1b88143090 tx=0x7f1b8001f030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4708216fb22fed server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:47.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.169+0000 7f1b87e00640 1 -- 172.21.15.87:0/3285393077 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b80001c50 con 0x7f1b70004da0 2024-05-27T06:28:47.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.169+0000 7f1b87e00640 1 -- 172.21.15.87:0/3285393077 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b80006d60 con 0x7f1b70004da0 2024-05-27T06:28:47.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.169+0000 7f1b87e00640 1 -- 172.21.15.87:0/3285393077 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b800a8ca0 con 0x7f1b70004da0 2024-05-27T06:28:47.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.169+0000 7f1b8ec00640 1 -- 172.21.15.87:0/3285393077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b70004da0 msgr2=0x7f1b70005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:47.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.169+0000 7f1b8ec00640 1 --2- 172.21.15.87:0/3285393077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b70004da0 0x7f1b70005230 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1b88143090 tx=0x7f1b8001f030 comp rx=0 tx=0).stop 2024-05-27T06:28:47.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.169+0000 7f1b8e200640 1 -- 172.21.15.87:0/3285393077 reap_dead start 2024-05-27T06:28:47.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.173+0000 7f1b8ec00640 1 -- 172.21.15.87:0/3285393077 shutdown_connections 2024-05-27T06:28:47.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.173+0000 7f1b8ec00640 1 -- 172.21.15.87:0/3285393077 >> 172.21.15.87:0/3285393077 conn(0x7f1b880d2e90 msgr2=0x7f1b880711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:47.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.173+0000 7f1b8ec00640 1 -- 172.21.15.87:0/3285393077 shutdown_connections 2024-05-27T06:28:47.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.173+0000 7f1b8ec00640 1 -- 172.21.15.87:0/3285393077 wait complete. 2024-05-27T06:28:47.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.173+0000 7f1b8ec00640 1 Processor -- start 2024-05-27T06:28:47.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.173+0000 7f1b8ec00640 1 -- start start 2024-05-27T06:28:47.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.173+0000 7f1b8ec00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b70004da0 0x7f1b880cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:47.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.173+0000 7f1b8ec00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b88145e40 0x7f1b88145180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:47.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.173+0000 7f1b8ec00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b881456c0 0x7f1b881f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:47.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.173+0000 7f1b8ec00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1b88070840 con 0x7f1b881456c0 2024-05-27T06:28:47.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.173+0000 7f1b8ec00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1b880706c0 con 0x7f1b88145e40 2024-05-27T06:28:47.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.173+0000 7f1b8ec00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1b880709c0 con 0x7f1b70004da0 2024-05-27T06:28:47.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.177+0000 7f1b8e200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b881456c0 0x7f1b881f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:47.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.177+0000 7f1b8e200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b881456c0 0x7f1b881f52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39866/0 (socket says 172.21.15.87:39866) 2024-05-27T06:28:47.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.177+0000 7f1b8e200640 1 -- 172.21.15.87:0/2469255687 learned_addr learned my addr 172.21.15.87:0/2469255687 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:47.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.177+0000 7f1b8ce00640 1 --2- 172.21.15.87:0/2469255687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b88145e40 0x7f1b88145180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:47.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.177+0000 7f1b8d800640 1 --2- 172.21.15.87:0/2469255687 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b70004da0 0x7f1b880cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:47.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.177+0000 7f1b8e200640 1 -- 172.21.15.87:0/2469255687 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b70004da0 msgr2=0x7f1b880cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:47.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.177+0000 7f1b8e200640 1 --2- 172.21.15.87:0/2469255687 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b70004da0 0x7f1b880cddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:47.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.177+0000 7f1b8e200640 1 -- 172.21.15.87:0/2469255687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b88145e40 msgr2=0x7f1b88145180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:47.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.177+0000 7f1b8e200640 1 --2- 172.21.15.87:0/2469255687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b88145e40 0x7f1b88145180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:47.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.177+0000 7f1b8e200640 1 -- 172.21.15.87:0/2469255687 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b88145ad0 con 0x7f1b881456c0 2024-05-27T06:28:47.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.177+0000 7f1b8e200640 1 --2- 172.21.15.87:0/2469255687 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b881456c0 0x7f1b881f52d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1b8001d730 tx=0x7f1b70005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:47.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.177+0000 7f1b85600640 1 -- 172.21.15.87:0/2469255687 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b80001c50 con 0x7f1b881456c0 2024-05-27T06:28:47.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.177+0000 7f1b85600640 1 -- 172.21.15.87:0/2469255687 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b80006b60 con 0x7f1b881456c0 2024-05-27T06:28:47.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.177+0000 7f1b85600640 1 -- 172.21.15.87:0/2469255687 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b80007da0 con 0x7f1b881456c0 2024-05-27T06:28:47.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.177+0000 7f1b8ec00640 1 -- 172.21.15.87:0/2469255687 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b88160990 con 0x7f1b881456c0 2024-05-27T06:28:47.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.177+0000 7f1b8ec00640 1 -- 172.21.15.87:0/2469255687 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b881468c0 con 0x7f1b881456c0 2024-05-27T06:28:47.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.177+0000 7f1b8ec00640 1 -- 172.21.15.87:0/2469255687 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b881606e0 con 0x7f1b881456c0 2024-05-27T06:28:47.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.177+0000 7f1b85600640 1 -- 172.21.15.87:0/2469255687 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1b80003b80 con 0x7f1b881456c0 2024-05-27T06:28:47.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.181+0000 7f1b85600640 1 --2- 172.21.15.87:0/2469255687 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f1b6806f400 0x7f1b68071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:47.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.181+0000 7f1b85600640 1 -- 172.21.15.87:0/2469255687 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f1b8012c270 con 0x7f1b881456c0 2024-05-27T06:28:47.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.181+0000 7f1b8d800640 1 --2- 172.21.15.87:0/2469255687 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f1b6806f400 0x7f1b68071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:47.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.181+0000 7f1b8d800640 1 --2- 172.21.15.87:0/2469255687 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f1b6806f400 0x7f1b68071910 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c009b20 tx=0x7f1b7c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:47.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.185+0000 7f1b85600640 1 -- 172.21.15.87:0/2469255687 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f1b800c1060 con 0x7f1b881456c0 2024-05-27T06:28:47.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.333+0000 7f1b8ec00640 1 -- 172.21.15.87:0/2469255687 --> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1b8806aa30 con 0x7f1b6806f400 2024-05-27T06:28:47.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.341+0000 7f1b85600640 1 -- 172.21.15.87:0/2469255687 <== mgr.4111 v2:172.21.15.87:6832/2724754260 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246627 (secure 0 0 0) 0x7f1b8806aa30 con 0x7f1b6806f400 2024-05-27T06:28:47.343 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:47.344 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-27T06:28:47.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.345+0000 7f1b8ec00640 1 -- 172.21.15.87:0/2469255687 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f1b6806f400 msgr2=0x7f1b68071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:47.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.345+0000 7f1b8ec00640 1 --2- 172.21.15.87:0/2469255687 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f1b6806f400 0x7f1b68071910 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c009b20 tx=0x7f1b7c008040 comp rx=0 tx=0).stop 2024-05-27T06:28:47.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.345+0000 7f1b8ec00640 1 -- 172.21.15.87:0/2469255687 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b881456c0 msgr2=0x7f1b881f52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:47.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.345+0000 7f1b8ec00640 1 --2- 172.21.15.87:0/2469255687 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b881456c0 0x7f1b881f52d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1b8001d730 tx=0x7f1b70005840 comp rx=0 tx=0).stop 2024-05-27T06:28:47.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.345+0000 7f1b8ec00640 1 -- 172.21.15.87:0/2469255687 shutdown_connections 2024-05-27T06:28:47.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.345+0000 7f1b8ec00640 1 --2- 172.21.15.87:0/2469255687 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f1b6806f400 0x7f1b68071910 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:47.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.345+0000 7f1b8ec00640 1 --2- 172.21.15.87:0/2469255687 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b881456c0 0x7f1b881f52d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:47.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.345+0000 7f1b8ec00640 1 --2- 172.21.15.87:0/2469255687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b88145e40 0x7f1b88145180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:47.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.345+0000 7f1b8ec00640 1 --2- 172.21.15.87:0/2469255687 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b70004da0 0x7f1b880cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:47.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.345+0000 7f1b8ec00640 1 -- 172.21.15.87:0/2469255687 >> 172.21.15.87:0/2469255687 conn(0x7f1b880d2e90 msgr2=0x7f1b880d1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:47.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.345+0000 7f1b8ec00640 1 -- 172.21.15.87:0/2469255687 shutdown_connections 2024-05-27T06:28:47.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:47.345+0000 7f1b8ec00640 1 -- 172.21.15.87:0/2469255687 wait complete. 2024-05-27T06:28:47.364 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2024-05-27T06:28:46.582480+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220584,"kb_used_data":4392,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754136,"statfs":{"total":773094113280,"available":772868235264,"internally_reserved":0,"allocated":4497408,"data_stored":2591384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001342"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666012+0000","last_change":"2024-05-27T06:28:40.666012+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666012+0000","last_undegraded":"2024-05-27T06:28:40.666012+0000","last_fullsized":"2024-05-27T06:28:40.666012+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.671554+0000","last_change":"2024-05-27T06:28:40.671554+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.671554+0000","last_undegraded":"2024-05-27T06:28:40.671554+0000","last_fullsized":"2024-05-27T06:28:40.671554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664525+0000","last_change":"2024-05-27T06:28:40.664525+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664525+0000","last_undegraded":"2024-05-27T06:28:40.664525+0000","last_fullsized":"2024-05-27T06:28:40.664525+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.659111+0000","last_change":"2024-05-27T06:28:40.659111+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.659111+0000","last_undegraded":"2024-05-27T06:28:40.659111+0000","last_fullsized":"2024-05-27T06:28:40.659111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.659584+0000","last_change":"2024-05-27T06:28:40.659584+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.659584+0000","last_undegraded":"2024-05-27T06:28:40.659584+0000","last_fullsized":"2024-05-27T06:28:40.659584+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.657488+0000","last_change":"2024-05-27T06:28:40.657488+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.657488+0000","last_undegraded":"2024-05-27T06:28:40.657488+0000","last_fullsized":"2024-05-27T06:28:40.657488+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.667129+0000","last_change":"2024-05-27T06:28:40.667129+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.667129+0000","last_undegraded":"2024-05-27T06:28:40.667129+0000","last_fullsized":"2024-05-27T06:28:40.667129+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.662161+0000","last_change":"2024-05-27T06:28:40.662161+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.662161+0000","last_undegraded":"2024-05-27T06:28:40.662161+0000","last_fullsized":"2024-05-27T06:28:40.662161+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664576+0000","last_change":"2024-05-27T06:28:40.664576+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664576+0000","last_undegraded":"2024-05-27T06:28:40.664576+0000","last_fullsized":"2024-05-27T06:28:40.664576+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.669507+0000","last_change":"2024-05-27T06:28:40.669507+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.669507+0000","last_undegraded":"2024-05-27T06:28:40.669507+0000","last_fullsized":"2024-05-27T06:28:40.669507+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.665538+0000","last_change":"2024-05-27T06:28:40.665538+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.665538+0000","last_undegraded":"2024-05-27T06:28:40.665538+0000","last_fullsized":"2024-05-27T06:28:40.665538+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664473+0000","last_change":"2024-05-27T06:28:40.664473+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664473+0000","last_undegraded":"2024-05-27T06:28:40.664473+0000","last_fullsized":"2024-05-27T06:28:40.664473+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.667541+0000","last_change":"2024-05-27T06:28:40.667541+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.667541+0000","last_undegraded":"2024-05-27T06:28:40.667541+0000","last_fullsized":"2024-05-27T06:28:40.667541+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.662387+0000","last_change":"2024-05-27T06:28:40.662387+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.662387+0000","last_undegraded":"2024-05-27T06:28:40.662387+0000","last_fullsized":"2024-05-27T06:28:40.662387+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666106+0000","last_change":"2024-05-27T06:28:40.666106+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666106+0000","last_undegraded":"2024-05-27T06:28:40.666106+0000","last_fullsized":"2024-05-27T06:28:40.666106+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664652+0000","last_change":"2024-05-27T06:28:40.664652+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664652+0000","last_undegraded":"2024-05-27T06:28:40.664652+0000","last_fullsized":"2024-05-27T06:28:40.664652+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.663563+0000","last_change":"2024-05-27T06:28:40.663563+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.663563+0000","last_undegraded":"2024-05-27T06:28:40.663563+0000","last_fullsized":"2024-05-27T06:28:40.663563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.656139+0000","last_change":"2024-05-27T06:28:40.656139+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.656139+0000","last_undegraded":"2024-05-27T06:28:40.656139+0000","last_fullsized":"2024-05-27T06:28:40.656139+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.658793+0000","last_change":"2024-05-27T06:28:40.658793+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.658793+0000","last_undegraded":"2024-05-27T06:28:40.658793+0000","last_fullsized":"2024-05-27T06:28:40.658793+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.655144+0000","last_change":"2024-05-27T06:28:40.655144+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.655144+0000","last_undegraded":"2024-05-27T06:28:40.655144+0000","last_fullsized":"2024-05-27T06:28:40.655144+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664913+0000","last_change":"2024-05-27T06:28:40.664913+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664913+0000","last_undegraded":"2024-05-27T06:28:40.664913+0000","last_fullsized":"2024-05-27T06:28:40.664913+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.660387+0000","last_change":"2024-05-27T06:28:40.660387+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.660387+0000","last_undegraded":"2024-05-27T06:28:40.660387+0000","last_fullsized":"2024-05-27T06:28:40.660387+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.662122+0000","last_change":"2024-05-27T06:28:40.662122+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.662122+0000","last_undegraded":"2024-05-27T06:28:40.662122+0000","last_fullsized":"2024-05-27T06:28:40.662122+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.657911+0000","last_change":"2024-05-27T06:28:40.657911+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.657911+0000","last_undegraded":"2024-05-27T06:28:40.657911+0000","last_fullsized":"2024-05-27T06:28:40.657911+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.656715+0000","last_change":"2024-05-27T06:28:40.656715+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.656715+0000","last_undegraded":"2024-05-27T06:28:40.656715+0000","last_fullsized":"2024-05-27T06:28:40.656715+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.660450+0000","last_change":"2024-05-27T06:28:40.660450+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.660450+0000","last_undegraded":"2024-05-27T06:28:40.660450+0000","last_fullsized":"2024-05-27T06:28:40.660450+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.655779+0000","last_change":"2024-05-27T06:28:40.655779+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.655779+0000","last_undegraded":"2024-05-27T06:28:40.655779+0000","last_fullsized":"2024-05-27T06:28:40.655779+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666097+0000","last_change":"2024-05-27T06:28:40.666097+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666097+0000","last_undegraded":"2024-05-27T06:28:40.666097+0000","last_fullsized":"2024-05-27T06:28:40.666097+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.655258+0000","last_change":"2024-05-27T06:28:40.655258+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.655258+0000","last_undegraded":"2024-05-27T06:28:40.655258+0000","last_fullsized":"2024-05-27T06:28:40.655258+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.655515+0000","last_change":"2024-05-27T06:28:40.655515+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.655515+0000","last_undegraded":"2024-05-27T06:28:40.655515+0000","last_fullsized":"2024-05-27T06:28:40.655515+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661353+0000","last_change":"2024-05-27T06:28:40.661353+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661353+0000","last_undegraded":"2024-05-27T06:28:40.661353+0000","last_fullsized":"2024-05-27T06:28:40.661353+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.657381+0000","last_change":"2024-05-27T06:28:40.657381+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.657381+0000","last_undegraded":"2024-05-27T06:28:40.657381+0000","last_fullsized":"2024-05-27T06:28:40.657381+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661094+0000","last_change":"2024-05-27T06:28:40.661094+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661094+0000","last_undegraded":"2024-05-27T06:28:40.661094+0000","last_fullsized":"2024-05-27T06:28:40.661094+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678349+0000","last_change":"2024-05-27T06:28:40.669695+0000","last_active":"2024-05-27T06:28:40.678349+0000","last_peered":"2024-05-27T06:28:40.678349+0000","last_clean":"2024-05-27T06:28:40.678349+0000","last_became_active":"2024-05-27T06:28:40.669333+0000","last_became_peered":"2024-05-27T06:28:40.669333+0000","last_unstale":"2024-05-27T06:28:40.678349+0000","last_undegraded":"2024-05-27T06:28:40.678349+0000","last_fullsized":"2024-05-27T06:28:40.678349+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:26:04.076545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.658480+0000","last_change":"2024-05-27T06:28:40.658480+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.658480+0000","last_undegraded":"2024-05-27T06:28:40.658480+0000","last_fullsized":"2024-05-27T06:28:40.658480+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678911+0000","last_change":"2024-05-27T06:28:40.673139+0000","last_active":"2024-05-27T06:28:40.678911+0000","last_peered":"2024-05-27T06:28:40.678911+0000","last_clean":"2024-05-27T06:28:40.678911+0000","last_became_active":"2024-05-27T06:28:40.672841+0000","last_became_peered":"2024-05-27T06:28:40.672841+0000","last_unstale":"2024-05-27T06:28:40.678911+0000","last_undegraded":"2024-05-27T06:28:40.678911+0000","last_fullsized":"2024-05-27T06:28:40.678911+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T06:56:04.095609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.658308+0000","last_change":"2024-05-27T06:28:40.658308+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.658308+0000","last_undegraded":"2024-05-27T06:28:40.658308+0000","last_fullsized":"2024-05-27T06:28:40.658308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678553+0000","last_change":"2024-05-27T06:28:40.672478+0000","last_active":"2024-05-27T06:28:40.678553+0000","last_peered":"2024-05-27T06:28:40.678553+0000","last_clean":"2024-05-27T06:28:40.678553+0000","last_became_active":"2024-05-27T06:28:40.672172+0000","last_became_peered":"2024-05-27T06:28:40.672172+0000","last_unstale":"2024-05-27T06:28:40.678553+0000","last_undegraded":"2024-05-27T06:28:40.678553+0000","last_fullsized":"2024-05-27T06:28:40.678553+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:13:59.179683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666498+0000","last_change":"2024-05-27T06:28:40.666498+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666498+0000","last_undegraded":"2024-05-27T06:28:40.666498+0000","last_fullsized":"2024-05-27T06:28:40.666498+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.685173+0000","last_change":"2024-05-27T06:28:40.677480+0000","last_active":"2024-05-27T06:28:40.685173+0000","last_peered":"2024-05-27T06:28:40.685173+0000","last_clean":"2024-05-27T06:28:40.685173+0000","last_became_active":"2024-05-27T06:28:40.677186+0000","last_became_peered":"2024-05-27T06:28:40.677186+0000","last_unstale":"2024-05-27T06:28:40.685173+0000","last_undegraded":"2024-05-27T06:28:40.685173+0000","last_fullsized":"2024-05-27T06:28:40.685173+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:16:49.937382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664434+0000","last_change":"2024-05-27T06:28:40.664434+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664434+0000","last_undegraded":"2024-05-27T06:28:40.664434+0000","last_fullsized":"2024-05-27T06:28:40.664434+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.682962+0000","last_change":"2024-05-27T06:28:40.676566+0000","last_active":"2024-05-27T06:28:40.682962+0000","last_peered":"2024-05-27T06:28:40.682962+0000","last_clean":"2024-05-27T06:28:40.682962+0000","last_became_active":"2024-05-27T06:28:40.676114+0000","last_became_peered":"2024-05-27T06:28:40.676114+0000","last_unstale":"2024-05-27T06:28:40.682962+0000","last_undegraded":"2024-05-27T06:28:40.682962+0000","last_fullsized":"2024-05-27T06:28:40.682962+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:04:39.297606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.665726+0000","last_change":"2024-05-27T06:28:40.665726+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.665726+0000","last_undegraded":"2024-05-27T06:28:40.665726+0000","last_fullsized":"2024-05-27T06:28:40.665726+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.685518+0000","last_change":"2024-05-27T06:28:40.681743+0000","last_active":"2024-05-27T06:28:40.685518+0000","last_peered":"2024-05-27T06:28:40.685518+0000","last_clean":"2024-05-27T06:28:40.685518+0000","last_became_active":"2024-05-27T06:28:40.681385+0000","last_became_peered":"2024-05-27T06:28:40.681385+0000","last_unstale":"2024-05-27T06:28:40.685518+0000","last_undegraded":"2024-05-27T06:28:40.685518+0000","last_fullsized":"2024-05-27T06:28:40.685518+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:04:39.297606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661324+0000","last_change":"2024-05-27T06:28:40.661324+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661324+0000","last_undegraded":"2024-05-27T06:28:40.661324+0000","last_fullsized":"2024-05-27T06:28:40.661324+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678962+0000","last_change":"2024-05-27T06:28:40.673602+0000","last_active":"2024-05-27T06:28:40.678962+0000","last_peered":"2024-05-27T06:28:40.678962+0000","last_clean":"2024-05-27T06:28:40.678962+0000","last_became_active":"2024-05-27T06:28:40.673279+0000","last_became_peered":"2024-05-27T06:28:40.673279+0000","last_unstale":"2024-05-27T06:28:40.678962+0000","last_undegraded":"2024-05-27T06:28:40.678962+0000","last_fullsized":"2024-05-27T06:28:40.678962+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:18:47.874305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.665064+0000","last_change":"2024-05-27T06:28:40.665064+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.665064+0000","last_undegraded":"2024-05-27T06:28:40.665064+0000","last_fullsized":"2024-05-27T06:28:40.665064+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.669177+0000","last_change":"2024-05-27T06:28:40.667506+0000","last_active":"2024-05-27T06:28:40.669177+0000","last_peered":"2024-05-27T06:28:40.669177+0000","last_clean":"2024-05-27T06:28:40.669177+0000","last_became_active":"2024-05-27T06:28:40.666805+0000","last_became_peered":"2024-05-27T06:28:40.666805+0000","last_unstale":"2024-05-27T06:28:40.669177+0000","last_undegraded":"2024-05-27T06:28:40.669177+0000","last_fullsized":"2024-05-27T06:28:40.669177+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:17:08.471701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.657337+0000","last_change":"2024-05-27T06:28:40.657337+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.657337+0000","last_undegraded":"2024-05-27T06:28:40.657337+0000","last_fullsized":"2024-05-27T06:28:40.657337+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.681300+0000","last_change":"2024-05-27T06:28:40.679319+0000","last_active":"2024-05-27T06:28:40.681300+0000","last_peered":"2024-05-27T06:28:40.681300+0000","last_clean":"2024-05-27T06:28:40.681300+0000","last_became_active":"2024-05-27T06:28:40.678970+0000","last_became_peered":"2024-05-27T06:28:40.678970+0000","last_unstale":"2024-05-27T06:28:40.681300+0000","last_undegraded":"2024-05-27T06:28:40.681300+0000","last_fullsized":"2024-05-27T06:28:40.681300+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:59:06.313098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.662678+0000","last_change":"2024-05-27T06:28:40.662678+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.662678+0000","last_undegraded":"2024-05-27T06:28:40.662678+0000","last_fullsized":"2024-05-27T06:28:40.662678+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.685252+0000","last_change":"2024-05-27T06:28:40.680595+0000","last_active":"2024-05-27T06:28:40.685252+0000","last_peered":"2024-05-27T06:28:40.685252+0000","last_clean":"2024-05-27T06:28:40.685252+0000","last_became_active":"2024-05-27T06:28:40.680213+0000","last_became_peered":"2024-05-27T06:28:40.680213+0000","last_unstale":"2024-05-27T06:28:40.685252+0000","last_undegraded":"2024-05-27T06:28:40.685252+0000","last_fullsized":"2024-05-27T06:28:40.685252+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:12:15.418800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.659359+0000","last_change":"2024-05-27T06:28:40.659359+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.659359+0000","last_undegraded":"2024-05-27T06:28:40.659359+0000","last_fullsized":"2024-05-27T06:28:40.659359+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.676705+0000","last_change":"2024-05-27T06:28:40.674198+0000","last_active":"2024-05-27T06:28:40.676705+0000","last_peered":"2024-05-27T06:28:40.676705+0000","last_clean":"2024-05-27T06:28:40.676705+0000","last_became_active":"2024-05-27T06:28:40.673825+0000","last_became_peered":"2024-05-27T06:28:40.673825+0000","last_unstale":"2024-05-27T06:28:40.676705+0000","last_undegraded":"2024-05-27T06:28:40.676705+0000","last_fullsized":"2024-05-27T06:28:40.676705+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T06:56:04.095609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.658786+0000","last_change":"2024-05-27T06:28:40.658786+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.658786+0000","last_undegraded":"2024-05-27T06:28:40.658786+0000","last_fullsized":"2024-05-27T06:28:40.658786+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.680398+0000","last_change":"2024-05-27T06:28:40.677467+0000","last_active":"2024-05-27T06:28:40.680398+0000","last_peered":"2024-05-27T06:28:40.680398+0000","last_clean":"2024-05-27T06:28:40.680398+0000","last_became_active":"2024-05-27T06:28:40.677128+0000","last_became_peered":"2024-05-27T06:28:40.677128+0000","last_unstale":"2024-05-27T06:28:40.680398+0000","last_undegraded":"2024-05-27T06:28:40.680398+0000","last_fullsized":"2024-05-27T06:28:40.680398+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:52:37.091584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.663954+0000","last_change":"2024-05-27T06:28:40.663954+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.663954+0000","last_undegraded":"2024-05-27T06:28:40.663954+0000","last_fullsized":"2024-05-27T06:28:40.663954+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.682084+0000","last_change":"2024-05-27T06:28:40.681038+0000","last_active":"2024-05-27T06:28:40.682084+0000","last_peered":"2024-05-27T06:28:40.682084+0000","last_clean":"2024-05-27T06:28:40.682084+0000","last_became_active":"2024-05-27T06:28:40.680758+0000","last_became_peered":"2024-05-27T06:28:40.680758+0000","last_unstale":"2024-05-27T06:28:40.682084+0000","last_undegraded":"2024-05-27T06:28:40.682084+0000","last_fullsized":"2024-05-27T06:28:40.682084+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T06:54:59.433478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.663479+0000","last_change":"2024-05-27T06:28:40.663479+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.663479+0000","last_undegraded":"2024-05-27T06:28:40.663479+0000","last_fullsized":"2024-05-27T06:28:40.663479+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678818+0000","last_change":"2024-05-27T06:28:40.673610+0000","last_active":"2024-05-27T06:28:40.678818+0000","last_peered":"2024-05-27T06:28:40.678818+0000","last_clean":"2024-05-27T06:28:40.678818+0000","last_became_active":"2024-05-27T06:28:40.673294+0000","last_became_peered":"2024-05-27T06:28:40.673294+0000","last_unstale":"2024-05-27T06:28:40.678818+0000","last_undegraded":"2024-05-27T06:28:40.678818+0000","last_fullsized":"2024-05-27T06:28:40.678818+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T06:56:04.095609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.662436+0000","last_change":"2024-05-27T06:28:40.662436+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.662436+0000","last_undegraded":"2024-05-27T06:28:40.662436+0000","last_fullsized":"2024-05-27T06:28:40.662436+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678457+0000","last_change":"2024-05-27T06:28:40.672146+0000","last_active":"2024-05-27T06:28:40.678457+0000","last_peered":"2024-05-27T06:28:40.678457+0000","last_clean":"2024-05-27T06:28:40.678457+0000","last_became_active":"2024-05-27T06:28:40.671021+0000","last_became_peered":"2024-05-27T06:28:40.671021+0000","last_unstale":"2024-05-27T06:28:40.678457+0000","last_undegraded":"2024-05-27T06:28:40.678457+0000","last_fullsized":"2024-05-27T06:28:40.678457+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:00:20.482241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664559+0000","last_change":"2024-05-27T06:28:40.664559+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664559+0000","last_undegraded":"2024-05-27T06:28:40.664559+0000","last_fullsized":"2024-05-27T06:28:40.664559+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.685487+0000","last_change":"2024-05-27T06:28:40.681584+0000","last_active":"2024-05-27T06:28:40.685487+0000","last_peered":"2024-05-27T06:28:40.685487+0000","last_clean":"2024-05-27T06:28:40.685487+0000","last_became_active":"2024-05-27T06:28:40.681279+0000","last_became_peered":"2024-05-27T06:28:40.681279+0000","last_unstale":"2024-05-27T06:28:40.685487+0000","last_undegraded":"2024-05-27T06:28:40.685487+0000","last_fullsized":"2024-05-27T06:28:40.685487+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T06:56:04.095609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.667742+0000","last_change":"2024-05-27T06:28:40.667742+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.667742+0000","last_undegraded":"2024-05-27T06:28:40.667742+0000","last_fullsized":"2024-05-27T06:28:40.667742+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.682990+0000","last_change":"2024-05-27T06:28:40.679172+0000","last_active":"2024-05-27T06:28:40.682990+0000","last_peered":"2024-05-27T06:28:40.682990+0000","last_clean":"2024-05-27T06:28:40.682990+0000","last_became_active":"2024-05-27T06:28:40.678786+0000","last_became_peered":"2024-05-27T06:28:40.678786+0000","last_unstale":"2024-05-27T06:28:40.682990+0000","last_undegraded":"2024-05-27T06:28:40.682990+0000","last_fullsized":"2024-05-27T06:28:40.682990+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:55:20.077082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664987+0000","last_change":"2024-05-27T06:28:40.664987+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664987+0000","last_undegraded":"2024-05-27T06:28:40.664987+0000","last_fullsized":"2024-05-27T06:28:40.664987+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.685154+0000","last_change":"2024-05-27T06:28:40.677177+0000","last_active":"2024-05-27T06:28:40.685154+0000","last_peered":"2024-05-27T06:28:40.685154+0000","last_clean":"2024-05-27T06:28:40.685154+0000","last_became_active":"2024-05-27T06:28:40.676640+0000","last_became_peered":"2024-05-27T06:28:40.676640+0000","last_unstale":"2024-05-27T06:28:40.685154+0000","last_undegraded":"2024-05-27T06:28:40.685154+0000","last_fullsized":"2024-05-27T06:28:40.685154+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:00:20.482241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.658945+0000","last_change":"2024-05-27T06:28:40.658945+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.658945+0000","last_undegraded":"2024-05-27T06:28:40.658945+0000","last_fullsized":"2024-05-27T06:28:40.658945+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.680529+0000","last_change":"2024-05-27T06:28:40.675405+0000","last_active":"2024-05-27T06:28:40.680529+0000","last_peered":"2024-05-27T06:28:40.680529+0000","last_clean":"2024-05-27T06:28:40.680529+0000","last_became_active":"2024-05-27T06:28:40.675004+0000","last_became_peered":"2024-05-27T06:28:40.675004+0000","last_unstale":"2024-05-27T06:28:40.680529+0000","last_undegraded":"2024-05-27T06:28:40.680529+0000","last_fullsized":"2024-05-27T06:28:40.680529+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:01:06.950501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.657363+0000","last_change":"2024-05-27T06:28:40.657363+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.657363+0000","last_undegraded":"2024-05-27T06:28:40.657363+0000","last_fullsized":"2024-05-27T06:28:40.657363+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.677993+0000","last_change":"2024-05-27T06:28:40.670977+0000","last_active":"2024-05-27T06:28:40.677993+0000","last_peered":"2024-05-27T06:28:40.677993+0000","last_clean":"2024-05-27T06:28:40.677993+0000","last_became_active":"2024-05-27T06:28:40.670723+0000","last_became_peered":"2024-05-27T06:28:40.670723+0000","last_unstale":"2024-05-27T06:28:40.677993+0000","last_undegraded":"2024-05-27T06:28:40.677993+0000","last_fullsized":"2024-05-27T06:28:40.677993+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:58:11.217383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661895+0000","last_change":"2024-05-27T06:28:40.661895+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661895+0000","last_undegraded":"2024-05-27T06:28:40.661895+0000","last_fullsized":"2024-05-27T06:28:40.661895+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.662351+0000","last_change":"2024-05-27T06:28:40.661275+0000","last_active":"2024-05-27T06:28:40.662351+0000","last_peered":"2024-05-27T06:28:40.662351+0000","last_clean":"2024-05-27T06:28:40.662351+0000","last_became_active":"2024-05-27T06:28:40.661013+0000","last_became_peered":"2024-05-27T06:28:40.661013+0000","last_unstale":"2024-05-27T06:28:40.662351+0000","last_undegraded":"2024-05-27T06:28:40.662351+0000","last_fullsized":"2024-05-27T06:28:40.662351+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:22:56.239970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661597+0000","last_change":"2024-05-27T06:28:40.661597+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661597+0000","last_undegraded":"2024-05-27T06:28:40.661597+0000","last_fullsized":"2024-05-27T06:28:40.661597+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.675384+0000","last_change":"2024-05-27T06:28:40.672102+0000","last_active":"2024-05-27T06:28:40.675384+0000","last_peered":"2024-05-27T06:28:40.675384+0000","last_clean":"2024-05-27T06:28:40.675384+0000","last_became_active":"2024-05-27T06:28:40.671774+0000","last_became_peered":"2024-05-27T06:28:40.671774+0000","last_unstale":"2024-05-27T06:28:40.675384+0000","last_undegraded":"2024-05-27T06:28:40.675384+0000","last_fullsized":"2024-05-27T06:28:40.675384+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:40:43.723380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666694+0000","last_change":"2024-05-27T06:28:40.666694+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666694+0000","last_undegraded":"2024-05-27T06:28:40.666694+0000","last_fullsized":"2024-05-27T06:28:40.666694+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.682769+0000","last_change":"2024-05-27T06:28:40.679403+0000","last_active":"2024-05-27T06:28:40.682769+0000","last_peered":"2024-05-27T06:28:40.682769+0000","last_clean":"2024-05-27T06:28:40.682769+0000","last_became_active":"2024-05-27T06:28:40.679101+0000","last_became_peered":"2024-05-27T06:28:40.679101+0000","last_unstale":"2024-05-27T06:28:40.682769+0000","last_undegraded":"2024-05-27T06:28:40.682769+0000","last_fullsized":"2024-05-27T06:28:40.682769+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:18:47.874305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.664021+0000","last_change":"2024-05-27T06:28:40.664021+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.664021+0000","last_undegraded":"2024-05-27T06:28:40.664021+0000","last_fullsized":"2024-05-27T06:28:40.664021+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.668814+0000","last_change":"2024-05-27T06:28:40.667132+0000","last_active":"2024-05-27T06:28:40.668814+0000","last_peered":"2024-05-27T06:28:40.668814+0000","last_clean":"2024-05-27T06:28:40.668814+0000","last_became_active":"2024-05-27T06:28:40.666811+0000","last_became_peered":"2024-05-27T06:28:40.666811+0000","last_unstale":"2024-05-27T06:28:40.668814+0000","last_undegraded":"2024-05-27T06:28:40.668814+0000","last_fullsized":"2024-05-27T06:28:40.668814+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:30:24.675813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.658112+0000","last_change":"2024-05-27T06:28:40.658112+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.658112+0000","last_undegraded":"2024-05-27T06:28:40.658112+0000","last_fullsized":"2024-05-27T06:28:40.658112+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.676796+0000","last_change":"2024-05-27T06:28:40.674354+0000","last_active":"2024-05-27T06:28:40.676796+0000","last_peered":"2024-05-27T06:28:40.676796+0000","last_clean":"2024-05-27T06:28:40.676796+0000","last_became_active":"2024-05-27T06:28:40.673991+0000","last_became_peered":"2024-05-27T06:28:40.673991+0000","last_unstale":"2024-05-27T06:28:40.676796+0000","last_undegraded":"2024-05-27T06:28:40.676796+0000","last_fullsized":"2024-05-27T06:28:40.676796+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:26.993778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.662200+0000","last_change":"2024-05-27T06:28:40.662200+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.662200+0000","last_undegraded":"2024-05-27T06:28:40.662200+0000","last_fullsized":"2024-05-27T06:28:40.662200+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.680630+0000","last_change":"2024-05-27T06:28:40.676434+0000","last_active":"2024-05-27T06:28:40.680630+0000","last_peered":"2024-05-27T06:28:40.680630+0000","last_clean":"2024-05-27T06:28:40.680630+0000","last_became_active":"2024-05-27T06:28:40.676154+0000","last_became_peered":"2024-05-27T06:28:40.676154+0000","last_unstale":"2024-05-27T06:28:40.680630+0000","last_undegraded":"2024-05-27T06:28:40.680630+0000","last_fullsized":"2024-05-27T06:28:40.680630+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:29:20.698358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666027+0000","last_change":"2024-05-27T06:28:40.666027+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666027+0000","last_undegraded":"2024-05-27T06:28:40.666027+0000","last_fullsized":"2024-05-27T06:28:40.666027+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.668201+0000","last_change":"2024-05-27T06:28:40.666405+0000","last_active":"2024-05-27T06:28:40.668201+0000","last_peered":"2024-05-27T06:28:40.668201+0000","last_clean":"2024-05-27T06:28:40.668201+0000","last_became_active":"2024-05-27T06:28:40.666146+0000","last_became_peered":"2024-05-27T06:28:40.666146+0000","last_unstale":"2024-05-27T06:28:40.668201+0000","last_undegraded":"2024-05-27T06:28:40.668201+0000","last_fullsized":"2024-05-27T06:28:40.668201+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:18:47.874305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.663494+0000","last_change":"2024-05-27T06:28:40.663494+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.663494+0000","last_undegraded":"2024-05-27T06:28:40.663494+0000","last_fullsized":"2024-05-27T06:28:40.663494+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.680403+0000","last_change":"2024-05-27T06:28:40.677362+0000","last_active":"2024-05-27T06:28:40.680403+0000","last_peered":"2024-05-27T06:28:40.680403+0000","last_clean":"2024-05-27T06:28:40.680403+0000","last_became_active":"2024-05-27T06:28:40.677080+0000","last_became_peered":"2024-05-27T06:28:40.677080+0000","last_unstale":"2024-05-27T06:28:40.680403+0000","last_undegraded":"2024-05-27T06:28:40.680403+0000","last_fullsized":"2024-05-27T06:28:40.680403+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:26.993778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.657732+0000","last_change":"2024-05-27T06:28:40.657732+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.657732+0000","last_undegraded":"2024-05-27T06:28:40.657732+0000","last_fullsized":"2024-05-27T06:28:40.657732+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.680428+0000","last_change":"2024-05-27T06:28:40.675180+0000","last_active":"2024-05-27T06:28:40.680428+0000","last_peered":"2024-05-27T06:28:40.680428+0000","last_clean":"2024-05-27T06:28:40.680428+0000","last_became_active":"2024-05-27T06:28:40.674872+0000","last_became_peered":"2024-05-27T06:28:40.674872+0000","last_unstale":"2024-05-27T06:28:40.680428+0000","last_undegraded":"2024-05-27T06:28:40.680428+0000","last_fullsized":"2024-05-27T06:28:40.680428+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:16:49.937382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661851+0000","last_change":"2024-05-27T06:28:40.661851+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661851+0000","last_undegraded":"2024-05-27T06:28:40.661851+0000","last_fullsized":"2024-05-27T06:28:40.661851+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.680773+0000","last_change":"2024-05-27T06:28:40.672373+0000","last_active":"2024-05-27T06:28:40.680773+0000","last_peered":"2024-05-27T06:28:40.680773+0000","last_clean":"2024-05-27T06:28:40.680773+0000","last_became_active":"2024-05-27T06:28:40.672028+0000","last_became_peered":"2024-05-27T06:28:40.672028+0000","last_unstale":"2024-05-27T06:28:40.680773+0000","last_undegraded":"2024-05-27T06:28:40.680773+0000","last_fullsized":"2024-05-27T06:28:40.680773+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:26:04.076545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.661227+0000","last_change":"2024-05-27T06:28:40.661227+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.661227+0000","last_undegraded":"2024-05-27T06:28:40.661227+0000","last_fullsized":"2024-05-27T06:28:40.661227+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.678483+0000","last_change":"2024-05-27T06:28:40.674194+0000","last_active":"2024-05-27T06:28:40.678483+0000","last_peered":"2024-05-27T06:28:40.678483+0000","last_clean":"2024-05-27T06:28:40.678483+0000","last_became_active":"2024-05-27T06:28:40.673676+0000","last_became_peered":"2024-05-27T06:28:40.673676+0000","last_unstale":"2024-05-27T06:28:40.678483+0000","last_undegraded":"2024-05-27T06:28:40.678483+0000","last_fullsized":"2024-05-27T06:28:40.678483+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:12:15.418800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-27T06:28:40.666390+0000","last_change":"2024-05-27T06:28:40.666390+0000","last_active":"2024-05-27T06:28:40.644994+0000","last_peered":"2024-05-27T06:28:40.644994+0000","last_clean":"2024-05-27T06:28:40.644994+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:28:40.666390+0000","last_undegraded":"2024-05-27T06:28:40.666390+0000","last_fullsized":"2024-05-27T06:28:40.666390+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.685492+0000","last_change":"2024-05-27T06:28:40.681617+0000","last_active":"2024-05-27T06:28:40.685492+0000","last_peered":"2024-05-27T06:28:40.685492+0000","last_clean":"2024-05-27T06:28:40.685492+0000","last_became_active":"2024-05-27T06:28:40.681325+0000","last_became_peered":"2024-05-27T06:28:40.681325+0000","last_unstale":"2024-05-27T06:28:40.685492+0000","last_undegraded":"2024-05-27T06:28:40.685492+0000","last_fullsized":"2024-05-27T06:28:40.685492+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:26.993778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":138,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T06:28:40.667859+0000","last_change":"2024-05-27T06:27:28.692457+0000","last_active":"2024-05-27T06:28:40.667859+0000","last_peered":"2024-05-27T06:28:40.667859+0000","last_clean":"2024-05-27T06:28:40.667859+0000","last_became_active":"2024-05-27T06:27:28.691290+0000","last_became_peered":"2024-05-27T06:27:28.691290+0000","last_unstale":"2024-05-27T06:28:40.667859+0000","last_undegraded":"2024-05-27T06:28:40.667859+0000","last_fullsized":"2024-05-27T06:28:40.667859+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_clean_scrub_stamp":"2024-05-27T06:27:26.991915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:45.563728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":766699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":766699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T06:28:50.368 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T06:28:50.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.517+0000 7fd040c00640 1 Processor -- start 2024-05-27T06:28:50.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.517+0000 7fd040c00640 1 -- start start 2024-05-27T06:28:50.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.521+0000 7fd040c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd03c163ed0 0x7fd03c0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:50.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.521+0000 7fd040c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd03c0b5310 0x7fd03c0b5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:50.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.521+0000 7fd040c00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd03c161160 con 0x7fd03c160d50 2024-05-27T06:28:50.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.521+0000 7fd040c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fd03c0cea40 con 0x7fd03c163ed0 2024-05-27T06:28:50.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.521+0000 7fd040c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd03c0cf230 con 0x7fd03c0b5310 2024-05-27T06:28:50.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.521+0000 7fd03b400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd03c160d50 0x7fd03c1637c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:55160/0 (socket says 172.21.15.87:55160) 2024-05-27T06:28:50.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.521+0000 7fd03b400640 1 -- 172.21.15.87:0/3537895079 learned_addr learned my addr 172.21.15.87:0/3537895079 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:50.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.521+0000 7fd03be00640 1 --2- 172.21.15.87:0/3537895079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd03c0b5310 0x7fd03c0b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:50.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.521+0000 7fd032a00640 1 --2- 172.21.15.87:0/3537895079 >> v2:172.21.15.149:3300/0 conn(0x7fd03c163ed0 0x7fd03c0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:50.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.521+0000 7fd03aa00640 1 -- 172.21.15.87:0/3537895079 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1494255438 0 0) 0x7fd03c161160 con 0x7fd03c160d50 2024-05-27T06:28:50.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.521+0000 7fd03aa00640 1 -- 172.21.15.87:0/3537895079 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd020003530 con 0x7fd03c160d50 2024-05-27T06:28:50.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.521+0000 7fd03be00640 1 -- 172.21.15.87:0/3537895079 >> v2:172.21.15.149:3300/0 conn(0x7fd03c163ed0 msgr2=0x7fd03c0ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:50.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.521+0000 7fd03be00640 1 --2- 172.21.15.87:0/3537895079 >> v2:172.21.15.149:3300/0 conn(0x7fd03c163ed0 0x7fd03c0ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:50.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.521+0000 7fd03be00640 1 -- 172.21.15.87:0/3537895079 >> v1:172.21.15.87:6789/0 conn(0x7fd03c160d50 legacy=0x7fd03c1637c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:50.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.521+0000 7fd03be00640 1 -- 172.21.15.87:0/3537895079 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd03c0cf480 con 0x7fd03c0b5310 2024-05-27T06:28:50.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.525+0000 7fd03be00640 1 --2- 172.21.15.87:0/3537895079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd03c0b5310 0x7fd03c0b5720 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd034009d90 tx=0x7fd03401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b59d5c5c05e3612 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:50.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.525+0000 7fd03aa00640 1 -- 172.21.15.87:0/3537895079 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0340b2070 con 0x7fd03c0b5310 2024-05-27T06:28:50.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.525+0000 7fd03aa00640 1 -- 172.21.15.87:0/3537895079 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0340a5830 con 0x7fd03c0b5310 2024-05-27T06:28:50.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.525+0000 7fd03aa00640 1 -- 172.21.15.87:0/3537895079 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0340a5c00 con 0x7fd03c0b5310 2024-05-27T06:28:50.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.525+0000 7fd040c00640 1 -- 172.21.15.87:0/3537895079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd03c0b5310 msgr2=0x7fd03c0b5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:50.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.525+0000 7fd040c00640 1 --2- 172.21.15.87:0/3537895079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd03c0b5310 0x7fd03c0b5720 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd034009d90 tx=0x7fd03401c970 comp rx=0 tx=0).stop 2024-05-27T06:28:50.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.525+0000 7fd040c00640 1 -- 172.21.15.87:0/3537895079 shutdown_connections 2024-05-27T06:28:50.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.525+0000 7fd040c00640 1 --2- 172.21.15.87:0/3537895079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd03c0b5310 0x7fd03c0b5720 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:50.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.525+0000 7fd040c00640 1 --2- 172.21.15.87:0/3537895079 >> v2:172.21.15.149:3300/0 conn(0x7fd03c163ed0 0x7fd03c0ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:50.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.525+0000 7fd040c00640 1 -- 172.21.15.87:0/3537895079 >> 172.21.15.87:0/3537895079 conn(0x7fd03c071060 msgr2=0x7fd03c071470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:50.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.525+0000 7fd040c00640 1 -- 172.21.15.87:0/3537895079 shutdown_connections 2024-05-27T06:28:50.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.525+0000 7fd040c00640 1 -- 172.21.15.87:0/3537895079 wait complete. 2024-05-27T06:28:50.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.529+0000 7fd040c00640 1 Processor -- start 2024-05-27T06:28:50.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.529+0000 7fd040c00640 1 -- start start 2024-05-27T06:28:50.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.529+0000 7fd040c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd03c0b5310 0x7fd03c15f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:50.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.529+0000 7fd040c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd03c160d50 0x7fd03c152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:50.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.529+0000 7fd040c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd03c152eb0 0x7fd03c1532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:50.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.529+0000 7fd040c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c16cce0 con 0x7fd03c160d50 2024-05-27T06:28:50.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.529+0000 7fd040c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c16cb60 con 0x7fd03c152eb0 2024-05-27T06:28:50.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.529+0000 7fd040c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd03c16ce60 con 0x7fd03c0b5310 2024-05-27T06:28:50.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.529+0000 7fd032a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd03c160d50 0x7fd03c152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:50.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.529+0000 7fd032a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd03c160d50 0x7fd03c152970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39882/0 (socket says 172.21.15.87:39882) 2024-05-27T06:28:50.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.529+0000 7fd032a00640 1 -- 172.21.15.87:0/4068700848 learned_addr learned my addr 172.21.15.87:0/4068700848 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:50.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.529+0000 7fd03b400640 1 --2- 172.21.15.87:0/4068700848 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd03c0b5310 0x7fd03c15f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:50.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.529+0000 7fd03be00640 1 --2- 172.21.15.87:0/4068700848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd03c152eb0 0x7fd03c1532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:50.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.529+0000 7fd032a00640 1 -- 172.21.15.87:0/4068700848 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd03c0b5310 msgr2=0x7fd03c15f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:50.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.529+0000 7fd032a00640 1 --2- 172.21.15.87:0/4068700848 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd03c0b5310 0x7fd03c15f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:50.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.529+0000 7fd032a00640 1 -- 172.21.15.87:0/4068700848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd03c152eb0 msgr2=0x7fd03c1532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:50.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.529+0000 7fd032a00640 1 --2- 172.21.15.87:0/4068700848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd03c152eb0 0x7fd03c1532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:50.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.529+0000 7fd032a00640 1 -- 172.21.15.87:0/4068700848 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd03c1569c0 con 0x7fd03c160d50 2024-05-27T06:28:50.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.529+0000 7fd03be00640 1 --2- 172.21.15.87:0/4068700848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd03c152eb0 0x7fd03c1532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:50.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.529+0000 7fd032a00640 1 --2- 172.21.15.87:0/4068700848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd03c160d50 0x7fd03c152970 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd02400e870 tx=0x7fd02400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:50.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.529+0000 7fd033e00640 1 -- 172.21.15.87:0/4068700848 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd024017070 con 0x7fd03c160d50 2024-05-27T06:28:50.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.529+0000 7fd033e00640 1 -- 172.21.15.87:0/4068700848 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd02400c940 con 0x7fd03c160d50 2024-05-27T06:28:50.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.529+0000 7fd040c00640 1 -- 172.21.15.87:0/4068700848 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd03c156ca0 con 0x7fd03c160d50 2024-05-27T06:28:50.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.529+0000 7fd033e00640 1 -- 172.21.15.87:0/4068700848 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02400cd30 con 0x7fd03c160d50 2024-05-27T06:28:50.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.529+0000 7fd040c00640 1 -- 172.21.15.87:0/4068700848 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd03c157260 con 0x7fd03c160d50 2024-05-27T06:28:50.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.533+0000 7fd040c00640 1 -- 172.21.15.87:0/4068700848 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd03c13e580 con 0x7fd03c160d50 2024-05-27T06:28:50.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.533+0000 7fd033e00640 1 -- 172.21.15.87:0/4068700848 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd02401a070 con 0x7fd03c160d50 2024-05-27T06:28:50.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.533+0000 7fd033e00640 1 --2- 172.21.15.87:0/4068700848 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd01806f400 0x7fd018071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:50.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.533+0000 7fd033e00640 1 -- 172.21.15.87:0/4068700848 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fd02408f6b0 con 0x7fd03c160d50 2024-05-27T06:28:50.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.533+0000 7fd03b400640 1 --2- 172.21.15.87:0/4068700848 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd01806f400 0x7fd018071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:50.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.533+0000 7fd03b400640 1 --2- 172.21.15.87:0/4068700848 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd01806f400 0x7fd018071910 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd02c007a70 tx=0x7fd02c0079c0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:50.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.537+0000 7fd033e00640 1 -- 172.21.15.87:0/4068700848 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fd03c13e580 con 0x7fd03c160d50 2024-05-27T06:28:50.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.697+0000 7fd040c00640 1 -- 172.21.15.87:0/4068700848 --> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd03c156750 con 0x7fd01806f400 2024-05-27T06:28:50.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.705+0000 7fd033e00640 1 -- 172.21.15.87:0/4068700848 <== mgr.4111 v2:172.21.15.87:6832/2724754260 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7fd03c156750 con 0x7fd01806f400 2024-05-27T06:28:50.704 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:50.706 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-27T06:28:50.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.705+0000 7fd040c00640 1 -- 172.21.15.87:0/4068700848 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd01806f400 msgr2=0x7fd018071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:50.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.705+0000 7fd040c00640 1 --2- 172.21.15.87:0/4068700848 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd01806f400 0x7fd018071910 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd02c007a70 tx=0x7fd02c0079c0 comp rx=0 tx=0).stop 2024-05-27T06:28:50.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.705+0000 7fd040c00640 1 -- 172.21.15.87:0/4068700848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd03c160d50 msgr2=0x7fd03c152970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:50.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.705+0000 7fd040c00640 1 --2- 172.21.15.87:0/4068700848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd03c160d50 0x7fd03c152970 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd02400e870 tx=0x7fd02400ec70 comp rx=0 tx=0).stop 2024-05-27T06:28:50.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.705+0000 7fd040c00640 1 -- 172.21.15.87:0/4068700848 shutdown_connections 2024-05-27T06:28:50.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.705+0000 7fd040c00640 1 --2- 172.21.15.87:0/4068700848 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd01806f400 0x7fd018071910 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:50.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.705+0000 7fd040c00640 1 --2- 172.21.15.87:0/4068700848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd03c152eb0 0x7fd03c1532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:50.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.705+0000 7fd040c00640 1 --2- 172.21.15.87:0/4068700848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd03c160d50 0x7fd03c152970 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:50.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.705+0000 7fd040c00640 1 --2- 172.21.15.87:0/4068700848 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd03c0b5310 0x7fd03c15f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:50.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.705+0000 7fd040c00640 1 -- 172.21.15.87:0/4068700848 >> 172.21.15.87:0/4068700848 conn(0x7fd03c071060 msgr2=0x7fd03c1621c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:50.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.705+0000 7fd040c00640 1 -- 172.21.15.87:0/4068700848 shutdown_connections 2024-05-27T06:28:50.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.705+0000 7fd040c00640 1 -- 172.21.15.87:0/4068700848 wait complete. 2024-05-27T06:28:50.725 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-05-27T06:28:50.583359+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220816,"kb_used_data":4648,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753904,"statfs":{"total":773094113280,"available":772867997696,"internally_reserved":0,"allocated":4759552,"data_stored":2707076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.928824"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214591+0000","last_change":"2024-05-27T06:28:41.684202+0000","last_active":"2024-05-27T06:28:44.214591+0000","last_peered":"2024-05-27T06:28:44.214591+0000","last_clean":"2024-05-27T06:28:44.214591+0000","last_became_active":"2024-05-27T06:28:41.683863+0000","last_became_peered":"2024-05-27T06:28:41.683863+0000","last_unstale":"2024-05-27T06:28:44.214591+0000","last_undegraded":"2024-05-27T06:28:44.214591+0000","last_fullsized":"2024-05-27T06:28:44.214591+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:21:01.146280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214292+0000","last_change":"2024-05-27T06:28:41.677158+0000","last_active":"2024-05-27T06:28:44.214292+0000","last_peered":"2024-05-27T06:28:44.214292+0000","last_clean":"2024-05-27T06:28:44.214292+0000","last_became_active":"2024-05-27T06:28:41.676849+0000","last_became_peered":"2024-05-27T06:28:41.676849+0000","last_unstale":"2024-05-27T06:28:44.214292+0000","last_undegraded":"2024-05-27T06:28:44.214292+0000","last_fullsized":"2024-05-27T06:28:44.214292+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:55:55.839776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214671+0000","last_change":"2024-05-27T06:28:41.685935+0000","last_active":"2024-05-27T06:28:44.214671+0000","last_peered":"2024-05-27T06:28:44.214671+0000","last_clean":"2024-05-27T06:28:44.214671+0000","last_became_active":"2024-05-27T06:28:41.685613+0000","last_became_peered":"2024-05-27T06:28:41.685613+0000","last_unstale":"2024-05-27T06:28:44.214671+0000","last_undegraded":"2024-05-27T06:28:44.214671+0000","last_fullsized":"2024-05-27T06:28:44.214671+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:06:14.581452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:42.677399+0000","last_change":"2024-05-27T06:28:41.676256+0000","last_active":"2024-05-27T06:28:42.677399+0000","last_peered":"2024-05-27T06:28:42.677399+0000","last_clean":"2024-05-27T06:28:42.677399+0000","last_became_active":"2024-05-27T06:28:41.675591+0000","last_became_peered":"2024-05-27T06:28:41.675591+0000","last_unstale":"2024-05-27T06:28:42.677399+0000","last_undegraded":"2024-05-27T06:28:42.677399+0000","last_fullsized":"2024-05-27T06:28:42.677399+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:18:48.881639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:42.677285+0000","last_change":"2024-05-27T06:28:41.665348+0000","last_active":"2024-05-27T06:28:42.677285+0000","last_peered":"2024-05-27T06:28:42.677285+0000","last_clean":"2024-05-27T06:28:42.677285+0000","last_became_active":"2024-05-27T06:28:41.665017+0000","last_became_peered":"2024-05-27T06:28:41.665017+0000","last_unstale":"2024-05-27T06:28:42.677285+0000","last_undegraded":"2024-05-27T06:28:42.677285+0000","last_fullsized":"2024-05-27T06:28:42.677285+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:58:12.224717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:43.705349+0000","last_change":"2024-05-27T06:28:41.692688+0000","last_active":"2024-05-27T06:28:43.705349+0000","last_peered":"2024-05-27T06:28:43.705349+0000","last_clean":"2024-05-27T06:28:43.705349+0000","last_became_active":"2024-05-27T06:28:41.692431+0000","last_became_peered":"2024-05-27T06:28:41.692431+0000","last_unstale":"2024-05-27T06:28:43.705349+0000","last_undegraded":"2024-05-27T06:28:43.705349+0000","last_fullsized":"2024-05-27T06:28:43.705349+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:14:03.520838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:43.665411+0000","last_change":"2024-05-27T06:28:41.696159+0000","last_active":"2024-05-27T06:28:43.665411+0000","last_peered":"2024-05-27T06:28:43.665411+0000","last_clean":"2024-05-27T06:28:43.665411+0000","last_became_active":"2024-05-27T06:28:41.694654+0000","last_became_peered":"2024-05-27T06:28:41.694654+0000","last_unstale":"2024-05-27T06:28:43.665411+0000","last_undegraded":"2024-05-27T06:28:43.665411+0000","last_fullsized":"2024-05-27T06:28:43.665411+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:00:43.948438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.213954+0000","last_change":"2024-05-27T06:28:41.679099+0000","last_active":"2024-05-27T06:28:44.213954+0000","last_peered":"2024-05-27T06:28:44.213954+0000","last_clean":"2024-05-27T06:28:44.213954+0000","last_became_active":"2024-05-27T06:28:41.678789+0000","last_became_peered":"2024-05-27T06:28:41.678789+0000","last_unstale":"2024-05-27T06:28:44.213954+0000","last_undegraded":"2024-05-27T06:28:44.213954+0000","last_fullsized":"2024-05-27T06:28:44.213954+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:16:06.347782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214793+0000","last_change":"2024-05-27T06:28:41.682971+0000","last_active":"2024-05-27T06:28:44.214793+0000","last_peered":"2024-05-27T06:28:44.214793+0000","last_clean":"2024-05-27T06:28:44.214793+0000","last_became_active":"2024-05-27T06:28:41.679162+0000","last_became_peered":"2024-05-27T06:28:41.679162+0000","last_unstale":"2024-05-27T06:28:44.214793+0000","last_undegraded":"2024-05-27T06:28:44.214793+0000","last_fullsized":"2024-05-27T06:28:44.214793+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:18:41.908898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:43.666024+0000","last_change":"2024-05-27T06:28:41.681045+0000","last_active":"2024-05-27T06:28:43.666024+0000","last_peered":"2024-05-27T06:28:43.666024+0000","last_clean":"2024-05-27T06:28:43.666024+0000","last_became_active":"2024-05-27T06:28:41.680721+0000","last_became_peered":"2024-05-27T06:28:41.680721+0000","last_unstale":"2024-05-27T06:28:43.666024+0000","last_undegraded":"2024-05-27T06:28:43.666024+0000","last_fullsized":"2024-05-27T06:28:43.666024+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:47:58.779935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:43.666002+0000","last_change":"2024-05-27T06:28:41.687915+0000","last_active":"2024-05-27T06:28:43.666002+0000","last_peered":"2024-05-27T06:28:43.666002+0000","last_clean":"2024-05-27T06:28:43.666002+0000","last_became_active":"2024-05-27T06:28:41.687564+0000","last_became_peered":"2024-05-27T06:28:41.687564+0000","last_unstale":"2024-05-27T06:28:43.666002+0000","last_undegraded":"2024-05-27T06:28:43.666002+0000","last_fullsized":"2024-05-27T06:28:43.666002+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:34:13.790183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214562+0000","last_change":"2024-05-27T06:28:41.686291+0000","last_active":"2024-05-27T06:28:44.214562+0000","last_peered":"2024-05-27T06:28:44.214562+0000","last_clean":"2024-05-27T06:28:44.214562+0000","last_became_active":"2024-05-27T06:28:41.685990+0000","last_became_peered":"2024-05-27T06:28:41.685990+0000","last_unstale":"2024-05-27T06:28:44.214562+0000","last_undegraded":"2024-05-27T06:28:44.214562+0000","last_fullsized":"2024-05-27T06:28:44.214562+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:29:46.987937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:43.665533+0000","last_change":"2024-05-27T06:28:41.692932+0000","last_active":"2024-05-27T06:28:43.665533+0000","last_peered":"2024-05-27T06:28:43.665533+0000","last_clean":"2024-05-27T06:28:43.665533+0000","last_became_active":"2024-05-27T06:28:41.687203+0000","last_became_peered":"2024-05-27T06:28:41.687203+0000","last_unstale":"2024-05-27T06:28:43.665533+0000","last_undegraded":"2024-05-27T06:28:43.665533+0000","last_fullsized":"2024-05-27T06:28:43.665533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:16:06.347782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214392+0000","last_change":"2024-05-27T06:28:41.669186+0000","last_active":"2024-05-27T06:28:44.214392+0000","last_peered":"2024-05-27T06:28:44.214392+0000","last_clean":"2024-05-27T06:28:44.214392+0000","last_became_active":"2024-05-27T06:28:41.668830+0000","last_became_peered":"2024-05-27T06:28:41.668830+0000","last_unstale":"2024-05-27T06:28:44.214392+0000","last_undegraded":"2024-05-27T06:28:44.214392+0000","last_fullsized":"2024-05-27T06:28:44.214392+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:19:32.150310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:43.665399+0000","last_change":"2024-05-27T06:28:41.686560+0000","last_active":"2024-05-27T06:28:43.665399+0000","last_peered":"2024-05-27T06:28:43.665399+0000","last_clean":"2024-05-27T06:28:43.665399+0000","last_became_active":"2024-05-27T06:28:41.686223+0000","last_became_peered":"2024-05-27T06:28:41.686223+0000","last_unstale":"2024-05-27T06:28:43.665399+0000","last_undegraded":"2024-05-27T06:28:43.665399+0000","last_fullsized":"2024-05-27T06:28:43.665399+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:54:43.415493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214596+0000","last_change":"2024-05-27T06:28:41.687995+0000","last_active":"2024-05-27T06:28:44.214596+0000","last_peered":"2024-05-27T06:28:44.214596+0000","last_clean":"2024-05-27T06:28:44.214596+0000","last_became_active":"2024-05-27T06:28:41.687313+0000","last_became_peered":"2024-05-27T06:28:41.687313+0000","last_unstale":"2024-05-27T06:28:44.214596+0000","last_undegraded":"2024-05-27T06:28:44.214596+0000","last_fullsized":"2024-05-27T06:28:44.214596+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:29:46.987937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.215968+0000","last_change":"2024-05-27T06:28:41.685822+0000","last_active":"2024-05-27T06:28:44.215968+0000","last_peered":"2024-05-27T06:28:44.215968+0000","last_clean":"2024-05-27T06:28:44.215968+0000","last_became_active":"2024-05-27T06:28:41.685511+0000","last_became_peered":"2024-05-27T06:28:41.685511+0000","last_unstale":"2024-05-27T06:28:44.215968+0000","last_undegraded":"2024-05-27T06:28:44.215968+0000","last_fullsized":"2024-05-27T06:28:44.215968+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:57:50.543290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:42.675847+0000","last_change":"2024-05-27T06:28:41.677352+0000","last_active":"2024-05-27T06:28:42.675847+0000","last_peered":"2024-05-27T06:28:42.675847+0000","last_clean":"2024-05-27T06:28:42.675847+0000","last_became_active":"2024-05-27T06:28:41.676628+0000","last_became_peered":"2024-05-27T06:28:41.676628+0000","last_unstale":"2024-05-27T06:28:42.675847+0000","last_undegraded":"2024-05-27T06:28:42.675847+0000","last_fullsized":"2024-05-27T06:28:42.675847+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:27:37.562707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:42.677342+0000","last_change":"2024-05-27T06:28:41.690525+0000","last_active":"2024-05-27T06:28:42.677342+0000","last_peered":"2024-05-27T06:28:42.677342+0000","last_clean":"2024-05-27T06:28:42.677342+0000","last_became_active":"2024-05-27T06:28:41.690207+0000","last_became_peered":"2024-05-27T06:28:41.690207+0000","last_unstale":"2024-05-27T06:28:42.677342+0000","last_undegraded":"2024-05-27T06:28:42.677342+0000","last_fullsized":"2024-05-27T06:28:42.677342+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:14:00.187017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:42.675629+0000","last_change":"2024-05-27T06:28:41.677365+0000","last_active":"2024-05-27T06:28:42.675629+0000","last_peered":"2024-05-27T06:28:42.675629+0000","last_clean":"2024-05-27T06:28:42.675629+0000","last_became_active":"2024-05-27T06:28:41.676860+0000","last_became_peered":"2024-05-27T06:28:41.676860+0000","last_unstale":"2024-05-27T06:28:42.675629+0000","last_undegraded":"2024-05-27T06:28:42.675629+0000","last_fullsized":"2024-05-27T06:28:42.675629+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:19:32.150310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:43.665764+0000","last_change":"2024-05-27T06:28:41.692621+0000","last_active":"2024-05-27T06:28:43.665764+0000","last_peered":"2024-05-27T06:28:43.665764+0000","last_clean":"2024-05-27T06:28:43.665764+0000","last_became_active":"2024-05-27T06:28:41.687850+0000","last_became_peered":"2024-05-27T06:28:41.687850+0000","last_unstale":"2024-05-27T06:28:43.665764+0000","last_undegraded":"2024-05-27T06:28:43.665764+0000","last_fullsized":"2024-05-27T06:28:43.665764+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:57:50.543290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214973+0000","last_change":"2024-05-27T06:28:41.667489+0000","last_active":"2024-05-27T06:28:44.214973+0000","last_peered":"2024-05-27T06:28:44.214973+0000","last_clean":"2024-05-27T06:28:44.214973+0000","last_became_active":"2024-05-27T06:28:41.667159+0000","last_became_peered":"2024-05-27T06:28:41.667159+0000","last_unstale":"2024-05-27T06:28:44.214973+0000","last_undegraded":"2024-05-27T06:28:44.214973+0000","last_fullsized":"2024-05-27T06:28:44.214973+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:21:17.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.215054+0000","last_change":"2024-05-27T06:28:41.679260+0000","last_active":"2024-05-27T06:28:44.215054+0000","last_peered":"2024-05-27T06:28:44.215054+0000","last_clean":"2024-05-27T06:28:44.215054+0000","last_became_active":"2024-05-27T06:28:41.678948+0000","last_became_peered":"2024-05-27T06:28:41.678948+0000","last_unstale":"2024-05-27T06:28:44.215054+0000","last_undegraded":"2024-05-27T06:28:44.215054+0000","last_fullsized":"2024-05-27T06:28:44.215054+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:11:43.407773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:42.677119+0000","last_change":"2024-05-27T06:28:41.683568+0000","last_active":"2024-05-27T06:28:42.677119+0000","last_peered":"2024-05-27T06:28:42.677119+0000","last_clean":"2024-05-27T06:28:42.677119+0000","last_became_active":"2024-05-27T06:28:41.683222+0000","last_became_peered":"2024-05-27T06:28:41.683222+0000","last_unstale":"2024-05-27T06:28:42.677119+0000","last_undegraded":"2024-05-27T06:28:42.677119+0000","last_fullsized":"2024-05-27T06:28:42.677119+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:10:24.840501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:42.675838+0000","last_change":"2024-05-27T06:28:41.680710+0000","last_active":"2024-05-27T06:28:42.675838+0000","last_peered":"2024-05-27T06:28:42.675838+0000","last_clean":"2024-05-27T06:28:42.675838+0000","last_became_active":"2024-05-27T06:28:41.680410+0000","last_became_peered":"2024-05-27T06:28:41.680410+0000","last_unstale":"2024-05-27T06:28:42.675838+0000","last_undegraded":"2024-05-27T06:28:42.675838+0000","last_fullsized":"2024-05-27T06:28:42.675838+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:49:17.043121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:43.705854+0000","last_change":"2024-05-27T06:28:41.692550+0000","last_active":"2024-05-27T06:28:43.705854+0000","last_peered":"2024-05-27T06:28:43.705854+0000","last_clean":"2024-05-27T06:28:43.705854+0000","last_became_active":"2024-05-27T06:28:41.689176+0000","last_became_peered":"2024-05-27T06:28:41.689176+0000","last_unstale":"2024-05-27T06:28:43.705854+0000","last_undegraded":"2024-05-27T06:28:43.705854+0000","last_fullsized":"2024-05-27T06:28:43.705854+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:38:23.963380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:42.675838+0000","last_change":"2024-05-27T06:28:41.682057+0000","last_active":"2024-05-27T06:28:42.675838+0000","last_peered":"2024-05-27T06:28:42.675838+0000","last_clean":"2024-05-27T06:28:42.675838+0000","last_became_active":"2024-05-27T06:28:41.681771+0000","last_became_peered":"2024-05-27T06:28:41.681771+0000","last_unstale":"2024-05-27T06:28:42.675838+0000","last_undegraded":"2024-05-27T06:28:42.675838+0000","last_fullsized":"2024-05-27T06:28:42.675838+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:21:17.188464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:43.665799+0000","last_change":"2024-05-27T06:28:41.694686+0000","last_active":"2024-05-27T06:28:43.665799+0000","last_peered":"2024-05-27T06:28:43.665799+0000","last_clean":"2024-05-27T06:28:43.665799+0000","last_became_active":"2024-05-27T06:28:41.694386+0000","last_became_peered":"2024-05-27T06:28:41.694386+0000","last_unstale":"2024-05-27T06:28:43.665799+0000","last_undegraded":"2024-05-27T06:28:43.665799+0000","last_fullsized":"2024-05-27T06:28:43.665799+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:55:55.839776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:42.675526+0000","last_change":"2024-05-27T06:28:41.688553+0000","last_active":"2024-05-27T06:28:42.675526+0000","last_peered":"2024-05-27T06:28:42.675526+0000","last_clean":"2024-05-27T06:28:42.675526+0000","last_became_active":"2024-05-27T06:28:41.688100+0000","last_became_peered":"2024-05-27T06:28:41.688100+0000","last_unstale":"2024-05-27T06:28:42.675526+0000","last_undegraded":"2024-05-27T06:28:42.675526+0000","last_fullsized":"2024-05-27T06:28:42.675526+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T06:55:00.440811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:42.675327+0000","last_change":"2024-05-27T06:28:41.686806+0000","last_active":"2024-05-27T06:28:42.675327+0000","last_peered":"2024-05-27T06:28:42.675327+0000","last_clean":"2024-05-27T06:28:42.675327+0000","last_became_active":"2024-05-27T06:28:41.686412+0000","last_became_peered":"2024-05-27T06:28:41.686412+0000","last_unstale":"2024-05-27T06:28:42.675327+0000","last_undegraded":"2024-05-27T06:28:42.675327+0000","last_fullsized":"2024-05-27T06:28:42.675327+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:59:07.320432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.215295+0000","last_change":"2024-05-27T06:28:41.684540+0000","last_active":"2024-05-27T06:28:44.215295+0000","last_peered":"2024-05-27T06:28:44.215295+0000","last_clean":"2024-05-27T06:28:44.215295+0000","last_became_active":"2024-05-27T06:28:41.684109+0000","last_became_peered":"2024-05-27T06:28:41.684109+0000","last_unstale":"2024-05-27T06:28:44.215295+0000","last_undegraded":"2024-05-27T06:28:44.215295+0000","last_fullsized":"2024-05-27T06:28:44.215295+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:18:41.908898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:43.705270+0000","last_change":"2024-05-27T06:28:41.681516+0000","last_active":"2024-05-27T06:28:43.705270+0000","last_peered":"2024-05-27T06:28:43.705270+0000","last_clean":"2024-05-27T06:28:43.705270+0000","last_became_active":"2024-05-27T06:28:41.681196+0000","last_became_peered":"2024-05-27T06:28:41.681196+0000","last_unstale":"2024-05-27T06:28:43.705270+0000","last_undegraded":"2024-05-27T06:28:43.705270+0000","last_fullsized":"2024-05-27T06:28:43.705270+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:21:44.355982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.215743+0000","last_change":"2024-05-27T06:28:41.685831+0000","last_active":"2024-05-27T06:28:44.215743+0000","last_peered":"2024-05-27T06:28:44.215743+0000","last_clean":"2024-05-27T06:28:44.215743+0000","last_became_active":"2024-05-27T06:28:41.685465+0000","last_became_peered":"2024-05-27T06:28:41.685465+0000","last_unstale":"2024-05-27T06:28:44.215743+0000","last_undegraded":"2024-05-27T06:28:44.215743+0000","last_fullsized":"2024-05-27T06:28:44.215743+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:16:06.347782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:42.675969+0000","last_change":"2024-05-27T06:28:40.669695+0000","last_active":"2024-05-27T06:28:42.675969+0000","last_peered":"2024-05-27T06:28:42.675969+0000","last_clean":"2024-05-27T06:28:42.675969+0000","last_became_active":"2024-05-27T06:28:40.669333+0000","last_became_peered":"2024-05-27T06:28:40.669333+0000","last_unstale":"2024-05-27T06:28:42.675969+0000","last_undegraded":"2024-05-27T06:28:42.675969+0000","last_fullsized":"2024-05-27T06:28:42.675969+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:18:47.874305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:43.705854+0000","last_change":"2024-05-27T06:28:41.688337+0000","last_active":"2024-05-27T06:28:43.705854+0000","last_peered":"2024-05-27T06:28:43.705854+0000","last_clean":"2024-05-27T06:28:43.705854+0000","last_became_active":"2024-05-27T06:28:41.687142+0000","last_became_peered":"2024-05-27T06:28:41.687142+0000","last_unstale":"2024-05-27T06:28:43.705854+0000","last_undegraded":"2024-05-27T06:28:43.705854+0000","last_fullsized":"2024-05-27T06:28:43.705854+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:29:46.987937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214600+0000","last_change":"2024-05-27T06:28:40.673139+0000","last_active":"2024-05-27T06:28:44.214600+0000","last_peered":"2024-05-27T06:28:44.214600+0000","last_clean":"2024-05-27T06:28:44.214600+0000","last_became_active":"2024-05-27T06:28:40.672841+0000","last_became_peered":"2024-05-27T06:28:40.672841+0000","last_unstale":"2024-05-27T06:28:44.214600+0000","last_undegraded":"2024-05-27T06:28:44.214600+0000","last_fullsized":"2024-05-27T06:28:44.214600+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:52:37.091584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.215173+0000","last_change":"2024-05-27T06:28:41.675501+0000","last_active":"2024-05-27T06:28:44.215173+0000","last_peered":"2024-05-27T06:28:44.215173+0000","last_clean":"2024-05-27T06:28:44.215173+0000","last_became_active":"2024-05-27T06:28:41.668512+0000","last_became_peered":"2024-05-27T06:28:41.668512+0000","last_unstale":"2024-05-27T06:28:44.215173+0000","last_undegraded":"2024-05-27T06:28:44.215173+0000","last_fullsized":"2024-05-27T06:28:44.215173+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:21:44.355982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:43.705907+0000","last_change":"2024-05-27T06:28:40.672478+0000","last_active":"2024-05-27T06:28:43.705907+0000","last_peered":"2024-05-27T06:28:43.705907+0000","last_clean":"2024-05-27T06:28:43.705907+0000","last_became_active":"2024-05-27T06:28:40.672172+0000","last_became_peered":"2024-05-27T06:28:40.672172+0000","last_unstale":"2024-05-27T06:28:43.705907+0000","last_undegraded":"2024-05-27T06:28:43.705907+0000","last_fullsized":"2024-05-27T06:28:43.705907+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:52:37.091584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214488+0000","last_change":"2024-05-27T06:28:41.685249+0000","last_active":"2024-05-27T06:28:44.214488+0000","last_peered":"2024-05-27T06:28:44.214488+0000","last_clean":"2024-05-27T06:28:44.214488+0000","last_became_active":"2024-05-27T06:28:41.684931+0000","last_became_peered":"2024-05-27T06:28:41.684931+0000","last_unstale":"2024-05-27T06:28:44.214488+0000","last_undegraded":"2024-05-27T06:28:44.214488+0000","last_fullsized":"2024-05-27T06:28:44.214488+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:23:20.297745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214787+0000","last_change":"2024-05-27T06:28:40.677480+0000","last_active":"2024-05-27T06:28:44.214787+0000","last_peered":"2024-05-27T06:28:44.214787+0000","last_clean":"2024-05-27T06:28:44.214787+0000","last_became_active":"2024-05-27T06:28:40.677186+0000","last_became_peered":"2024-05-27T06:28:40.677186+0000","last_unstale":"2024-05-27T06:28:44.214787+0000","last_undegraded":"2024-05-27T06:28:44.214787+0000","last_fullsized":"2024-05-27T06:28:44.214787+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:18:47.874305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.213627+0000","last_change":"2024-05-27T06:28:41.689907+0000","last_active":"2024-05-27T06:28:44.213627+0000","last_peered":"2024-05-27T06:28:44.213627+0000","last_clean":"2024-05-27T06:28:44.213627+0000","last_became_active":"2024-05-27T06:28:41.689639+0000","last_became_peered":"2024-05-27T06:28:41.689639+0000","last_unstale":"2024-05-27T06:28:44.213627+0000","last_undegraded":"2024-05-27T06:28:44.213627+0000","last_fullsized":"2024-05-27T06:28:44.213627+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:21:58.249141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:43.665731+0000","last_change":"2024-05-27T06:28:40.676566+0000","last_active":"2024-05-27T06:28:43.665731+0000","last_peered":"2024-05-27T06:28:43.665731+0000","last_clean":"2024-05-27T06:28:43.665731+0000","last_became_active":"2024-05-27T06:28:40.676114+0000","last_became_peered":"2024-05-27T06:28:40.676114+0000","last_unstale":"2024-05-27T06:28:43.665731+0000","last_undegraded":"2024-05-27T06:28:43.665731+0000","last_fullsized":"2024-05-27T06:28:43.665731+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:52:37.091584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:43.665654+0000","last_change":"2024-05-27T06:28:41.693876+0000","last_active":"2024-05-27T06:28:43.665654+0000","last_peered":"2024-05-27T06:28:43.665654+0000","last_clean":"2024-05-27T06:28:43.665654+0000","last_became_active":"2024-05-27T06:28:41.683069+0000","last_became_peered":"2024-05-27T06:28:41.683069+0000","last_unstale":"2024-05-27T06:28:43.665654+0000","last_undegraded":"2024-05-27T06:28:43.665654+0000","last_fullsized":"2024-05-27T06:28:43.665654+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:48:54.248180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.215302+0000","last_change":"2024-05-27T06:28:40.681743+0000","last_active":"2024-05-27T06:28:44.215302+0000","last_peered":"2024-05-27T06:28:44.215302+0000","last_clean":"2024-05-27T06:28:44.215302+0000","last_became_active":"2024-05-27T06:28:40.681385+0000","last_became_peered":"2024-05-27T06:28:40.681385+0000","last_unstale":"2024-05-27T06:28:44.215302+0000","last_undegraded":"2024-05-27T06:28:44.215302+0000","last_fullsized":"2024-05-27T06:28:44.215302+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:12:15.418800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214649+0000","last_change":"2024-05-27T06:28:41.690720+0000","last_active":"2024-05-27T06:28:44.214649+0000","last_peered":"2024-05-27T06:28:44.214649+0000","last_clean":"2024-05-27T06:28:44.214649+0000","last_became_active":"2024-05-27T06:28:41.689982+0000","last_became_peered":"2024-05-27T06:28:41.689982+0000","last_unstale":"2024-05-27T06:28:44.214649+0000","last_undegraded":"2024-05-27T06:28:44.214649+0000","last_fullsized":"2024-05-27T06:28:44.214649+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:27:37.562707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:43.705285+0000","last_change":"2024-05-27T06:28:40.673602+0000","last_active":"2024-05-27T06:28:43.705285+0000","last_peered":"2024-05-27T06:28:43.705285+0000","last_clean":"2024-05-27T06:28:43.705285+0000","last_became_active":"2024-05-27T06:28:40.673279+0000","last_became_peered":"2024-05-27T06:28:40.673279+0000","last_unstale":"2024-05-27T06:28:43.705285+0000","last_undegraded":"2024-05-27T06:28:43.705285+0000","last_fullsized":"2024-05-27T06:28:43.705285+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:12:15.418800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214655+0000","last_change":"2024-05-27T06:28:41.692264+0000","last_active":"2024-05-27T06:28:44.214655+0000","last_peered":"2024-05-27T06:28:44.214655+0000","last_clean":"2024-05-27T06:28:44.214655+0000","last_became_active":"2024-05-27T06:28:41.691842+0000","last_became_peered":"2024-05-27T06:28:41.691842+0000","last_unstale":"2024-05-27T06:28:44.214655+0000","last_undegraded":"2024-05-27T06:28:44.214655+0000","last_fullsized":"2024-05-27T06:28:44.214655+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:23:58.439881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214297+0000","last_change":"2024-05-27T06:28:40.667506+0000","last_active":"2024-05-27T06:28:44.214297+0000","last_peered":"2024-05-27T06:28:44.214297+0000","last_clean":"2024-05-27T06:28:44.214297+0000","last_became_active":"2024-05-27T06:28:40.666805+0000","last_became_peered":"2024-05-27T06:28:40.666805+0000","last_unstale":"2024-05-27T06:28:44.214297+0000","last_undegraded":"2024-05-27T06:28:44.214297+0000","last_fullsized":"2024-05-27T06:28:44.214297+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:10:23.833168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:42.677522+0000","last_change":"2024-05-27T06:28:41.676387+0000","last_active":"2024-05-27T06:28:42.677522+0000","last_peered":"2024-05-27T06:28:42.677522+0000","last_clean":"2024-05-27T06:28:42.677522+0000","last_became_active":"2024-05-27T06:28:41.675964+0000","last_became_peered":"2024-05-27T06:28:41.675964+0000","last_unstale":"2024-05-27T06:28:42.677522+0000","last_undegraded":"2024-05-27T06:28:42.677522+0000","last_fullsized":"2024-05-27T06:28:42.677522+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T06:56:05.102943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214598+0000","last_change":"2024-05-27T06:28:40.679319+0000","last_active":"2024-05-27T06:28:44.214598+0000","last_peered":"2024-05-27T06:28:44.214598+0000","last_clean":"2024-05-27T06:28:44.214598+0000","last_became_active":"2024-05-27T06:28:40.678970+0000","last_became_peered":"2024-05-27T06:28:40.678970+0000","last_unstale":"2024-05-27T06:28:44.214598+0000","last_undegraded":"2024-05-27T06:28:44.214598+0000","last_fullsized":"2024-05-27T06:28:44.214598+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:21:16.181130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.215898+0000","last_change":"2024-05-27T06:28:41.688809+0000","last_active":"2024-05-27T06:28:44.215898+0000","last_peered":"2024-05-27T06:28:44.215898+0000","last_clean":"2024-05-27T06:28:44.215898+0000","last_became_active":"2024-05-27T06:28:41.683715+0000","last_became_peered":"2024-05-27T06:28:41.683715+0000","last_unstale":"2024-05-27T06:28:44.215898+0000","last_undegraded":"2024-05-27T06:28:44.215898+0000","last_fullsized":"2024-05-27T06:28:44.215898+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:48:54.248180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:43.666204+0000","last_change":"2024-05-27T06:28:40.680595+0000","last_active":"2024-05-27T06:28:43.666204+0000","last_peered":"2024-05-27T06:28:43.666204+0000","last_clean":"2024-05-27T06:28:43.666204+0000","last_became_active":"2024-05-27T06:28:40.680213+0000","last_became_peered":"2024-05-27T06:28:40.680213+0000","last_unstale":"2024-05-27T06:28:43.666204+0000","last_undegraded":"2024-05-27T06:28:43.666204+0000","last_fullsized":"2024-05-27T06:28:43.666204+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:59:06.313098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214603+0000","last_change":"2024-05-27T06:28:41.681106+0000","last_active":"2024-05-27T06:28:44.214603+0000","last_peered":"2024-05-27T06:28:44.214603+0000","last_clean":"2024-05-27T06:28:44.214603+0000","last_became_active":"2024-05-27T06:28:41.680818+0000","last_became_peered":"2024-05-27T06:28:41.680818+0000","last_unstale":"2024-05-27T06:28:44.214603+0000","last_undegraded":"2024-05-27T06:28:44.214603+0000","last_fullsized":"2024-05-27T06:28:44.214603+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:11:43.407773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:43.666134+0000","last_change":"2024-05-27T06:28:40.674198+0000","last_active":"2024-05-27T06:28:43.666134+0000","last_peered":"2024-05-27T06:28:43.666134+0000","last_clean":"2024-05-27T06:28:43.666134+0000","last_became_active":"2024-05-27T06:28:40.673825+0000","last_became_peered":"2024-05-27T06:28:40.673825+0000","last_unstale":"2024-05-27T06:28:43.666134+0000","last_undegraded":"2024-05-27T06:28:43.666134+0000","last_fullsized":"2024-05-27T06:28:43.666134+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T06:54:59.433478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.215358+0000","last_change":"2024-05-27T06:28:41.666580+0000","last_active":"2024-05-27T06:28:44.215358+0000","last_peered":"2024-05-27T06:28:44.215358+0000","last_clean":"2024-05-27T06:28:44.215358+0000","last_became_active":"2024-05-27T06:28:41.666264+0000","last_became_peered":"2024-05-27T06:28:41.666264+0000","last_unstale":"2024-05-27T06:28:44.215358+0000","last_undegraded":"2024-05-27T06:28:44.215358+0000","last_fullsized":"2024-05-27T06:28:44.215358+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:21:58.249141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214253+0000","last_change":"2024-05-27T06:28:40.677467+0000","last_active":"2024-05-27T06:28:44.214253+0000","last_peered":"2024-05-27T06:28:44.214253+0000","last_clean":"2024-05-27T06:28:44.214253+0000","last_became_active":"2024-05-27T06:28:40.677128+0000","last_became_peered":"2024-05-27T06:28:40.677128+0000","last_unstale":"2024-05-27T06:28:44.214253+0000","last_undegraded":"2024-05-27T06:28:44.214253+0000","last_fullsized":"2024-05-27T06:28:44.214253+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:39:40.641072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.213636+0000","last_change":"2024-05-27T06:28:41.686767+0000","last_active":"2024-05-27T06:28:44.213636+0000","last_peered":"2024-05-27T06:28:44.213636+0000","last_clean":"2024-05-27T06:28:44.213636+0000","last_became_active":"2024-05-27T06:28:41.686305+0000","last_became_peered":"2024-05-27T06:28:41.686305+0000","last_unstale":"2024-05-27T06:28:44.213636+0000","last_undegraded":"2024-05-27T06:28:44.213636+0000","last_fullsized":"2024-05-27T06:28:44.213636+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:14:03.520838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214455+0000","last_change":"2024-05-27T06:28:40.681038+0000","last_active":"2024-05-27T06:28:44.214455+0000","last_peered":"2024-05-27T06:28:44.214455+0000","last_clean":"2024-05-27T06:28:44.214455+0000","last_became_active":"2024-05-27T06:28:40.680758+0000","last_became_peered":"2024-05-27T06:28:40.680758+0000","last_unstale":"2024-05-27T06:28:44.214455+0000","last_undegraded":"2024-05-27T06:28:44.214455+0000","last_fullsized":"2024-05-27T06:28:44.214455+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:49:16.035788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214117+0000","last_change":"2024-05-27T06:28:41.683776+0000","last_active":"2024-05-27T06:28:44.214117+0000","last_peered":"2024-05-27T06:28:44.214117+0000","last_clean":"2024-05-27T06:28:44.214117+0000","last_became_active":"2024-05-27T06:28:41.683168+0000","last_became_peered":"2024-05-27T06:28:41.683168+0000","last_unstale":"2024-05-27T06:28:44.214117+0000","last_undegraded":"2024-05-27T06:28:44.214117+0000","last_fullsized":"2024-05-27T06:28:44.214117+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:26:24.260053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:43.705440+0000","last_change":"2024-05-27T06:28:40.673610+0000","last_active":"2024-05-27T06:28:43.705440+0000","last_peered":"2024-05-27T06:28:43.705440+0000","last_clean":"2024-05-27T06:28:43.705440+0000","last_became_active":"2024-05-27T06:28:40.673294+0000","last_became_peered":"2024-05-27T06:28:40.673294+0000","last_unstale":"2024-05-27T06:28:43.705440+0000","last_undegraded":"2024-05-27T06:28:43.705440+0000","last_fullsized":"2024-05-27T06:28:43.705440+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:04:39.297606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.215506+0000","last_change":"2024-05-27T06:28:41.683946+0000","last_active":"2024-05-27T06:28:44.215506+0000","last_peered":"2024-05-27T06:28:44.215506+0000","last_clean":"2024-05-27T06:28:44.215506+0000","last_became_active":"2024-05-27T06:28:41.683642+0000","last_became_peered":"2024-05-27T06:28:41.683642+0000","last_unstale":"2024-05-27T06:28:44.215506+0000","last_undegraded":"2024-05-27T06:28:44.215506+0000","last_fullsized":"2024-05-27T06:28:44.215506+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:54:43.415493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:42.675218+0000","last_change":"2024-05-27T06:28:40.672146+0000","last_active":"2024-05-27T06:28:42.675218+0000","last_peered":"2024-05-27T06:28:42.675218+0000","last_clean":"2024-05-27T06:28:42.675218+0000","last_became_active":"2024-05-27T06:28:40.671021+0000","last_became_peered":"2024-05-27T06:28:40.671021+0000","last_unstale":"2024-05-27T06:28:42.675218+0000","last_undegraded":"2024-05-27T06:28:42.675218+0000","last_fullsized":"2024-05-27T06:28:42.675218+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:58:11.217383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214170+0000","last_change":"2024-05-27T06:28:41.685119+0000","last_active":"2024-05-27T06:28:44.214170+0000","last_peered":"2024-05-27T06:28:44.214170+0000","last_clean":"2024-05-27T06:28:44.214170+0000","last_became_active":"2024-05-27T06:28:41.684465+0000","last_became_peered":"2024-05-27T06:28:41.684465+0000","last_unstale":"2024-05-27T06:28:44.214170+0000","last_undegraded":"2024-05-27T06:28:44.214170+0000","last_fullsized":"2024-05-27T06:28:44.214170+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:57:50.543290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214572+0000","last_change":"2024-05-27T06:28:40.681584+0000","last_active":"2024-05-27T06:28:44.214572+0000","last_peered":"2024-05-27T06:28:44.214572+0000","last_clean":"2024-05-27T06:28:44.214572+0000","last_became_active":"2024-05-27T06:28:40.681279+0000","last_became_peered":"2024-05-27T06:28:40.681279+0000","last_unstale":"2024-05-27T06:28:44.214572+0000","last_undegraded":"2024-05-27T06:28:44.214572+0000","last_fullsized":"2024-05-27T06:28:44.214572+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:59:06.313098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214173+0000","last_change":"2024-05-27T06:28:41.678906+0000","last_active":"2024-05-27T06:28:44.214173+0000","last_peered":"2024-05-27T06:28:44.214173+0000","last_clean":"2024-05-27T06:28:44.214173+0000","last_became_active":"2024-05-27T06:28:41.678587+0000","last_became_peered":"2024-05-27T06:28:41.678587+0000","last_unstale":"2024-05-27T06:28:44.214173+0000","last_undegraded":"2024-05-27T06:28:44.214173+0000","last_fullsized":"2024-05-27T06:28:44.214173+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:48:54.248180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:43.666158+0000","last_change":"2024-05-27T06:28:40.679172+0000","last_active":"2024-05-27T06:28:43.666158+0000","last_peered":"2024-05-27T06:28:43.666158+0000","last_clean":"2024-05-27T06:28:43.666158+0000","last_became_active":"2024-05-27T06:28:40.678786+0000","last_became_peered":"2024-05-27T06:28:40.678786+0000","last_unstale":"2024-05-27T06:28:43.666158+0000","last_undegraded":"2024-05-27T06:28:43.666158+0000","last_fullsized":"2024-05-27T06:28:43.666158+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:19:31.142977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:43.666053+0000","last_change":"2024-05-27T06:28:41.694113+0000","last_active":"2024-05-27T06:28:43.666053+0000","last_peered":"2024-05-27T06:28:43.666053+0000","last_clean":"2024-05-27T06:28:43.666053+0000","last_became_active":"2024-05-27T06:28:41.693827+0000","last_became_peered":"2024-05-27T06:28:41.693827+0000","last_unstale":"2024-05-27T06:28:43.666053+0000","last_undegraded":"2024-05-27T06:28:43.666053+0000","last_fullsized":"2024-05-27T06:28:43.666053+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:21:01.146280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.215198+0000","last_change":"2024-05-27T06:28:40.677177+0000","last_active":"2024-05-27T06:28:44.215198+0000","last_peered":"2024-05-27T06:28:44.215198+0000","last_clean":"2024-05-27T06:28:44.215198+0000","last_became_active":"2024-05-27T06:28:40.676640+0000","last_became_peered":"2024-05-27T06:28:40.676640+0000","last_unstale":"2024-05-27T06:28:44.215198+0000","last_undegraded":"2024-05-27T06:28:44.215198+0000","last_fullsized":"2024-05-27T06:28:44.215198+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:13:59.179683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.215085+0000","last_change":"2024-05-27T06:28:41.690822+0000","last_active":"2024-05-27T06:28:44.215085+0000","last_peered":"2024-05-27T06:28:44.215085+0000","last_clean":"2024-05-27T06:28:44.215085+0000","last_became_active":"2024-05-27T06:28:41.689232+0000","last_became_peered":"2024-05-27T06:28:41.689232+0000","last_unstale":"2024-05-27T06:28:44.215085+0000","last_undegraded":"2024-05-27T06:28:44.215085+0000","last_fullsized":"2024-05-27T06:28:44.215085+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:39:41.648406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:42.677509+0000","last_change":"2024-05-27T06:28:40.675405+0000","last_active":"2024-05-27T06:28:42.677509+0000","last_peered":"2024-05-27T06:28:42.677509+0000","last_clean":"2024-05-27T06:28:42.677509+0000","last_became_active":"2024-05-27T06:28:40.675004+0000","last_became_peered":"2024-05-27T06:28:40.675004+0000","last_unstale":"2024-05-27T06:28:42.677509+0000","last_undegraded":"2024-05-27T06:28:42.677509+0000","last_fullsized":"2024-05-27T06:28:42.677509+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:03:34.053963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:42.677708+0000","last_change":"2024-05-27T06:28:41.687624+0000","last_active":"2024-05-27T06:28:42.677708+0000","last_peered":"2024-05-27T06:28:42.677708+0000","last_clean":"2024-05-27T06:28:42.677708+0000","last_became_active":"2024-05-27T06:28:41.687241+0000","last_became_peered":"2024-05-27T06:28:41.687241+0000","last_unstale":"2024-05-27T06:28:42.677708+0000","last_undegraded":"2024-05-27T06:28:42.677708+0000","last_fullsized":"2024-05-27T06:28:42.677708+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:15:28.001112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:43.705501+0000","last_change":"2024-05-27T06:28:40.670977+0000","last_active":"2024-05-27T06:28:43.705501+0000","last_peered":"2024-05-27T06:28:43.705501+0000","last_clean":"2024-05-27T06:28:43.705501+0000","last_became_active":"2024-05-27T06:28:40.670723+0000","last_became_peered":"2024-05-27T06:28:40.670723+0000","last_unstale":"2024-05-27T06:28:43.705501+0000","last_undegraded":"2024-05-27T06:28:43.705501+0000","last_fullsized":"2024-05-27T06:28:43.705501+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:55:20.077082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214785+0000","last_change":"2024-05-27T06:28:41.687547+0000","last_active":"2024-05-27T06:28:44.214785+0000","last_peered":"2024-05-27T06:28:44.214785+0000","last_clean":"2024-05-27T06:28:44.214785+0000","last_became_active":"2024-05-27T06:28:41.686339+0000","last_became_peered":"2024-05-27T06:28:41.686339+0000","last_unstale":"2024-05-27T06:28:44.214785+0000","last_undegraded":"2024-05-27T06:28:44.214785+0000","last_fullsized":"2024-05-27T06:28:44.214785+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:06:14.581452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:42.677400+0000","last_change":"2024-05-27T06:28:40.661275+0000","last_active":"2024-05-27T06:28:42.677400+0000","last_peered":"2024-05-27T06:28:42.677400+0000","last_clean":"2024-05-27T06:28:42.677400+0000","last_became_active":"2024-05-27T06:28:40.661013+0000","last_became_peered":"2024-05-27T06:28:40.661013+0000","last_unstale":"2024-05-27T06:28:42.677400+0000","last_undegraded":"2024-05-27T06:28:42.677400+0000","last_fullsized":"2024-05-27T06:28:42.677400+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:44:23.104759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.213670+0000","last_change":"2024-05-27T06:28:41.680430+0000","last_active":"2024-05-27T06:28:44.213670+0000","last_peered":"2024-05-27T06:28:44.213670+0000","last_clean":"2024-05-27T06:28:44.213670+0000","last_became_active":"2024-05-27T06:28:41.680173+0000","last_became_peered":"2024-05-27T06:28:41.680173+0000","last_unstale":"2024-05-27T06:28:44.213670+0000","last_undegraded":"2024-05-27T06:28:44.213670+0000","last_fullsized":"2024-05-27T06:28:44.213670+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:31:20.165169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:42.677227+0000","last_change":"2024-05-27T06:28:40.672102+0000","last_active":"2024-05-27T06:28:42.677227+0000","last_peered":"2024-05-27T06:28:42.677227+0000","last_clean":"2024-05-27T06:28:42.677227+0000","last_became_active":"2024-05-27T06:28:40.671774+0000","last_became_peered":"2024-05-27T06:28:40.671774+0000","last_unstale":"2024-05-27T06:28:42.677227+0000","last_undegraded":"2024-05-27T06:28:42.677227+0000","last_fullsized":"2024-05-27T06:28:42.677227+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:38:15.446867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:43.665531+0000","last_change":"2024-05-27T06:28:41.688145+0000","last_active":"2024-05-27T06:28:43.665531+0000","last_peered":"2024-05-27T06:28:43.665531+0000","last_clean":"2024-05-27T06:28:43.665531+0000","last_became_active":"2024-05-27T06:28:41.687543+0000","last_became_peered":"2024-05-27T06:28:41.687543+0000","last_unstale":"2024-05-27T06:28:43.665531+0000","last_undegraded":"2024-05-27T06:28:43.665531+0000","last_fullsized":"2024-05-27T06:28:43.665531+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:26:24.260053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.215260+0000","last_change":"2024-05-27T06:28:40.679403+0000","last_active":"2024-05-27T06:28:44.215260+0000","last_peered":"2024-05-27T06:28:44.215260+0000","last_clean":"2024-05-27T06:28:44.215260+0000","last_became_active":"2024-05-27T06:28:40.679101+0000","last_became_peered":"2024-05-27T06:28:40.679101+0000","last_unstale":"2024-05-27T06:28:44.215260+0000","last_undegraded":"2024-05-27T06:28:44.215260+0000","last_fullsized":"2024-05-27T06:28:44.215260+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:52:37.091584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214349+0000","last_change":"2024-05-27T06:28:41.690011+0000","last_active":"2024-05-27T06:28:44.214349+0000","last_peered":"2024-05-27T06:28:44.214349+0000","last_clean":"2024-05-27T06:28:44.214349+0000","last_became_active":"2024-05-27T06:28:41.689691+0000","last_became_peered":"2024-05-27T06:28:41.689691+0000","last_unstale":"2024-05-27T06:28:44.214349+0000","last_undegraded":"2024-05-27T06:28:44.214349+0000","last_fullsized":"2024-05-27T06:28:44.214349+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:34:13.790183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:42.677049+0000","last_change":"2024-05-27T06:28:40.667132+0000","last_active":"2024-05-27T06:28:42.677049+0000","last_peered":"2024-05-27T06:28:42.677049+0000","last_clean":"2024-05-27T06:28:42.677049+0000","last_became_active":"2024-05-27T06:28:40.666811+0000","last_became_peered":"2024-05-27T06:28:40.666811+0000","last_unstale":"2024-05-27T06:28:42.677049+0000","last_undegraded":"2024-05-27T06:28:42.677049+0000","last_fullsized":"2024-05-27T06:28:42.677049+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:45:05.351899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:43.705576+0000","last_change":"2024-05-27T06:28:41.687021+0000","last_active":"2024-05-27T06:28:43.705576+0000","last_peered":"2024-05-27T06:28:43.705576+0000","last_clean":"2024-05-27T06:28:43.705576+0000","last_became_active":"2024-05-27T06:28:41.686672+0000","last_became_peered":"2024-05-27T06:28:41.686672+0000","last_unstale":"2024-05-27T06:28:43.705576+0000","last_undegraded":"2024-05-27T06:28:43.705576+0000","last_fullsized":"2024-05-27T06:28:43.705576+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:31:20.165169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:43.666255+0000","last_change":"2024-05-27T06:28:40.674354+0000","last_active":"2024-05-27T06:28:43.666255+0000","last_peered":"2024-05-27T06:28:43.666255+0000","last_clean":"2024-05-27T06:28:43.666255+0000","last_became_active":"2024-05-27T06:28:40.673991+0000","last_became_peered":"2024-05-27T06:28:40.673991+0000","last_unstale":"2024-05-27T06:28:43.666255+0000","last_undegraded":"2024-05-27T06:28:43.666255+0000","last_fullsized":"2024-05-27T06:28:43.666255+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:27:36.555373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.215858+0000","last_change":"2024-05-27T06:28:41.689506+0000","last_active":"2024-05-27T06:28:44.215858+0000","last_peered":"2024-05-27T06:28:44.215858+0000","last_clean":"2024-05-27T06:28:44.215858+0000","last_became_active":"2024-05-27T06:28:41.689182+0000","last_became_peered":"2024-05-27T06:28:41.689182+0000","last_unstale":"2024-05-27T06:28:44.215858+0000","last_undegraded":"2024-05-27T06:28:44.215858+0000","last_fullsized":"2024-05-27T06:28:44.215858+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:26:24.260053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:42.677585+0000","last_change":"2024-05-27T06:28:40.676434+0000","last_active":"2024-05-27T06:28:42.677585+0000","last_peered":"2024-05-27T06:28:42.677585+0000","last_clean":"2024-05-27T06:28:42.677585+0000","last_became_active":"2024-05-27T06:28:40.676154+0000","last_became_peered":"2024-05-27T06:28:40.676154+0000","last_unstale":"2024-05-27T06:28:42.677585+0000","last_undegraded":"2024-05-27T06:28:42.677585+0000","last_fullsized":"2024-05-27T06:28:42.677585+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:01:59.082053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214466+0000","last_change":"2024-05-27T06:28:41.677106+0000","last_active":"2024-05-27T06:28:44.214466+0000","last_peered":"2024-05-27T06:28:44.214466+0000","last_clean":"2024-05-27T06:28:44.214466+0000","last_became_active":"2024-05-27T06:28:41.676802+0000","last_became_peered":"2024-05-27T06:28:41.676802+0000","last_unstale":"2024-05-27T06:28:44.214466+0000","last_undegraded":"2024-05-27T06:28:44.214466+0000","last_fullsized":"2024-05-27T06:28:44.214466+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:47:58.779935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214792+0000","last_change":"2024-05-27T06:28:40.666405+0000","last_active":"2024-05-27T06:28:44.214792+0000","last_peered":"2024-05-27T06:28:44.214792+0000","last_clean":"2024-05-27T06:28:44.214792+0000","last_became_active":"2024-05-27T06:28:40.666146+0000","last_became_peered":"2024-05-27T06:28:40.666146+0000","last_unstale":"2024-05-27T06:28:44.214792+0000","last_undegraded":"2024-05-27T06:28:44.214792+0000","last_fullsized":"2024-05-27T06:28:44.214792+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:55:20.077082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.213782+0000","last_change":"2024-05-27T06:28:41.693843+0000","last_active":"2024-05-27T06:28:44.213782+0000","last_peered":"2024-05-27T06:28:44.213782+0000","last_clean":"2024-05-27T06:28:44.213782+0000","last_became_active":"2024-05-27T06:28:41.693555+0000","last_became_peered":"2024-05-27T06:28:41.693555+0000","last_unstale":"2024-05-27T06:28:44.213782+0000","last_undegraded":"2024-05-27T06:28:44.213782+0000","last_fullsized":"2024-05-27T06:28:44.213782+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:38:23.963380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214445+0000","last_change":"2024-05-27T06:28:40.677362+0000","last_active":"2024-05-27T06:28:44.214445+0000","last_peered":"2024-05-27T06:28:44.214445+0000","last_clean":"2024-05-27T06:28:44.214445+0000","last_became_active":"2024-05-27T06:28:40.677080+0000","last_became_peered":"2024-05-27T06:28:40.677080+0000","last_unstale":"2024-05-27T06:28:44.214445+0000","last_undegraded":"2024-05-27T06:28:44.214445+0000","last_fullsized":"2024-05-27T06:28:44.214445+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:12:15.418800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:43.705296+0000","last_change":"2024-05-27T06:28:41.680486+0000","last_active":"2024-05-27T06:28:43.705296+0000","last_peered":"2024-05-27T06:28:43.705296+0000","last_clean":"2024-05-27T06:28:43.705296+0000","last_became_active":"2024-05-27T06:28:41.679457+0000","last_became_peered":"2024-05-27T06:28:41.679457+0000","last_unstale":"2024-05-27T06:28:43.705296+0000","last_undegraded":"2024-05-27T06:28:43.705296+0000","last_fullsized":"2024-05-27T06:28:43.705296+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:21:58.249141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:42.675366+0000","last_change":"2024-05-27T06:28:40.675180+0000","last_active":"2024-05-27T06:28:42.675366+0000","last_peered":"2024-05-27T06:28:42.675366+0000","last_clean":"2024-05-27T06:28:42.675366+0000","last_became_active":"2024-05-27T06:28:40.674872+0000","last_became_peered":"2024-05-27T06:28:40.674872+0000","last_unstale":"2024-05-27T06:28:42.675366+0000","last_undegraded":"2024-05-27T06:28:42.675366+0000","last_fullsized":"2024-05-27T06:28:42.675366+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:13:59.179683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214773+0000","last_change":"2024-05-27T06:28:41.679465+0000","last_active":"2024-05-27T06:28:44.214773+0000","last_peered":"2024-05-27T06:28:44.214773+0000","last_clean":"2024-05-27T06:28:44.214773+0000","last_became_active":"2024-05-27T06:28:41.679146+0000","last_became_peered":"2024-05-27T06:28:41.679146+0000","last_unstale":"2024-05-27T06:28:44.214773+0000","last_undegraded":"2024-05-27T06:28:44.214773+0000","last_fullsized":"2024-05-27T06:28:44.214773+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:49:17.043121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214310+0000","last_change":"2024-05-27T06:28:40.672373+0000","last_active":"2024-05-27T06:28:44.214310+0000","last_peered":"2024-05-27T06:28:44.214310+0000","last_clean":"2024-05-27T06:28:44.214310+0000","last_became_active":"2024-05-27T06:28:40.672028+0000","last_became_peered":"2024-05-27T06:28:40.672028+0000","last_unstale":"2024-05-27T06:28:44.214310+0000","last_undegraded":"2024-05-27T06:28:44.214310+0000","last_fullsized":"2024-05-27T06:28:44.214310+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:58:11.217383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.215580+0000","last_change":"2024-05-27T06:28:41.684864+0000","last_active":"2024-05-27T06:28:44.215580+0000","last_peered":"2024-05-27T06:28:44.215580+0000","last_clean":"2024-05-27T06:28:44.215580+0000","last_became_active":"2024-05-27T06:28:41.684648+0000","last_became_peered":"2024-05-27T06:28:41.684648+0000","last_unstale":"2024-05-27T06:28:44.215580+0000","last_undegraded":"2024-05-27T06:28:44.215580+0000","last_fullsized":"2024-05-27T06:28:44.215580+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:00:43.948438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.213915+0000","last_change":"2024-05-27T06:28:40.674194+0000","last_active":"2024-05-27T06:28:44.213915+0000","last_peered":"2024-05-27T06:28:44.213915+0000","last_clean":"2024-05-27T06:28:44.213915+0000","last_became_active":"2024-05-27T06:28:40.673676+0000","last_became_peered":"2024-05-27T06:28:40.673676+0000","last_unstale":"2024-05-27T06:28:44.213915+0000","last_undegraded":"2024-05-27T06:28:44.213915+0000","last_fullsized":"2024-05-27T06:28:44.213915+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:27:36.555373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:43.666047+0000","last_change":"2024-05-27T06:28:41.692997+0000","last_active":"2024-05-27T06:28:43.666047+0000","last_peered":"2024-05-27T06:28:43.666047+0000","last_clean":"2024-05-27T06:28:43.666047+0000","last_became_active":"2024-05-27T06:28:41.692662+0000","last_became_peered":"2024-05-27T06:28:41.692662+0000","last_unstale":"2024-05-27T06:28:43.666047+0000","last_undegraded":"2024-05-27T06:28:43.666047+0000","last_fullsized":"2024-05-27T06:28:43.666047+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:40.644994+0000","last_clean_scrub_stamp":"2024-05-27T06:28:40.644994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:23:20.297745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.215773+0000","last_change":"2024-05-27T06:28:40.681617+0000","last_active":"2024-05-27T06:28:44.215773+0000","last_peered":"2024-05-27T06:28:44.215773+0000","last_clean":"2024-05-27T06:28:44.215773+0000","last_became_active":"2024-05-27T06:28:40.681325+0000","last_became_peered":"2024-05-27T06:28:40.681325+0000","last_unstale":"2024-05-27T06:28:44.215773+0000","last_undegraded":"2024-05-27T06:28:44.215773+0000","last_fullsized":"2024-05-27T06:28:44.215773+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:28:39.637660+0000","last_clean_scrub_stamp":"2024-05-27T06:28:39.637660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:55:20.077082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":142,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-27T06:28:44.214733+0000","last_change":"2024-05-27T06:27:28.692457+0000","last_active":"2024-05-27T06:28:44.214733+0000","last_peered":"2024-05-27T06:28:44.214733+0000","last_clean":"2024-05-27T06:28:44.214733+0000","last_became_active":"2024-05-27T06:27:28.691290+0000","last_became_peered":"2024-05-27T06:27:28.691290+0000","last_unstale":"2024-05-27T06:28:44.214733+0000","last_undegraded":"2024-05-27T06:28:44.214733+0000","last_fullsized":"2024-05-27T06:28:44.214733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_clean_scrub_stamp":"2024-05-27T06:27:26.991915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:45.563728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":782240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":190772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":190302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":190794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":191836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":190260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":190280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":780592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T06:28:50.729 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-27T06:28:50.729 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-27T06:28:50.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.925+0000 7fb238200640 1 Processor -- start 2024-05-27T06:28:50.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.925+0000 7fb238200640 1 -- start start 2024-05-27T06:28:50.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.929+0000 7fb238200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2301610c0 0x7fb2300d02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:50.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.929+0000 7fb238200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb2300d0810 0x7fb2300d1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:50.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.929+0000 7fb238200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2300d1130 con 0x7fb2300d1c40 2024-05-27T06:28:50.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.929+0000 7fb238200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fb2300d0c20 con 0x7fb2300d0810 2024-05-27T06:28:50.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.929+0000 7fb238200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb2300d2050 con 0x7fb2301610c0 2024-05-27T06:28:50.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.929+0000 7fb234e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb2300d0810 0x7fb2300d1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:50.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.929+0000 7fb234e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb2300d0810 0x7fb2300d1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39886/0 (socket says 172.21.15.87:39886) 2024-05-27T06:28:50.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.929+0000 7fb234e00640 1 -- 172.21.15.87:0/1938136515 learned_addr learned my addr 172.21.15.87:0/1938136515 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:50.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.929+0000 7fb235800640 1 --2- 172.21.15.87:0/1938136515 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2301610c0 0x7fb2300d02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:50.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.929+0000 7fb234e00640 1 -- 172.21.15.87:0/1938136515 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2301610c0 msgr2=0x7fb2300d02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:50.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.929+0000 7fb234e00640 1 --2- 172.21.15.87:0/1938136515 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2301610c0 0x7fb2300d02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:50.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.929+0000 7fb234e00640 1 -- 172.21.15.87:0/1938136515 >> v1:172.21.15.149:6789/0 conn(0x7fb2300d1c40 legacy=0x7fb23006eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:50.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.929+0000 7fb234e00640 1 -- 172.21.15.87:0/1938136515 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2300d0e50 con 0x7fb2300d0810 2024-05-27T06:28:50.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.929+0000 7fb22fe00640 1 -- 172.21.15.87:0/1938136515 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1187261190 0 0) 0x7fb2300d1130 con 0x7fb2300d1c40 2024-05-27T06:28:50.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.929+0000 7fb234e00640 1 --2- 172.21.15.87:0/1938136515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2300d0810 0x7fb2300d1700 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb21c009870 tx=0x7fb21c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f968541f7b384192 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:50.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.933+0000 7fb22fe00640 1 -- 172.21.15.87:0/1938136515 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c0aa660 con 0x7fb2300d0810 2024-05-27T06:28:50.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.933+0000 7fb22fe00640 1 -- 172.21.15.87:0/1938136515 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb21c0af070 con 0x7fb2300d0810 2024-05-27T06:28:50.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.933+0000 7fb22fe00640 1 -- 172.21.15.87:0/1938136515 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c0aaa20 con 0x7fb2300d0810 2024-05-27T06:28:50.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.933+0000 7fb238200640 1 -- 172.21.15.87:0/1938136515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2300d0810 msgr2=0x7fb2300d1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:50.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.933+0000 7fb238200640 1 --2- 172.21.15.87:0/1938136515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2300d0810 0x7fb2300d1700 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb21c009870 tx=0x7fb21c01c500 comp rx=0 tx=0).stop 2024-05-27T06:28:50.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.933+0000 7fb238200640 1 -- 172.21.15.87:0/1938136515 shutdown_connections 2024-05-27T06:28:50.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.933+0000 7fb238200640 1 --2- 172.21.15.87:0/1938136515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2300d0810 0x7fb2300d1700 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:50.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.933+0000 7fb238200640 1 --2- 172.21.15.87:0/1938136515 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2301610c0 0x7fb2300d02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:50.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.933+0000 7fb238200640 1 -- 172.21.15.87:0/1938136515 >> 172.21.15.87:0/1938136515 conn(0x7fb2300b46b0 msgr2=0x7fb2300b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:50.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.933+0000 7fb238200640 1 -- 172.21.15.87:0/1938136515 shutdown_connections 2024-05-27T06:28:50.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.933+0000 7fb238200640 1 -- 172.21.15.87:0/1938136515 wait complete. 2024-05-27T06:28:50.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.933+0000 7fb238200640 1 Processor -- start 2024-05-27T06:28:50.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.933+0000 7fb238200640 1 -- start start 2024-05-27T06:28:50.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.937+0000 7fb238200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2300d0810 0x7fb230147240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:50.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.937+0000 7fb238200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2300d1c40 0x7fb230156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:50.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.937+0000 7fb238200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2301610c0 0x7fb23009e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:50.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.937+0000 7fb238200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb2301614d0 con 0x7fb2300d1c40 2024-05-27T06:28:50.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.937+0000 7fb238200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb230162040 con 0x7fb2300d0810 2024-05-27T06:28:50.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.937+0000 7fb238200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb230161650 con 0x7fb2301610c0 2024-05-27T06:28:50.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.937+0000 7fb234e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2300d1c40 0x7fb230156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:50.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.937+0000 7fb234e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2300d1c40 0x7fb230156320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39896/0 (socket says 172.21.15.87:39896) 2024-05-27T06:28:50.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.937+0000 7fb234e00640 1 -- 172.21.15.87:0/732081305 learned_addr learned my addr 172.21.15.87:0/732081305 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:50.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.937+0000 7fb235800640 1 --2- 172.21.15.87:0/732081305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2300d0810 0x7fb230147240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:50.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.937+0000 7fb236200640 1 --2- 172.21.15.87:0/732081305 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2301610c0 0x7fb23009e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:50.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.937+0000 7fb234e00640 1 -- 172.21.15.87:0/732081305 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2301610c0 msgr2=0x7fb23009e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:50.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.937+0000 7fb234e00640 1 --2- 172.21.15.87:0/732081305 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2301610c0 0x7fb23009e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:50.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.937+0000 7fb234e00640 1 -- 172.21.15.87:0/732081305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2300d0810 msgr2=0x7fb230147240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:50.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.937+0000 7fb234e00640 1 --2- 172.21.15.87:0/732081305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2300d0810 0x7fb230147240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:50.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.937+0000 7fb234e00640 1 -- 172.21.15.87:0/732081305 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb230159b80 con 0x7fb2300d1c40 2024-05-27T06:28:50.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.937+0000 7fb236200640 1 --2- 172.21.15.87:0/732081305 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2301610c0 0x7fb23009e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:50.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.937+0000 7fb234e00640 1 --2- 172.21.15.87:0/732081305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2300d1c40 0x7fb230156320 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb21c019170 tx=0x7fb21c019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:50.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.937+0000 7fb22d600640 1 -- 172.21.15.87:0/732081305 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c0bd5f0 con 0x7fb2300d1c40 2024-05-27T06:28:50.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.937+0000 7fb22d600640 1 -- 172.21.15.87:0/732081305 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb21c0bd790 con 0x7fb2300d1c40 2024-05-27T06:28:50.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.937+0000 7fb22d600640 1 -- 172.21.15.87:0/732081305 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c0bdb60 con 0x7fb2300d1c40 2024-05-27T06:28:50.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.937+0000 7fb238200640 1 -- 172.21.15.87:0/732081305 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2301595c0 con 0x7fb2300d1c40 2024-05-27T06:28:50.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.937+0000 7fb238200640 1 -- 172.21.15.87:0/732081305 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb23009bf70 con 0x7fb2300d1c40 2024-05-27T06:28:50.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.937+0000 7fb238200640 1 -- 172.21.15.87:0/732081305 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb23006aa30 con 0x7fb2300d1c40 2024-05-27T06:28:50.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.941+0000 7fb22d600640 1 -- 172.21.15.87:0/732081305 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb21c0b33f0 con 0x7fb2300d1c40 2024-05-27T06:28:50.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.941+0000 7fb22d600640 1 --2- 172.21.15.87:0/732081305 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb21006f400 0x7fb210071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:50.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.941+0000 7fb22d600640 1 -- 172.21.15.87:0/732081305 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fb21c129c30 con 0x7fb2300d1c40 2024-05-27T06:28:50.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.941+0000 7fb235800640 1 --2- 172.21.15.87:0/732081305 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb21006f400 0x7fb210071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:50.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.941+0000 7fb235800640 1 --2- 172.21.15.87:0/732081305 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb21006f400 0x7fb210071910 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb2301477c0 tx=0x7fb224009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:50.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:50.945+0000 7fb22d600640 1 -- 172.21.15.87:0/732081305 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb21c016150 con 0x7fb2300d1c40 2024-05-27T06:28:51.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.157+0000 7fb238200640 1 -- 172.21.15.87:0/732081305 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fb23009efe0 con 0x7fb2300d1c40 2024-05-27T06:28:51.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.157+0000 7fb22d600640 1 -- 172.21.15.87:0/732081305 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7fb21c0f6450 con 0x7fb2300d1c40 2024-05-27T06:28:51.157 INFO:teuthology.orchestra.run.smithi087.stdout:[client.0] 2024-05-27T06:28:51.157 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCfJ1RmAld8BxAAigqU2F3mGXtAfw0L9Bfp2A== 2024-05-27T06:28:51.157 INFO:teuthology.orchestra.run.smithi087.stdout: caps mds = "allow" 2024-05-27T06:28:51.157 INFO:teuthology.orchestra.run.smithi087.stdout: caps mon = "allow r" 2024-05-27T06:28:51.158 INFO:teuthology.orchestra.run.smithi087.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-27T06:28:51.158 INFO:teuthology.orchestra.run.smithi087.stderr:updated caps for client.0 2024-05-27T06:28:51.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.161+0000 7fb238200640 1 -- 172.21.15.87:0/732081305 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb21006f400 msgr2=0x7fb210071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:51.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.161+0000 7fb238200640 1 --2- 172.21.15.87:0/732081305 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb21006f400 0x7fb210071910 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb2301477c0 tx=0x7fb224009190 comp rx=0 tx=0).stop 2024-05-27T06:28:51.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.161+0000 7fb238200640 1 -- 172.21.15.87:0/732081305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2300d1c40 msgr2=0x7fb230156320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:51.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.161+0000 7fb238200640 1 --2- 172.21.15.87:0/732081305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2300d1c40 0x7fb230156320 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb21c019170 tx=0x7fb21c019300 comp rx=0 tx=0).stop 2024-05-27T06:28:51.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.161+0000 7fb238200640 1 -- 172.21.15.87:0/732081305 shutdown_connections 2024-05-27T06:28:51.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.161+0000 7fb238200640 1 --2- 172.21.15.87:0/732081305 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb21006f400 0x7fb210071910 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:51.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.161+0000 7fb238200640 1 --2- 172.21.15.87:0/732081305 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2301610c0 0x7fb23009e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:51.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.161+0000 7fb238200640 1 --2- 172.21.15.87:0/732081305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2300d1c40 0x7fb230156320 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:51.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.161+0000 7fb238200640 1 --2- 172.21.15.87:0/732081305 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2300d0810 0x7fb230147240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:51.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.161+0000 7fb238200640 1 -- 172.21.15.87:0/732081305 >> 172.21.15.87:0/732081305 conn(0x7fb2300b46b0 msgr2=0x7fb230159dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:51.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.161+0000 7fb238200640 1 -- 172.21.15.87:0/732081305 shutdown_connections 2024-05-27T06:28:51.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.161+0000 7fb238200640 1 -- 172.21.15.87:0/732081305 wait complete. 2024-05-27T06:28:51.179 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T06:28:51.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.325+0000 7f215f200640 1 Processor -- start 2024-05-27T06:28:51.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.325+0000 7f215f200640 1 -- start start 2024-05-27T06:28:51.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.329+0000 7f215f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f215815cfe0 0x7f215815d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:51.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.329+0000 7f215f200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f215815d930 con 0x7f21580cbf90 2024-05-27T06:28:51.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.329+0000 7f215f200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f215815dbb0 con 0x7f21580d1740 2024-05-27T06:28:51.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.329+0000 7f215f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f215815de90 con 0x7f215815cfe0 2024-05-27T06:28:51.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.329+0000 7f2157e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f21580cbf90 0x7f215806cfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:55172/0 (socket says 172.21.15.87:55172) 2024-05-27T06:28:51.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.329+0000 7f2157e00640 1 -- 172.21.15.87:0/435326557 learned_addr learned my addr 172.21.15.87:0/435326557 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:51.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.329+0000 7f214f400640 1 --2- 172.21.15.87:0/435326557 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f215815cfe0 0x7f215815d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:51.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.329+0000 7f2157400640 1 -- 172.21.15.87:0/435326557 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1765201040 0 0) 0x7f2148001120 con 0x7f21580cbf90 2024-05-27T06:28:51.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.329+0000 7f2157400640 1 -- 172.21.15.87:0/435326557 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f213c005740 con 0x7f21580cbf90 2024-05-27T06:28:51.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.329+0000 7f2157400640 1 -- 172.21.15.87:0/435326557 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3335363257 0 0) 0x7f215815dbb0 con 0x7f21580d1740 2024-05-27T06:28:51.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.329+0000 7f2157400640 1 -- 172.21.15.87:0/435326557 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2148001120 con 0x7f21580d1740 2024-05-27T06:28:51.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.329+0000 7f214f400640 1 -- 172.21.15.87:0/435326557 >> v1:172.21.15.149:6789/0 conn(0x7f21580d1740 legacy=0x7f21580d1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:51.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.329+0000 7f214f400640 1 -- 172.21.15.87:0/435326557 >> v1:172.21.15.87:6789/0 conn(0x7f21580cbf90 legacy=0x7f215806cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:51.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.329+0000 7f214f400640 1 -- 172.21.15.87:0/435326557 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215806c7c0 con 0x7f215815cfe0 2024-05-27T06:28:51.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.333+0000 7f214f400640 1 --2- 172.21.15.87:0/435326557 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f215815cfe0 0x7f215815d3f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f21400097f0 tx=0x7f214001ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b6022a3db85b634 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:51.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.333+0000 7f2157400640 1 -- 172.21.15.87:0/435326557 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21400b5070 con 0x7f215815cfe0 2024-05-27T06:28:51.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.333+0000 7f2157400640 1 -- 172.21.15.87:0/435326557 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21400a89d0 con 0x7f215815cfe0 2024-05-27T06:28:51.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.333+0000 7f2157400640 1 -- 172.21.15.87:0/435326557 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21400a8da0 con 0x7f215815cfe0 2024-05-27T06:28:51.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.333+0000 7f215f200640 1 -- 172.21.15.87:0/435326557 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f215815cfe0 msgr2=0x7f215815d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:51.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.333+0000 7f215f200640 1 --2- 172.21.15.87:0/435326557 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f215815cfe0 0x7f215815d3f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f21400097f0 tx=0x7f214001ecd0 comp rx=0 tx=0).stop 2024-05-27T06:28:51.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.333+0000 7f215f200640 1 -- 172.21.15.87:0/435326557 shutdown_connections 2024-05-27T06:28:51.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.333+0000 7f215f200640 1 --2- 172.21.15.87:0/435326557 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f215815cfe0 0x7f215815d3f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:51.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.333+0000 7f215f200640 1 -- 172.21.15.87:0/435326557 >> 172.21.15.87:0/435326557 conn(0x7f21580b46b0 msgr2=0x7f21580b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:51.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.333+0000 7f215f200640 1 -- 172.21.15.87:0/435326557 shutdown_connections 2024-05-27T06:28:51.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.333+0000 7f215f200640 1 -- 172.21.15.87:0/435326557 wait complete. 2024-05-27T06:28:51.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.337+0000 7f215f200640 1 Processor -- start 2024-05-27T06:28:51.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.337+0000 7f215f200640 1 -- start start 2024-05-27T06:28:51.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.337+0000 7f215f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21580cbf90 0x7f21581f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:51.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.337+0000 7f215f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21580d1740 0x7f21580af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:51.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.337+0000 7f215f200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f215815cfe0 0x7f21580afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:51.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.337+0000 7f215f200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f21580cc3a0 con 0x7f215815cfe0 2024-05-27T06:28:51.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.337+0000 7f215f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f215815e170 con 0x7f21580d1740 2024-05-27T06:28:51.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.337+0000 7f215f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f215806ec50 con 0x7f21580cbf90 2024-05-27T06:28:51.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.337+0000 7f215d200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f215815cfe0 0x7f21580afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:51.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.337+0000 7f215d200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f215815cfe0 0x7f21580afc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39906/0 (socket says 172.21.15.87:39906) 2024-05-27T06:28:51.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.337+0000 7f215d200640 1 -- 172.21.15.87:0/3902769878 learned_addr learned my addr 172.21.15.87:0/3902769878 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:51.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.337+0000 7f2157e00640 1 --2- 172.21.15.87:0/3902769878 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21580cbf90 0x7f21581f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:51.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.337+0000 7f214f400640 1 --2- 172.21.15.87:0/3902769878 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21580d1740 0x7f21580af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:51.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.337+0000 7f215d200640 1 -- 172.21.15.87:0/3902769878 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21580cbf90 msgr2=0x7f21581f5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:51.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.337+0000 7f215d200640 1 --2- 172.21.15.87:0/3902769878 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21580cbf90 0x7f21581f5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:51.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.337+0000 7f215d200640 1 -- 172.21.15.87:0/3902769878 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21580d1740 msgr2=0x7f21580af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:51.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.337+0000 7f215d200640 1 --2- 172.21.15.87:0/3902769878 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21580d1740 0x7f21580af6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:51.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.337+0000 7f215d200640 1 -- 172.21.15.87:0/3902769878 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21580c7320 con 0x7f215815cfe0 2024-05-27T06:28:51.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.337+0000 7f215d200640 1 --2- 172.21.15.87:0/3902769878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f215815cfe0 0x7f21580afc30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f215000c730 tx=0x7f215000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:51.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.337+0000 7f2154c00640 1 -- 172.21.15.87:0/3902769878 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2150003b80 con 0x7f215815cfe0 2024-05-27T06:28:51.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.337+0000 7f2154c00640 1 -- 172.21.15.87:0/3902769878 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2150003d20 con 0x7f215815cfe0 2024-05-27T06:28:51.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.337+0000 7f215f200640 1 -- 172.21.15.87:0/3902769878 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21580c9210 con 0x7f215815cfe0 2024-05-27T06:28:51.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.337+0000 7f2154c00640 1 -- 172.21.15.87:0/3902769878 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2150005310 con 0x7f215815cfe0 2024-05-27T06:28:51.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.337+0000 7f215f200640 1 -- 172.21.15.87:0/3902769878 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21580c97d0 con 0x7f215815cfe0 2024-05-27T06:28:51.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.341+0000 7f215f200640 1 -- 172.21.15.87:0/3902769878 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f215806aa30 con 0x7f215815cfe0 2024-05-27T06:28:51.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.341+0000 7f2154c00640 1 -- 172.21.15.87:0/3902769878 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f21500054b0 con 0x7f215815cfe0 2024-05-27T06:28:51.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.341+0000 7f2154c00640 1 --2- 172.21.15.87:0/3902769878 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f213406f400 0x7f2134071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:51.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.341+0000 7f2154c00640 1 -- 172.21.15.87:0/3902769878 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f215008faf0 con 0x7f215815cfe0 2024-05-27T06:28:51.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.341+0000 7f2157e00640 1 --2- 172.21.15.87:0/3902769878 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f213406f400 0x7f2134071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:51.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.345+0000 7f2157e00640 1 --2- 172.21.15.87:0/3902769878 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f213406f400 0x7f2134071910 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2148000c10 tx=0x7f2148007ef0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:51.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.345+0000 7f2154c00640 1 -- 172.21.15.87:0/3902769878 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f215005c400 con 0x7f215815cfe0 2024-05-27T06:28:51.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.537+0000 7f215f200640 1 -- 172.21.15.87:0/3902769878 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21580c7600 con 0x7f215815cfe0 2024-05-27T06:28:51.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.537+0000 7f2154c00640 1 -- 172.21.15.87:0/3902769878 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5178 (secure 0 0 0) 0x7f2150060700 con 0x7f215815cfe0 2024-05-27T06:28:51.535 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:51.535 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/662047769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":662047769},{"type":"v1","addr":"172.21.15.87:6837","nonce":662047769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4861,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/553113849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":553113849},{"type":"v1","addr":"172.21.15.149:6834","nonce":553113849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/381728425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":381728425},{"type":"v1","addr":"172.21.15.149:6835","nonce":381728425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T06:28:41.065900+0000","modified":"2024-05-27T06:28:44.080313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2661735568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2661735568},{"type":"v1","addr":"172.21.15.87:6835","nonce":2661735568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4920,"qdb_cluster":[4920]},"id":2}]} 2024-05-27T06:28:51.535 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 18 2024-05-27T06:28:51.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.537+0000 7f215f200640 1 -- 172.21.15.87:0/3902769878 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f213406f400 msgr2=0x7f2134071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:51.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.537+0000 7f215f200640 1 --2- 172.21.15.87:0/3902769878 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f213406f400 0x7f2134071910 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2148000c10 tx=0x7f2148007ef0 comp rx=0 tx=0).stop 2024-05-27T06:28:51.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.537+0000 7f215f200640 1 -- 172.21.15.87:0/3902769878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f215815cfe0 msgr2=0x7f21580afc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:51.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.537+0000 7f215f200640 1 --2- 172.21.15.87:0/3902769878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f215815cfe0 0x7f21580afc30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f215000c730 tx=0x7f215000cbf0 comp rx=0 tx=0).stop 2024-05-27T06:28:51.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.537+0000 7f215f200640 1 -- 172.21.15.87:0/3902769878 shutdown_connections 2024-05-27T06:28:51.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.537+0000 7f215f200640 1 --2- 172.21.15.87:0/3902769878 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f213406f400 0x7f2134071910 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:51.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.537+0000 7f215f200640 1 --2- 172.21.15.87:0/3902769878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f215815cfe0 0x7f21580afc30 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:51.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.537+0000 7f215f200640 1 --2- 172.21.15.87:0/3902769878 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21580d1740 0x7f21580af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:51.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.537+0000 7f215f200640 1 --2- 172.21.15.87:0/3902769878 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21580cbf90 0x7f21581f5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:51.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.537+0000 7f215f200640 1 -- 172.21.15.87:0/3902769878 >> 172.21.15.87:0/3902769878 conn(0x7f21580b46b0 msgr2=0x7f215806f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:51.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.537+0000 7f215f200640 1 -- 172.21.15.87:0/3902769878 shutdown_connections 2024-05-27T06:28:51.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:51.537+0000 7f215f200640 1 -- 172.21.15.87:0/3902769878 wait complete. 2024-05-27T06:28:51.959 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-27T06:28:41.065900+0000', 'modified': '2024-05-27T06:28:44.080313+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4920}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4920': {'gid': 4920, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.87:6835/2661735568', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6834', 'nonce': 2661735568}, {'type': 'v1', 'addr': '172.21.15.87:6835', 'nonce': 2661735568}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4920, 'qdb_cluster': [4920]} 2024-05-27T06:28:51.959 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-27T06:28:51.960 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-27T06:28:52.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.113+0000 7f7301800640 1 Processor -- start 2024-05-27T06:28:52.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.113+0000 7f7301800640 1 -- start start 2024-05-27T06:28:52.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.113+0000 7f7301800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72fc160370 0x7f72fc160780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.113+0000 7f7301800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72fc15ce80 con 0x7f72fc073f30 2024-05-27T06:28:52.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.113+0000 7f7301800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72fc15d160 con 0x7f72fc06fcf0 2024-05-27T06:28:52.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.113+0000 7f7301800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f72fc15d720 con 0x7f72fc160370 2024-05-27T06:28:52.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.113+0000 7f72faa00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f72fc073f30 0x7f72fc072a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:55180/0 (socket says 172.21.15.87:55180) 2024-05-27T06:28:52.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.113+0000 7f72faa00640 1 -- 172.21.15.87:0/496774936 learned_addr learned my addr 172.21.15.87:0/496774936 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:52.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.113+0000 7f72fa000640 1 --2- 172.21.15.87:0/496774936 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72fc160370 0x7f72fc160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.113+0000 7f72f9600640 1 -- 172.21.15.87:0/496774936 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 745703416 0 0) 0x7f72fc15ce80 con 0x7f72fc073f30 2024-05-27T06:28:52.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.113+0000 7f72f9600640 1 -- 172.21.15.87:0/496774936 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72e0003530 con 0x7f72fc073f30 2024-05-27T06:28:52.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.113+0000 7f72f9600640 1 -- 172.21.15.87:0/496774936 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4178863320 0 0) 0x7f72fc15d160 con 0x7f72fc06fcf0 2024-05-27T06:28:52.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.113+0000 7f72f9600640 1 -- 172.21.15.87:0/496774936 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72fc15ce80 con 0x7f72fc06fcf0 2024-05-27T06:28:52.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.113+0000 7f72f9600640 1 -- 172.21.15.87:0/496774936 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1428091180 0 0) 0x7f72e0003530 con 0x7f72fc073f30 2024-05-27T06:28:52.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.113+0000 7f72f9600640 1 -- 172.21.15.87:0/496774936 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72fc160370 msgr2=0x7f72fc160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:52.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.113+0000 7f72f9600640 1 --2- 172.21.15.87:0/496774936 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72fc160370 0x7f72fc160780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.113+0000 7f72f9600640 1 -- 172.21.15.87:0/496774936 >> v1:172.21.15.149:6789/0 conn(0x7f72fc06fcf0 legacy=0x7f72fc070100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:52.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.113+0000 7f72f9600640 1 -- 172.21.15.87:0/496774936 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72fc15d440 con 0x7f72fc073f30 2024-05-27T06:28:52.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.113+0000 7f72f9600640 1 -- 172.21.15.87:0/496774936 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7f72ec001680 con 0x7f72fc073f30 2024-05-27T06:28:52.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.113+0000 7f72f9600640 1 -- 172.21.15.87:0/496774936 >> v1:172.21.15.87:6789/0 conn(0x7f72fc073f30 legacy=0x7f72fc072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:52.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.113+0000 7f72f9600640 1 --2- 172.21.15.87:0/496774936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72e0003c70 0x7f72e00040c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.113+0000 7f72f9600640 1 --2- 172.21.15.87:0/496774936 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72e0004810 0x7f72e0004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.113+0000 7f72f9600640 1 --2- 172.21.15.87:0/496774936 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72fc160370 0x7f72e000dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.113+0000 7f72f9600640 1 -- 172.21.15.87:0/496774936 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc15d720 con 0x7f72e0003c70 2024-05-27T06:28:52.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.113+0000 7f72f9600640 1 -- 172.21.15.87:0/496774936 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f72e00055d0 con 0x7f72e0004810 2024-05-27T06:28:52.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.113+0000 7f72f9600640 1 -- 172.21.15.87:0/496774936 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f72e000e120 con 0x7f72fc160370 2024-05-27T06:28:52.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.113+0000 7f72faa00640 1 --2- 172.21.15.87:0/496774936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72e0003c70 0x7f72e00040c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.117+0000 7f72fa000640 1 --2- 172.21.15.87:0/496774936 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72e0004810 0x7f72e0004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.117+0000 7f72fb400640 1 --2- 172.21.15.87:0/496774936 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72fc160370 0x7f72e000dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.117+0000 7f72faa00640 1 -- 172.21.15.87:0/496774936 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72fc160370 msgr2=0x7f72e000dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:52.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.117+0000 7f72faa00640 1 --2- 172.21.15.87:0/496774936 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72fc160370 0x7f72e000dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.117+0000 7f72faa00640 1 -- 172.21.15.87:0/496774936 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72e0004810 msgr2=0x7f72e0004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:52.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.117+0000 7f72faa00640 1 --2- 172.21.15.87:0/496774936 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72e0004810 0x7f72e0004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.117+0000 7f72faa00640 1 -- 172.21.15.87:0/496774936 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e0003530 con 0x7f72e0003c70 2024-05-27T06:28:52.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.117+0000 7f72faa00640 1 --2- 172.21.15.87:0/496774936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72e0003c70 0x7f72e00040c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0d1330 tx=0x7f72ec01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b60705e83629d9d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:52.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.117+0000 7f72f9600640 1 -- 172.21.15.87:0/496774936 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ec007bd0 con 0x7f72e0003c70 2024-05-27T06:28:52.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.117+0000 7f72f9600640 1 -- 172.21.15.87:0/496774936 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72ec0a9020 con 0x7f72e0003c70 2024-05-27T06:28:52.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.117+0000 7f72f9600640 1 -- 172.21.15.87:0/496774936 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ec005b00 con 0x7f72e0003c70 2024-05-27T06:28:52.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.121+0000 7f7301800640 1 -- 172.21.15.87:0/496774936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72e0003c70 msgr2=0x7f72e00040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:52.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.121+0000 7f7301800640 1 --2- 172.21.15.87:0/496774936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72e0003c70 0x7f72e00040c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0d1330 tx=0x7f72ec01ca20 comp rx=0 tx=0).stop 2024-05-27T06:28:52.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.121+0000 7f72fb400640 1 -- 172.21.15.87:0/496774936 reap_dead start 2024-05-27T06:28:52.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.121+0000 7f7301800640 1 -- 172.21.15.87:0/496774936 shutdown_connections 2024-05-27T06:28:52.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.121+0000 7f7301800640 1 -- 172.21.15.87:0/496774936 >> 172.21.15.87:0/496774936 conn(0x7f72fc0b2fb0 msgr2=0x7f72fc0b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:52.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.121+0000 7f7301800640 1 -- 172.21.15.87:0/496774936 shutdown_connections 2024-05-27T06:28:52.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.121+0000 7f7301800640 1 -- 172.21.15.87:0/496774936 wait complete. 2024-05-27T06:28:52.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.121+0000 7f7301800640 1 Processor -- start 2024-05-27T06:28:52.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.121+0000 7f7301800640 1 -- start start 2024-05-27T06:28:52.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.121+0000 7f7301800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72e0003c70 0x7f72fc14fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.125+0000 7f7301800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72fc14a4c0 0x7f72fc15e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.125+0000 7f7301800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72fc150220 0x7f72fc15ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.125+0000 7f7301800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc156bc0 con 0x7f72fc14a4c0 2024-05-27T06:28:52.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.125+0000 7f7301800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc156a40 con 0x7f72e0003c70 2024-05-27T06:28:52.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.125+0000 7f7301800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f72fc074340 con 0x7f72fc150220 2024-05-27T06:28:52.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.125+0000 7f72fa000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72fc14a4c0 0x7f72fc15e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.125+0000 7f72fa000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72fc14a4c0 0x7f72fc15e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39922/0 (socket says 172.21.15.87:39922) 2024-05-27T06:28:52.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.125+0000 7f72fa000640 1 -- 172.21.15.87:0/4286855186 learned_addr learned my addr 172.21.15.87:0/4286855186 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:52.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.125+0000 7f72faa00640 1 --2- 172.21.15.87:0/4286855186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72e0003c70 0x7f72fc14fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.125+0000 7f72fb400640 1 --2- 172.21.15.87:0/4286855186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72fc150220 0x7f72fc15ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.125+0000 7f72fa000640 1 -- 172.21.15.87:0/4286855186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72fc150220 msgr2=0x7f72fc15ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:52.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.125+0000 7f72fa000640 1 --2- 172.21.15.87:0/4286855186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72fc150220 0x7f72fc15ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.125+0000 7f72fa000640 1 -- 172.21.15.87:0/4286855186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72e0003c70 msgr2=0x7f72fc14fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:52.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.125+0000 7f72fa000640 1 --2- 172.21.15.87:0/4286855186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72e0003c70 0x7f72fc14fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.125+0000 7f72fa000640 1 -- 172.21.15.87:0/4286855186 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72fc1f8b40 con 0x7f72fc14a4c0 2024-05-27T06:28:52.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.125+0000 7f72fa000640 1 --2- 172.21.15.87:0/4286855186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72fc14a4c0 0x7f72fc15e920 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f72e8011940 tx=0x7f72e8011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:52.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.125+0000 7f72f2a00640 1 -- 172.21.15.87:0/4286855186 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e8019070 con 0x7f72fc14a4c0 2024-05-27T06:28:52.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.125+0000 7f72f2a00640 1 -- 172.21.15.87:0/4286855186 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e8004240 con 0x7f72fc14a4c0 2024-05-27T06:28:52.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.125+0000 7f7301800640 1 -- 172.21.15.87:0/4286855186 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72fc1f8e20 con 0x7f72fc14a4c0 2024-05-27T06:28:52.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.125+0000 7f72f2a00640 1 -- 172.21.15.87:0/4286855186 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e800f8e0 con 0x7f72fc14a4c0 2024-05-27T06:28:52.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.125+0000 7f7301800640 1 -- 172.21.15.87:0/4286855186 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72fc1f53d0 con 0x7f72fc14a4c0 2024-05-27T06:28:52.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.125+0000 7f72f2a00640 1 -- 172.21.15.87:0/4286855186 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f72e801c070 con 0x7f72fc14a4c0 2024-05-27T06:28:52.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.129+0000 7f72f2a00640 1 --2- 172.21.15.87:0/4286855186 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f72dc06f430 0x7f72dc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.129+0000 7f72f2a00640 1 -- 172.21.15.87:0/4286855186 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f72e808f8f0 con 0x7f72fc14a4c0 2024-05-27T06:28:52.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.129+0000 7f72faa00640 1 --2- 172.21.15.87:0/4286855186 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f72dc06f430 0x7f72dc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.129+0000 7f7308dc1000 1 Processor -- start 2024-05-27T06:28:52.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.129+0000 7f72faa00640 1 --2- 172.21.15.87:0/4286855186 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f72dc06f430 0x7f72dc071940 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f72fc072290 tx=0x7f72ec001860 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:52.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.129+0000 7f7308dc1000 1 -- start start 2024-05-27T06:28:52.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.129+0000 7f7308dc1000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d7b8fcf1f0 0x55d7b9118c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.129+0000 7f7308dc1000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fc7f90 0x55d7b91191a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.129+0000 7f7308dc1000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55d7b8fb1a60 0x55d7b91196e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.129+0000 7f7308dc1000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55d7b8f2b6f0 con 0x55d7b8fc7f90 2024-05-27T06:28:52.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.129+0000 7f7308dc1000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55d7b8f1b290 con 0x55d7b8fcf1f0 2024-05-27T06:28:52.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.129+0000 7f7308dc1000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55d7b8f1f2d0 con 0x55d7b8fb1a60 2024-05-27T06:28:52.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.129+0000 7f72fa000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fc7f90 0x55d7b91191a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.129+0000 7f72fa000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fc7f90 0x55d7b91191a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39938/0 (socket says 172.21.15.87:39938) 2024-05-27T06:28:52.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.129+0000 7f72fa000640 1 -- 172.21.15.87:0/1264717852 learned_addr learned my addr 172.21.15.87:0/1264717852 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:52.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.129+0000 7f72faa00640 1 --2- 172.21.15.87:0/1264717852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d7b8fcf1f0 0x55d7b9118c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.129+0000 7f72fb400640 1 --2- 172.21.15.87:0/1264717852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55d7b8fb1a60 0x55d7b91196e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.129+0000 7f72fa000640 1 -- 172.21.15.87:0/1264717852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55d7b8fb1a60 msgr2=0x55d7b91196e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:52.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.129+0000 7f72fa000640 1 --2- 172.21.15.87:0/1264717852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55d7b8fb1a60 0x55d7b91196e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.129+0000 7f72fa000640 1 -- 172.21.15.87:0/1264717852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d7b8fcf1f0 msgr2=0x55d7b9118c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:52.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.129+0000 7f72fa000640 1 --2- 172.21.15.87:0/1264717852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d7b8fcf1f0 0x55d7b9118c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.129+0000 7f72fa000640 1 -- 172.21.15.87:0/1264717852 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7b8ef9c10 con 0x55d7b8fc7f90 2024-05-27T06:28:52.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.129+0000 7f72fb400640 1 --2- 172.21.15.87:0/1264717852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55d7b8fb1a60 0x55d7b91196e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:52.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.129+0000 7f72fa000640 1 --2- 172.21.15.87:0/1264717852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fc7f90 0x55d7b91191a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f72e80585c0 tx=0x7f72e805ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c5e8a8a9453727 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:52.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.133+0000 7f72e7400640 1 -- 172.21.15.87:0/1264717852 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e8023040 con 0x55d7b8fc7f90 2024-05-27T06:28:52.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.133+0000 7f72e7400640 1 -- 172.21.15.87:0/1264717852 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e8060380 con 0x55d7b8fc7f90 2024-05-27T06:28:52.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.133+0000 7f72e7400640 1 -- 172.21.15.87:0/1264717852 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e8064b10 con 0x55d7b8fc7f90 2024-05-27T06:28:52.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.133+0000 7f7308dc1000 1 -- 172.21.15.87:0/1264717852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fc7f90 msgr2=0x55d7b91191a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:52.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.133+0000 7f7308dc1000 1 --2- 172.21.15.87:0/1264717852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fc7f90 0x55d7b91191a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f72e80585c0 tx=0x7f72e805ba50 comp rx=0 tx=0).stop 2024-05-27T06:28:52.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.133+0000 7f7308dc1000 1 -- 172.21.15.87:0/1264717852 shutdown_connections 2024-05-27T06:28:52.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.133+0000 7f7308dc1000 1 --2- 172.21.15.87:0/1264717852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55d7b8fb1a60 0x55d7b91196e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.133+0000 7f7308dc1000 1 --2- 172.21.15.87:0/1264717852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fc7f90 0x55d7b91191a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.133+0000 7f7308dc1000 1 --2- 172.21.15.87:0/1264717852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d7b8fcf1f0 0x55d7b9118c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.133+0000 7f7308dc1000 1 -- 172.21.15.87:0/1264717852 >> 172.21.15.87:0/1264717852 conn(0x55d7b8fd5db0 msgr2=0x55d7b90fbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:52.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.133+0000 7f7308dc1000 1 -- 172.21.15.87:0/1264717852 shutdown_connections 2024-05-27T06:28:52.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.133+0000 7f7308dc1000 1 -- 172.21.15.87:0/1264717852 wait complete. 2024-05-27T06:28:52.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.133+0000 7f7308dc1000 1 -- start start 2024-05-27T06:28:52.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.133+0000 7f7308dc1000 1 Processor -- start 2024-05-27T06:28:52.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.133+0000 7f7308dc1000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fb1a60 0x55d7b90d7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.133+0000 7f7308dc1000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55d7b8fc7f90 0x55d7b90da640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.133+0000 7f7308dc1000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d7b8fcf1f0 0x55d7b90dab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.133+0000 7f7308dc1000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55d7b8eb37d0 con 0x55d7b8fb1a60 2024-05-27T06:28:52.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.133+0000 7f7308dc1000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55d7b8f23900 con 0x55d7b8fcf1f0 2024-05-27T06:28:52.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.133+0000 7f7308dc1000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55d7b8ec81a0 con 0x55d7b8fc7f90 2024-05-27T06:28:52.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f7308dc1000 10 client.0 _ll_register_callbacks cb 0x55d7b90ba560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T06:28:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f72faa00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fb1a60 0x55d7b90d7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f72faa00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fb1a60 0x55d7b90d7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39944/0 (socket says 172.21.15.87:39944) 2024-05-27T06:28:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f72faa00640 1 -- 172.21.15.87:0/2771682049 learned_addr learned my addr 172.21.15.87:0/2771682049 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f72fa000640 1 --2- 172.21.15.87:0/2771682049 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55d7b8fc7f90 0x55d7b90da640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f72fb400640 1 --2- 172.21.15.87:0/2771682049 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d7b8fcf1f0 0x55d7b90dab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f72faa00640 1 -- 172.21.15.87:0/2771682049 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55d7b8fc7f90 msgr2=0x55d7b90da640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:52.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f72faa00640 1 --2- 172.21.15.87:0/2771682049 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55d7b8fc7f90 0x55d7b90da640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f72faa00640 1 -- 172.21.15.87:0/2771682049 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d7b8fcf1f0 msgr2=0x55d7b90dab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:52.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f72faa00640 1 --2- 172.21.15.87:0/2771682049 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d7b8fcf1f0 0x55d7b90dab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f72faa00640 1 -- 172.21.15.87:0/2771682049 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7b8f639d0 con 0x55d7b8fb1a60 2024-05-27T06:28:52.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f72faa00640 1 --2- 172.21.15.87:0/2771682049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fb1a60 0x55d7b90d7290 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0983d0 tx=0x7f72ec019860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca30440524efa6b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:52.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f72dbe00640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-27T06:28:52.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f72dbe00640 1 -- 172.21.15.87:0/2771682049 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ec007520 con 0x55d7b8fb1a60 2024-05-27T06:28:52.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f72dbe00640 1 -- 172.21.15.87:0/2771682049 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f72ec0076c0 con 0x55d7b8fb1a60 2024-05-27T06:28:52.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f7308dc1000 1 -- 172.21.15.87:0/2771682049 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72e8060380 con 0x55d7b8fb1a60 2024-05-27T06:28:52.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f72dbe00640 1 -- 172.21.15.87:0/2771682049 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f72ec0cd050 con 0x55d7b8fb1a60 2024-05-27T06:28:52.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f7308dc1000 10 client.5109 fetch_fsmap learned FSMap version 18 2024-05-27T06:28:52.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f7308dc1000 1 -- 172.21.15.87:0/2771682049 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55d7b8ef6530 con 0x55d7b8fb1a60 2024-05-27T06:28:52.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f72dbe00640 1 -- 172.21.15.87:0/2771682049 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e8060380 con 0x55d7b8fb1a60 2024-05-27T06:28:52.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f72dbe00640 1 -- 172.21.15.87:0/2771682049 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f72ec0d0020 con 0x55d7b8fb1a60 2024-05-27T06:28:52.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f7308dc1000 10 client.5109 fetch_fsmap finished waiting for FSMap version 18 2024-05-27T06:28:52.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f7308dc1000 10 client.5109 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-27T06:28:52.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f7308dc1000 20 client.5109 populate_metadata read hostname 'smithi087' 2024-05-27T06:28:52.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f7308dc1000 1 --2- 172.21.15.87:0/2771682049 >> [v2:172.21.15.87:6834/2661735568,v1:172.21.15.87:6835/2661735568] conn(0x55d7b8bc37d0 0x55d7b911fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f7308dc1000 4 client.5109 mds_command: new command op to 4920 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T06:28:52.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f7308dc1000 1 -- 172.21.15.87:0/2771682049 --> [v2:172.21.15.87:6834/2661735568,v1:172.21.15.87:6835/2661735568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7b8eb6be0 con 0x55d7b8bc37d0 2024-05-27T06:28:52.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f72fa000640 1 --2- 172.21.15.87:0/2771682049 >> [v2:172.21.15.87:6834/2661735568,v1:172.21.15.87:6835/2661735568] conn(0x55d7b8bc37d0 0x55d7b911fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f72dbe00640 10 client.5109 ms_handle_connect on v2:172.21.15.87:6834/2661735568 2024-05-27T06:28:52.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f72fa000640 1 --2- 172.21.15.87:0/2771682049 >> [v2:172.21.15.87:6834/2661735568,v1:172.21.15.87:6835/2661735568] conn(0x55d7b8bc37d0 0x55d7b911fb70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f149ce0203c45c37 server_cookie=ccd7e7b831ff85cb in_seq=0 out_seq=0 2024-05-27T06:28:52.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f72dbe00640 1 -- 172.21.15.87:0/2771682049 <== mds.0 v2:172.21.15.87:6834/2661735568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55d7b8eb6be0 con 0x55d7b8bc37d0 2024-05-27T06:28:52.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f72dbe00640 10 client.5109 handle_command_reply: tid=0 2024-05-27T06:28:52.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f7308dc1000 1 client.5109 shutdown 2024-05-27T06:28:52.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f7308dc1000 1 -- 172.21.15.87:0/2771682049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fb1a60 msgr2=0x55d7b90d7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:52.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f7308dc1000 1 --2- 172.21.15.87:0/2771682049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fb1a60 0x55d7b90d7290 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0983d0 tx=0x7f72ec019860 comp rx=0 tx=0).stop 2024-05-27T06:28:52.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f7308dc1000 1 -- 172.21.15.87:0/2771682049 shutdown_connections 2024-05-27T06:28:52.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f7308dc1000 1 --2- 172.21.15.87:0/2771682049 >> [v2:172.21.15.87:6834/2661735568,v1:172.21.15.87:6835/2661735568] conn(0x55d7b8bc37d0 0x55d7b911fb70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f7308dc1000 1 --2- 172.21.15.87:0/2771682049 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d7b8fcf1f0 0x55d7b90dab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f7308dc1000 1 --2- 172.21.15.87:0/2771682049 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55d7b8fc7f90 0x55d7b90da640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f7308dc1000 1 --2- 172.21.15.87:0/2771682049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fb1a60 0x55d7b90d7290 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f72dbe00640 0 client.5109 ms_handle_reset on v2:172.21.15.87:6834/2661735568 2024-05-27T06:28:52.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f7308dc1000 1 -- 172.21.15.87:0/2771682049 >> 172.21.15.87:0/2771682049 conn(0x55d7b8fd5db0 msgr2=0x55d7b90d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:52.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f7308dc1000 1 -- 172.21.15.87:0/2771682049 shutdown_connections 2024-05-27T06:28:52.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.137+0000 7f7308dc1000 1 -- 172.21.15.87:0/2771682049 wait complete. 2024-05-27T06:28:52.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.141+0000 7f7308dc1000 20 client.5109 trim_cache size 0 max 16384 2024-05-27T06:28:52.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.157+0000 7f7308dc1000 1 Processor -- start 2024-05-27T06:28:52.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.157+0000 7f7308dc1000 1 -- start start 2024-05-27T06:28:52.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.157+0000 7f7308dc1000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d7b8fb1a60 0x55d7b9186ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.157+0000 7f7308dc1000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55d7b8fc7f90 0x55d7b91873e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.157+0000 7f7308dc1000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fcf1f0 0x55d7b9187920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.157+0000 7f7308dc1000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc2018d0 con 0x55d7b8fcf1f0 2024-05-27T06:28:52.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.157+0000 7f7308dc1000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc200cd0 con 0x55d7b8fb1a60 2024-05-27T06:28:52.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.157+0000 7f7308dc1000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f72fc201280 con 0x55d7b8fc7f90 2024-05-27T06:28:52.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.157+0000 7f72fb400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fcf1f0 0x55d7b9187920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.157+0000 7f72fb400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fcf1f0 0x55d7b9187920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39946/0 (socket says 172.21.15.87:39946) 2024-05-27T06:28:52.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.157+0000 7f72fb400640 1 -- 172.21.15.87:0/1266094105 learned_addr learned my addr 172.21.15.87:0/1266094105 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:52.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.161+0000 7f72faa00640 1 --2- 172.21.15.87:0/1266094105 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d7b8fb1a60 0x55d7b9186ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.161+0000 7f72fa000640 1 --2- 172.21.15.87:0/1266094105 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55d7b8fc7f90 0x55d7b91873e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.161+0000 7f72fb400640 1 -- 172.21.15.87:0/1266094105 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55d7b8fc7f90 msgr2=0x55d7b91873e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:52.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.161+0000 7f72fb400640 1 --2- 172.21.15.87:0/1266094105 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55d7b8fc7f90 0x55d7b91873e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.161+0000 7f72fb400640 1 -- 172.21.15.87:0/1266094105 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d7b8fb1a60 msgr2=0x55d7b9186ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:52.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.161+0000 7f72fb400640 1 --2- 172.21.15.87:0/1266094105 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d7b8fb1a60 0x55d7b9186ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.161+0000 7f72fb400640 1 -- 172.21.15.87:0/1266094105 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7b8ebc880 con 0x55d7b8fcf1f0 2024-05-27T06:28:52.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.161+0000 7f72fb400640 1 --2- 172.21.15.87:0/1266094105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fcf1f0 0x55d7b9187920 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f72fc15fc80 tx=0x7f72f4002030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb1eccd759f7451 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:52.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.161+0000 7f72e6a00640 1 -- 172.21.15.87:0/1266094105 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f401a020 con 0x55d7b8fcf1f0 2024-05-27T06:28:52.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.161+0000 7f72e6a00640 1 -- 172.21.15.87:0/1266094105 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f4003980 con 0x55d7b8fcf1f0 2024-05-27T06:28:52.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.161+0000 7f72e6a00640 1 -- 172.21.15.87:0/1266094105 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f4003d50 con 0x55d7b8fcf1f0 2024-05-27T06:28:52.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.161+0000 7f7308dc1000 1 -- 172.21.15.87:0/1266094105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fcf1f0 msgr2=0x55d7b9187920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:52.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.161+0000 7f7308dc1000 1 --2- 172.21.15.87:0/1266094105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fcf1f0 0x55d7b9187920 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f72fc15fc80 tx=0x7f72f4002030 comp rx=0 tx=0).stop 2024-05-27T06:28:52.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.161+0000 7f7308dc1000 1 -- 172.21.15.87:0/1266094105 shutdown_connections 2024-05-27T06:28:52.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.161+0000 7f7308dc1000 1 --2- 172.21.15.87:0/1266094105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fcf1f0 0x55d7b9187920 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.161+0000 7f7308dc1000 1 --2- 172.21.15.87:0/1266094105 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55d7b8fc7f90 0x55d7b91873e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.161+0000 7f7308dc1000 1 --2- 172.21.15.87:0/1266094105 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d7b8fb1a60 0x55d7b9186ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.161+0000 7f7308dc1000 1 -- 172.21.15.87:0/1266094105 >> 172.21.15.87:0/1266094105 conn(0x55d7b8fd5db0 msgr2=0x55d7b90fbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:52.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.161+0000 7f7308dc1000 1 -- 172.21.15.87:0/1266094105 shutdown_connections 2024-05-27T06:28:52.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.161+0000 7f7308dc1000 1 -- 172.21.15.87:0/1266094105 wait complete. 2024-05-27T06:28:52.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.161+0000 7f7308dc1000 1 -- start start 2024-05-27T06:28:52.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.161+0000 7f7308dc1000 1 Processor -- start 2024-05-27T06:28:52.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55d7b8fb1a60 0x55d7b91876f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fc7f90 0x55d7b9124670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d7b8fcf1f0 0x55d7b9124bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55d7b8f9f590 con 0x55d7b8fc7f90 2024-05-27T06:28:52.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55d7b8ede650 con 0x55d7b8fcf1f0 2024-05-27T06:28:52.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55d7b8f2a4c0 con 0x55d7b8fb1a60 2024-05-27T06:28:52.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 10 client.0 _ll_register_callbacks cb 0x7f72e8009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T06:28:52.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f72fa000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fc7f90 0x55d7b9124670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f72fa000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fc7f90 0x55d7b9124670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39950/0 (socket says 172.21.15.87:39950) 2024-05-27T06:28:52.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f72fa000640 1 -- 172.21.15.87:0/3396683505 learned_addr learned my addr 172.21.15.87:0/3396683505 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:52.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f72faa00640 1 --2- 172.21.15.87:0/3396683505 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55d7b8fb1a60 0x55d7b91876f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f72fb400640 1 --2- 172.21.15.87:0/3396683505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d7b8fcf1f0 0x55d7b9124bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f72fa000640 1 -- 172.21.15.87:0/3396683505 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55d7b8fb1a60 msgr2=0x55d7b91876f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:52.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f72fa000640 1 --2- 172.21.15.87:0/3396683505 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55d7b8fb1a60 0x55d7b91876f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f72fa000640 1 -- 172.21.15.87:0/3396683505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d7b8fcf1f0 msgr2=0x55d7b9124bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:52.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f72fa000640 1 --2- 172.21.15.87:0/3396683505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d7b8fcf1f0 0x55d7b9124bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f72fa000640 1 -- 172.21.15.87:0/3396683505 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7b8ed2ea0 con 0x55d7b8fc7f90 2024-05-27T06:28:52.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f72faa00640 1 --2- 172.21.15.87:0/3396683505 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55d7b8fb1a60 0x55d7b91876f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:52.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f72fa000640 1 --2- 172.21.15.87:0/3396683505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fc7f90 0x55d7b9124670 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f72e805bf60 tx=0x7f72e801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d4a1a668304d4b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f72dbe00640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-27T06:28:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f72dbe00640 1 -- 172.21.15.87:0/3396683505 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e8023040 con 0x55d7b8fc7f90 2024-05-27T06:28:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f72dbe00640 1 -- 172.21.15.87:0/3396683505 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f72e8064b10 con 0x55d7b8fc7f90 2024-05-27T06:28:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 1 -- 172.21.15.87:0/3396683505 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72f4003980 con 0x55d7b8fc7f90 2024-05-27T06:28:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f72dbe00640 1 -- 172.21.15.87:0/3396683505 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f72e8083050 con 0x55d7b8fc7f90 2024-05-27T06:28:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 10 client.5115 fetch_fsmap learned FSMap version 18 2024-05-27T06:28:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 1 -- 172.21.15.87:0/3396683505 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55d7b8f9fa20 con 0x55d7b8fc7f90 2024-05-27T06:28:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f72dbe00640 1 -- 172.21.15.87:0/3396683505 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f4003980 con 0x55d7b8fc7f90 2024-05-27T06:28:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f72dbe00640 1 -- 172.21.15.87:0/3396683505 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f72e805b230 con 0x55d7b8fc7f90 2024-05-27T06:28:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 10 client.5115 fetch_fsmap finished waiting for FSMap version 18 2024-05-27T06:28:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 10 client.5115 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-27T06:28:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 20 client.5115 populate_metadata read hostname 'smithi087' 2024-05-27T06:28:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 1 --2- 172.21.15.87:0/3396683505 >> [v2:172.21.15.87:6834/2661735568,v1:172.21.15.87:6835/2661735568] conn(0x55d7b8bb1830 0x55d7b91250f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 4 client.5115 mds_command: new command op to 4920 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-27T06:28:52.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 1 -- 172.21.15.87:0/3396683505 --> [v2:172.21.15.87:6834/2661735568,v1:172.21.15.87:6835/2661735568] -- command(tid 0: {"prefix": "status"}) -- 0x55d7b8ebade0 con 0x55d7b8bb1830 2024-05-27T06:28:52.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f72faa00640 1 --2- 172.21.15.87:0/3396683505 >> [v2:172.21.15.87:6834/2661735568,v1:172.21.15.87:6835/2661735568] conn(0x55d7b8bb1830 0x55d7b91250f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f72dbe00640 10 client.5115 ms_handle_connect on v2:172.21.15.87:6834/2661735568 2024-05-27T06:28:52.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f72faa00640 1 --2- 172.21.15.87:0/3396683505 >> [v2:172.21.15.87:6834/2661735568,v1:172.21.15.87:6835/2661735568] conn(0x55d7b8bb1830 0x55d7b91250f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e65922763282f67 server_cookie=95994a49af55bc63 in_seq=0 out_seq=0 2024-05-27T06:28:52.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f72dbe00640 1 -- 172.21.15.87:0/3396683505 <== mds.0 v2:172.21.15.87:6834/2661735568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55d7b8ebade0 con 0x55d7b8bb1830 2024-05-27T06:28:52.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f72dbe00640 10 client.5115 handle_command_reply: tid=0 2024-05-27T06:28:52.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 1 client.5115 shutdown 2024-05-27T06:28:52.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 1 -- 172.21.15.87:0/3396683505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fc7f90 msgr2=0x55d7b9124670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:52.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 1 --2- 172.21.15.87:0/3396683505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fc7f90 0x55d7b9124670 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f72e805bf60 tx=0x7f72e801f000 comp rx=0 tx=0).stop 2024-05-27T06:28:52.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 1 -- 172.21.15.87:0/3396683505 shutdown_connections 2024-05-27T06:28:52.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 1 --2- 172.21.15.87:0/3396683505 >> [v2:172.21.15.87:6834/2661735568,v1:172.21.15.87:6835/2661735568] conn(0x55d7b8bb1830 0x55d7b91250f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 1 --2- 172.21.15.87:0/3396683505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d7b8fcf1f0 0x55d7b9124bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 1 --2- 172.21.15.87:0/3396683505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55d7b8fc7f90 0x55d7b9124670 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f72dbe00640 0 client.5115 ms_handle_reset on v2:172.21.15.87:6834/2661735568 2024-05-27T06:28:52.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 1 --2- 172.21.15.87:0/3396683505 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55d7b8fb1a60 0x55d7b91876f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 1 -- 172.21.15.87:0/3396683505 >> 172.21.15.87:0/3396683505 conn(0x55d7b8fd5db0 msgr2=0x55d7b90fbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:52.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 1 -- 172.21.15.87:0/3396683505 shutdown_connections 2024-05-27T06:28:52.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 1 -- 172.21.15.87:0/3396683505 wait complete. 2024-05-27T06:28:52.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.165+0000 7f7308dc1000 20 client.5115 trim_cache size 0 max 16384 2024-05-27T06:28:52.169 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-27T06:28:52.169 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_fsid": "0412686d-4f35-45cc-b082-ef9741c1aff5", 2024-05-27T06:28:52.169 INFO:teuthology.orchestra.run.smithi087.stdout: "whoami": 0, 2024-05-27T06:28:52.169 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 4920, 2024-05-27T06:28:52.170 INFO:teuthology.orchestra.run.smithi087.stdout: "want_state": "up:active", 2024-05-27T06:28:52.170 INFO:teuthology.orchestra.run.smithi087.stdout: "state": "up:active", 2024-05-27T06:28:52.170 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs", 2024-05-27T06:28:52.170 INFO:teuthology.orchestra.run.smithi087.stdout: "rank_uptime": 10.515870104999999, 2024-05-27T06:28:52.170 INFO:teuthology.orchestra.run.smithi087.stdout: "mdsmap_epoch": 18, 2024-05-27T06:28:52.170 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch": 38, 2024-05-27T06:28:52.170 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch_barrier": 38, 2024-05-27T06:28:52.170 INFO:teuthology.orchestra.run.smithi087.stdout: "uptime": 17.355836086 2024-05-27T06:28:52.170 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-27T06:28:52.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.169+0000 7f7301800640 1 -- 172.21.15.87:0/4286855186 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f72dc06f430 msgr2=0x7f72dc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:52.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.169+0000 7f7301800640 1 --2- 172.21.15.87:0/4286855186 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f72dc06f430 0x7f72dc071940 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f72fc072290 tx=0x7f72ec001860 comp rx=0 tx=0).stop 2024-05-27T06:28:52.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.169+0000 7f7301800640 1 -- 172.21.15.87:0/4286855186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72fc14a4c0 msgr2=0x7f72fc15e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:52.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.169+0000 7f7301800640 1 --2- 172.21.15.87:0/4286855186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72fc14a4c0 0x7f72fc15e920 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f72e8011940 tx=0x7f72e8011e00 comp rx=0 tx=0).stop 2024-05-27T06:28:52.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.169+0000 7f7301800640 1 -- 172.21.15.87:0/4286855186 shutdown_connections 2024-05-27T06:28:52.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.169+0000 7f7301800640 1 --2- 172.21.15.87:0/4286855186 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f72dc06f430 0x7f72dc071940 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.169+0000 7f7301800640 1 --2- 172.21.15.87:0/4286855186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f72fc150220 0x7f72fc15ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.169+0000 7f7301800640 1 --2- 172.21.15.87:0/4286855186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72fc14a4c0 0x7f72fc15e920 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.169+0000 7f7301800640 1 --2- 172.21.15.87:0/4286855186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72e0003c70 0x7f72fc14fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.169+0000 7f7301800640 1 -- 172.21.15.87:0/4286855186 >> 172.21.15.87:0/4286855186 conn(0x7f72fc0b2fb0 msgr2=0x7f72fc070100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:52.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.169+0000 7f7301800640 1 -- 172.21.15.87:0/4286855186 shutdown_connections 2024-05-27T06:28:52.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.169+0000 7f7301800640 1 -- 172.21.15.87:0/4286855186 wait complete. 2024-05-27T06:28:52.185 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-27T06:28:52.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.333+0000 7f3960800640 1 Processor -- start 2024-05-27T06:28:52.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.333+0000 7f3960800640 1 -- start start 2024-05-27T06:28:52.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.337+0000 7f3960800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3958072eb0 0x7f39580d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.337+0000 7f3960800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39580d1c80 0x7f39580ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.337+0000 7f3960800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39580d2090 con 0x7f3958072aa0 2024-05-27T06:28:52.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.337+0000 7f3960800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f39580cdd30 con 0x7f3958072eb0 2024-05-27T06:28:52.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.337+0000 7f3960800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f39580cd120 con 0x7f39580d1c80 2024-05-27T06:28:52.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.337+0000 7f395d400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3958072eb0 0x7f39580d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.337+0000 7f395de00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f3958072aa0 0x7f395806d820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:55190/0 (socket says 172.21.15.87:55190) 2024-05-27T06:28:52.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.337+0000 7f395de00640 1 -- 172.21.15.87:0/600531354 learned_addr learned my addr 172.21.15.87:0/600531354 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:52.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.337+0000 7f395e800640 1 --2- 172.21.15.87:0/600531354 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39580d1c80 0x7f39580ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.337+0000 7f395ca00640 1 -- 172.21.15.87:0/600531354 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2956017223 0 0) 0x7f39580d2090 con 0x7f3958072aa0 2024-05-27T06:28:52.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.337+0000 7f395d400640 1 -- 172.21.15.87:0/600531354 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39580d1c80 msgr2=0x7f39580ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:52.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.337+0000 7f395d400640 1 --2- 172.21.15.87:0/600531354 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39580d1c80 0x7f39580ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.337+0000 7f395d400640 1 -- 172.21.15.87:0/600531354 >> v1:172.21.15.87:6789/0 conn(0x7f3958072aa0 legacy=0x7f395806d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:52.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.337+0000 7f395d400640 1 -- 172.21.15.87:0/600531354 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39580cd400 con 0x7f3958072eb0 2024-05-27T06:28:52.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.337+0000 7f395d400640 1 --2- 172.21.15.87:0/600531354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3958072eb0 0x7f39580d1740 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f39480097c0 tx=0x7f394801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be08157b1162c28 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:52.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.341+0000 7f395ca00640 1 -- 172.21.15.87:0/600531354 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39480a7070 con 0x7f3958072eb0 2024-05-27T06:28:52.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.341+0000 7f395ca00640 1 -- 172.21.15.87:0/600531354 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39480b0070 con 0x7f3958072eb0 2024-05-27T06:28:52.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.341+0000 7f395ca00640 1 -- 172.21.15.87:0/600531354 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39480ab890 con 0x7f3958072eb0 2024-05-27T06:28:52.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.341+0000 7f3960800640 1 -- 172.21.15.87:0/600531354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3958072eb0 msgr2=0x7f39580d1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:52.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.341+0000 7f3960800640 1 --2- 172.21.15.87:0/600531354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3958072eb0 0x7f39580d1740 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f39480097c0 tx=0x7f394801c470 comp rx=0 tx=0).stop 2024-05-27T06:28:52.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.341+0000 7f3960800640 1 -- 172.21.15.87:0/600531354 shutdown_connections 2024-05-27T06:28:52.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.341+0000 7f3960800640 1 --2- 172.21.15.87:0/600531354 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39580d1c80 0x7f39580ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.341+0000 7f3960800640 1 --2- 172.21.15.87:0/600531354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3958072eb0 0x7f39580d1740 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.341+0000 7f3960800640 1 -- 172.21.15.87:0/600531354 >> 172.21.15.87:0/600531354 conn(0x7f39580b46b0 msgr2=0x7f39580b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:52.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.341+0000 7f3960800640 1 -- 172.21.15.87:0/600531354 shutdown_connections 2024-05-27T06:28:52.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.341+0000 7f3960800640 1 -- 172.21.15.87:0/600531354 wait complete. 2024-05-27T06:28:52.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.341+0000 7f3960800640 1 Processor -- start 2024-05-27T06:28:52.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.341+0000 7f3960800640 1 -- start start 2024-05-27T06:28:52.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.345+0000 7f3960800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3958072aa0 0x7f39580cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.345+0000 7f3960800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3958072eb0 0x7f3958159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.345+0000 7f3960800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39580d1c80 0x7f3958167c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.345+0000 7f3960800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f39580cccb0 con 0x7f3958072aa0 2024-05-27T06:28:52.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.345+0000 7f3960800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f395806df30 con 0x7f3958072eb0 2024-05-27T06:28:52.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.345+0000 7f3960800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f39580cce30 con 0x7f39580d1c80 2024-05-27T06:28:52.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.345+0000 7f395de00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3958072aa0 0x7f39580cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.345+0000 7f395de00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3958072aa0 0x7f39580cfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39976/0 (socket says 172.21.15.87:39976) 2024-05-27T06:28:52.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.345+0000 7f395de00640 1 -- 172.21.15.87:0/3160632581 learned_addr learned my addr 172.21.15.87:0/3160632581 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:52.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.345+0000 7f395e800640 1 --2- 172.21.15.87:0/3160632581 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39580d1c80 0x7f3958167c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.345+0000 7f395d400640 1 --2- 172.21.15.87:0/3160632581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3958072eb0 0x7f3958159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.345+0000 7f395de00640 1 -- 172.21.15.87:0/3160632581 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39580d1c80 msgr2=0x7f3958167c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:52.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.345+0000 7f395de00640 1 --2- 172.21.15.87:0/3160632581 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39580d1c80 0x7f3958167c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.345+0000 7f395de00640 1 -- 172.21.15.87:0/3160632581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3958072eb0 msgr2=0x7f3958159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:52.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.345+0000 7f395de00640 1 --2- 172.21.15.87:0/3160632581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3958072eb0 0x7f3958159d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.345+0000 7f395de00640 1 -- 172.21.15.87:0/3160632581 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39580cf120 con 0x7f3958072aa0 2024-05-27T06:28:52.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.345+0000 7f395de00640 1 --2- 172.21.15.87:0/3160632581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3958072aa0 0x7f39580cfee0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f394c00c460 tx=0x7f394c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:52.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.345+0000 7f3952000640 1 -- 172.21.15.87:0/3160632581 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394c018070 con 0x7f3958072aa0 2024-05-27T06:28:52.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.345+0000 7f3952000640 1 -- 172.21.15.87:0/3160632581 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f394c007500 con 0x7f3958072aa0 2024-05-27T06:28:52.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.345+0000 7f3960800640 1 -- 172.21.15.87:0/3160632581 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39580cf400 con 0x7f3958072aa0 2024-05-27T06:28:52.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.345+0000 7f3952000640 1 -- 172.21.15.87:0/3160632581 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394c004a30 con 0x7f3958072aa0 2024-05-27T06:28:52.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.345+0000 7f3960800640 1 -- 172.21.15.87:0/3160632581 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39580cf9c0 con 0x7f3958072aa0 2024-05-27T06:28:52.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.345+0000 7f3960800640 1 -- 172.21.15.87:0/3160632581 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f395806aa30 con 0x7f3958072aa0 2024-05-27T06:28:52.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.349+0000 7f3952000640 1 -- 172.21.15.87:0/3160632581 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f394c01b070 con 0x7f3958072aa0 2024-05-27T06:28:52.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.349+0000 7f3952000640 1 --2- 172.21.15.87:0/3160632581 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f393c06f430 0x7f393c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:52.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.349+0000 7f3952000640 1 -- 172.21.15.87:0/3160632581 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f394c08e6b0 con 0x7f3958072aa0 2024-05-27T06:28:52.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.349+0000 7f395d400640 1 --2- 172.21.15.87:0/3160632581 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f393c06f430 0x7f393c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:52.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.349+0000 7f395d400640 1 --2- 172.21.15.87:0/3160632581 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f393c06f430 0x7f393c071940 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f39480af000 tx=0x7f39480a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:52.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.353+0000 7f3952000640 1 -- 172.21.15.87:0/3160632581 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f394c05b410 con 0x7f3958072aa0 2024-05-27T06:28:52.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.545+0000 7f3960800640 1 -- 172.21.15.87:0/3160632581 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f395815a890 con 0x7f3958072aa0 2024-05-27T06:28:52.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.545+0000 7f3952000640 1 -- 172.21.15.87:0/3160632581 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7f394c05ad10 con 0x7f3958072aa0 2024-05-27T06:28:52.542 INFO:teuthology.orchestra.run.smithi087.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-27T06:28:52.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.545+0000 7f3960800640 1 -- 172.21.15.87:0/3160632581 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f393c06f430 msgr2=0x7f393c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:52.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.545+0000 7f3960800640 1 --2- 172.21.15.87:0/3160632581 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f393c06f430 0x7f393c071940 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f39480af000 tx=0x7f39480a7000 comp rx=0 tx=0).stop 2024-05-27T06:28:52.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.545+0000 7f3960800640 1 -- 172.21.15.87:0/3160632581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3958072aa0 msgr2=0x7f39580cfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:52.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.545+0000 7f3960800640 1 --2- 172.21.15.87:0/3160632581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3958072aa0 0x7f39580cfee0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f394c00c460 tx=0x7f394c00c920 comp rx=0 tx=0).stop 2024-05-27T06:28:52.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.545+0000 7f3960800640 1 -- 172.21.15.87:0/3160632581 shutdown_connections 2024-05-27T06:28:52.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.545+0000 7f3960800640 1 --2- 172.21.15.87:0/3160632581 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f393c06f430 0x7f393c071940 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.545+0000 7f3960800640 1 --2- 172.21.15.87:0/3160632581 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39580d1c80 0x7f3958167c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.545+0000 7f3960800640 1 --2- 172.21.15.87:0/3160632581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3958072eb0 0x7f3958159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.545+0000 7f3960800640 1 --2- 172.21.15.87:0/3160632581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3958072aa0 0x7f39580cfee0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:52.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.545+0000 7f3960800640 1 -- 172.21.15.87:0/3160632581 >> 172.21.15.87:0/3160632581 conn(0x7f39580b46b0 msgr2=0x7f39580ae350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:52.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.545+0000 7f3960800640 1 -- 172.21.15.87:0/3160632581 shutdown_connections 2024-05-27T06:28:52.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52.545+0000 7f3960800640 1 -- 172.21.15.87:0/3160632581 wait complete. 2024-05-27T06:28:52.564 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-27T06:28:52.564 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-27T06:28:52.564 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-05-27T06:28:52.564 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-27T06:28:52.564 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-27T06:28:52.564 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-27T06:28:52.565 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-27T06:28:52.565 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-27T06:28:52.565 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-27T06:28:52.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:52.565 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-05-27T06:28:52.574 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T06:28:52.574 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T06:28:52.575 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T06:28:52.575 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:52.575 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-05-27T06:28:52.575 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:52.575 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:28:52.575 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:52.575 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-05-27T06:28:52.575 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:28:52.575 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:52.575 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-05-27T06:28:52.575 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:28:52.575 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:52.575 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-27T06:28:52.575 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:52.576 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-27T06:28:52.576 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42409sec preferred_lft 42409sec 2024-05-27T06:28:52.576 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-05-27T06:28:52.576 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:52.576 INFO:teuthology.orchestra.run.smithi087.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-27T06:28:52.576 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 02:42:75:41:48:14 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:52.576 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-27T06:28:52.576 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:52.576 INFO:teuthology.orchestra.run.smithi087.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-27T06:28:52.576 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:52.576 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-27T06:28:52.576 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:52.576 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-27T06:28:52.576 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:52.577 INFO:teuthology.orchestra.run.smithi087.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-27T06:28:52.577 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:28:52.577 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-27T06:28:52.577 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:52.577 INFO:teuthology.orchestra.run.smithi087.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-27T06:28:52.577 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:28:52.577 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-05-27T06:28:52.577 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:52.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:52.578 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-27T06:28:52.639 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-05-27T06:28:52.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:52.641 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-05-27T06:28:52.696 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-05-27T06:28:52.697 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-27T06:28:52.697 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-27T06:28:52.697 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-27T06:28:52.697 INFO:teuthology.orchestra.run.smithi087.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-27T06:28:52.697 INFO:teuthology.orchestra.run.smithi087.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-27T06:28:52.697 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-27T06:28:52.697 INFO:teuthology.orchestra.run.smithi087.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:28:52.697 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:28:52.697 INFO:teuthology.orchestra.run.smithi087.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:28:52.697 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-27T06:28:52.698 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:28:52.698 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-27T06:28:52.698 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-27T06:28:52.698 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-27T06:28:52.698 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-27T06:28:52.698 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-27T06:28:52.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:28:52.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:28:52.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:52.832 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-05-27T06:28:52.840 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-27T06:28:52.841 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-27T06:28:52.841 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-27T06:28:52.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:52.841 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-05-27T06:28:52.905 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-27T06:28:52.905 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T06:28:52.905 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-27T06:28:52.957 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-27T06:28:52.958 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T06:28:52.958 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-27T06:28:53.013 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-05-27T06:28:53.077 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T06:28:53.130 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-05-27T06:28:53.130 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-05-27T06:28:53.130 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-05-27T06:28:53.130 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-05-27T06:28:53.131 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-05-27T06:28:53.131 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-05-27T06:28:53.131 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-05-27T06:28:53.131 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-05-27T06:28:53.131 INFO:teuthology.orchestra.run.smithi087.stdout:/run/lock 2024-05-27T06:28:53.131 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-05-27T06:28:53.131 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-05-27T06:28:53.131 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-05-27T06:28:53.131 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T06:28:53.131 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-05-27T06:28:53.131 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-05-27T06:28:53.131 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-05-27T06:28:53.131 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-05-27T06:28:53.132 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/fs/nfsd 2024-05-27T06:28:53.132 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-05-27T06:28:53.132 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-05-27T06:28:53.132 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysusers.service 2024-05-27T06:28:53.132 INFO:teuthology.orchestra.run.smithi087.stdout:/run/rpc_pipefs 2024-05-27T06:28:53.132 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-05-27T06:28:53.132 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-05-27T06:28:53.132 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2024-05-27T06:28:53.132 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2024-05-27T06:28:53.132 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2024-05-27T06:28:53.132 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2024-05-27T06:28:53.132 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-05-27T06:28:53.132 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:28:53.132 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:28:53.133 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:28:53.133 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:28:53.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:53.134 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-05-27T06:28:53.184 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-27T06:28:53.185 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-27T06:28:53.228 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-05-27T06:28:53.248 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T06:28:53.303 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-05-27T06:28:53.303 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-05-27T06:28:53.303 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-05-27T06:28:53.304 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-05-27T06:28:53.304 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-05-27T06:28:53.304 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-05-27T06:28:53.304 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-05-27T06:28:53.304 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-05-27T06:28:53.304 INFO:teuthology.orchestra.run.smithi087.stdout:/run/lock 2024-05-27T06:28:53.304 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-05-27T06:28:53.304 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-05-27T06:28:53.304 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-05-27T06:28:53.304 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T06:28:53.304 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-05-27T06:28:53.304 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-05-27T06:28:53.305 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-05-27T06:28:53.305 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-05-27T06:28:53.305 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/fs/nfsd 2024-05-27T06:28:53.305 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-05-27T06:28:53.305 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-05-27T06:28:53.305 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysusers.service 2024-05-27T06:28:53.305 INFO:teuthology.orchestra.run.smithi087.stdout:/run/rpc_pipefs 2024-05-27T06:28:53.305 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-05-27T06:28:53.305 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-05-27T06:28:53.305 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2024-05-27T06:28:53.305 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2024-05-27T06:28:53.305 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2024-05-27T06:28:53.305 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2024-05-27T06:28:53.306 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-05-27T06:28:53.306 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:28:53.306 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:28:53.306 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:28:53.306 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:28:53.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:53.307 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-05-27T06:28:53.333 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:2024-05-27T06:28:53.333+0000 7f7e0c42e580 -1 init, newargv = 0x7f7dfc001600 newargc=15 2024-05-27T06:28:53.333 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[37336]: starting ceph client 2024-05-27T06:28:53.340 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[37336]: starting fuse 2024-05-27T06:28:53.342 INFO:teuthology.orchestra.run.smithi087.stdout:44 2024-05-27T06:28:53.342 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-05-27T06:28:53.342 DEBUG:teuthology.orchestra.run.smithi087:> sudo stdin-killer -- python3 -c ' 2024-05-27T06:28:53.342 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-05-27T06:28:53.342 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-05-27T06:28:53.342 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-05-27T06:28:53.343 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-05-27T06:28:53.343 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:28:53.343 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-05-27T06:28:53.343 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-27T06:28:53.343 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-05-27T06:28:53.343 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-27T06:28:53.343 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:28:53.343 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-05-27T06:28:53.343 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-05-27T06:28:53.343 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-05-27T06:28:53.343 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-05-27T06:28:53.343 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:28:53.343 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-05-27T06:28:53.343 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-27T06:28:53.343 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-27T06:28:53.344 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-27T06:28:53.344 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-05-27T06:28:53.344 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-05-27T06:28:53.344 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-05-27T06:28:53.344 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-27T06:28:53.344 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:28:53.344 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.0")) 2024-05-27T06:28:53.344 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-05-27T06:28:53.468 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.0.37336.asok 2024-05-27T06:28:53.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:28:53.480 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37336.asok 2024-05-27T06:28:53.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:53.480 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37336.asok status 2024-05-27T06:28:53.658 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-27T06:28:53.658 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-05-27T06:28:53.658 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "38f9d900c83c63799fbdbe61acc9a11b0d3554a6", 2024-05-27T06:28:53.659 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 19.0.0-3872-g38f9d900 (38f9d900c83c63799fbdbe61acc9a11b0d3554a6) squid (dev)", 2024-05-27T06:28:53.659 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "0", 2024-05-27T06:28:53.659 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-05-27T06:28:53.659 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-27T06:28:53.659 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "37336", 2024-05-27T06:28:53.659 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-05-27T06:28:53.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:53.660 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-05-27T06:28:53.660 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-05-27T06:28:53.660 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 5133, 2024-05-27T06:28:53.660 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-05-27T06:28:53.660 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-05-27T06:28:53.661 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-05-27T06:28:53.661 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 5133 2024-05-27T06:28:53.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:53.661 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-05-27T06:28:53.661 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-05-27T06:28:53.661 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-05-27T06:28:53.661 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1818940395 2024-05-27T06:28:53.662 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:53.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:53.662 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-05-27T06:28:53.662 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-05-27T06:28:53.662 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-05-27T06:28:53.662 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1818940395 2024-05-27T06:28:53.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:53.663 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.5133 192.168.0.1:0/1818940395", 2024-05-27T06:28:53.663 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/1818940395", 2024-05-27T06:28:53.663 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-05-27T06:28:53.663 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 18, 2024-05-27T06:28:53.663 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 38, 2024-05-27T06:28:53.663 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-05-27T06:28:53.663 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-05-27T06:28:53.664 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-05-27T06:28:53.664 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-27T06:28:53.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:53.674 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-05-27T06:28:53.674 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-27T06:28:53.684 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-05-27T06:28:53.684 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-27T06:28:53.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:53.685 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-27T06:28:53.750 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create data_new --pg_num_min 64 2024-05-27T06:28:53.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.949+0000 7f522ca00640 1 Processor -- start 2024-05-27T06:28:53.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.949+0000 7f522ca00640 1 -- start start 2024-05-27T06:28:53.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.953+0000 7f522ca00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5228070b00 0x7f522815fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:53.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.953+0000 7f522ca00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f522806e2a0 0x7f52280aee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:53.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.953+0000 7f522ca00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f522806f7f0 con 0x7f522806d780 2024-05-27T06:28:53.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.953+0000 7f522ca00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f522806fa60 con 0x7f522806e2a0 2024-05-27T06:28:53.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.953+0000 7f522ca00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f522806fd40 con 0x7f5228070b00 2024-05-27T06:28:53.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.953+0000 7f5226800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f522806e2a0 0x7f52280aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:53.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.953+0000 7f521d400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f522806d780 0x7f522806db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:55192/0 (socket says 172.21.15.87:55192) 2024-05-27T06:28:53.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.953+0000 7f521d400640 1 -- 172.21.15.87:0/2083424241 learned_addr learned my addr 172.21.15.87:0/2083424241 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:53.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.953+0000 7f5225e00640 1 --2- 172.21.15.87:0/2083424241 >> v2:172.21.15.149:3300/0 conn(0x7f5228070b00 0x7f522815fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:53.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.953+0000 7f5226800640 1 -- 172.21.15.87:0/2083424241 >> v2:172.21.15.149:3300/0 conn(0x7f5228070b00 msgr2=0x7f522815fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:53.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.953+0000 7f5226800640 1 --2- 172.21.15.87:0/2083424241 >> v2:172.21.15.149:3300/0 conn(0x7f5228070b00 0x7f522815fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:53.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.953+0000 7f5226800640 1 -- 172.21.15.87:0/2083424241 >> v1:172.21.15.87:6789/0 conn(0x7f522806d780 legacy=0x7f522806db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:53.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.953+0000 7f5226800640 1 -- 172.21.15.87:0/2083424241 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5228070020 con 0x7f522806e2a0 2024-05-27T06:28:53.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.953+0000 7f5225400640 1 -- 172.21.15.87:0/2083424241 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2745296322 0 0) 0x7f522806f7f0 con 0x7f522806d780 2024-05-27T06:28:53.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.953+0000 7f5225e00640 1 --2- 172.21.15.87:0/2083424241 >> v2:172.21.15.149:3300/0 conn(0x7f5228070b00 0x7f522815fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:53.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.957+0000 7f5226800640 1 --2- 172.21.15.87:0/2083424241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f522806e2a0 0x7f52280aee90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5228070f70 tx=0x7f522001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da91467b8518e8d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:53.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.957+0000 7f5225400640 1 -- 172.21.15.87:0/2083424241 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52200b2070 con 0x7f522806e2a0 2024-05-27T06:28:53.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.957+0000 7f5225400640 1 -- 172.21.15.87:0/2083424241 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52200a5930 con 0x7f522806e2a0 2024-05-27T06:28:53.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.957+0000 7f5225400640 1 -- 172.21.15.87:0/2083424241 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52200a5d00 con 0x7f522806e2a0 2024-05-27T06:28:53.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.957+0000 7f522ca00640 1 -- 172.21.15.87:0/2083424241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f522806e2a0 msgr2=0x7f52280aee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:53.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.957+0000 7f522ca00640 1 --2- 172.21.15.87:0/2083424241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f522806e2a0 0x7f52280aee90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5228070f70 tx=0x7f522001c870 comp rx=0 tx=0).stop 2024-05-27T06:28:53.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.957+0000 7f522ca00640 1 -- 172.21.15.87:0/2083424241 shutdown_connections 2024-05-27T06:28:53.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.957+0000 7f522ca00640 1 --2- 172.21.15.87:0/2083424241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f522806e2a0 0x7f52280aee90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:53.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.957+0000 7f522ca00640 1 --2- 172.21.15.87:0/2083424241 >> v2:172.21.15.149:3300/0 conn(0x7f5228070b00 0x7f522815fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:53.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.957+0000 7f522ca00640 1 -- 172.21.15.87:0/2083424241 >> 172.21.15.87:0/2083424241 conn(0x7f52280d1be0 msgr2=0x7f52280d1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:53.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.957+0000 7f522ca00640 1 -- 172.21.15.87:0/2083424241 shutdown_connections 2024-05-27T06:28:53.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.957+0000 7f522ca00640 1 -- 172.21.15.87:0/2083424241 wait complete. 2024-05-27T06:28:53.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.957+0000 7f522ca00640 1 Processor -- start 2024-05-27T06:28:53.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.961+0000 7f522ca00640 1 -- start start 2024-05-27T06:28:53.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.961+0000 7f522ca00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f522806d780 0x7f52281fa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:53.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.961+0000 7f522ca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f522806e2a0 0x7f5228151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:53.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.961+0000 7f522ca00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5228070b00 0x7f5228151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:53.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.961+0000 7f522ca00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f52280afd60 con 0x7f5228070b00 2024-05-27T06:28:53.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.961+0000 7f522ca00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f52280afbe0 con 0x7f522806e2a0 2024-05-27T06:28:53.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.961+0000 7f522ca00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f52280afee0 con 0x7f522806d780 2024-05-27T06:28:53.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.961+0000 7f5226800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5228070b00 0x7f5228151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:53.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.961+0000 7f5226800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5228070b00 0x7f5228151da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39994/0 (socket says 172.21.15.87:39994) 2024-05-27T06:28:53.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.961+0000 7f5226800640 1 -- 172.21.15.87:0/82703978 learned_addr learned my addr 172.21.15.87:0/82703978 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:53.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.961+0000 7f521d400640 1 --2- 172.21.15.87:0/82703978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f522806e2a0 0x7f5228151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:53.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.961+0000 7f5225e00640 1 --2- 172.21.15.87:0/82703978 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f522806d780 0x7f52281fa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:53.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.961+0000 7f5226800640 1 -- 172.21.15.87:0/82703978 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f522806d780 msgr2=0x7f52281fa0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:53.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.961+0000 7f5226800640 1 --2- 172.21.15.87:0/82703978 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f522806d780 0x7f52281fa0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:53.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.961+0000 7f5226800640 1 -- 172.21.15.87:0/82703978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f522806e2a0 msgr2=0x7f5228151860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:53.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.961+0000 7f5226800640 1 --2- 172.21.15.87:0/82703978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f522806e2a0 0x7f5228151860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:53.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.961+0000 7f5226800640 1 -- 172.21.15.87:0/82703978 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52281656e0 con 0x7f5228070b00 2024-05-27T06:28:53.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.961+0000 7f521d400640 1 --2- 172.21.15.87:0/82703978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f522806e2a0 0x7f5228151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:53.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.961+0000 7f5225e00640 1 --2- 172.21.15.87:0/82703978 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f522806d780 0x7f52281fa0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:53.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.961+0000 7f5226800640 1 --2- 172.21.15.87:0/82703978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5228070b00 0x7f5228151da0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f52200b0040 tx=0x7f5220019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:53.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.961+0000 7f521ea00640 1 -- 172.21.15.87:0/82703978 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52200b2050 con 0x7f5228070b00 2024-05-27T06:28:53.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.961+0000 7f521ea00640 1 -- 172.21.15.87:0/82703978 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52200b3040 con 0x7f5228070b00 2024-05-27T06:28:53.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.961+0000 7f521ea00640 1 -- 172.21.15.87:0/82703978 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52200ad910 con 0x7f5228070b00 2024-05-27T06:28:53.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.961+0000 7f522ca00640 1 -- 172.21.15.87:0/82703978 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52281659c0 con 0x7f5228070b00 2024-05-27T06:28:53.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.961+0000 7f522ca00640 1 -- 172.21.15.87:0/82703978 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5228162060 con 0x7f5228070b00 2024-05-27T06:28:53.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.961+0000 7f522ca00640 1 -- 172.21.15.87:0/82703978 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f522806aa30 con 0x7f5228070b00 2024-05-27T06:28:53.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.965+0000 7f521ea00640 1 -- 172.21.15.87:0/82703978 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f52200c0020 con 0x7f5228070b00 2024-05-27T06:28:53.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.965+0000 7f521ea00640 1 --2- 172.21.15.87:0/82703978 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f520406f400 0x7f5204071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:53.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.965+0000 7f521ea00640 1 -- 172.21.15.87:0/82703978 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f5220129ff0 con 0x7f5228070b00 2024-05-27T06:28:53.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.965+0000 7f5225e00640 1 --2- 172.21.15.87:0/82703978 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f520406f400 0x7f5204071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:53.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.965+0000 7f5225e00640 1 --2- 172.21.15.87:0/82703978 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f520406f400 0x7f5204071910 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f521800a9b0 tx=0x7f5218008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:53.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:53.969+0000 7f521ea00640 1 -- 172.21.15.87:0/82703978 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f5220016520 con 0x7f5228070b00 2024-05-27T06:28:54.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.129+0000 7f522ca00640 1 -- 172.21.15.87:0/82703978 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64} v 0) -- 0x7f5228069e00 con 0x7f5228070b00 2024-05-27T06:28:54.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.721+0000 7f521ea00640 1 -- 172.21.15.87:0/82703978 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64}]=0 pool 'data_new' created v39) ==== 124+0+0 (secure 0 0 0) 0x7f52200f6d10 con 0x7f5228070b00 2024-05-27T06:28:54.719 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'data_new' created 2024-05-27T06:28:54.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.725+0000 7f522ca00640 1 -- 172.21.15.87:0/82703978 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f520406f400 msgr2=0x7f5204071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:54.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.725+0000 7f522ca00640 1 --2- 172.21.15.87:0/82703978 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f520406f400 0x7f5204071910 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f521800a9b0 tx=0x7f5218008040 comp rx=0 tx=0).stop 2024-05-27T06:28:54.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.725+0000 7f522ca00640 1 -- 172.21.15.87:0/82703978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5228070b00 msgr2=0x7f5228151da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:54.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.725+0000 7f522ca00640 1 --2- 172.21.15.87:0/82703978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5228070b00 0x7f5228151da0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f52200b0040 tx=0x7f5220019610 comp rx=0 tx=0).stop 2024-05-27T06:28:54.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.725+0000 7f522ca00640 1 -- 172.21.15.87:0/82703978 shutdown_connections 2024-05-27T06:28:54.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.725+0000 7f522ca00640 1 --2- 172.21.15.87:0/82703978 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f520406f400 0x7f5204071910 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:54.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.725+0000 7f522ca00640 1 --2- 172.21.15.87:0/82703978 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5228070b00 0x7f5228151da0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:54.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.725+0000 7f522ca00640 1 --2- 172.21.15.87:0/82703978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f522806e2a0 0x7f5228151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:54.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.725+0000 7f522ca00640 1 --2- 172.21.15.87:0/82703978 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f522806d780 0x7f52281fa0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:54.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.725+0000 7f522ca00640 1 -- 172.21.15.87:0/82703978 >> 172.21.15.87:0/82703978 conn(0x7f52280d1be0 msgr2=0x7f52280b1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:54.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.725+0000 7f522ca00640 1 -- 172.21.15.87:0/82703978 shutdown_connections 2024-05-27T06:28:54.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.725+0000 7f522ca00640 1 -- 172.21.15.87:0/82703978 wait complete. 2024-05-27T06:28:54.751 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs data_new 2024-05-27T06:28:54.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.901+0000 7f1f5e200640 1 Processor -- start 2024-05-27T06:28:54.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.901+0000 7f1f5e200640 1 -- start start 2024-05-27T06:28:54.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f5e200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1f58070b00 0x7f1f5815fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:54.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f5e200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f5806d780 0x7f1f5806db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:54.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f5e200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f5806f7f0 con 0x7f1f5806e0d0 2024-05-27T06:28:54.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f5e200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f1f580afea0 con 0x7f1f58070b00 2024-05-27T06:28:54.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f5e200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1f5806fa60 con 0x7f1f5806d780 2024-05-27T06:28:54.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f57e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f1f5806e0d0 0x7f1f581638c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:55890/0 (socket says 172.21.15.87:55890) 2024-05-27T06:28:54.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f57e00640 1 -- 172.21.15.87:0/1546288970 learned_addr learned my addr 172.21.15.87:0/1546288970 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:54.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f56a00640 1 --2- 172.21.15.87:0/1546288970 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f5806d780 0x7f1f5806db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:54.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f57400640 1 --2- 172.21.15.87:0/1546288970 >> v2:172.21.15.149:3300/0 conn(0x7f1f58070b00 0x7f1f5815fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:54.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f56000640 1 -- 172.21.15.87:0/1546288970 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3103790791 0 0) 0x7f1f5806f7f0 con 0x7f1f5806e0d0 2024-05-27T06:28:54.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f56000640 1 -- 172.21.15.87:0/1546288970 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f3c003530 con 0x7f1f5806e0d0 2024-05-27T06:28:54.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f56000640 1 -- 172.21.15.87:0/1546288970 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1774678487 0 0) 0x7f1f3c003530 con 0x7f1f5806e0d0 2024-05-27T06:28:54.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f56000640 1 -- 172.21.15.87:0/1546288970 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f5806d780 msgr2=0x7f1f5806db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:54.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f56000640 1 --2- 172.21.15.87:0/1546288970 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f5806d780 0x7f1f5806db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:54.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f56000640 1 -- 172.21.15.87:0/1546288970 >> v2:172.21.15.149:3300/0 conn(0x7f1f58070b00 msgr2=0x7f1f5815fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:54.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f56000640 1 --2- 172.21.15.87:0/1546288970 >> v2:172.21.15.149:3300/0 conn(0x7f1f58070b00 0x7f1f5815fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:54.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f56000640 1 -- 172.21.15.87:0/1546288970 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5806fd40 con 0x7f1f5806e0d0 2024-05-27T06:28:54.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f56000640 1 -- 172.21.15.87:0/1546288970 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7f1f50001a80 con 0x7f1f5806e0d0 2024-05-27T06:28:54.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f56000640 1 -- 172.21.15.87:0/1546288970 >> v1:172.21.15.87:6789/0 conn(0x7f1f5806e0d0 legacy=0x7f1f581638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:54.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f56000640 1 --2- 172.21.15.87:0/1546288970 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f3c003a10 0x7f1f3c003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:54.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f56000640 1 --2- 172.21.15.87:0/1546288970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f3c004810 0x7f1f3c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:54.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f56000640 1 --2- 172.21.15.87:0/1546288970 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f3c005160 0x7f1f3c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:54.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f56000640 1 -- 172.21.15.87:0/1546288970 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1f580afea0 con 0x7f1f3c004810 2024-05-27T06:28:54.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f56000640 1 -- 172.21.15.87:0/1546288970 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5806fa60 con 0x7f1f3c003a10 2024-05-27T06:28:54.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f56000640 1 -- 172.21.15.87:0/1546288970 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1f3c00c0c0 con 0x7f1f3c005160 2024-05-27T06:28:54.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f56a00640 1 --2- 172.21.15.87:0/1546288970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f3c004810 0x7f1f3c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:54.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f57e00640 1 --2- 172.21.15.87:0/1546288970 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f3c005160 0x7f1f3c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:54.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f57400640 1 --2- 172.21.15.87:0/1546288970 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f3c003a10 0x7f1f3c003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:54.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f56a00640 1 -- 172.21.15.87:0/1546288970 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f3c005160 msgr2=0x7f1f3c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:54.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f56a00640 1 --2- 172.21.15.87:0/1546288970 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f3c005160 0x7f1f3c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:54.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f56a00640 1 -- 172.21.15.87:0/1546288970 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f3c003a10 msgr2=0x7f1f3c003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:54.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f56a00640 1 --2- 172.21.15.87:0/1546288970 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f3c003a10 0x7f1f3c003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:54.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f56a00640 1 -- 172.21.15.87:0/1546288970 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f3c003530 con 0x7f1f3c004810 2024-05-27T06:28:54.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.905+0000 7f1f57e00640 1 --2- 172.21.15.87:0/1546288970 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f3c005160 0x7f1f3c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:54.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.909+0000 7f1f56a00640 1 --2- 172.21.15.87:0/1546288970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f3c004810 0x7f1f3c004c20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1f580731e0 tx=0x7f1f4401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec56f870d249683a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:54.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.909+0000 7f1f56000640 1 -- 172.21.15.87:0/1546288970 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f44009670 con 0x7f1f3c004810 2024-05-27T06:28:54.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.909+0000 7f1f56000640 1 -- 172.21.15.87:0/1546288970 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f440a93f0 con 0x7f1f3c004810 2024-05-27T06:28:54.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.909+0000 7f1f56000640 1 -- 172.21.15.87:0/1546288970 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f440a97a0 con 0x7f1f3c004810 2024-05-27T06:28:54.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.909+0000 7f1f5e200640 1 -- 172.21.15.87:0/1546288970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f3c004810 msgr2=0x7f1f3c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:54.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.909+0000 7f1f5e200640 1 --2- 172.21.15.87:0/1546288970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f3c004810 0x7f1f3c004c20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1f580731e0 tx=0x7f1f4401c8e0 comp rx=0 tx=0).stop 2024-05-27T06:28:54.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.909+0000 7f1f57e00640 1 -- 172.21.15.87:0/1546288970 reap_dead start 2024-05-27T06:28:54.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.909+0000 7f1f5e200640 1 -- 172.21.15.87:0/1546288970 shutdown_connections 2024-05-27T06:28:54.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.909+0000 7f1f5e200640 1 -- 172.21.15.87:0/1546288970 >> 172.21.15.87:0/1546288970 conn(0x7f1f580d1be0 msgr2=0x7f1f580d1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:54.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.909+0000 7f1f5e200640 1 -- 172.21.15.87:0/1546288970 shutdown_connections 2024-05-27T06:28:54.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.909+0000 7f1f5e200640 1 -- 172.21.15.87:0/1546288970 wait complete. 2024-05-27T06:28:54.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.913+0000 7f1f5e200640 1 Processor -- start 2024-05-27T06:28:54.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.913+0000 7f1f5e200640 1 -- start start 2024-05-27T06:28:54.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.913+0000 7f1f5e200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f3c004810 0x7f1f581611d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:54.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.913+0000 7f1f5e200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f581434f0 0x7f1f5815b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:54.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.913+0000 7f1f5e200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f5815b770 0x7f1f5815e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:54.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.913+0000 7f1f5e200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5806e4e0 con 0x7f1f5815b770 2024-05-27T06:28:54.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.913+0000 7f1f5e200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5806cf80 con 0x7f1f3c004810 2024-05-27T06:28:54.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.913+0000 7f1f5e200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1f5816aa20 con 0x7f1f581434f0 2024-05-27T06:28:54.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.913+0000 7f1f57e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f5815b770 0x7f1f5815e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:54.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.913+0000 7f1f57e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f5815b770 0x7f1f5815e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33758/0 (socket says 172.21.15.87:33758) 2024-05-27T06:28:54.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.913+0000 7f1f57e00640 1 -- 172.21.15.87:0/3924360690 learned_addr learned my addr 172.21.15.87:0/3924360690 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:54.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.917+0000 7f1f57400640 1 --2- 172.21.15.87:0/3924360690 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f3c004810 0x7f1f581611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:54.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.917+0000 7f1f56a00640 1 --2- 172.21.15.87:0/3924360690 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f581434f0 0x7f1f5815b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:54.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.917+0000 7f1f57e00640 1 -- 172.21.15.87:0/3924360690 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f581434f0 msgr2=0x7f1f5815b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:54.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.917+0000 7f1f57e00640 1 --2- 172.21.15.87:0/3924360690 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f581434f0 0x7f1f5815b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:54.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.917+0000 7f1f57e00640 1 -- 172.21.15.87:0/3924360690 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f3c004810 msgr2=0x7f1f581611d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:54.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.917+0000 7f1f57e00640 1 --2- 172.21.15.87:0/3924360690 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f3c004810 0x7f1f581611d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:54.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.917+0000 7f1f57e00640 1 -- 172.21.15.87:0/3924360690 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5815d040 con 0x7f1f5815b770 2024-05-27T06:28:54.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.917+0000 7f1f57e00640 1 --2- 172.21.15.87:0/3924360690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f5815b770 0x7f1f5815e5a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1f580b48c0 tx=0x7f1f50007be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:54.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.917+0000 7f1f4f400640 1 -- 172.21.15.87:0/3924360690 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5000ea80 con 0x7f1f5815b770 2024-05-27T06:28:54.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.917+0000 7f1f4f400640 1 -- 172.21.15.87:0/3924360690 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f5000ec60 con 0x7f1f5815b770 2024-05-27T06:28:54.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.917+0000 7f1f4f400640 1 -- 172.21.15.87:0/3924360690 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5000ee50 con 0x7f1f5815b770 2024-05-27T06:28:54.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.917+0000 7f1f5e200640 1 -- 172.21.15.87:0/3924360690 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f5815c280 con 0x7f1f5815b770 2024-05-27T06:28:54.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.917+0000 7f1f5e200640 1 -- 172.21.15.87:0/3924360690 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f58161760 con 0x7f1f5815b770 2024-05-27T06:28:54.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.917+0000 7f1f5e200640 1 -- 172.21.15.87:0/3924360690 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f5815cdb0 con 0x7f1f5815b770 2024-05-27T06:28:54.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.917+0000 7f1f4f400640 1 -- 172.21.15.87:0/3924360690 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1f5001a020 con 0x7f1f5815b770 2024-05-27T06:28:54.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.917+0000 7f1f4f400640 1 --2- 172.21.15.87:0/3924360690 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f1f3806f430 0x7f1f38071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:54.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.921+0000 7f1f4f400640 1 -- 172.21.15.87:0/3924360690 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6464+0+0 (secure 0 0 0) 0x7f1f5008f270 con 0x7f1f5815b770 2024-05-27T06:28:54.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.921+0000 7f1f57400640 1 --2- 172.21.15.87:0/3924360690 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f1f3806f430 0x7f1f38071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:54.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.921+0000 7f1f57400640 1 --2- 172.21.15.87:0/3924360690 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f1f3806f430 0x7f1f38071940 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1f48009ba0 tx=0x7f1f48008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:54.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:54.925+0000 7f1f4f400640 1 -- 172.21.15.87:0/3924360690 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f1f5815d040 con 0x7f1f5815b770 2024-05-27T06:28:55.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.117+0000 7f1f5e200640 1 -- 172.21.15.87:0/3924360690 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"} v 0) -- 0x7f1f5806aa30 con 0x7f1f5815b770 2024-05-27T06:28:55.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.737+0000 7f1f4f400640 1 -- 172.21.15.87:0/3924360690 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"}]=0 added data pool 7 to fsmap v19) ==== 131+0+0 (secure 0 0 0) 0x7f1f50062e20 con 0x7f1f5815b770 2024-05-27T06:28:55.735 INFO:teuthology.orchestra.run.smithi087.stderr:added data pool 7 to fsmap 2024-05-27T06:28:55.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.741+0000 7f1f5e200640 1 -- 172.21.15.87:0/3924360690 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f1f3806f430 msgr2=0x7f1f38071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:55.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.741+0000 7f1f5e200640 1 --2- 172.21.15.87:0/3924360690 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f1f3806f430 0x7f1f38071940 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1f48009ba0 tx=0x7f1f48008040 comp rx=0 tx=0).stop 2024-05-27T06:28:55.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.741+0000 7f1f5e200640 1 -- 172.21.15.87:0/3924360690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f5815b770 msgr2=0x7f1f5815e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:55.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.741+0000 7f1f5e200640 1 --2- 172.21.15.87:0/3924360690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f5815b770 0x7f1f5815e5a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1f580b48c0 tx=0x7f1f50007be0 comp rx=0 tx=0).stop 2024-05-27T06:28:55.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.741+0000 7f1f5e200640 1 -- 172.21.15.87:0/3924360690 shutdown_connections 2024-05-27T06:28:55.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.741+0000 7f1f5e200640 1 --2- 172.21.15.87:0/3924360690 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f1f3806f430 0x7f1f38071940 secure :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1f48009ba0 tx=0x7f1f48008040 comp rx=0 tx=0).stop 2024-05-27T06:28:55.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.741+0000 7f1f5e200640 1 --2- 172.21.15.87:0/3924360690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f5815b770 0x7f1f5815e5a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:55.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.741+0000 7f1f5e200640 1 --2- 172.21.15.87:0/3924360690 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f581434f0 0x7f1f5815b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:55.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.741+0000 7f1f5e200640 1 --2- 172.21.15.87:0/3924360690 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f3c004810 0x7f1f581611d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:55.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.741+0000 7f1f5e200640 1 -- 172.21.15.87:0/3924360690 >> 172.21.15.87:0/3924360690 conn(0x7f1f580d1be0 msgr2=0x7f1f581662d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:55.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.741+0000 7f1f5e200640 1 -- 172.21.15.87:0/3924360690 shutdown_connections 2024-05-27T06:28:55.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.741+0000 7f1f5e200640 1 -- 172.21.15.87:0/3924360690 wait complete. 2024-05-27T06:28:55.767 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T06:28:55.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.917+0000 7fef6f400640 1 Processor -- start 2024-05-27T06:28:55.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.917+0000 7fef6f400640 1 -- start start 2024-05-27T06:28:55.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.917+0000 7fef6f400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fef6806e320 0x7fef680b5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:55.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.917+0000 7fef6f400640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef680af650 con 0x7fef6806d430 2024-05-27T06:28:55.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.917+0000 7fef6f400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef680b6050 con 0x7fef680b5c40 2024-05-27T06:28:55.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.917+0000 7fef6f400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fef6806fe30 con 0x7fef6806e320 2024-05-27T06:28:55.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.917+0000 7fef6ca00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fef6806d430 0x7fef680aef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:55906/0 (socket says 172.21.15.87:55906) 2024-05-27T06:28:55.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.917+0000 7fef6ca00640 1 -- 172.21.15.87:0/4135359753 learned_addr learned my addr 172.21.15.87:0/4135359753 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:55.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.917+0000 7fef67e00640 1 --2- 172.21.15.87:0/4135359753 >> v2:172.21.15.149:3300/0 conn(0x7fef6806e320 0x7fef680b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:55.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.917+0000 7fef67400640 1 -- 172.21.15.87:0/4135359753 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2834163057 0 0) 0x7fef58001120 con 0x7fef6806d430 2024-05-27T06:28:55.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.917+0000 7fef67400640 1 -- 172.21.15.87:0/4135359753 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef4c003530 con 0x7fef6806d430 2024-05-27T06:28:55.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.917+0000 7fef67400640 1 -- 172.21.15.87:0/4135359753 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3136198748 0 0) 0x7fef600014a0 con 0x7fef680b5c40 2024-05-27T06:28:55.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.917+0000 7fef67400640 1 -- 172.21.15.87:0/4135359753 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef58001120 con 0x7fef680b5c40 2024-05-27T06:28:55.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.921+0000 7fef67400640 1 -- 172.21.15.87:0/4135359753 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2955112591 0 0) 0x7fef4c003530 con 0x7fef6806d430 2024-05-27T06:28:55.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.921+0000 7fef67e00640 1 -- 172.21.15.87:0/4135359753 >> v1:172.21.15.149:6789/0 conn(0x7fef680b5c40 legacy=0x7fef680702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:55.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.921+0000 7fef67e00640 1 -- 172.21.15.87:0/4135359753 >> v1:172.21.15.87:6789/0 conn(0x7fef6806d430 legacy=0x7fef680aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:55.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.921+0000 7fef67e00640 1 -- 172.21.15.87:0/4135359753 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef6806f240 con 0x7fef6806e320 2024-05-27T06:28:55.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.921+0000 7fef67e00640 1 --2- 172.21.15.87:0/4135359753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef6806e320 0x7fef680b5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fef540097c0 tx=0x7fef5401c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4091bce83dcc9be4 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:55.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.921+0000 7fef67400640 1 -- 172.21.15.87:0/4135359753 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef540b0070 con 0x7fef6806e320 2024-05-27T06:28:55.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.921+0000 7fef67400640 1 -- 172.21.15.87:0/4135359753 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef540ab400 con 0x7fef6806e320 2024-05-27T06:28:55.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.921+0000 7fef67400640 1 -- 172.21.15.87:0/4135359753 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef580018d0 con 0x7fef6806e320 2024-05-27T06:28:55.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.925+0000 7fef6f400640 1 -- 172.21.15.87:0/4135359753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef6806e320 msgr2=0x7fef680b5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:55.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.925+0000 7fef6f400640 1 --2- 172.21.15.87:0/4135359753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef6806e320 0x7fef680b5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fef540097c0 tx=0x7fef5401c3a0 comp rx=0 tx=0).stop 2024-05-27T06:28:55.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.925+0000 7fef6f400640 1 -- 172.21.15.87:0/4135359753 shutdown_connections 2024-05-27T06:28:55.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.925+0000 7fef6f400640 1 --2- 172.21.15.87:0/4135359753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef6806e320 0x7fef680b5700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:55.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.925+0000 7fef6f400640 1 -- 172.21.15.87:0/4135359753 >> 172.21.15.87:0/4135359753 conn(0x7fef680d1e70 msgr2=0x7fef680d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:55.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.925+0000 7fef6f400640 1 -- 172.21.15.87:0/4135359753 shutdown_connections 2024-05-27T06:28:55.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.925+0000 7fef6f400640 1 -- 172.21.15.87:0/4135359753 wait complete. 2024-05-27T06:28:55.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.925+0000 7fef6f400640 1 Processor -- start 2024-05-27T06:28:55.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.925+0000 7fef6f400640 1 -- start start 2024-05-27T06:28:55.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.929+0000 7fef6f400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef6806d430 0x7fef68141930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:55.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.929+0000 7fef6f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef6806e320 0x7fef680b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:55.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.929+0000 7fef6f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef680b5c40 0x7fef680b3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:55.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.929+0000 7fef6f400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fef68070de0 con 0x7fef6806d430 2024-05-27T06:28:55.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.929+0000 7fef6f400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fef6806fac0 con 0x7fef6806e320 2024-05-27T06:28:55.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.929+0000 7fef6f400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fef6806e730 con 0x7fef680b5c40 2024-05-27T06:28:55.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.929+0000 7fef6ca00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef6806d430 0x7fef68141930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:55.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.929+0000 7fef6ca00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef6806d430 0x7fef68141930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33760/0 (socket says 172.21.15.87:33760) 2024-05-27T06:28:55.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.929+0000 7fef6ca00640 1 -- 172.21.15.87:0/3153049028 learned_addr learned my addr 172.21.15.87:0/3153049028 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:55.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.929+0000 7fef67e00640 1 --2- 172.21.15.87:0/3153049028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef6806e320 0x7fef680b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:55.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.929+0000 7fef6d400640 1 --2- 172.21.15.87:0/3153049028 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef680b5c40 0x7fef680b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:55.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.929+0000 7fef6ca00640 1 -- 172.21.15.87:0/3153049028 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef680b5c40 msgr2=0x7fef680b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:55.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.929+0000 7fef6ca00640 1 --2- 172.21.15.87:0/3153049028 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef680b5c40 0x7fef680b3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:55.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.929+0000 7fef6ca00640 1 -- 172.21.15.87:0/3153049028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef6806e320 msgr2=0x7fef680b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:55.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.929+0000 7fef6ca00640 1 --2- 172.21.15.87:0/3153049028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef6806e320 0x7fef680b2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:55.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.929+0000 7fef6ca00640 1 -- 172.21.15.87:0/3153049028 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef68141e70 con 0x7fef6806d430 2024-05-27T06:28:55.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.929+0000 7fef67e00640 1 --2- 172.21.15.87:0/3153049028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef6806e320 0x7fef680b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:55.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.929+0000 7fef6d400640 1 --2- 172.21.15.87:0/3153049028 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef680b5c40 0x7fef680b3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:55.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.929+0000 7fef6ca00640 1 --2- 172.21.15.87:0/3153049028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef6806d430 0x7fef68141930 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fef5800c700 tx=0x7fef5800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:55.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.929+0000 7fef64c00640 1 -- 172.21.15.87:0/3153049028 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef58017070 con 0x7fef6806d430 2024-05-27T06:28:55.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.929+0000 7fef64c00640 1 -- 172.21.15.87:0/3153049028 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef58005cf0 con 0x7fef6806d430 2024-05-27T06:28:55.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.929+0000 7fef64c00640 1 -- 172.21.15.87:0/3153049028 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef58007290 con 0x7fef6806d430 2024-05-27T06:28:55.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.929+0000 7fef6f400640 1 -- 172.21.15.87:0/3153049028 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef68153730 con 0x7fef6806d430 2024-05-27T06:28:55.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.929+0000 7fef6f400640 1 -- 172.21.15.87:0/3153049028 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef68153cf0 con 0x7fef6806d430 2024-05-27T06:28:55.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.929+0000 7fef6f400640 1 -- 172.21.15.87:0/3153049028 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef6806aa30 con 0x7fef6806d430 2024-05-27T06:28:55.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.929+0000 7fef64c00640 1 -- 172.21.15.87:0/3153049028 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fef5801a070 con 0x7fef6806d430 2024-05-27T06:28:55.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.933+0000 7fef64c00640 1 --2- 172.21.15.87:0/3153049028 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fef4806f400 0x7fef48071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:55.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.933+0000 7fef64c00640 1 -- 172.21.15.87:0/3153049028 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6496+0+0 (secure 0 0 0) 0x7fef5808ebd0 con 0x7fef6806d430 2024-05-27T06:28:55.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.933+0000 7fef67e00640 1 --2- 172.21.15.87:0/3153049028 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fef4806f400 0x7fef48071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:55.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.933+0000 7fef67e00640 1 --2- 172.21.15.87:0/3153049028 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fef4806f400 0x7fef48071910 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fef540ad000 tx=0x7fef54008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:55.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:55.937+0000 7fef64c00640 1 -- 172.21.15.87:0/3153049028 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fef680af650 con 0x7fef6806d430 2024-05-27T06:28:56.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.125+0000 7fef6f400640 1 -- 172.21.15.87:0/3153049028 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef68163600 con 0x7fef6806d430 2024-05-27T06:28:56.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.125+0000 7fef64c00640 1 -- 172.21.15.87:0/3153049028 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5180 (secure 0 0 0) 0x7fef5805b840 con 0x7fef6806d430 2024-05-27T06:28:56.125 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:56.125 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/662047769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":662047769},{"type":"v1","addr":"172.21.15.87:6837","nonce":662047769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4861,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/553113849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":553113849},{"type":"v1","addr":"172.21.15.149:6834","nonce":553113849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/381728425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":381728425},{"type":"v1","addr":"172.21.15.149:6835","nonce":381728425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T06:28:41.065900+0000","modified":"2024-05-27T06:28:55.121337+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2661735568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2661735568},{"type":"v1","addr":"172.21.15.87:6835","nonce":2661735568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4920,"qdb_cluster":[4920]},"id":2}]} 2024-05-27T06:28:56.126 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 19 2024-05-27T06:28:56.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.129+0000 7fef6f400640 1 -- 172.21.15.87:0/3153049028 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fef4806f400 msgr2=0x7fef48071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:56.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.129+0000 7fef6f400640 1 --2- 172.21.15.87:0/3153049028 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fef4806f400 0x7fef48071910 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fef540ad000 tx=0x7fef54008040 comp rx=0 tx=0).stop 2024-05-27T06:28:56.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.129+0000 7fef6f400640 1 -- 172.21.15.87:0/3153049028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef6806d430 msgr2=0x7fef68141930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:56.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.129+0000 7fef6f400640 1 --2- 172.21.15.87:0/3153049028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef6806d430 0x7fef68141930 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fef5800c700 tx=0x7fef5800cbc0 comp rx=0 tx=0).stop 2024-05-27T06:28:56.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.129+0000 7fef6f400640 1 -- 172.21.15.87:0/3153049028 shutdown_connections 2024-05-27T06:28:56.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.129+0000 7fef6f400640 1 --2- 172.21.15.87:0/3153049028 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fef4806f400 0x7fef48071910 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:56.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.129+0000 7fef6f400640 1 --2- 172.21.15.87:0/3153049028 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef680b5c40 0x7fef680b3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:56.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.129+0000 7fef6f400640 1 --2- 172.21.15.87:0/3153049028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef6806e320 0x7fef680b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:56.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.129+0000 7fef6f400640 1 --2- 172.21.15.87:0/3153049028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef6806d430 0x7fef68141930 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:56.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.129+0000 7fef6f400640 1 -- 172.21.15.87:0/3153049028 >> 172.21.15.87:0/3153049028 conn(0x7fef680d1e70 msgr2=0x7fef680701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:56.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.129+0000 7fef6f400640 1 -- 172.21.15.87:0/3153049028 shutdown_connections 2024-05-27T06:28:56.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.129+0000 7fef6f400640 1 -- 172.21.15.87:0/3153049028 wait complete. 2024-05-27T06:28:56.147 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T06:28:56.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.293+0000 7f7e44e00640 1 Processor -- start 2024-05-27T06:28:56.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.293+0000 7f7e44e00640 1 -- start start 2024-05-27T06:28:56.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.297+0000 7f7e44e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7e400cbf90 0x7f7e4006cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:56.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.297+0000 7f7e44e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e4006d500 0x7f7e4015cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:56.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.297+0000 7f7e44e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7e4015d520 0x7f7e400d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:56.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.297+0000 7f7e44e00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f7e4006d910 con 0x7f7e4015d520 2024-05-27T06:28:56.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.297+0000 7f7e44e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f7e4015d930 con 0x7f7e400cbf90 2024-05-27T06:28:56.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.297+0000 7f7e44e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7e4015dbb0 con 0x7f7e4006d500 2024-05-27T06:28:56.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.297+0000 7f7e3e800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7e4015d520 0x7f7e400d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:56.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.297+0000 7f7e3e800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7e4015d520 0x7f7e400d1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33774/0 (socket says 172.21.15.87:33774) 2024-05-27T06:28:56.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.297+0000 7f7e3e800640 1 -- 172.21.15.87:0/1494794739 learned_addr learned my addr 172.21.15.87:0/1494794739 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:56.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.297+0000 7f7e3de00640 1 --2- 172.21.15.87:0/1494794739 >> v2:172.21.15.149:3300/0 conn(0x7f7e400cbf90 0x7f7e4006cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:56.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.297+0000 7f7e35400640 1 --2- 172.21.15.87:0/1494794739 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e4006d500 0x7f7e4015cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:56.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.297+0000 7f7e3e800640 1 -- 172.21.15.87:0/1494794739 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e4006d500 msgr2=0x7f7e4015cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:56.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.297+0000 7f7e3e800640 1 --2- 172.21.15.87:0/1494794739 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e4006d500 0x7f7e4015cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:56.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.297+0000 7f7e3e800640 1 -- 172.21.15.87:0/1494794739 >> v2:172.21.15.149:3300/0 conn(0x7f7e400cbf90 msgr2=0x7f7e4006cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:56.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.297+0000 7f7e3e800640 1 --2- 172.21.15.87:0/1494794739 >> v2:172.21.15.149:3300/0 conn(0x7f7e400cbf90 0x7f7e4006cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:56.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.297+0000 7f7e3e800640 1 -- 172.21.15.87:0/1494794739 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e4015de90 con 0x7f7e4015d520 2024-05-27T06:28:56.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.301+0000 7f7e3e800640 1 --2- 172.21.15.87:0/1494794739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e4015d520 0x7f7e400d1740 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7e40070560 tx=0x7f7e380213e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1a2a986d5e11bd server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:56.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.301+0000 7f7e3d400640 1 -- 172.21.15.87:0/1494794739 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e380b6070 con 0x7f7e4015d520 2024-05-27T06:28:56.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.301+0000 7f7e3d400640 1 -- 172.21.15.87:0/1494794739 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e3800b2d0 con 0x7f7e4015d520 2024-05-27T06:28:56.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.301+0000 7f7e3d400640 1 -- 172.21.15.87:0/1494794739 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3800b480 con 0x7f7e4015d520 2024-05-27T06:28:56.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.301+0000 7f7e44e00640 1 -- 172.21.15.87:0/1494794739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e4015d520 msgr2=0x7f7e400d1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:56.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.301+0000 7f7e44e00640 1 --2- 172.21.15.87:0/1494794739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e4015d520 0x7f7e400d1740 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7e40070560 tx=0x7f7e380213e0 comp rx=0 tx=0).stop 2024-05-27T06:28:56.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.301+0000 7f7e44e00640 1 -- 172.21.15.87:0/1494794739 shutdown_connections 2024-05-27T06:28:56.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.301+0000 7f7e44e00640 1 --2- 172.21.15.87:0/1494794739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e4015d520 0x7f7e400d1740 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:56.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.301+0000 7f7e44e00640 1 --2- 172.21.15.87:0/1494794739 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e4006d500 0x7f7e4015cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:56.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.301+0000 7f7e44e00640 1 --2- 172.21.15.87:0/1494794739 >> v2:172.21.15.149:3300/0 conn(0x7f7e400cbf90 0x7f7e4006cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:56.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.301+0000 7f7e44e00640 1 -- 172.21.15.87:0/1494794739 >> 172.21.15.87:0/1494794739 conn(0x7f7e400b46b0 msgr2=0x7f7e400b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:56.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.301+0000 7f7e44e00640 1 -- 172.21.15.87:0/1494794739 shutdown_connections 2024-05-27T06:28:56.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.301+0000 7f7e44e00640 1 -- 172.21.15.87:0/1494794739 wait complete. 2024-05-27T06:28:56.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.301+0000 7f7e44e00640 1 Processor -- start 2024-05-27T06:28:56.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.301+0000 7f7e44e00640 1 -- start start 2024-05-27T06:28:56.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.305+0000 7f7e44e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e4006d500 0x7f7e401fa0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:56.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.305+0000 7f7e44e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e400cbf90 0x7f7e400c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:56.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.305+0000 7f7e44e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e4015d520 0x7f7e4014f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:56.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.305+0000 7f7e44e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4015e170 con 0x7f7e4006d500 2024-05-27T06:28:56.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.305+0000 7f7e44e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4006caa0 con 0x7f7e4015d520 2024-05-27T06:28:56.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.305+0000 7f7e44e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7e400cc3a0 con 0x7f7e400cbf90 2024-05-27T06:28:56.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.305+0000 7f7e3de00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e4006d500 0x7f7e401fa0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:56.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.305+0000 7f7e3de00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e4006d500 0x7f7e401fa0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33788/0 (socket says 172.21.15.87:33788) 2024-05-27T06:28:56.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.305+0000 7f7e3de00640 1 -- 172.21.15.87:0/1764119983 learned_addr learned my addr 172.21.15.87:0/1764119983 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:56.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.305+0000 7f7e35400640 1 --2- 172.21.15.87:0/1764119983 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e400cbf90 0x7f7e400c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:56.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.305+0000 7f7e3e800640 1 --2- 172.21.15.87:0/1764119983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e4015d520 0x7f7e4014f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:56.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.305+0000 7f7e3de00640 1 -- 172.21.15.87:0/1764119983 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e400cbf90 msgr2=0x7f7e400c85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:56.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.305+0000 7f7e3de00640 1 --2- 172.21.15.87:0/1764119983 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e400cbf90 0x7f7e400c85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:56.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.305+0000 7f7e3de00640 1 -- 172.21.15.87:0/1764119983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e4015d520 msgr2=0x7f7e4014f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:56.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.305+0000 7f7e3de00640 1 --2- 172.21.15.87:0/1764119983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e4015d520 0x7f7e4014f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:56.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.305+0000 7f7e3de00640 1 -- 172.21.15.87:0/1764119983 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e40152c40 con 0x7f7e4006d500 2024-05-27T06:28:56.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.305+0000 7f7e3de00640 1 --2- 172.21.15.87:0/1764119983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e4006d500 0x7f7e401fa0e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000e8a0 tx=0x7f7e3000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:56.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.305+0000 7f7e36a00640 1 -- 172.21.15.87:0/1764119983 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e30017070 con 0x7f7e4006d500 2024-05-27T06:28:56.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.305+0000 7f7e36a00640 1 -- 172.21.15.87:0/1764119983 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e3000c940 con 0x7f7e4006d500 2024-05-27T06:28:56.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.305+0000 7f7e44e00640 1 -- 172.21.15.87:0/1764119983 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e40152f20 con 0x7f7e4006d500 2024-05-27T06:28:56.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.305+0000 7f7e36a00640 1 -- 172.21.15.87:0/1764119983 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3000ccf0 con 0x7f7e4006d500 2024-05-27T06:28:56.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.305+0000 7f7e44e00640 1 -- 172.21.15.87:0/1764119983 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e400b0a50 con 0x7f7e4006d500 2024-05-27T06:28:56.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.305+0000 7f7e44e00640 1 -- 172.21.15.87:0/1764119983 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e4006aa30 con 0x7f7e4006d500 2024-05-27T06:28:56.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.309+0000 7f7e36a00640 1 -- 172.21.15.87:0/1764119983 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7e3001a070 con 0x7f7e4006d500 2024-05-27T06:28:56.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.309+0000 7f7e36a00640 1 --2- 172.21.15.87:0/1764119983 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7e1c06f400 0x7f7e1c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:56.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.309+0000 7f7e36a00640 1 -- 172.21.15.87:0/1764119983 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6496+0+0 (secure 0 0 0) 0x7f7e3008f820 con 0x7f7e4006d500 2024-05-27T06:28:56.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.309+0000 7f7e35400640 1 --2- 172.21.15.87:0/1764119983 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7e1c06f400 0x7f7e1c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:56.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.309+0000 7f7e35400640 1 --2- 172.21.15.87:0/1764119983 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7e1c06f400 0x7f7e1c071910 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7e400b08b0 tx=0x7f7e28008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:56.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.313+0000 7f7e36a00640 1 -- 172.21.15.87:0/1764119983 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7e3005c490 con 0x7f7e4006d500 2024-05-27T06:28:56.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.473+0000 7f7e44e00640 1 -- 172.21.15.87:0/1764119983 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7e400b0520 con 0x7f7e4006d500 2024-05-27T06:28:56.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.473+0000 7f7e36a00640 1 -- 172.21.15.87:0/1764119983 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+18755 (secure 0 0 0) 0x7f7e3005bd90 con 0x7f7e4006d500 2024-05-27T06:28:56.472 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:28:56.472 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":40,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:28:55.121034+0000","last_up_change":"2024-05-27T06:27:25.988592+0000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T06:27:26.590191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-27T06:28:39.228886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-27T06:28:40.012993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2024-05-27T06:28:54.140490+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6801","nonce":3674824716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6803","nonce":3674824716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6807","nonce":3674824716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6805","nonce":3674824716}]},"public_addr":"172.21.15.87:6801/3674824716","cluster_addr":"172.21.15.87:6803/3674824716","heartbeat_back_addr":"172.21.15.87:6807/3674824716","heartbeat_front_addr":"172.21.15.87:6805/3674824716","state":["exists","up"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6809","nonce":2443981288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6811","nonce":2443981288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6815","nonce":2443981288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6813","nonce":2443981288}]},"public_addr":"172.21.15.87:6809/2443981288","cluster_addr":"172.21.15.87:6811/2443981288","heartbeat_back_addr":"172.21.15.87:6815/2443981288","heartbeat_front_addr":"172.21.15.87:6813/2443981288","state":["exists","up"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6819","nonce":1441249238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6823","nonce":1441249238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6831","nonce":1441249238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6825","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6827","nonce":1441249238}]},"public_addr":"172.21.15.87:6819/1441249238","cluster_addr":"172.21.15.87:6823/1441249238","heartbeat_back_addr":"172.21.15.87:6831/1441249238","heartbeat_front_addr":"172.21.15.87:6827/1441249238","state":["exists","up"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6818","nonce":1173805234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6822","nonce":1173805234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6829","nonce":1173805234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6826","nonce":1173805234}]},"public_addr":"172.21.15.87:6818/1173805234","cluster_addr":"172.21.15.87:6822/1173805234","heartbeat_back_addr":"172.21.15.87:6829/1173805234","heartbeat_front_addr":"172.21.15.87:6826/1173805234","state":["exists","up"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6819","nonce":1551871079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6823","nonce":1551871079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6831","nonce":1551871079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6827","nonce":1551871079}]},"public_addr":"172.21.15.149:6819/1551871079","cluster_addr":"172.21.15.149:6823/1551871079","heartbeat_back_addr":"172.21.15.149:6831/1551871079","heartbeat_front_addr":"172.21.15.149:6827/1551871079","state":["exists","up"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6818","nonce":582864816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6822","nonce":582864816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6830","nonce":582864816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6826","nonce":582864816}]},"public_addr":"172.21.15.149:6818/582864816","cluster_addr":"172.21.15.149:6822/582864816","heartbeat_back_addr":"172.21.15.149:6830/582864816","heartbeat_front_addr":"172.21.15.149:6826/582864816","state":["exists","up"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6801","nonce":531351314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6803","nonce":531351314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6807","nonce":531351314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6805","nonce":531351314}]},"public_addr":"172.21.15.149:6801/531351314","cluster_addr":"172.21.15.149:6803/531351314","heartbeat_back_addr":"172.21.15.149:6807/531351314","heartbeat_front_addr":"172.21.15.149:6805/531351314","state":["exists","up"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6809","nonce":1171039913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6811","nonce":1171039913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6815","nonce":1171039913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6813","nonce":1171039913}]},"public_addr":"172.21.15.149:6809/1171039913","cluster_addr":"172.21.15.149:6811/1171039913","heartbeat_back_addr":"172.21.15.149:6815/1171039913","heartbeat_front_addr":"172.21.15.149:6813/1171039913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.589776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.819787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.767566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.683842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.038885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.120319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.687007+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.812832+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:28:56.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.477+0000 7f7e44e00640 1 -- 172.21.15.87:0/1764119983 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7e1c06f400 msgr2=0x7f7e1c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:56.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.477+0000 7f7e44e00640 1 --2- 172.21.15.87:0/1764119983 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7e1c06f400 0x7f7e1c071910 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7e400b08b0 tx=0x7f7e28008040 comp rx=0 tx=0).stop 2024-05-27T06:28:56.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.477+0000 7f7e44e00640 1 -- 172.21.15.87:0/1764119983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e4006d500 msgr2=0x7f7e401fa0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:56.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.477+0000 7f7e44e00640 1 --2- 172.21.15.87:0/1764119983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e4006d500 0x7f7e401fa0e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000e8a0 tx=0x7f7e3000eca0 comp rx=0 tx=0).stop 2024-05-27T06:28:56.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.477+0000 7f7e44e00640 1 -- 172.21.15.87:0/1764119983 shutdown_connections 2024-05-27T06:28:56.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.477+0000 7f7e44e00640 1 --2- 172.21.15.87:0/1764119983 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7e1c06f400 0x7f7e1c071910 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:56.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.477+0000 7f7e44e00640 1 --2- 172.21.15.87:0/1764119983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e4015d520 0x7f7e4014f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:56.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.477+0000 7f7e44e00640 1 --2- 172.21.15.87:0/1764119983 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e400cbf90 0x7f7e400c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:56.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.477+0000 7f7e44e00640 1 --2- 172.21.15.87:0/1764119983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e4006d500 0x7f7e401fa0e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:56.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.477+0000 7f7e44e00640 1 -- 172.21.15.87:0/1764119983 >> 172.21.15.87:0/1764119983 conn(0x7f7e400b46b0 msgr2=0x7f7e400afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:56.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.477+0000 7f7e44e00640 1 -- 172.21.15.87:0/1764119983 shutdown_connections 2024-05-27T06:28:56.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.477+0000 7f7e44e00640 1 -- 172.21.15.87:0/1764119983 wait complete. 2024-05-27T06:28:56.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:56.495 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch layoutfile) 2024-05-27T06:28:56.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:56.511 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir layoutdir) 2024-05-27T06:28:56.566 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rw' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2024-05-27T06:28:56.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.773+0000 7f958d800640 1 Processor -- start 2024-05-27T06:28:56.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.773+0000 7f958d800640 1 -- start start 2024-05-27T06:28:56.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.773+0000 7f958d800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f95880d1700 0x7f95880d1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:56.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.777+0000 7f958d800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95880d2050 con 0x7f958806c940 2024-05-27T06:28:56.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.777+0000 7f958d800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95880cf530 con 0x7f9588157310 2024-05-27T06:28:56.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.777+0000 7f958d800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f95880d0140 con 0x7f95880d1700 2024-05-27T06:28:56.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.777+0000 7f957e000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f95880d1700 0x7f95880d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:56.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.777+0000 7f9587400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f958806c940 0x7f958806cd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:55912/0 (socket says 172.21.15.87:55912) 2024-05-27T06:28:56.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.777+0000 7f9587400640 1 -- 172.21.15.87:0/625756867 learned_addr learned my addr 172.21.15.87:0/625756867 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:56.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.777+0000 7f957e000640 1 -- 172.21.15.87:0/625756867 >> v1:172.21.15.149:6789/0 conn(0x7f9588157310 legacy=0x7f958815dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:56.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.777+0000 7f957e000640 1 -- 172.21.15.87:0/625756867 >> v1:172.21.15.87:6789/0 conn(0x7f958806c940 legacy=0x7f958806cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:56.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.777+0000 7f957e000640 1 -- 172.21.15.87:0/625756867 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95880cf810 con 0x7f95880d1700 2024-05-27T06:28:56.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.777+0000 7f957e000640 1 --2- 172.21.15.87:0/625756867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95880d1700 0x7f95880d1b10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f95700097f0 tx=0x7f957001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d321c5aacfed0d7d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:56.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.777+0000 7f9586000640 1 -- 172.21.15.87:0/625756867 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95700b0070 con 0x7f95880d1700 2024-05-27T06:28:56.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.781+0000 7f9586000640 1 -- 172.21.15.87:0/625756867 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95700ab600 con 0x7f95880d1700 2024-05-27T06:28:56.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.781+0000 7f9586000640 1 -- 172.21.15.87:0/625756867 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95700ab9d0 con 0x7f95880d1700 2024-05-27T06:28:56.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.781+0000 7f958d800640 1 -- 172.21.15.87:0/625756867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95880d1700 msgr2=0x7f95880d1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:56.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.781+0000 7f958d800640 1 --2- 172.21.15.87:0/625756867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95880d1700 0x7f95880d1b10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f95700097f0 tx=0x7f957001c410 comp rx=0 tx=0).stop 2024-05-27T06:28:56.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.781+0000 7f958d800640 1 -- 172.21.15.87:0/625756867 shutdown_connections 2024-05-27T06:28:56.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.781+0000 7f958d800640 1 --2- 172.21.15.87:0/625756867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95880d1700 0x7f95880d1b10 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:56.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.781+0000 7f958d800640 1 -- 172.21.15.87:0/625756867 >> 172.21.15.87:0/625756867 conn(0x7f95880b46b0 msgr2=0x7f95880b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:56.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.781+0000 7f958d800640 1 -- 172.21.15.87:0/625756867 shutdown_connections 2024-05-27T06:28:56.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.781+0000 7f958d800640 1 -- 172.21.15.87:0/625756867 wait complete. 2024-05-27T06:28:56.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.781+0000 7f958d800640 1 Processor -- start 2024-05-27T06:28:56.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.781+0000 7f958d800640 1 -- start start 2024-05-27T06:28:56.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.785+0000 7f958d800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f958806c940 0x7f958814f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:56.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.785+0000 7f958d800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95880d1700 0x7f95880aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:56.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.785+0000 7f958d800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9588157310 0x7f95881606d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:56.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.785+0000 7f958d800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f95880707c0 con 0x7f9588157310 2024-05-27T06:28:56.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.785+0000 7f958d800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9588070640 con 0x7f95880d1700 2024-05-27T06:28:56.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.785+0000 7f958d800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f958816b4e0 con 0x7f958806c940 2024-05-27T06:28:56.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.785+0000 7f9587400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9588157310 0x7f95881606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:56.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.785+0000 7f9587400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9588157310 0x7f95881606d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33810/0 (socket says 172.21.15.87:33810) 2024-05-27T06:28:56.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.785+0000 7f9587400640 1 -- 172.21.15.87:0/3278810343 learned_addr learned my addr 172.21.15.87:0/3278810343 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:56.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.785+0000 7f9586a00640 1 --2- 172.21.15.87:0/3278810343 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f958806c940 0x7f958814f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:56.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.785+0000 7f957e000640 1 --2- 172.21.15.87:0/3278810343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95880d1700 0x7f95880aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:56.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.785+0000 7f9587400640 1 -- 172.21.15.87:0/3278810343 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f958806c940 msgr2=0x7f958814f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:56.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.785+0000 7f9587400640 1 --2- 172.21.15.87:0/3278810343 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f958806c940 0x7f958814f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:56.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.785+0000 7f9587400640 1 -- 172.21.15.87:0/3278810343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95880d1700 msgr2=0x7f95880aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:56.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.785+0000 7f9587400640 1 --2- 172.21.15.87:0/3278810343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95880d1700 0x7f95880aeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:56.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.785+0000 7f9587400640 1 -- 172.21.15.87:0/3278810343 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95880afee0 con 0x7f9588157310 2024-05-27T06:28:56.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.785+0000 7f9586a00640 1 --2- 172.21.15.87:0/3278810343 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f958806c940 0x7f958814f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:56.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.785+0000 7f9587400640 1 --2- 172.21.15.87:0/3278810343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9588157310 0x7f95881606d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f958000c3f0 tx=0x7f958000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:56.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.785+0000 7f957f400640 1 -- 172.21.15.87:0/3278810343 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9580017070 con 0x7f9588157310 2024-05-27T06:28:56.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.785+0000 7f957f400640 1 -- 172.21.15.87:0/3278810343 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9580005cf0 con 0x7f9588157310 2024-05-27T06:28:56.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.785+0000 7f958d800640 1 -- 172.21.15.87:0/3278810343 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95881515c0 con 0x7f9588157310 2024-05-27T06:28:56.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.785+0000 7f957f400640 1 -- 172.21.15.87:0/3278810343 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95800072d0 con 0x7f9588157310 2024-05-27T06:28:56.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.785+0000 7f958d800640 1 -- 172.21.15.87:0/3278810343 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9588151b80 con 0x7f9588157310 2024-05-27T06:28:56.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.785+0000 7f958d800640 1 -- 172.21.15.87:0/3278810343 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f958806aa30 con 0x7f9588157310 2024-05-27T06:28:56.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.789+0000 7f957f400640 1 -- 172.21.15.87:0/3278810343 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f958001a070 con 0x7f9588157310 2024-05-27T06:28:56.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.789+0000 7f957f400640 1 --2- 172.21.15.87:0/3278810343 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f956406f400 0x7f9564071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:56.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.789+0000 7f957f400640 1 -- 172.21.15.87:0/3278810343 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f958008e870 con 0x7f9588157310 2024-05-27T06:28:56.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.789+0000 7f9586a00640 1 --2- 172.21.15.87:0/3278810343 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f956406f400 0x7f9564071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:56.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.789+0000 7f9586a00640 1 --2- 172.21.15.87:0/3278810343 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f956406f400 0x7f9564071910 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f95880d2290 tx=0x7f9578009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:56.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:56.793+0000 7f957f400640 1 -- 172.21.15.87:0/3278810343 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f95880afee0 con 0x7f9588157310 2024-05-27T06:28:57.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.005+0000 7f958d800640 1 -- 172.21.15.87:0/3278810343 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) -- 0x7f9588151320 con 0x7f9588157310 2024-05-27T06:28:57.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.009+0000 7f957f400640 1 -- 172.21.15.87:0/3278810343 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v14) ==== 210+0+167 (secure 0 0 0) 0x7f95880d2050 con 0x7f9588157310 2024-05-27T06:28:57.008 INFO:teuthology.orchestra.run.smithi087.stdout:[client.0] 2024-05-27T06:28:57.008 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCfJ1RmAld8BxAAigqU2F3mGXtAfw0L9Bfp2A== 2024-05-27T06:28:57.008 INFO:teuthology.orchestra.run.smithi087.stdout: caps mds = "allow rw" 2024-05-27T06:28:57.008 INFO:teuthology.orchestra.run.smithi087.stdout: caps mon = "allow r" 2024-05-27T06:28:57.008 INFO:teuthology.orchestra.run.smithi087.stdout: caps osd = "allow rw pool=cephfs_data,allow rw pool=data_new" 2024-05-27T06:28:57.008 INFO:teuthology.orchestra.run.smithi087.stderr:updated caps for client.0 2024-05-27T06:28:57.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.013+0000 7f958d800640 1 -- 172.21.15.87:0/3278810343 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f956406f400 msgr2=0x7f9564071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:57.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.013+0000 7f958d800640 1 --2- 172.21.15.87:0/3278810343 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f956406f400 0x7f9564071910 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f95880d2290 tx=0x7f9578009040 comp rx=0 tx=0).stop 2024-05-27T06:28:57.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.013+0000 7f958d800640 1 -- 172.21.15.87:0/3278810343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9588157310 msgr2=0x7f95881606d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:57.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.013+0000 7f958d800640 1 --2- 172.21.15.87:0/3278810343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9588157310 0x7f95881606d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f958000c3f0 tx=0x7f958000c8b0 comp rx=0 tx=0).stop 2024-05-27T06:28:57.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.013+0000 7f958d800640 1 -- 172.21.15.87:0/3278810343 shutdown_connections 2024-05-27T06:28:57.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.013+0000 7f958d800640 1 --2- 172.21.15.87:0/3278810343 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f956406f400 0x7f9564071910 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:57.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.013+0000 7f958d800640 1 --2- 172.21.15.87:0/3278810343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9588157310 0x7f95881606d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:57.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.013+0000 7f958d800640 1 --2- 172.21.15.87:0/3278810343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95880d1700 0x7f95880aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:57.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.013+0000 7f958d800640 1 --2- 172.21.15.87:0/3278810343 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f958806c940 0x7f958814f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:57.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.013+0000 7f958d800640 1 -- 172.21.15.87:0/3278810343 >> 172.21.15.87:0/3278810343 conn(0x7f95880b46b0 msgr2=0x7f9588153d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:57.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.013+0000 7f958d800640 1 -- 172.21.15.87:0/3278810343 shutdown_connections 2024-05-27T06:28:57.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.013+0000 7f958d800640 1 -- 172.21.15.87:0/3278810343 wait complete. 2024-05-27T06:28:57.030 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:28:57.030 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:28:57.039 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T06:28:57.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.233+0000 7f7994400640 1 Processor -- start 2024-05-27T06:28:57.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.233+0000 7f7994400640 1 -- start start 2024-05-27T06:28:57.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.233+0000 7f7994400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f798c0aec30 0x7f798c0702b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:57.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.233+0000 7f7994400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f798c06c720 0x7f798c06cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:57.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.233+0000 7f7994400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f798c06fe20 con 0x7f798c06efc0 2024-05-27T06:28:57.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.233+0000 7f7994400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f798c0b0ba0 con 0x7f798c06c720 2024-05-27T06:28:57.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.233+0000 7f7994400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f798c15ef50 con 0x7f798c0aec30 2024-05-27T06:28:57.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.237+0000 7f7992400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f798c06c720 0x7f798c06cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:57.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.237+0000 7f7992400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f798c06c720 0x7f798c06cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33816/0 (socket says 172.21.15.87:33816) 2024-05-27T06:28:57.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.237+0000 7f7992400640 1 -- 172.21.15.87:0/4265977090 learned_addr learned my addr 172.21.15.87:0/4265977090 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:57.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.237+0000 7f7992400640 1 -- 172.21.15.87:0/4265977090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f798c0aec30 msgr2=0x7f798c0702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:57.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.237+0000 7f7991a00640 1 --2- 172.21.15.87:0/4265977090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f798c0aec30 0x7f798c0702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:57.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.237+0000 7f7992400640 1 --2- 172.21.15.87:0/4265977090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f798c0aec30 0x7f798c0702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:57.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.237+0000 7f7992400640 1 -- 172.21.15.87:0/4265977090 >> v1:172.21.15.149:6789/0 conn(0x7f798c06efc0 legacy=0x7f798c06f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:57.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.237+0000 7f7992400640 1 -- 172.21.15.87:0/4265977090 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f798c0b08c0 con 0x7f798c06c720 2024-05-27T06:28:57.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.237+0000 7f7991a00640 1 --2- 172.21.15.87:0/4265977090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f798c0aec30 0x7f798c0702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:57.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.241+0000 7f7992400640 1 --2- 172.21.15.87:0/4265977090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f798c06c720 0x7f798c06cb30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7984009e50 tx=0x7f798401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=518a501b58fa94b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:57.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.241+0000 7f798be00640 1 -- 172.21.15.87:0/4265977090 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79840a5660 con 0x7f798c06c720 2024-05-27T06:28:57.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.241+0000 7f798be00640 1 -- 172.21.15.87:0/4265977090 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79840a5800 con 0x7f798c06c720 2024-05-27T06:28:57.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.241+0000 7f798be00640 1 -- 172.21.15.87:0/4265977090 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79840a5bd0 con 0x7f798c06c720 2024-05-27T06:28:57.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.241+0000 7f7994400640 1 -- 172.21.15.87:0/4265977090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f798c06c720 msgr2=0x7f798c06cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:57.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.241+0000 7f7994400640 1 --2- 172.21.15.87:0/4265977090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f798c06c720 0x7f798c06cb30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7984009e50 tx=0x7f798401c910 comp rx=0 tx=0).stop 2024-05-27T06:28:57.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.241+0000 7f7994400640 1 -- 172.21.15.87:0/4265977090 shutdown_connections 2024-05-27T06:28:57.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.241+0000 7f7994400640 1 --2- 172.21.15.87:0/4265977090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f798c06c720 0x7f798c06cb30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:57.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.241+0000 7f7994400640 1 --2- 172.21.15.87:0/4265977090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f798c0aec30 0x7f798c0702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:57.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.241+0000 7f7994400640 1 -- 172.21.15.87:0/4265977090 >> 172.21.15.87:0/4265977090 conn(0x7f798c0b2fb0 msgr2=0x7f798c0b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:57.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.241+0000 7f7994400640 1 -- 172.21.15.87:0/4265977090 shutdown_connections 2024-05-27T06:28:57.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.241+0000 7f7994400640 1 -- 172.21.15.87:0/4265977090 wait complete. 2024-05-27T06:28:57.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.245+0000 7f7994400640 1 Processor -- start 2024-05-27T06:28:57.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.245+0000 7f7994400640 1 -- start start 2024-05-27T06:28:57.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.245+0000 7f7994400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f798c06c720 0x7f798c157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:57.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.245+0000 7f7994400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f798c06efc0 0x7f798c14d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:57.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.245+0000 7f7994400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f798c0aec30 0x7f798c09a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:57.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.245+0000 7f7994400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f798c06e0c0 con 0x7f798c06efc0 2024-05-27T06:28:57.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.245+0000 7f7994400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f798c06df40 con 0x7f798c0aec30 2024-05-27T06:28:57.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.245+0000 7f7994400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f798c06d070 con 0x7f798c06c720 2024-05-27T06:28:57.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.245+0000 7f7991000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f798c06efc0 0x7f798c14d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:57.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.245+0000 7f7991000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f798c06efc0 0x7f798c14d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33832/0 (socket says 172.21.15.87:33832) 2024-05-27T06:28:57.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.245+0000 7f7991000640 1 -- 172.21.15.87:0/1167498750 learned_addr learned my addr 172.21.15.87:0/1167498750 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:57.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.245+0000 7f7992400640 1 --2- 172.21.15.87:0/1167498750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f798c0aec30 0x7f798c09a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:57.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.245+0000 7f7991a00640 1 --2- 172.21.15.87:0/1167498750 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f798c06c720 0x7f798c157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:57.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.249+0000 7f7991000640 1 -- 172.21.15.87:0/1167498750 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f798c06c720 msgr2=0x7f798c157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:57.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.249+0000 7f7991000640 1 --2- 172.21.15.87:0/1167498750 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f798c06c720 0x7f798c157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:57.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.249+0000 7f7991000640 1 -- 172.21.15.87:0/1167498750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f798c0aec30 msgr2=0x7f798c09a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:57.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.249+0000 7f7991000640 1 --2- 172.21.15.87:0/1167498750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f798c0aec30 0x7f798c09a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:57.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.249+0000 7f7991000640 1 -- 172.21.15.87:0/1167498750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f798c14c380 con 0x7f798c06efc0 2024-05-27T06:28:57.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.249+0000 7f7991000640 1 --2- 172.21.15.87:0/1167498750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f798c06efc0 0x7f798c14d420 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f797800b410 tx=0x7f797800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:57.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.249+0000 7f7989600640 1 -- 172.21.15.87:0/1167498750 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7978015030 con 0x7f798c06efc0 2024-05-27T06:28:57.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.249+0000 7f7989600640 1 -- 172.21.15.87:0/1167498750 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7978004020 con 0x7f798c06efc0 2024-05-27T06:28:57.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.249+0000 7f7994400640 1 -- 172.21.15.87:0/1167498750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f798c14c660 con 0x7f798c06efc0 2024-05-27T06:28:57.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.249+0000 7f7989600640 1 -- 172.21.15.87:0/1167498750 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7978004450 con 0x7f798c06efc0 2024-05-27T06:28:57.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.249+0000 7f7994400640 1 -- 172.21.15.87:0/1167498750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f798c14cc20 con 0x7f798c06efc0 2024-05-27T06:28:57.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.249+0000 7f7994400640 1 -- 172.21.15.87:0/1167498750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f798c06aa30 con 0x7f798c06efc0 2024-05-27T06:28:57.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.249+0000 7f7989600640 1 -- 172.21.15.87:0/1167498750 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7978018070 con 0x7f798c06efc0 2024-05-27T06:28:57.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.249+0000 7f7989600640 1 --2- 172.21.15.87:0/1167498750 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f796c06f400 0x7f796c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:57.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.253+0000 7f7989600640 1 -- 172.21.15.87:0/1167498750 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f797808f000 con 0x7f798c06efc0 2024-05-27T06:28:57.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.253+0000 7f7991a00640 1 --2- 172.21.15.87:0/1167498750 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f796c06f400 0x7f796c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:57.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.253+0000 7f7991a00640 1 --2- 172.21.15.87:0/1167498750 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f796c06f400 0x7f796c071910 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7980006fd0 tx=0x7f7980008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:57.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.257+0000 7f7989600640 1 -- 172.21.15.87:0/1167498750 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f797805b620 con 0x7f798c06efc0 2024-05-27T06:28:57.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.425+0000 7f7994400640 1 -- 172.21.15.87:0/1167498750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f798c14c100 con 0x7f798c06efc0 2024-05-27T06:28:57.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.425+0000 7f7989600640 1 -- 172.21.15.87:0/1167498750 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) ==== 80+0+0 (secure 0 0 0) 0x7f798c14c100 con 0x7f798c06efc0 2024-05-27T06:28:57.424 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2024-05-27T06:28:57.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.429+0000 7f7994400640 1 -- 172.21.15.87:0/1167498750 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f796c06f400 msgr2=0x7f796c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:57.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.429+0000 7f7994400640 1 --2- 172.21.15.87:0/1167498750 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f796c06f400 0x7f796c071910 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7980006fd0 tx=0x7f7980008040 comp rx=0 tx=0).stop 2024-05-27T06:28:57.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.429+0000 7f7994400640 1 -- 172.21.15.87:0/1167498750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f798c06efc0 msgr2=0x7f798c14d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:57.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.429+0000 7f7994400640 1 --2- 172.21.15.87:0/1167498750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f798c06efc0 0x7f798c14d420 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f797800b410 tx=0x7f797800b8d0 comp rx=0 tx=0).stop 2024-05-27T06:28:57.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.429+0000 7f7994400640 1 -- 172.21.15.87:0/1167498750 shutdown_connections 2024-05-27T06:28:57.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.429+0000 7f7994400640 1 --2- 172.21.15.87:0/1167498750 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f796c06f400 0x7f796c071910 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:57.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.429+0000 7f7994400640 1 --2- 172.21.15.87:0/1167498750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f798c0aec30 0x7f798c09a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:57.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.429+0000 7f7994400640 1 --2- 172.21.15.87:0/1167498750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f798c06efc0 0x7f798c14d420 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:57.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.429+0000 7f7994400640 1 --2- 172.21.15.87:0/1167498750 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f798c06c720 0x7f798c157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:57.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.429+0000 7f7994400640 1 -- 172.21.15.87:0/1167498750 >> 172.21.15.87:0/1167498750 conn(0x7f798c0b2fb0 msgr2=0x7f798c160900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:57.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.429+0000 7f7994400640 1 -- 172.21.15.87:0/1167498750 shutdown_connections 2024-05-27T06:28:57.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.429+0000 7f7994400640 1 -- 172.21.15.87:0/1167498750 wait complete. 2024-05-27T06:28:57.446 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:28:57.446 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:28:57.455 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T06:28:57.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.649+0000 7f3cbf800640 1 Processor -- start 2024-05-27T06:28:57.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.649+0000 7f3cbf800640 1 -- start start 2024-05-27T06:28:57.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.653+0000 7f3cbf800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3cb80d1d40 0x7f3cb81604b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:57.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.653+0000 7f3cbf800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3cb81609f0 0x7f3cb80b5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:57.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.653+0000 7f3cbf800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cb815cd50 con 0x7f3cb815c940 2024-05-27T06:28:57.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.653+0000 7f3cbf800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f3cb80d0ec0 con 0x7f3cb80d1d40 2024-05-27T06:28:57.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.653+0000 7f3cbf800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f3cb8160e00 con 0x7f3cb81609f0 2024-05-27T06:28:57.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.653+0000 7f3cb7e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3cb80d1d40 0x7f3cb81604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:57.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.653+0000 7f3cb7e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3cb80d1d40 0x7f3cb81604b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33836/0 (socket says 172.21.15.87:33836) 2024-05-27T06:28:57.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.653+0000 7f3cb7e00640 1 -- 172.21.15.87:0/4052964436 learned_addr learned my addr 172.21.15.87:0/4052964436 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:57.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.653+0000 7f3cbd800640 1 --2- 172.21.15.87:0/4052964436 >> v2:172.21.15.149:3300/0 conn(0x7f3cb81609f0 0x7f3cb80b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:57.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.653+0000 7f3cb7e00640 1 -- 172.21.15.87:0/4052964436 >> v2:172.21.15.149:3300/0 conn(0x7f3cb81609f0 msgr2=0x7f3cb80b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:57.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.653+0000 7f3cb7e00640 1 --2- 172.21.15.87:0/4052964436 >> v2:172.21.15.149:3300/0 conn(0x7f3cb81609f0 0x7f3cb80b5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:57.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.653+0000 7f3cb7e00640 1 -- 172.21.15.87:0/4052964436 >> v1:172.21.15.149:6789/0 conn(0x7f3cb815c940 legacy=0x7f3cb80d1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:57.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.653+0000 7f3cb7e00640 1 -- 172.21.15.87:0/4052964436 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb80d2150 con 0x7f3cb80d1d40 2024-05-27T06:28:57.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.657+0000 7f3cb7e00640 1 --2- 172.21.15.87:0/4052964436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cb80d1d40 0x7f3cb81604b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8073a60 tx=0x7f3ca401c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=215660a7d66e4c69 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:57.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.657+0000 7f3cb7400640 1 -- 172.21.15.87:0/4052964436 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca40b0070 con 0x7f3cb80d1d40 2024-05-27T06:28:57.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.657+0000 7f3cb7400640 1 -- 172.21.15.87:0/4052964436 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ca40ab600 con 0x7f3cb80d1d40 2024-05-27T06:28:57.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.657+0000 7f3cb7400640 1 -- 172.21.15.87:0/4052964436 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca40ab9d0 con 0x7f3cb80d1d40 2024-05-27T06:28:57.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.657+0000 7f3cbf800640 1 -- 172.21.15.87:0/4052964436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cb80d1d40 msgr2=0x7f3cb81604b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:57.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.657+0000 7f3cbf800640 1 --2- 172.21.15.87:0/4052964436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cb80d1d40 0x7f3cb81604b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8073a60 tx=0x7f3ca401c310 comp rx=0 tx=0).stop 2024-05-27T06:28:57.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.657+0000 7f3cbf800640 1 -- 172.21.15.87:0/4052964436 shutdown_connections 2024-05-27T06:28:57.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.657+0000 7f3cbf800640 1 --2- 172.21.15.87:0/4052964436 >> v2:172.21.15.149:3300/0 conn(0x7f3cb81609f0 0x7f3cb80b5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:57.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.657+0000 7f3cbf800640 1 --2- 172.21.15.87:0/4052964436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cb80d1d40 0x7f3cb81604b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:57.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.657+0000 7f3cbf800640 1 -- 172.21.15.87:0/4052964436 >> 172.21.15.87:0/4052964436 conn(0x7f3cb80712e0 msgr2=0x7f3cb80716f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:57.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.657+0000 7f3cbf800640 1 -- 172.21.15.87:0/4052964436 shutdown_connections 2024-05-27T06:28:57.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.657+0000 7f3cbf800640 1 -- 172.21.15.87:0/4052964436 wait complete. 2024-05-27T06:28:57.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.657+0000 7f3cbf800640 1 Processor -- start 2024-05-27T06:28:57.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.661+0000 7f3cbf800640 1 -- start start 2024-05-27T06:28:57.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.661+0000 7f3cbf800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cb80d1d40 0x7f3cb8166460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:57.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.661+0000 7f3cbf800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cb815c940 0x7f3cb81669a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:57.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.661+0000 7f3cbf800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3cb81609f0 0x7f3cb8143170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:57.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.661+0000 7f3cbf800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb81611c0 con 0x7f3cb815c940 2024-05-27T06:28:57.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.661+0000 7f3cbf800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb80d0560 con 0x7f3cb80d1d40 2024-05-27T06:28:57.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.661+0000 7f3cbf800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3cb80b5cd0 con 0x7f3cb81609f0 2024-05-27T06:28:57.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.661+0000 7f3cb7e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cb815c940 0x7f3cb81669a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:57.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.661+0000 7f3cb7e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cb815c940 0x7f3cb81669a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33850/0 (socket says 172.21.15.87:33850) 2024-05-27T06:28:57.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.661+0000 7f3cb7e00640 1 -- 172.21.15.87:0/519637703 learned_addr learned my addr 172.21.15.87:0/519637703 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:57.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.661+0000 7f3cbce00640 1 --2- 172.21.15.87:0/519637703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cb80d1d40 0x7f3cb8166460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:57.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.661+0000 7f3cbd800640 1 --2- 172.21.15.87:0/519637703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3cb81609f0 0x7f3cb8143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:57.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.661+0000 7f3cb7e00640 1 -- 172.21.15.87:0/519637703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3cb81609f0 msgr2=0x7f3cb8143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:57.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.661+0000 7f3cb7e00640 1 --2- 172.21.15.87:0/519637703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3cb81609f0 0x7f3cb8143170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:57.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.661+0000 7f3cb7e00640 1 -- 172.21.15.87:0/519637703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cb80d1d40 msgr2=0x7f3cb8166460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:57.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.661+0000 7f3cb7e00640 1 --2- 172.21.15.87:0/519637703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cb80d1d40 0x7f3cb8166460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:57.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.661+0000 7f3cb7e00640 1 -- 172.21.15.87:0/519637703 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb81515b0 con 0x7f3cb815c940 2024-05-27T06:28:57.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.661+0000 7f3cbd800640 1 --2- 172.21.15.87:0/519637703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3cb81609f0 0x7f3cb8143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:57.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.661+0000 7f3cb7e00640 1 --2- 172.21.15.87:0/519637703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cb815c940 0x7f3cb81669a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3ca40ae040 tx=0x7f3ca40190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:57.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.661+0000 7f3cb4c00640 1 -- 172.21.15.87:0/519637703 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca40b9070 con 0x7f3cb815c940 2024-05-27T06:28:57.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.661+0000 7f3cb4c00640 1 -- 172.21.15.87:0/519637703 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ca40b4400 con 0x7f3cb815c940 2024-05-27T06:28:57.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.661+0000 7f3cbf800640 1 -- 172.21.15.87:0/519637703 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb8151890 con 0x7f3cb815c940 2024-05-27T06:28:57.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.661+0000 7f3cb4c00640 1 -- 172.21.15.87:0/519637703 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca40b0040 con 0x7f3cb815c940 2024-05-27T06:28:57.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.661+0000 7f3cbf800640 1 -- 172.21.15.87:0/519637703 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb81441f0 con 0x7f3cb815c940 2024-05-27T06:28:57.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.661+0000 7f3cbf800640 1 -- 172.21.15.87:0/519637703 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cb806aa30 con 0x7f3cb815c940 2024-05-27T06:28:57.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.665+0000 7f3cb4c00640 1 -- 172.21.15.87:0/519637703 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3ca40bc070 con 0x7f3cb815c940 2024-05-27T06:28:57.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.665+0000 7f3cb4c00640 1 --2- 172.21.15.87:0/519637703 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3c9806f400 0x7f3c98071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:57.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.665+0000 7f3cb4c00640 1 -- 172.21.15.87:0/519637703 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f3ca41284c0 con 0x7f3cb815c940 2024-05-27T06:28:57.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.665+0000 7f3cbce00640 1 --2- 172.21.15.87:0/519637703 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3c9806f400 0x7f3c98071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:57.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.665+0000 7f3cbce00640 1 --2- 172.21.15.87:0/519637703 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3c9806f400 0x7f3c98071910 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0098e0 tx=0x7f3cac009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:57.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.669+0000 7f3cb4c00640 1 -- 172.21.15.87:0/519637703 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f3cb815cd50 con 0x7f3cb815c940 2024-05-27T06:28:57.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.841+0000 7f3cbf800640 1 -- 172.21.15.87:0/519637703 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3cb8072400 con 0x7f3cb815c940 2024-05-27T06:28:57.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.841+0000 7f3cb4c00640 1 -- 172.21.15.87:0/519637703 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) ==== 80+0+0 (secure 0 0 0) 0x7f3ca40f4af0 con 0x7f3cb815c940 2024-05-27T06:28:57.841 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2024-05-27T06:28:57.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.845+0000 7f3cbf800640 1 -- 172.21.15.87:0/519637703 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3c9806f400 msgr2=0x7f3c98071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:57.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.845+0000 7f3cbf800640 1 --2- 172.21.15.87:0/519637703 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3c9806f400 0x7f3c98071910 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0098e0 tx=0x7f3cac009060 comp rx=0 tx=0).stop 2024-05-27T06:28:57.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.845+0000 7f3cbf800640 1 -- 172.21.15.87:0/519637703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cb815c940 msgr2=0x7f3cb81669a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:57.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.845+0000 7f3cbf800640 1 --2- 172.21.15.87:0/519637703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cb815c940 0x7f3cb81669a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3ca40ae040 tx=0x7f3ca40190b0 comp rx=0 tx=0).stop 2024-05-27T06:28:57.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.845+0000 7f3cbf800640 1 -- 172.21.15.87:0/519637703 shutdown_connections 2024-05-27T06:28:57.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.845+0000 7f3cbf800640 1 --2- 172.21.15.87:0/519637703 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3c9806f400 0x7f3c98071910 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:57.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.845+0000 7f3cbf800640 1 --2- 172.21.15.87:0/519637703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3cb81609f0 0x7f3cb8143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:57.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.845+0000 7f3cbf800640 1 --2- 172.21.15.87:0/519637703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cb815c940 0x7f3cb81669a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:57.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.845+0000 7f3cbf800640 1 --2- 172.21.15.87:0/519637703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cb80d1d40 0x7f3cb8166460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:57.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.845+0000 7f3cbf800640 1 -- 172.21.15.87:0/519637703 >> 172.21.15.87:0/519637703 conn(0x7f3cb80712e0 msgr2=0x7f3cb80b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:57.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.845+0000 7f3cbf800640 1 -- 172.21.15.87:0/519637703 shutdown_connections 2024-05-27T06:28:57.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:57.845+0000 7f3cbf800640 1 -- 172.21.15.87:0/519637703 wait complete. 2024-05-27T06:28:57.863 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-05-27T06:28:57.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:57.863 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-27T06:28:57.881 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[37336]: fuse finished with error 0 and tester_r 0 2024-05-27T06:28:57.884 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:28:57.907 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-05-27T06:28:57.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:57.908 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-27T06:28:57.961 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-27T06:28:58.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.153+0000 7f29e6a00640 1 Processor -- start 2024-05-27T06:28:58.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.153+0000 7f29e6a00640 1 -- start start 2024-05-27T06:28:58.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.153+0000 7f29e6a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f29e0071ad0 0x7f29e01608c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:58.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.153+0000 7f29e6a00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29e0163ed0 con 0x7f29e00b5460 2024-05-27T06:28:58.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.153+0000 7f29e6a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29e01641b0 con 0x7f29e00ce7e0 2024-05-27T06:28:58.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.153+0000 7f29e6a00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f29e0164490 con 0x7f29e0071ad0 2024-05-27T06:28:58.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.153+0000 7f29d7400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f29e00b5460 0x7f29e00713c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:55920/0 (socket says 172.21.15.87:55920) 2024-05-27T06:28:58.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.153+0000 7f29d7400640 1 -- 172.21.15.87:0/1186135601 learned_addr learned my addr 172.21.15.87:0/1186135601 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:58.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.153+0000 7f29e4a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f29e0071ad0 0x7f29e01608c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:58.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.153+0000 7f29e4a00640 1 -- 172.21.15.87:0/1186135601 >> v1:172.21.15.149:6789/0 conn(0x7f29e00ce7e0 legacy=0x7f29e015fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:58.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.153+0000 7f29df400640 1 -- 172.21.15.87:0/1186135601 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1250521962 0 0) 0x7f29e0163ed0 con 0x7f29e00b5460 2024-05-27T06:28:58.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.153+0000 7f29e4a00640 1 -- 172.21.15.87:0/1186135601 >> v1:172.21.15.87:6789/0 conn(0x7f29e00b5460 legacy=0x7f29e00713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:58.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.153+0000 7f29e4a00640 1 -- 172.21.15.87:0/1186135601 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e0164770 con 0x7f29e0071ad0 2024-05-27T06:28:58.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.157+0000 7f29e4a00640 1 --2- 172.21.15.87:0/1186135601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29e0071ad0 0x7f29e01608c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f29d80097c0 tx=0x7f29d801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3895349c350e0814 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:58.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.157+0000 7f29df400640 1 -- 172.21.15.87:0/1186135601 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d80b0070 con 0x7f29e0071ad0 2024-05-27T06:28:58.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.157+0000 7f29df400640 1 -- 172.21.15.87:0/1186135601 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d80ab600 con 0x7f29e0071ad0 2024-05-27T06:28:58.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.157+0000 7f29df400640 1 -- 172.21.15.87:0/1186135601 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d80ab9d0 con 0x7f29e0071ad0 2024-05-27T06:28:58.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.157+0000 7f29e6a00640 1 -- 172.21.15.87:0/1186135601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29e0071ad0 msgr2=0x7f29e01608c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:58.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.157+0000 7f29e6a00640 1 --2- 172.21.15.87:0/1186135601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29e0071ad0 0x7f29e01608c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f29d80097c0 tx=0x7f29d801c380 comp rx=0 tx=0).stop 2024-05-27T06:28:58.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.157+0000 7f29e6a00640 1 -- 172.21.15.87:0/1186135601 shutdown_connections 2024-05-27T06:28:58.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.157+0000 7f29e6a00640 1 --2- 172.21.15.87:0/1186135601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29e0071ad0 0x7f29e01608c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:58.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.157+0000 7f29e6a00640 1 -- 172.21.15.87:0/1186135601 >> 172.21.15.87:0/1186135601 conn(0x7f29e00d2550 msgr2=0x7f29e00d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:58.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.157+0000 7f29e6a00640 1 -- 172.21.15.87:0/1186135601 shutdown_connections 2024-05-27T06:28:58.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.157+0000 7f29e6a00640 1 -- 172.21.15.87:0/1186135601 wait complete. 2024-05-27T06:28:58.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.161+0000 7f29e6a00640 1 Processor -- start 2024-05-27T06:28:58.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.161+0000 7f29e6a00640 1 -- start start 2024-05-27T06:28:58.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.161+0000 7f29e6a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29e00b5460 0x7f29e014c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:58.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.161+0000 7f29e6a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29e00ce7e0 0x7f29e0162bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:58.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.161+0000 7f29e6a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29e014d010 0x7f29e0163100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:58.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.161+0000 7f29e6a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f29e016e8b0 con 0x7f29e00ce7e0 2024-05-27T06:28:58.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.161+0000 7f29e6a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f29e016e730 con 0x7f29e00b5460 2024-05-27T06:28:58.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.161+0000 7f29e6a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f29e016ea30 con 0x7f29e014d010 2024-05-27T06:28:58.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.161+0000 7f29d7400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29e00ce7e0 0x7f29e0162bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:58.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.161+0000 7f29d7400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29e00ce7e0 0x7f29e0162bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33874/0 (socket says 172.21.15.87:33874) 2024-05-27T06:28:58.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.161+0000 7f29d7400640 1 -- 172.21.15.87:0/1441749915 learned_addr learned my addr 172.21.15.87:0/1441749915 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:58.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.165+0000 7f29d7400640 1 -- 172.21.15.87:0/1441749915 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29e014d010 msgr2=0x7f29e0163100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:58.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.165+0000 7f29d7400640 1 --2- 172.21.15.87:0/1441749915 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29e014d010 0x7f29e0163100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:58.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.165+0000 7f29d7400640 1 -- 172.21.15.87:0/1441749915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29e00b5460 msgr2=0x7f29e014c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:58.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.165+0000 7f29dfe00640 1 --2- 172.21.15.87:0/1441749915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29e00b5460 0x7f29e014c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:58.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.165+0000 7f29d7400640 1 --2- 172.21.15.87:0/1441749915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29e00b5460 0x7f29e014c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:58.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.165+0000 7f29d7400640 1 -- 172.21.15.87:0/1441749915 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e014ce20 con 0x7f29e00ce7e0 2024-05-27T06:28:58.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.165+0000 7f29dfe00640 1 --2- 172.21.15.87:0/1441749915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29e00b5460 0x7f29e014c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:58.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.165+0000 7f29d7400640 1 --2- 172.21.15.87:0/1441749915 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29e00ce7e0 0x7f29e0162bc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f29c800c3f0 tx=0x7f29c800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:58.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.165+0000 7f29dcc00640 1 -- 172.21.15.87:0/1441749915 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c80074e0 con 0x7f29e00ce7e0 2024-05-27T06:28:58.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.165+0000 7f29dcc00640 1 -- 172.21.15.87:0/1441749915 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29c80047f0 con 0x7f29e00ce7e0 2024-05-27T06:28:58.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.165+0000 7f29e6a00640 1 -- 172.21.15.87:0/1441749915 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29e01567e0 con 0x7f29e00ce7e0 2024-05-27T06:28:58.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.165+0000 7f29dcc00640 1 -- 172.21.15.87:0/1441749915 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c8007680 con 0x7f29e00ce7e0 2024-05-27T06:28:58.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.165+0000 7f29e6a00640 1 -- 172.21.15.87:0/1441749915 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29e0156da0 con 0x7f29e00ce7e0 2024-05-27T06:28:58.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.165+0000 7f29e6a00640 1 -- 172.21.15.87:0/1441749915 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29e006aa30 con 0x7f29e00ce7e0 2024-05-27T06:28:58.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.165+0000 7f29dcc00640 1 -- 172.21.15.87:0/1441749915 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f29c8011070 con 0x7f29e00ce7e0 2024-05-27T06:28:58.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.165+0000 7f29dcc00640 1 --2- 172.21.15.87:0/1441749915 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f29bc06f400 0x7f29bc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:58.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.169+0000 7f29dcc00640 1 -- 172.21.15.87:0/1441749915 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f29c808f130 con 0x7f29e00ce7e0 2024-05-27T06:28:58.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.169+0000 7f29dfe00640 1 --2- 172.21.15.87:0/1441749915 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f29bc06f400 0x7f29bc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:58.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.169+0000 7f29dfe00640 1 --2- 172.21.15.87:0/1441749915 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f29bc06f400 0x7f29bc071910 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f29d0007fd0 tx=0x7f29d0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:58.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.173+0000 7f29dcc00640 1 -- 172.21.15.87:0/1441749915 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f29c805bd10 con 0x7f29e00ce7e0 2024-05-27T06:28:58.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.361+0000 7f29e6a00640 1 -- 172.21.15.87:0/1441749915 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f29e00b6a50 con 0x7f29e00ce7e0 2024-05-27T06:28:58.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.361+0000 7f29dcc00640 1 -- 172.21.15.87:0/1441749915 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) ==== 53+0+82 (secure 0 0 0) 0x7f29c805b610 con 0x7f29e00ce7e0 2024-05-27T06:28:58.360 INFO:teuthology.orchestra.run.smithi087.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2024-05-27T06:28:58.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.365+0000 7f29e6a00640 1 -- 172.21.15.87:0/1441749915 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f29bc06f400 msgr2=0x7f29bc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:58.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.365+0000 7f29e6a00640 1 --2- 172.21.15.87:0/1441749915 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f29bc06f400 0x7f29bc071910 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f29d0007fd0 tx=0x7f29d0009040 comp rx=0 tx=0).stop 2024-05-27T06:28:58.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.365+0000 7f29e6a00640 1 -- 172.21.15.87:0/1441749915 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29e00ce7e0 msgr2=0x7f29e0162bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:58.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.365+0000 7f29e6a00640 1 --2- 172.21.15.87:0/1441749915 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29e00ce7e0 0x7f29e0162bc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f29c800c3f0 tx=0x7f29c800c8b0 comp rx=0 tx=0).stop 2024-05-27T06:28:58.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.365+0000 7f29e6a00640 1 -- 172.21.15.87:0/1441749915 shutdown_connections 2024-05-27T06:28:58.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.365+0000 7f29e6a00640 1 --2- 172.21.15.87:0/1441749915 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f29bc06f400 0x7f29bc071910 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:58.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.365+0000 7f29e6a00640 1 --2- 172.21.15.87:0/1441749915 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29e014d010 0x7f29e0163100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:58.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.365+0000 7f29e6a00640 1 --2- 172.21.15.87:0/1441749915 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29e00ce7e0 0x7f29e0162bc0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:58.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.365+0000 7f29e6a00640 1 --2- 172.21.15.87:0/1441749915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29e00b5460 0x7f29e014c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:58.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.365+0000 7f29e6a00640 1 -- 172.21.15.87:0/1441749915 >> 172.21.15.87:0/1441749915 conn(0x7f29e00d2550 msgr2=0x7f29e015a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:58.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.365+0000 7f29e6a00640 1 -- 172.21.15.87:0/1441749915 shutdown_connections 2024-05-27T06:28:58.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58.365+0000 7f29e6a00640 1 -- 172.21.15.87:0/1441749915 wait complete. 2024-05-27T06:28:58.382 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-27T06:28:58.383 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-27T06:28:58.383 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-05-27T06:28:58.383 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-27T06:28:58.383 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-27T06:28:58.383 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-27T06:28:58.383 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-27T06:28:58.383 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-27T06:28:58.383 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-27T06:28:58.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:58.383 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-05-27T06:28:58.392 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T06:28:58.392 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T06:28:58.392 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T06:28:58.392 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:58.393 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-05-27T06:28:58.393 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:58.393 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:28:58.393 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:58.393 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-05-27T06:28:58.393 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:28:58.393 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:58.393 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-05-27T06:28:58.393 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:28:58.393 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:58.393 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-27T06:28:58.393 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:58.394 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-27T06:28:58.394 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42403sec preferred_lft 42403sec 2024-05-27T06:28:58.394 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-05-27T06:28:58.394 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:58.394 INFO:teuthology.orchestra.run.smithi087.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-27T06:28:58.394 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 02:42:75:41:48:14 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:58.394 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-27T06:28:58.394 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:58.394 INFO:teuthology.orchestra.run.smithi087.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-27T06:28:58.394 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-27T06:28:58.394 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-27T06:28:58.394 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:58.394 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-27T06:28:58.395 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:58.395 INFO:teuthology.orchestra.run.smithi087.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-27T06:28:58.395 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:28:58.395 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-27T06:28:58.395 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:58.395 INFO:teuthology.orchestra.run.smithi087.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-27T06:28:58.395 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:28:58.395 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-05-27T06:28:58.395 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:28:58.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:58.396 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-27T06:28:58.455 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-05-27T06:28:58.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:58.457 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-05-27T06:28:58.517 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-05-27T06:28:58.517 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-27T06:28:58.517 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-27T06:28:58.517 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-27T06:28:58.517 INFO:teuthology.orchestra.run.smithi087.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-27T06:28:58.517 INFO:teuthology.orchestra.run.smithi087.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-27T06:28:58.517 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-27T06:28:58.517 INFO:teuthology.orchestra.run.smithi087.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:28:58.517 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:28:58.517 INFO:teuthology.orchestra.run.smithi087.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:28:58.517 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-27T06:28:58.518 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:28:58.518 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-27T06:28:58.518 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-27T06:28:58.518 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-27T06:28:58.518 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-27T06:28:58.518 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-27T06:28:58.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:28:58.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:28:58.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:58.656 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-05-27T06:28:58.665 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-27T06:28:58.665 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-27T06:28:58.665 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-27T06:28:58.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:58.666 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-05-27T06:28:58.729 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-27T06:28:58.729 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T06:28:58.729 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-27T06:28:58.781 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-27T06:28:58.781 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T06:28:58.782 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-27T06:28:58.832 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-05-27T06:28:58.896 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T06:28:58.950 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-05-27T06:28:58.950 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-05-27T06:28:58.950 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-05-27T06:28:58.951 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-05-27T06:28:58.951 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-05-27T06:28:58.951 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-05-27T06:28:58.951 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-05-27T06:28:58.951 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-05-27T06:28:58.951 INFO:teuthology.orchestra.run.smithi087.stdout:/run/lock 2024-05-27T06:28:58.951 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-05-27T06:28:58.951 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-05-27T06:28:58.951 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-05-27T06:28:58.951 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T06:28:58.951 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-05-27T06:28:58.951 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-05-27T06:28:58.951 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-05-27T06:28:58.952 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-05-27T06:28:58.952 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/fs/nfsd 2024-05-27T06:28:58.952 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-05-27T06:28:58.952 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-05-27T06:28:58.952 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysusers.service 2024-05-27T06:28:58.952 INFO:teuthology.orchestra.run.smithi087.stdout:/run/rpc_pipefs 2024-05-27T06:28:58.952 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-05-27T06:28:58.952 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-05-27T06:28:58.952 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2024-05-27T06:28:58.952 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2024-05-27T06:28:58.952 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2024-05-27T06:28:58.952 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2024-05-27T06:28:58.952 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-05-27T06:28:58.953 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:28:58.953 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:28:58.953 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:28:58.953 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:28:58.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:58.954 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-05-27T06:28:59.008 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-27T06:28:59.009 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-27T06:28:59.056 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-05-27T06:28:59.077 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T06:28:59.131 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-05-27T06:28:59.132 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-05-27T06:28:59.132 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-05-27T06:28:59.132 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-05-27T06:28:59.132 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-05-27T06:28:59.132 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-05-27T06:28:59.132 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-05-27T06:28:59.133 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-05-27T06:28:59.133 INFO:teuthology.orchestra.run.smithi087.stdout:/run/lock 2024-05-27T06:28:59.133 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-05-27T06:28:59.133 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-05-27T06:28:59.134 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-05-27T06:28:59.134 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T06:28:59.134 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-05-27T06:28:59.134 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-05-27T06:28:59.134 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-05-27T06:28:59.135 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-05-27T06:28:59.135 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/fs/nfsd 2024-05-27T06:28:59.135 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-05-27T06:28:59.135 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-05-27T06:28:59.135 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysusers.service 2024-05-27T06:28:59.135 INFO:teuthology.orchestra.run.smithi087.stdout:/run/rpc_pipefs 2024-05-27T06:28:59.136 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-05-27T06:28:59.136 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-05-27T06:28:59.136 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2024-05-27T06:28:59.136 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2024-05-27T06:28:59.136 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2024-05-27T06:28:59.136 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2024-05-27T06:28:59.137 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-05-27T06:28:59.137 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:28:59.137 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:28:59.137 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:28:59.137 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:28:59.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:59.139 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-05-27T06:28:59.160 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:2024-05-27T06:28:59.161+0000 7f52c8449580 -1 init, newargv = 0x7f52ac003030 newargc=15 2024-05-27T06:28:59.160 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[37635]: starting ceph client 2024-05-27T06:28:59.167 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[37635]: starting fuse 2024-05-27T06:28:59.168 INFO:teuthology.orchestra.run.smithi087.stdout:44 2024-05-27T06:28:59.168 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-05-27T06:28:59.169 DEBUG:teuthology.orchestra.run.smithi087:> sudo stdin-killer -- python3 -c ' 2024-05-27T06:28:59.169 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-05-27T06:28:59.169 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-05-27T06:28:59.169 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-05-27T06:28:59.169 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-05-27T06:28:59.169 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:28:59.169 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-05-27T06:28:59.169 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-27T06:28:59.169 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-05-27T06:28:59.170 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-27T06:28:59.170 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:28:59.170 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-05-27T06:28:59.170 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-05-27T06:28:59.170 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-05-27T06:28:59.170 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-05-27T06:28:59.170 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:28:59.170 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-05-27T06:28:59.170 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-27T06:28:59.170 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-27T06:28:59.170 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-27T06:28:59.171 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-05-27T06:28:59.171 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-05-27T06:28:59.171 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-05-27T06:28:59.171 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-27T06:28:59.171 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:28:59.171 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.0")) 2024-05-27T06:28:59.171 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-05-27T06:28:59.293 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.0.37635.asok 2024-05-27T06:28:59.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:28:59.304 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37635.asok 2024-05-27T06:28:59.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:59.304 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37635.asok status 2024-05-27T06:28:59.481 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-27T06:28:59.481 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-05-27T06:28:59.481 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "38f9d900c83c63799fbdbe61acc9a11b0d3554a6", 2024-05-27T06:28:59.481 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 19.0.0-3872-g38f9d900 (38f9d900c83c63799fbdbe61acc9a11b0d3554a6) squid (dev)", 2024-05-27T06:28:59.482 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "0", 2024-05-27T06:28:59.482 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-05-27T06:28:59.482 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-27T06:28:59.482 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "37635", 2024-05-27T06:28:59.482 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-05-27T06:28:59.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:59.482 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-05-27T06:28:59.482 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-05-27T06:28:59.482 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 5196, 2024-05-27T06:28:59.482 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-05-27T06:28:59.482 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-05-27T06:28:59.482 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-05-27T06:28:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 5196 2024-05-27T06:28:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-05-27T06:28:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-05-27T06:28:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-05-27T06:28:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3152312300 2024-05-27T06:28:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:28:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-05-27T06:28:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-05-27T06:28:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-05-27T06:28:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3152312300 2024-05-27T06:28:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:28:59.484 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.5196 192.168.0.1:0/3152312300", 2024-05-27T06:28:59.484 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/3152312300", 2024-05-27T06:28:59.484 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-05-27T06:28:59.484 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 19, 2024-05-27T06:28:59.484 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 41, 2024-05-27T06:28:59.484 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-05-27T06:28:59.484 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-05-27T06:28:59.484 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-05-27T06:28:59.484 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-27T06:28:59.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:59.497 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-05-27T06:28:59.497 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-27T06:28:59.506 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-05-27T06:28:59.507 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-27T06:28:59.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:59.507 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-27T06:28:59.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:59.572 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2024-05-27T06:28:59.623 INFO:teuthology.orchestra.run.smithi087.stderr:setfattr: layoutfile: Permission denied 2024-05-27T06:28:59.624 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T06:28:59.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:28:59.625 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2024-05-27T06:28:59.674 INFO:teuthology.orchestra.run.smithi087.stderr:setfattr: layoutdir: Permission denied 2024-05-27T06:28:59.675 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T06:28:59.676 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:28:59.676 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:28:59.725 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T06:28:59.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.917+0000 7f983c600640 1 Processor -- start 2024-05-27T06:28:59.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.917+0000 7f983c600640 1 -- start start 2024-05-27T06:28:59.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.917+0000 7f983c600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f983406efc0 0x7f983406f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:59.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.917+0000 7f983c600640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f983406f910 con 0x7f983406c720 2024-05-27T06:28:59.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.917+0000 7f983c600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f983406fe20 con 0x7f98340aec30 2024-05-27T06:28:59.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.917+0000 7f983c600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f98340b0ba0 con 0x7f983406efc0 2024-05-27T06:28:59.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f983a600640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f983406c720 0x7f983406cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:55930/0 (socket says 172.21.15.87:55930) 2024-05-27T06:28:59.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f983a600640 1 -- 172.21.15.87:0/231545034 learned_addr learned my addr 172.21.15.87:0/231545034 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:28:59.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f9839200640 1 --2- 172.21.15.87:0/231545034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f983406efc0 0x7f983406f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:59.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f9833e00640 1 -- 172.21.15.87:0/231545034 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 482235675 0 0) 0x7f982c0014a0 con 0x7f983406c720 2024-05-27T06:28:59.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f9833e00640 1 -- 172.21.15.87:0/231545034 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f981c003530 con 0x7f983406c720 2024-05-27T06:28:59.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f9833e00640 1 -- 172.21.15.87:0/231545034 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4235307558 0 0) 0x7f983406fe20 con 0x7f98340aec30 2024-05-27T06:28:59.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f9833e00640 1 -- 172.21.15.87:0/231545034 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f982c0014a0 con 0x7f98340aec30 2024-05-27T06:28:59.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f9833e00640 1 -- 172.21.15.87:0/231545034 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2388539259 0 0) 0x7f981c003530 con 0x7f983406c720 2024-05-27T06:28:59.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f9833e00640 1 -- 172.21.15.87:0/231545034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f983406efc0 msgr2=0x7f983406f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:59.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f9833e00640 1 --2- 172.21.15.87:0/231545034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f983406efc0 0x7f983406f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:59.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f9833e00640 1 -- 172.21.15.87:0/231545034 >> v1:172.21.15.149:6789/0 conn(0x7f98340aec30 legacy=0x7f98340702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:59.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f9833e00640 1 -- 172.21.15.87:0/231545034 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f983415ef50 con 0x7f983406c720 2024-05-27T06:28:59.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f9833e00640 1 -- 172.21.15.87:0/231545034 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7f982c001c50 con 0x7f983406c720 2024-05-27T06:28:59.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f9839200640 1 --2- 172.21.15.87:0/231545034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f983406efc0 0x7f983406f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:28:59.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f9833e00640 1 -- 172.21.15.87:0/231545034 >> v1:172.21.15.87:6789/0 conn(0x7f983406c720 legacy=0x7f983406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:59.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f9833e00640 1 --2- 172.21.15.87:0/231545034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f981c003c20 0x7f981c004070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:59.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f9833e00640 1 --2- 172.21.15.87:0/231545034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f983406efc0 0x7f981c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:59.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f9833e00640 1 --2- 172.21.15.87:0/231545034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f981c004dc0 0x7f981c005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:59.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f9833e00640 1 -- 172.21.15.87:0/231545034 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f98340b0ba0 con 0x7f981c003c20 2024-05-27T06:28:59.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f9833e00640 1 -- 172.21.15.87:0/231545034 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f981c00bd00 con 0x7f981c004dc0 2024-05-27T06:28:59.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f9833e00640 1 -- 172.21.15.87:0/231545034 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f981c00bf00 con 0x7f983406efc0 2024-05-27T06:28:59.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f9839c00640 1 --2- 172.21.15.87:0/231545034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f981c003c20 0x7f981c004070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:59.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f9839200640 1 --2- 172.21.15.87:0/231545034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f983406efc0 0x7f981c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:59.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f983a600640 1 --2- 172.21.15.87:0/231545034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f981c004dc0 0x7f981c005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:59.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f9839c00640 1 -- 172.21.15.87:0/231545034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f983406efc0 msgr2=0x7f981c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:59.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f9839c00640 1 --2- 172.21.15.87:0/231545034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f983406efc0 0x7f981c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:59.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f9839c00640 1 -- 172.21.15.87:0/231545034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f981c004dc0 msgr2=0x7f981c005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:28:59.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f9839c00640 1 --2- 172.21.15.87:0/231545034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f981c004dc0 0x7f981c005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:59.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f9839c00640 1 -- 172.21.15.87:0/231545034 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981c003530 con 0x7f981c003c20 2024-05-27T06:28:59.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.921+0000 7f983a600640 1 --2- 172.21.15.87:0/231545034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f981c004dc0 0x7f981c005290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:28:59.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.925+0000 7f9839c00640 1 --2- 172.21.15.87:0/231545034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f981c003c20 0x7f981c004070 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9828001900 tx=0x7f982801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ecf37861187748 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:59.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.925+0000 7f9833e00640 1 -- 172.21.15.87:0/231545034 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98280a8050 con 0x7f981c003c20 2024-05-27T06:28:59.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.925+0000 7f9833e00640 1 -- 172.21.15.87:0/231545034 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98280052d0 con 0x7f981c003c20 2024-05-27T06:28:59.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.925+0000 7f9833e00640 1 -- 172.21.15.87:0/231545034 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9828001550 con 0x7f981c003c20 2024-05-27T06:28:59.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.925+0000 7f983c600640 1 -- 172.21.15.87:0/231545034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f981c003c20 msgr2=0x7f981c004070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:59.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.925+0000 7f983c600640 1 --2- 172.21.15.87:0/231545034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f981c003c20 0x7f981c004070 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9828001900 tx=0x7f982801c500 comp rx=0 tx=0).stop 2024-05-27T06:28:59.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.925+0000 7f983a600640 1 -- 172.21.15.87:0/231545034 reap_dead start 2024-05-27T06:28:59.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.925+0000 7f983c600640 1 -- 172.21.15.87:0/231545034 shutdown_connections 2024-05-27T06:28:59.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.925+0000 7f983c600640 1 -- 172.21.15.87:0/231545034 >> 172.21.15.87:0/231545034 conn(0x7f98340b2fb0 msgr2=0x7f98340b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:28:59.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.925+0000 7f983c600640 1 -- 172.21.15.87:0/231545034 shutdown_connections 2024-05-27T06:28:59.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.925+0000 7f983c600640 1 -- 172.21.15.87:0/231545034 wait complete. 2024-05-27T06:28:59.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.925+0000 7f983c600640 1 Processor -- start 2024-05-27T06:28:59.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.929+0000 7f983c600640 1 -- start start 2024-05-27T06:28:59.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.929+0000 7f983c600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f981c003c20 0x7f9834073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:59.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.929+0000 7f983c600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f983414c840 0x7f98341f9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:59.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.929+0000 7f983c600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9834163970 0x7f9834163d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:59.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.929+0000 7f983c600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f983406df40 con 0x7f983414c840 2024-05-27T06:28:59.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.929+0000 7f983c600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f98340b0530 con 0x7f981c003c20 2024-05-27T06:28:59.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.929+0000 7f983c600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f983406e0c0 con 0x7f9834163970 2024-05-27T06:28:59.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.929+0000 7f9839200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f983414c840 0x7f98341f9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:59.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.929+0000 7f9839200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f983414c840 0x7f98341f9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33902/0 (socket says 172.21.15.87:33902) 2024-05-27T06:28:59.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.929+0000 7f9839200640 1 -- 172.21.15.87:0/3188149920 learned_addr learned my addr 172.21.15.87:0/3188149920 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:28:59.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.929+0000 7f983a600640 1 --2- 172.21.15.87:0/3188149920 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9834163970 0x7f9834163d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:59.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.929+0000 7f9839c00640 1 --2- 172.21.15.87:0/3188149920 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f981c003c20 0x7f9834073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:59.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.929+0000 7f9839200640 1 -- 172.21.15.87:0/3188149920 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9834163970 msgr2=0x7f9834163d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:59.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.929+0000 7f9839200640 1 --2- 172.21.15.87:0/3188149920 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9834163970 0x7f9834163d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:59.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.929+0000 7f9839200640 1 -- 172.21.15.87:0/3188149920 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f981c003c20 msgr2=0x7f9834073480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:28:59.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.929+0000 7f9839200640 1 --2- 172.21.15.87:0/3188149920 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f981c003c20 0x7f9834073480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:28:59.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.929+0000 7f9839200640 1 -- 172.21.15.87:0/3188149920 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98341642c0 con 0x7f983414c840 2024-05-27T06:28:59.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.929+0000 7f9839c00640 1 --2- 172.21.15.87:0/3188149920 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f981c003c20 0x7f9834073480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:28:59.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.929+0000 7f9839200640 1 --2- 172.21.15.87:0/3188149920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f983414c840 0x7f98341f9340 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f98200119d0 tx=0x7f9820011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:59.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.929+0000 7f9831600640 1 -- 172.21.15.87:0/3188149920 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982000fb50 con 0x7f983414c840 2024-05-27T06:28:59.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.929+0000 7f9831600640 1 -- 172.21.15.87:0/3188149920 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f982000fcf0 con 0x7f983414c840 2024-05-27T06:28:59.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.929+0000 7f983c600640 1 -- 172.21.15.87:0/3188149920 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f983414e7c0 con 0x7f983414c840 2024-05-27T06:28:59.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.929+0000 7f9831600640 1 -- 172.21.15.87:0/3188149920 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982000fea0 con 0x7f983414c840 2024-05-27T06:28:59.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.929+0000 7f983c600640 1 -- 172.21.15.87:0/3188149920 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f983414e200 con 0x7f983414c840 2024-05-27T06:28:59.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.929+0000 7f983c600640 1 -- 172.21.15.87:0/3188149920 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9834073a10 con 0x7f983414c840 2024-05-27T06:28:59.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.933+0000 7f9831600640 1 -- 172.21.15.87:0/3188149920 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9820012040 con 0x7f983414c840 2024-05-27T06:28:59.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.933+0000 7f9831600640 1 --2- 172.21.15.87:0/3188149920 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f981406f430 0x7f9814071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:28:59.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.933+0000 7f9831600640 1 -- 172.21.15.87:0/3188149920 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f982008fa50 con 0x7f983414c840 2024-05-27T06:28:59.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.933+0000 7f9839c00640 1 --2- 172.21.15.87:0/3188149920 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f981406f430 0x7f9814071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:28:59.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.933+0000 7f9839c00640 1 --2- 172.21.15.87:0/3188149920 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f981406f430 0x7f9814071940 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f981c0057f0 tx=0x7f9828001370 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:28:59.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:28:59.937+0000 7f9831600640 1 -- 172.21.15.87:0/3188149920 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f9834073a10 con 0x7f983414c840 2024-05-27T06:29:00.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.105+0000 7f983c600640 1 -- 172.21.15.87:0/3188149920 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f983406aa30 con 0x7f983414c840 2024-05-27T06:29:00.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.105+0000 7f9831600640 1 -- 172.21.15.87:0/3188149920 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) ==== 80+0+0 (secure 0 0 0) 0x7f98341642c0 con 0x7f983414c840 2024-05-27T06:29:00.104 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2024-05-27T06:29:00.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.109+0000 7f983c600640 1 -- 172.21.15.87:0/3188149920 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f981406f430 msgr2=0x7f9814071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:00.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.109+0000 7f983c600640 1 --2- 172.21.15.87:0/3188149920 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f981406f430 0x7f9814071940 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f981c0057f0 tx=0x7f9828001370 comp rx=0 tx=0).stop 2024-05-27T06:29:00.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.109+0000 7f983c600640 1 -- 172.21.15.87:0/3188149920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f983414c840 msgr2=0x7f98341f9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:00.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.109+0000 7f983c600640 1 --2- 172.21.15.87:0/3188149920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f983414c840 0x7f98341f9340 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f98200119d0 tx=0x7f9820011e90 comp rx=0 tx=0).stop 2024-05-27T06:29:00.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.109+0000 7f983c600640 1 -- 172.21.15.87:0/3188149920 shutdown_connections 2024-05-27T06:29:00.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.109+0000 7f983c600640 1 --2- 172.21.15.87:0/3188149920 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f981406f430 0x7f9814071940 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:00.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.109+0000 7f983c600640 1 --2- 172.21.15.87:0/3188149920 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9834163970 0x7f9834163d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:00.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.109+0000 7f983c600640 1 --2- 172.21.15.87:0/3188149920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f983414c840 0x7f98341f9340 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:00.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.109+0000 7f983c600640 1 --2- 172.21.15.87:0/3188149920 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f981c003c20 0x7f9834073480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:00.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.109+0000 7f983c600640 1 -- 172.21.15.87:0/3188149920 >> 172.21.15.87:0/3188149920 conn(0x7f98340b2fb0 msgr2=0x7f983415ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:00.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.109+0000 7f983c600640 1 -- 172.21.15.87:0/3188149920 shutdown_connections 2024-05-27T06:29:00.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.109+0000 7f983c600640 1 -- 172.21.15.87:0/3188149920 wait complete. 2024-05-27T06:29:00.126 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:29:00.126 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:29:00.135 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T06:29:00.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.325+0000 7f5ad9200640 1 Processor -- start 2024-05-27T06:29:00.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.325+0000 7f5ad9200640 1 -- start start 2024-05-27T06:29:00.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.329+0000 7f5ad9200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5ad40aec30 0x7f5ad40702b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:00.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.329+0000 7f5ad9200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ad406efc0 0x7f5ad406f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:00.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.329+0000 7f5ad9200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ad406f910 con 0x7f5ad406c720 2024-05-27T06:29:00.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.329+0000 7f5ad9200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f5ad406fe20 con 0x7f5ad40aec30 2024-05-27T06:29:00.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.329+0000 7f5ad9200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad40b0ba0 con 0x7f5ad406efc0 2024-05-27T06:29:00.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.329+0000 7f5ad1400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ad406efc0 0x7f5ad406f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:00.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.329+0000 7f5ad1e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5ad40aec30 0x7f5ad40702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:00.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.329+0000 7f5ad1e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5ad40aec30 0x7f5ad40702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:48754/0 (socket says 172.21.15.87:48754) 2024-05-27T06:29:00.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.329+0000 7f5ad1e00640 1 -- 172.21.15.87:0/4032142173 learned_addr learned my addr 172.21.15.87:0/4032142173 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:00.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.329+0000 7f5ad1400640 1 --2- 172.21.15.87:0/4032142173 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ad406efc0 0x7f5ad406f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.87:52470/0 (socket says 172.21.15.87:52470) 2024-05-27T06:29:00.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.329+0000 7f5ad1e00640 1 -- 172.21.15.87:0/4032142173 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ad406efc0 msgr2=0x7f5ad406f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:00.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.329+0000 7f5ad1e00640 1 --2- 172.21.15.87:0/4032142173 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ad406efc0 0x7f5ad406f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:00.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.329+0000 7f5ad1e00640 1 -- 172.21.15.87:0/4032142173 >> v1:172.21.15.149:6789/0 conn(0x7f5ad406c720 legacy=0x7f5ad406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:00.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.329+0000 7f5ad1e00640 1 -- 172.21.15.87:0/4032142173 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad415ef50 con 0x7f5ad40aec30 2024-05-27T06:29:00.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.329+0000 7f5ad1400640 1 --2- 172.21.15.87:0/4032142173 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ad406efc0 0x7f5ad406f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:29:00.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.333+0000 7f5ad1e00640 1 --2- 172.21.15.87:0/4032142173 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ad40aec30 0x7f5ad40702b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4009e50 tx=0x7f5ac401c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed90798799f73d7c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:00.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.333+0000 7f5ad0a00640 1 -- 172.21.15.87:0/4032142173 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac40a56e0 con 0x7f5ad40aec30 2024-05-27T06:29:00.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.333+0000 7f5ad0a00640 1 -- 172.21.15.87:0/4032142173 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac40a5880 con 0x7f5ad40aec30 2024-05-27T06:29:00.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.333+0000 7f5ad0a00640 1 -- 172.21.15.87:0/4032142173 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac40a5c50 con 0x7f5ad40aec30 2024-05-27T06:29:00.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.333+0000 7f5ad9200640 1 -- 172.21.15.87:0/4032142173 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ad40aec30 msgr2=0x7f5ad40702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:00.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.333+0000 7f5ad9200640 1 --2- 172.21.15.87:0/4032142173 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ad40aec30 0x7f5ad40702b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4009e50 tx=0x7f5ac401c910 comp rx=0 tx=0).stop 2024-05-27T06:29:00.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.333+0000 7f5ad9200640 1 -- 172.21.15.87:0/4032142173 shutdown_connections 2024-05-27T06:29:00.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.333+0000 7f5ad9200640 1 --2- 172.21.15.87:0/4032142173 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ad406efc0 0x7f5ad406f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:00.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.333+0000 7f5ad9200640 1 --2- 172.21.15.87:0/4032142173 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ad40aec30 0x7f5ad40702b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:00.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.333+0000 7f5ad9200640 1 -- 172.21.15.87:0/4032142173 >> 172.21.15.87:0/4032142173 conn(0x7f5ad40b2fb0 msgr2=0x7f5ad40b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:00.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.333+0000 7f5ad9200640 1 -- 172.21.15.87:0/4032142173 shutdown_connections 2024-05-27T06:29:00.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.333+0000 7f5ad9200640 1 -- 172.21.15.87:0/4032142173 wait complete. 2024-05-27T06:29:00.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.333+0000 7f5ad9200640 1 Processor -- start 2024-05-27T06:29:00.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.337+0000 7f5ad9200640 1 -- start start 2024-05-27T06:29:00.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.337+0000 7f5ad9200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ad406c720 0x7f5ad4146990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:00.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.337+0000 7f5ad9200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ad406efc0 0x7f5ad4150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:00.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.337+0000 7f5ad9200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ad40aec30 0x7f5ad414a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:00.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.337+0000 7f5ad9200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad406df40 con 0x7f5ad406c720 2024-05-27T06:29:00.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.337+0000 7f5ad9200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad40af040 con 0x7f5ad40aec30 2024-05-27T06:29:00.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.337+0000 7f5ad9200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad406e0c0 con 0x7f5ad406efc0 2024-05-27T06:29:00.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.337+0000 7f5ad1e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ad406c720 0x7f5ad4146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:00.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.337+0000 7f5ad1e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ad406c720 0x7f5ad4146990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33910/0 (socket says 172.21.15.87:33910) 2024-05-27T06:29:00.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.337+0000 7f5ad1e00640 1 -- 172.21.15.87:0/3695827586 learned_addr learned my addr 172.21.15.87:0/3695827586 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:00.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.337+0000 7f5ad1400640 1 --2- 172.21.15.87:0/3695827586 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ad406efc0 0x7f5ad4150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:00.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.337+0000 7f5ad2800640 1 --2- 172.21.15.87:0/3695827586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ad40aec30 0x7f5ad414a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:00.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.337+0000 7f5ad1e00640 1 -- 172.21.15.87:0/3695827586 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ad406efc0 msgr2=0x7f5ad4150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:00.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.337+0000 7f5ad1e00640 1 --2- 172.21.15.87:0/3695827586 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ad406efc0 0x7f5ad4150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:00.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.337+0000 7f5ad1e00640 1 -- 172.21.15.87:0/3695827586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ad40aec30 msgr2=0x7f5ad414a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:00.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.337+0000 7f5ad1e00640 1 --2- 172.21.15.87:0/3695827586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ad40aec30 0x7f5ad414a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:00.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.337+0000 7f5ad1e00640 1 -- 172.21.15.87:0/3695827586 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad4150a70 con 0x7f5ad406c720 2024-05-27T06:29:00.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.337+0000 7f5ad1400640 1 --2- 172.21.15.87:0/3695827586 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ad406efc0 0x7f5ad4150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:29:00.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.337+0000 7f5ad1e00640 1 --2- 172.21.15.87:0/3695827586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ad406c720 0x7f5ad4146990 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5ac401a540 tx=0x7f5ac40196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:00.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.337+0000 7f5aca000640 1 -- 172.21.15.87:0/3695827586 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac40bc020 con 0x7f5ad406c720 2024-05-27T06:29:00.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.337+0000 7f5aca000640 1 -- 172.21.15.87:0/3695827586 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac40b8690 con 0x7f5ad406c720 2024-05-27T06:29:00.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.337+0000 7f5aca000640 1 -- 172.21.15.87:0/3695827586 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4009510 con 0x7f5ad406c720 2024-05-27T06:29:00.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.337+0000 7f5ad9200640 1 -- 172.21.15.87:0/3695827586 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad41471e0 con 0x7f5ad406c720 2024-05-27T06:29:00.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.337+0000 7f5ad9200640 1 -- 172.21.15.87:0/3695827586 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad41477a0 con 0x7f5ad406c720 2024-05-27T06:29:00.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.341+0000 7f5ad9200640 1 -- 172.21.15.87:0/3695827586 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ad406aa30 con 0x7f5ad406c720 2024-05-27T06:29:00.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.341+0000 7f5aca000640 1 -- 172.21.15.87:0/3695827586 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5ac40bf020 con 0x7f5ad406c720 2024-05-27T06:29:00.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.341+0000 7f5aca000640 1 --2- 172.21.15.87:0/3695827586 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5ab406f430 0x7f5ab4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:00.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.341+0000 7f5aca000640 1 -- 172.21.15.87:0/3695827586 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f5ac4129e90 con 0x7f5ad406c720 2024-05-27T06:29:00.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.341+0000 7f5ad1400640 1 --2- 172.21.15.87:0/3695827586 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5ab406f430 0x7f5ab4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:00.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.341+0000 7f5ad1400640 1 --2- 172.21.15.87:0/3695827586 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5ab406f430 0x7f5ab4071940 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4161140 tx=0x7f5ac0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:00.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.345+0000 7f5aca000640 1 -- 172.21.15.87:0/3695827586 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f5ac4016620 con 0x7f5ad406c720 2024-05-27T06:29:00.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.513+0000 7f5ad9200640 1 -- 172.21.15.87:0/3695827586 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5ad4155740 con 0x7f5ad406c720 2024-05-27T06:29:00.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.513+0000 7f5aca000640 1 -- 172.21.15.87:0/3695827586 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) ==== 80+0+0 (secure 0 0 0) 0x7f5ac40f69f0 con 0x7f5ad406c720 2024-05-27T06:29:00.512 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2024-05-27T06:29:00.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.517+0000 7f5ad9200640 1 -- 172.21.15.87:0/3695827586 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5ab406f430 msgr2=0x7f5ab4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:00.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.517+0000 7f5ad9200640 1 --2- 172.21.15.87:0/3695827586 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5ab406f430 0x7f5ab4071940 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4161140 tx=0x7f5ac0008040 comp rx=0 tx=0).stop 2024-05-27T06:29:00.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.517+0000 7f5ad9200640 1 -- 172.21.15.87:0/3695827586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ad406c720 msgr2=0x7f5ad4146990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:00.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.517+0000 7f5ad9200640 1 --2- 172.21.15.87:0/3695827586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ad406c720 0x7f5ad4146990 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5ac401a540 tx=0x7f5ac40196b0 comp rx=0 tx=0).stop 2024-05-27T06:29:00.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.517+0000 7f5ad9200640 1 -- 172.21.15.87:0/3695827586 shutdown_connections 2024-05-27T06:29:00.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.517+0000 7f5ad9200640 1 --2- 172.21.15.87:0/3695827586 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5ab406f430 0x7f5ab4071940 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:00.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.517+0000 7f5ad9200640 1 --2- 172.21.15.87:0/3695827586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ad40aec30 0x7f5ad414a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:00.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.517+0000 7f5ad9200640 1 --2- 172.21.15.87:0/3695827586 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ad406efc0 0x7f5ad4150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:00.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.517+0000 7f5ad9200640 1 --2- 172.21.15.87:0/3695827586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ad406c720 0x7f5ad4146990 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:00.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.517+0000 7f5ad9200640 1 -- 172.21.15.87:0/3695827586 >> 172.21.15.87:0/3695827586 conn(0x7f5ad40b2fb0 msgr2=0x7f5ad40b1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:00.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.517+0000 7f5ad9200640 1 -- 172.21.15.87:0/3695827586 shutdown_connections 2024-05-27T06:29:00.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:00.517+0000 7f5ad9200640 1 -- 172.21.15.87:0/3695827586 wait complete. 2024-05-27T06:29:00.537 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-05-27T06:29:00.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:00.537 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-27T06:29:00.555 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[37635]: fuse finished with error 0 and tester_r 0 2024-05-27T06:29:00.557 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:29:06.438 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T06:29:06.442 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T06:29:06.658 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-05-27T06:29:06.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:06.659 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-27T06:29:06.669 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rwp' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2024-05-27T06:29:06.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.885+0000 7fab34600640 1 Processor -- start 2024-05-27T06:29:06.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.885+0000 7fab34600640 1 -- start start 2024-05-27T06:29:06.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.885+0000 7fab34600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab2c073640 0x7fab2c073a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:06.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.885+0000 7fab34600640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab2c160250 con 0x7fab2c06eb20 2024-05-27T06:29:06.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.885+0000 7fab34600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab2c0b0790 con 0x7fab2c0d1700 2024-05-27T06:29:06.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.885+0000 7fab34600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fab2c0731b0 con 0x7fab2c073640 2024-05-27T06:29:06.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.885+0000 7fab31c00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fab2c06eb20 0x7fab2c06d810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48532/0 (socket says 172.21.15.87:48532) 2024-05-27T06:29:06.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.885+0000 7fab31c00640 1 -- 172.21.15.87:0/3819292800 learned_addr learned my addr 172.21.15.87:0/3819292800 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:29:06.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.885+0000 7fab32600640 1 --2- 172.21.15.87:0/3819292800 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab2c073640 0x7fab2c073a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:06.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.885+0000 7fab2be00640 1 -- 172.21.15.87:0/3819292800 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 155062401 0 0) 0x7fab200014a0 con 0x7fab2c06eb20 2024-05-27T06:29:06.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.885+0000 7fab2be00640 1 -- 172.21.15.87:0/3819292800 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab14003530 con 0x7fab2c06eb20 2024-05-27T06:29:06.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.885+0000 7fab2be00640 1 -- 172.21.15.87:0/3819292800 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 94800549 0 0) 0x7fab2c0b0790 con 0x7fab2c0d1700 2024-05-27T06:29:06.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.885+0000 7fab2be00640 1 -- 172.21.15.87:0/3819292800 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab200014a0 con 0x7fab2c0d1700 2024-05-27T06:29:06.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.885+0000 7fab2be00640 1 -- 172.21.15.87:0/3819292800 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 68958311 0 0) 0x7fab14003530 con 0x7fab2c06eb20 2024-05-27T06:29:06.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.885+0000 7fab2be00640 1 -- 172.21.15.87:0/3819292800 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab2c073640 msgr2=0x7fab2c073a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:06.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.885+0000 7fab2be00640 1 --2- 172.21.15.87:0/3819292800 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab2c073640 0x7fab2c073a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:06.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.885+0000 7fab2be00640 1 -- 172.21.15.87:0/3819292800 >> v1:172.21.15.149:6789/0 conn(0x7fab2c0d1700 legacy=0x7fab2c0d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:06.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.889+0000 7fab2be00640 1 -- 172.21.15.87:0/3819292800 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab2c0b0a70 con 0x7fab2c06eb20 2024-05-27T06:29:06.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.889+0000 7fab2be00640 1 -- 172.21.15.87:0/3819292800 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7fab20001c50 con 0x7fab2c06eb20 2024-05-27T06:29:06.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.889+0000 7fab2be00640 1 -- 172.21.15.87:0/3819292800 >> v1:172.21.15.87:6789/0 conn(0x7fab2c06eb20 legacy=0x7fab2c06d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:06.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.889+0000 7fab2be00640 1 --2- 172.21.15.87:0/3819292800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab14003c70 0x7fab140040c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:06.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.889+0000 7fab2be00640 1 --2- 172.21.15.87:0/3819292800 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab2c073640 0x7fab14004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:06.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.889+0000 7fab2be00640 1 --2- 172.21.15.87:0/3819292800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab14004dc0 0x7fab14005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:06.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.889+0000 7fab2be00640 1 -- 172.21.15.87:0/3819292800 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fab2c0731b0 con 0x7fab14004dc0 2024-05-27T06:29:06.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.889+0000 7fab2be00640 1 -- 172.21.15.87:0/3819292800 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fab1400bc30 con 0x7fab14003c70 2024-05-27T06:29:06.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.889+0000 7fab2be00640 1 -- 172.21.15.87:0/3819292800 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fab1400be30 con 0x7fab2c073640 2024-05-27T06:29:06.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.889+0000 7fab32600640 1 --2- 172.21.15.87:0/3819292800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab14004dc0 0x7fab14005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:06.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.889+0000 7fab31200640 1 --2- 172.21.15.87:0/3819292800 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab2c073640 0x7fab14004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:06.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.889+0000 7fab31c00640 1 --2- 172.21.15.87:0/3819292800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab14003c70 0x7fab140040c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:06.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.889+0000 7fab32600640 1 -- 172.21.15.87:0/3819292800 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab2c073640 msgr2=0x7fab14004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:06.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.889+0000 7fab32600640 1 --2- 172.21.15.87:0/3819292800 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab2c073640 0x7fab14004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:06.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.889+0000 7fab32600640 1 -- 172.21.15.87:0/3819292800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab14003c70 msgr2=0x7fab140040c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:06.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.889+0000 7fab32600640 1 --2- 172.21.15.87:0/3819292800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab14003c70 0x7fab140040c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:06.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.889+0000 7fab32600640 1 -- 172.21.15.87:0/3819292800 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab14003530 con 0x7fab14004dc0 2024-05-27T06:29:06.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.889+0000 7fab32600640 1 --2- 172.21.15.87:0/3819292800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab14004dc0 0x7fab14005290 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fab2c164a70 tx=0x7fab2401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d85a4fdcc2792a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:06.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.893+0000 7fab2be00640 1 -- 172.21.15.87:0/3819292800 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab240b2070 con 0x7fab14004dc0 2024-05-27T06:29:06.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.893+0000 7fab2be00640 1 -- 172.21.15.87:0/3819292800 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab240a5510 con 0x7fab14004dc0 2024-05-27T06:29:06.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.893+0000 7fab2be00640 1 -- 172.21.15.87:0/3819292800 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab240096b0 con 0x7fab14004dc0 2024-05-27T06:29:06.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.893+0000 7fab34600640 1 -- 172.21.15.87:0/3819292800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab14004dc0 msgr2=0x7fab14005290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:06.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.893+0000 7fab34600640 1 --2- 172.21.15.87:0/3819292800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab14004dc0 0x7fab14005290 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fab2c164a70 tx=0x7fab2401ca30 comp rx=0 tx=0).stop 2024-05-27T06:29:06.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.893+0000 7fab32600640 1 -- 172.21.15.87:0/3819292800 reap_dead start 2024-05-27T06:29:06.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.893+0000 7fab34600640 1 -- 172.21.15.87:0/3819292800 shutdown_connections 2024-05-27T06:29:06.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.893+0000 7fab34600640 1 -- 172.21.15.87:0/3819292800 >> 172.21.15.87:0/3819292800 conn(0x7fab2c0b46b0 msgr2=0x7fab2c0b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:06.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.893+0000 7fab34600640 1 -- 172.21.15.87:0/3819292800 shutdown_connections 2024-05-27T06:29:06.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.893+0000 7fab34600640 1 -- 172.21.15.87:0/3819292800 wait complete. 2024-05-27T06:29:06.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.893+0000 7fab34600640 1 Processor -- start 2024-05-27T06:29:06.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.893+0000 7fab34600640 1 -- start start 2024-05-27T06:29:06.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.897+0000 7fab34600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab14004dc0 0x7fab2c14fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:06.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.897+0000 7fab34600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab2c0b2220 0x7fab2c161480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:06.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.897+0000 7fab34600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab2c0b2630 0x7fab2c1619c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:06.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.897+0000 7fab34600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fab2c0b0460 con 0x7fab2c0b2630 2024-05-27T06:29:06.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.897+0000 7fab34600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fab2c072e40 con 0x7fab14004dc0 2024-05-27T06:29:06.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.897+0000 7fab34600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fab2c06ef30 con 0x7fab2c0b2220 2024-05-27T06:29:06.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.897+0000 7fab32600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab2c0b2630 0x7fab2c1619c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:06.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.897+0000 7fab32600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab2c0b2630 0x7fab2c1619c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51032/0 (socket says 172.21.15.87:51032) 2024-05-27T06:29:06.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.897+0000 7fab32600640 1 -- 172.21.15.87:0/136899784 learned_addr learned my addr 172.21.15.87:0/136899784 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:06.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.897+0000 7fab31200640 1 --2- 172.21.15.87:0/136899784 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab2c0b2220 0x7fab2c161480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:06.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.897+0000 7fab31c00640 1 --2- 172.21.15.87:0/136899784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab14004dc0 0x7fab2c14fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:06.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.897+0000 7fab32600640 1 -- 172.21.15.87:0/136899784 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab2c0b2220 msgr2=0x7fab2c161480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:06.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.897+0000 7fab32600640 1 --2- 172.21.15.87:0/136899784 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab2c0b2220 0x7fab2c161480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:06.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.897+0000 7fab32600640 1 -- 172.21.15.87:0/136899784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab14004dc0 msgr2=0x7fab2c14fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:06.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.897+0000 7fab32600640 1 --2- 172.21.15.87:0/136899784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab14004dc0 0x7fab2c14fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:06.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.897+0000 7fab32600640 1 -- 172.21.15.87:0/136899784 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab2c154600 con 0x7fab2c0b2630 2024-05-27T06:29:06.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.897+0000 7fab32600640 1 --2- 172.21.15.87:0/136899784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab2c0b2630 0x7fab2c1619c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fab240b0040 tx=0x7fab14005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:06.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.897+0000 7fab29600640 1 -- 172.21.15.87:0/136899784 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab240bb070 con 0x7fab2c0b2630 2024-05-27T06:29:06.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.897+0000 7fab29600640 1 -- 172.21.15.87:0/136899784 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab24000e50 con 0x7fab2c0b2630 2024-05-27T06:29:06.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.897+0000 7fab34600640 1 -- 172.21.15.87:0/136899784 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab2c1548e0 con 0x7fab2c0b2630 2024-05-27T06:29:06.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.897+0000 7fab29600640 1 -- 172.21.15.87:0/136899784 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab240b2040 con 0x7fab2c0b2630 2024-05-27T06:29:06.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.897+0000 7fab34600640 1 -- 172.21.15.87:0/136899784 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab2c0b1d30 con 0x7fab2c0b2630 2024-05-27T06:29:06.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.897+0000 7fab34600640 1 -- 172.21.15.87:0/136899784 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab2c069a20 con 0x7fab2c0b2630 2024-05-27T06:29:06.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.901+0000 7fab29600640 1 -- 172.21.15.87:0/136899784 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fab240be070 con 0x7fab2c0b2630 2024-05-27T06:29:06.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.901+0000 7fab29600640 1 --2- 172.21.15.87:0/136899784 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fab0c06f400 0x7fab0c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:06.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.901+0000 7fab29600640 1 -- 172.21.15.87:0/136899784 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7fab24128a30 con 0x7fab2c0b2630 2024-05-27T06:29:06.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.901+0000 7fab31c00640 1 --2- 172.21.15.87:0/136899784 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fab0c06f400 0x7fab0c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:06.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.901+0000 7fab31c00640 1 --2- 172.21.15.87:0/136899784 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fab0c06f400 0x7fab0c071910 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fab200021c0 tx=0x7fab20001370 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:06.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:06.905+0000 7fab29600640 1 -- 172.21.15.87:0/136899784 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fab24016740 con 0x7fab2c0b2630 2024-05-27T06:29:07.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.121+0000 7fab34600640 1 -- 172.21.15.87:0/136899784 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) -- 0x7fab2c06aa30 con 0x7fab2c0b2630 2024-05-27T06:29:07.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.125+0000 7fab29600640 1 -- 172.21.15.87:0/136899784 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v15) ==== 211+0+168 (secure 0 0 0) 0x7fab240f5000 con 0x7fab2c0b2630 2024-05-27T06:29:07.125 INFO:teuthology.orchestra.run.smithi087.stdout:[client.0] 2024-05-27T06:29:07.125 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCfJ1RmAld8BxAAigqU2F3mGXtAfw0L9Bfp2A== 2024-05-27T06:29:07.125 INFO:teuthology.orchestra.run.smithi087.stdout: caps mds = "allow rwp" 2024-05-27T06:29:07.125 INFO:teuthology.orchestra.run.smithi087.stdout: caps mon = "allow r" 2024-05-27T06:29:07.125 INFO:teuthology.orchestra.run.smithi087.stdout: caps osd = "allow rw pool=cephfs_data,allow rw pool=data_new" 2024-05-27T06:29:07.125 INFO:teuthology.orchestra.run.smithi087.stderr:updated caps for client.0 2024-05-27T06:29:07.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.129+0000 7fab34600640 1 -- 172.21.15.87:0/136899784 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fab0c06f400 msgr2=0x7fab0c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:07.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.129+0000 7fab34600640 1 --2- 172.21.15.87:0/136899784 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fab0c06f400 0x7fab0c071910 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fab200021c0 tx=0x7fab20001370 comp rx=0 tx=0).stop 2024-05-27T06:29:07.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.129+0000 7fab34600640 1 -- 172.21.15.87:0/136899784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab2c0b2630 msgr2=0x7fab2c1619c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:07.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.129+0000 7fab34600640 1 --2- 172.21.15.87:0/136899784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab2c0b2630 0x7fab2c1619c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fab240b0040 tx=0x7fab14005840 comp rx=0 tx=0).stop 2024-05-27T06:29:07.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.129+0000 7fab34600640 1 -- 172.21.15.87:0/136899784 shutdown_connections 2024-05-27T06:29:07.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.129+0000 7fab34600640 1 --2- 172.21.15.87:0/136899784 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fab0c06f400 0x7fab0c071910 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:07.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.129+0000 7fab34600640 1 --2- 172.21.15.87:0/136899784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab2c0b2630 0x7fab2c1619c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:07.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.129+0000 7fab34600640 1 --2- 172.21.15.87:0/136899784 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab2c0b2220 0x7fab2c161480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:07.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.129+0000 7fab34600640 1 --2- 172.21.15.87:0/136899784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab14004dc0 0x7fab2c14fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:07.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.129+0000 7fab34600640 1 -- 172.21.15.87:0/136899784 >> 172.21.15.87:0/136899784 conn(0x7fab2c0b46b0 msgr2=0x7fab2c0ae5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:07.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.129+0000 7fab34600640 1 -- 172.21.15.87:0/136899784 shutdown_connections 2024-05-27T06:29:07.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.129+0000 7fab34600640 1 -- 172.21.15.87:0/136899784 wait complete. 2024-05-27T06:29:07.146 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-27T06:29:07.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.293+0000 7fb675e00640 1 Processor -- start 2024-05-27T06:29:07.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.293+0000 7fb675e00640 1 -- start start 2024-05-27T06:29:07.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.297+0000 7fb675e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb6700cbf90 0x7fb67006cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:07.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.297+0000 7fb675e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb67006d500 0x7fb67015cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:07.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.297+0000 7fb675e00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb67015d930 con 0x7fb67015d520 2024-05-27T06:29:07.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.297+0000 7fb675e00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fb67006d910 con 0x7fb67006d500 2024-05-27T06:29:07.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.297+0000 7fb675e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fb67015dbb0 con 0x7fb6700cbf90 2024-05-27T06:29:07.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.297+0000 7fb666000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb67006d500 0x7fb67015cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:07.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.297+0000 7fb66f400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb67015d520 0x7fb6700d1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48538/0 (socket says 172.21.15.87:48538) 2024-05-27T06:29:07.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.297+0000 7fb66f400640 1 -- 172.21.15.87:0/3156690874 learned_addr learned my addr 172.21.15.87:0/3156690874 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:29:07.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.297+0000 7fb66ea00640 1 --2- 172.21.15.87:0/3156690874 >> v2:172.21.15.149:3300/0 conn(0x7fb6700cbf90 0x7fb67006cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:07.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.297+0000 7fb666000640 1 -- 172.21.15.87:0/3156690874 >> v2:172.21.15.149:3300/0 conn(0x7fb6700cbf90 msgr2=0x7fb67006cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:07.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.297+0000 7fb666000640 1 --2- 172.21.15.87:0/3156690874 >> v2:172.21.15.149:3300/0 conn(0x7fb6700cbf90 0x7fb67006cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:07.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.297+0000 7fb666000640 1 -- 172.21.15.87:0/3156690874 >> v1:172.21.15.87:6789/0 conn(0x7fb67015d520 legacy=0x7fb6700d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:07.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.297+0000 7fb666000640 1 -- 172.21.15.87:0/3156690874 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67015de90 con 0x7fb67006d500 2024-05-27T06:29:07.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.297+0000 7fb66ea00640 1 --2- 172.21.15.87:0/3156690874 >> v2:172.21.15.149:3300/0 conn(0x7fb6700cbf90 0x7fb67006cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:29:07.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.297+0000 7fb66e000640 1 -- 172.21.15.87:0/3156690874 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1402629939 0 0) 0x7fb6680014a0 con 0x7fb67015d520 2024-05-27T06:29:07.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.301+0000 7fb666000640 1 --2- 172.21.15.87:0/3156690874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb67006d500 0x7fb67015cfe0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb670070560 tx=0x7fb65801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16107f68d1f7e7a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:07.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.301+0000 7fb66e000640 1 -- 172.21.15.87:0/3156690874 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6580b5070 con 0x7fb67006d500 2024-05-27T06:29:07.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.301+0000 7fb66e000640 1 -- 172.21.15.87:0/3156690874 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6580a8970 con 0x7fb67006d500 2024-05-27T06:29:07.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.301+0000 7fb66e000640 1 -- 172.21.15.87:0/3156690874 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6580a8d40 con 0x7fb67006d500 2024-05-27T06:29:07.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.301+0000 7fb675e00640 1 -- 172.21.15.87:0/3156690874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb67006d500 msgr2=0x7fb67015cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:07.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.301+0000 7fb675e00640 1 --2- 172.21.15.87:0/3156690874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb67006d500 0x7fb67015cfe0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb670070560 tx=0x7fb65801ec70 comp rx=0 tx=0).stop 2024-05-27T06:29:07.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.301+0000 7fb675e00640 1 -- 172.21.15.87:0/3156690874 shutdown_connections 2024-05-27T06:29:07.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.301+0000 7fb675e00640 1 --2- 172.21.15.87:0/3156690874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb67006d500 0x7fb67015cfe0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:07.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.301+0000 7fb675e00640 1 --2- 172.21.15.87:0/3156690874 >> v2:172.21.15.149:3300/0 conn(0x7fb6700cbf90 0x7fb67006cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:07.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.301+0000 7fb675e00640 1 -- 172.21.15.87:0/3156690874 >> 172.21.15.87:0/3156690874 conn(0x7fb6700b46b0 msgr2=0x7fb6700b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:07.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.301+0000 7fb675e00640 1 -- 172.21.15.87:0/3156690874 shutdown_connections 2024-05-27T06:29:07.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.301+0000 7fb675e00640 1 -- 172.21.15.87:0/3156690874 wait complete. 2024-05-27T06:29:07.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.305+0000 7fb675e00640 1 Processor -- start 2024-05-27T06:29:07.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.305+0000 7fb675e00640 1 -- start start 2024-05-27T06:29:07.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.305+0000 7fb675e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb67006d500 0x7fb6700c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:07.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.305+0000 7fb675e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6700cbf90 0x7fb670158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:07.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.305+0000 7fb675e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb67015d520 0x7fb670155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:07.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.305+0000 7fb675e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb67015e170 con 0x7fb6700cbf90 2024-05-27T06:29:07.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.305+0000 7fb675e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb67006caa0 con 0x7fb67006d500 2024-05-27T06:29:07.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.305+0000 7fb675e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb6700cc3a0 con 0x7fb67015d520 2024-05-27T06:29:07.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.305+0000 7fb666000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6700cbf90 0x7fb670158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:07.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.305+0000 7fb666000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6700cbf90 0x7fb670158350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51048/0 (socket says 172.21.15.87:51048) 2024-05-27T06:29:07.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.305+0000 7fb666000640 1 -- 172.21.15.87:0/1304021858 learned_addr learned my addr 172.21.15.87:0/1304021858 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:07.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.305+0000 7fb66ea00640 1 --2- 172.21.15.87:0/1304021858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb67006d500 0x7fb6700c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:07.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.305+0000 7fb66f400640 1 --2- 172.21.15.87:0/1304021858 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb67015d520 0x7fb670155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:07.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.305+0000 7fb666000640 1 -- 172.21.15.87:0/1304021858 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb67015d520 msgr2=0x7fb670155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:07.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.305+0000 7fb666000640 1 --2- 172.21.15.87:0/1304021858 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb67015d520 0x7fb670155b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:07.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.305+0000 7fb666000640 1 -- 172.21.15.87:0/1304021858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb67006d500 msgr2=0x7fb6700c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:07.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.305+0000 7fb666000640 1 --2- 172.21.15.87:0/1304021858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb67006d500 0x7fb6700c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:07.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.305+0000 7fb666000640 1 -- 172.21.15.87:0/1304021858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67015d230 con 0x7fb6700cbf90 2024-05-27T06:29:07.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.305+0000 7fb66ea00640 1 --2- 172.21.15.87:0/1304021858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb67006d500 0x7fb6700c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:29:07.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.305+0000 7fb666000640 1 --2- 172.21.15.87:0/1304021858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6700cbf90 0x7fb670158350 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb6580b3040 tx=0x7fb65801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:07.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.305+0000 7fb667e00640 1 -- 172.21.15.87:0/1304021858 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6580b5040 con 0x7fb6700cbf90 2024-05-27T06:29:07.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.305+0000 7fb667e00640 1 -- 172.21.15.87:0/1304021858 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6580bf070 con 0x7fb6700cbf90 2024-05-27T06:29:07.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.305+0000 7fb675e00640 1 -- 172.21.15.87:0/1304021858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6700c99c0 con 0x7fb6700cbf90 2024-05-27T06:29:07.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.305+0000 7fb667e00640 1 -- 172.21.15.87:0/1304021858 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6580b0940 con 0x7fb6700cbf90 2024-05-27T06:29:07.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.305+0000 7fb675e00640 1 -- 172.21.15.87:0/1304021858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6700c9400 con 0x7fb6700cbf90 2024-05-27T06:29:07.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.309+0000 7fb675e00640 1 -- 172.21.15.87:0/1304021858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb67006aa30 con 0x7fb6700cbf90 2024-05-27T06:29:07.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.309+0000 7fb667e00640 1 -- 172.21.15.87:0/1304021858 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb6580b0ae0 con 0x7fb6700cbf90 2024-05-27T06:29:07.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.309+0000 7fb667e00640 1 --2- 172.21.15.87:0/1304021858 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb64c06f400 0x7fb64c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:07.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.309+0000 7fb667e00640 1 -- 172.21.15.87:0/1304021858 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7fb65812cb20 con 0x7fb6700cbf90 2024-05-27T06:29:07.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.309+0000 7fb66ea00640 1 --2- 172.21.15.87:0/1304021858 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb64c06f400 0x7fb64c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:07.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.309+0000 7fb66ea00640 1 --2- 172.21.15.87:0/1304021858 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb64c06f400 0x7fb64c071910 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb66000b990 tx=0x7fb660008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:07.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.313+0000 7fb667e00640 1 -- 172.21.15.87:0/1304021858 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb6580187d0 con 0x7fb6700cbf90 2024-05-27T06:29:07.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.505+0000 7fb675e00640 1 -- 172.21.15.87:0/1304021858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb670156e10 con 0x7fb6700cbf90 2024-05-27T06:29:07.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.505+0000 7fb667e00640 1 -- 172.21.15.87:0/1304021858 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) ==== 53+0+82 (secure 0 0 0) 0x7fb6580f9710 con 0x7fb6700cbf90 2024-05-27T06:29:07.504 INFO:teuthology.orchestra.run.smithi087.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2024-05-27T06:29:07.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.509+0000 7fb675e00640 1 -- 172.21.15.87:0/1304021858 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb64c06f400 msgr2=0x7fb64c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:07.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.509+0000 7fb675e00640 1 --2- 172.21.15.87:0/1304021858 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb64c06f400 0x7fb64c071910 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb66000b990 tx=0x7fb660008040 comp rx=0 tx=0).stop 2024-05-27T06:29:07.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.509+0000 7fb675e00640 1 -- 172.21.15.87:0/1304021858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6700cbf90 msgr2=0x7fb670158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:07.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.509+0000 7fb675e00640 1 --2- 172.21.15.87:0/1304021858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6700cbf90 0x7fb670158350 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb6580b3040 tx=0x7fb65801ba10 comp rx=0 tx=0).stop 2024-05-27T06:29:07.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.509+0000 7fb675e00640 1 -- 172.21.15.87:0/1304021858 shutdown_connections 2024-05-27T06:29:07.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.509+0000 7fb675e00640 1 --2- 172.21.15.87:0/1304021858 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb64c06f400 0x7fb64c071910 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:07.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.509+0000 7fb675e00640 1 --2- 172.21.15.87:0/1304021858 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb67015d520 0x7fb670155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:07.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.509+0000 7fb675e00640 1 --2- 172.21.15.87:0/1304021858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6700cbf90 0x7fb670158350 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:07.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.509+0000 7fb675e00640 1 --2- 172.21.15.87:0/1304021858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb67006d500 0x7fb6700c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:07.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.509+0000 7fb675e00640 1 -- 172.21.15.87:0/1304021858 >> 172.21.15.87:0/1304021858 conn(0x7fb6700b46b0 msgr2=0x7fb6700cc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:07.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.509+0000 7fb675e00640 1 -- 172.21.15.87:0/1304021858 shutdown_connections 2024-05-27T06:29:07.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07.509+0000 7fb675e00640 1 -- 172.21.15.87:0/1304021858 wait complete. 2024-05-27T06:29:07.526 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-27T06:29:07.526 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-27T06:29:07.526 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-05-27T06:29:07.526 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-27T06:29:07.526 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-27T06:29:07.526 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-27T06:29:07.526 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-27T06:29:07.526 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-27T06:29:07.526 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-27T06:29:07.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:07.527 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-05-27T06:29:07.536 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T06:29:07.537 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T06:29:07.537 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T06:29:07.537 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:29:07.537 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-05-27T06:29:07.537 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:29:07.537 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:29:07.537 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-05-27T06:29:07.537 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-05-27T06:29:07.537 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:29:07.537 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-05-27T06:29:07.537 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-05-27T06:29:07.538 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:29:07.538 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:29:07.538 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-27T06:29:07.538 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:29:07.538 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-27T06:29:07.538 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42394sec preferred_lft 42394sec 2024-05-27T06:29:07.538 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-05-27T06:29:07.538 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:29:07.538 INFO:teuthology.orchestra.run.smithi087.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-27T06:29:07.538 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 02:42:75:41:48:14 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:29:07.538 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-27T06:29:07.538 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:29:07.538 INFO:teuthology.orchestra.run.smithi087.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-27T06:29:07.538 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-27T06:29:07.539 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-27T06:29:07.539 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:29:07.539 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-27T06:29:07.539 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:29:07.539 INFO:teuthology.orchestra.run.smithi087.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-27T06:29:07.539 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:29:07.539 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-27T06:29:07.539 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:29:07.539 INFO:teuthology.orchestra.run.smithi087.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-27T06:29:07.539 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:29:07.539 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-05-27T06:29:07.539 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:29:07.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:07.540 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-27T06:29:07.598 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-05-27T06:29:07.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:07.601 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-05-27T06:29:07.656 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-05-27T06:29:07.656 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-27T06:29:07.656 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-27T06:29:07.656 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-27T06:29:07.656 INFO:teuthology.orchestra.run.smithi087.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-27T06:29:07.656 INFO:teuthology.orchestra.run.smithi087.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-27T06:29:07.657 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-27T06:29:07.657 INFO:teuthology.orchestra.run.smithi087.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:29:07.657 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:29:07.657 INFO:teuthology.orchestra.run.smithi087.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:29:07.657 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-27T06:29:07.657 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:29:07.657 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-27T06:29:07.658 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-27T06:29:07.658 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-27T06:29:07.658 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-27T06:29:07.658 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-27T06:29:07.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:29:07.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:29:07.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:07.792 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-05-27T06:29:07.846 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-27T06:29:07.846 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-27T06:29:07.847 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-27T06:29:07.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:07.847 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-05-27T06:29:07.908 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-27T06:29:07.909 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T06:29:07.909 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-27T06:29:07.957 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-27T06:29:07.957 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T06:29:07.957 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-27T06:29:08.013 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-05-27T06:29:08.073 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T06:29:08.126 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-05-27T06:29:08.126 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-05-27T06:29:08.126 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-05-27T06:29:08.127 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-05-27T06:29:08.127 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-05-27T06:29:08.127 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-05-27T06:29:08.127 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-05-27T06:29:08.127 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-05-27T06:29:08.127 INFO:teuthology.orchestra.run.smithi087.stdout:/run/lock 2024-05-27T06:29:08.127 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-05-27T06:29:08.127 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-05-27T06:29:08.127 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-05-27T06:29:08.127 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T06:29:08.127 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-05-27T06:29:08.127 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-05-27T06:29:08.127 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-05-27T06:29:08.128 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-05-27T06:29:08.128 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/fs/nfsd 2024-05-27T06:29:08.128 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-05-27T06:29:08.128 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-05-27T06:29:08.128 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysusers.service 2024-05-27T06:29:08.128 INFO:teuthology.orchestra.run.smithi087.stdout:/run/rpc_pipefs 2024-05-27T06:29:08.128 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-05-27T06:29:08.128 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-05-27T06:29:08.128 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2024-05-27T06:29:08.128 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2024-05-27T06:29:08.128 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2024-05-27T06:29:08.128 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2024-05-27T06:29:08.128 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-05-27T06:29:08.128 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:29:08.129 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:29:08.129 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:29:08.129 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:29:08.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:08.130 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-05-27T06:29:08.184 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-27T06:29:08.185 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-27T06:29:08.227 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-05-27T06:29:08.248 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T06:29:08.299 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-05-27T06:29:08.299 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-05-27T06:29:08.299 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-05-27T06:29:08.299 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-05-27T06:29:08.299 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-05-27T06:29:08.299 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-05-27T06:29:08.299 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-05-27T06:29:08.299 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-05-27T06:29:08.299 INFO:teuthology.orchestra.run.smithi087.stdout:/run/lock 2024-05-27T06:29:08.299 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-05-27T06:29:08.299 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-05-27T06:29:08.299 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-05-27T06:29:08.299 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T06:29:08.300 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-05-27T06:29:08.300 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-05-27T06:29:08.300 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-05-27T06:29:08.300 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-05-27T06:29:08.300 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/fs/nfsd 2024-05-27T06:29:08.300 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-05-27T06:29:08.300 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-05-27T06:29:08.300 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysusers.service 2024-05-27T06:29:08.300 INFO:teuthology.orchestra.run.smithi087.stdout:/run/rpc_pipefs 2024-05-27T06:29:08.300 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-05-27T06:29:08.300 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-05-27T06:29:08.300 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2024-05-27T06:29:08.300 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2024-05-27T06:29:08.300 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2024-05-27T06:29:08.301 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2024-05-27T06:29:08.301 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-05-27T06:29:08.301 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:29:08.301 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:29:08.301 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:29:08.301 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:29:08.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:08.302 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-05-27T06:29:08.332 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:2024-05-27T06:29:08.333+0000 7fe13e323580 -1 init, newargv = 0x7fe124001090 newargc=15 2024-05-27T06:29:08.332 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[37828]: starting ceph client 2024-05-27T06:29:08.338 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[37828]: starting fuse 2024-05-27T06:29:08.341 INFO:teuthology.orchestra.run.smithi087.stdout:44 2024-05-27T06:29:08.341 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-05-27T06:29:08.341 DEBUG:teuthology.orchestra.run.smithi087:> sudo stdin-killer -- python3 -c ' 2024-05-27T06:29:08.341 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-05-27T06:29:08.342 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-05-27T06:29:08.342 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-05-27T06:29:08.342 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-05-27T06:29:08.342 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:29:08.342 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-05-27T06:29:08.342 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-27T06:29:08.342 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-05-27T06:29:08.342 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-27T06:29:08.342 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:29:08.342 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-05-27T06:29:08.342 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-05-27T06:29:08.342 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-05-27T06:29:08.342 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-05-27T06:29:08.343 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:29:08.343 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-05-27T06:29:08.343 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-27T06:29:08.343 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-27T06:29:08.343 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-27T06:29:08.343 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-05-27T06:29:08.343 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-05-27T06:29:08.343 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-05-27T06:29:08.343 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-27T06:29:08.343 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:29:08.343 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.0")) 2024-05-27T06:29:08.343 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-05-27T06:29:08.469 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.0.37828.asok 2024-05-27T06:29:08.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:29:08.480 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37828.asok 2024-05-27T06:29:08.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:08.480 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37828.asok status 2024-05-27T06:29:08.657 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-27T06:29:08.657 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-05-27T06:29:08.658 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "38f9d900c83c63799fbdbe61acc9a11b0d3554a6", 2024-05-27T06:29:08.658 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 19.0.0-3872-g38f9d900 (38f9d900c83c63799fbdbe61acc9a11b0d3554a6) squid (dev)", 2024-05-27T06:29:08.658 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "0", 2024-05-27T06:29:08.658 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-05-27T06:29:08.658 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-27T06:29:08.658 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "37828", 2024-05-27T06:29:08.658 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-05-27T06:29:08.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:08.658 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-05-27T06:29:08.658 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-05-27T06:29:08.658 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 5226, 2024-05-27T06:29:08.658 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-05-27T06:29:08.659 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-05-27T06:29:08.659 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-05-27T06:29:08.659 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 5226 2024-05-27T06:29:08.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:08.659 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-05-27T06:29:08.659 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-05-27T06:29:08.659 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-05-27T06:29:08.659 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2878559417 2024-05-27T06:29:08.659 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:29:08.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:08.659 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-05-27T06:29:08.659 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-05-27T06:29:08.659 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-05-27T06:29:08.659 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2878559417 2024-05-27T06:29:08.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:08.660 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.5226 192.168.0.1:0/2878559417", 2024-05-27T06:29:08.660 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/2878559417", 2024-05-27T06:29:08.660 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-05-27T06:29:08.660 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 19, 2024-05-27T06:29:08.660 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 41, 2024-05-27T06:29:08.660 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-05-27T06:29:08.660 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-05-27T06:29:08.660 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-05-27T06:29:08.660 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-27T06:29:08.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:08.673 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-05-27T06:29:08.673 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-27T06:29:08.682 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-05-27T06:29:08.683 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-27T06:29:08.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:08.683 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-27T06:29:08.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:08.749 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2024-05-27T06:29:08.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:08.805 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2024-05-27T06:29:08.864 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:29:08.864 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:29:08.913 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T06:29:09.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.105+0000 7f11d6c00640 1 Processor -- start 2024-05-27T06:29:09.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.105+0000 7f11d6c00640 1 -- start start 2024-05-27T06:29:09.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.105+0000 7f11d6c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f11d00aec30 0x7f11d00702b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:09.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.105+0000 7f11d6c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11d006efc0 0x7f11d006f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:09.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.105+0000 7f11d6c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11d006f910 con 0x7f11d006c720 2024-05-27T06:29:09.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.105+0000 7f11d6c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f11d006fe20 con 0x7f11d00aec30 2024-05-27T06:29:09.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.105+0000 7f11d6c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f11d00b0ba0 con 0x7f11d006efc0 2024-05-27T06:29:09.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.109+0000 7f11cfe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f11d00aec30 0x7f11d00702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:09.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.109+0000 7f11c7400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11d006efc0 0x7f11d006f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:09.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.109+0000 7f11c7400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11d006efc0 0x7f11d006f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.87:33472/0 (socket says 172.21.15.87:33472) 2024-05-27T06:29:09.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.109+0000 7f11c7400640 1 -- 172.21.15.87:0/100012287 learned_addr learned my addr 172.21.15.87:0/100012287 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:09.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.109+0000 7f11cf400640 1 -- 172.21.15.87:0/100012287 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3193327271 0 0) 0x7f11c80014a0 con 0x7f11d006c720 2024-05-27T06:29:09.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.109+0000 7f11c7400640 1 -- 172.21.15.87:0/100012287 >> v2:172.21.15.149:3300/0 conn(0x7f11d00aec30 msgr2=0x7f11d00702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:09.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.109+0000 7f11c7400640 1 --2- 172.21.15.87:0/100012287 >> v2:172.21.15.149:3300/0 conn(0x7f11d00aec30 0x7f11d00702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:09.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.109+0000 7f11c7400640 1 -- 172.21.15.87:0/100012287 >> v1:172.21.15.149:6789/0 conn(0x7f11d006c720 legacy=0x7f11d006cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:09.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.109+0000 7f11c7400640 1 -- 172.21.15.87:0/100012287 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d015ef50 con 0x7f11d006efc0 2024-05-27T06:29:09.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.113+0000 7f11c7400640 1 --2- 172.21.15.87:0/100012287 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11d006efc0 0x7f11d006f3d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009870 tx=0x7f11b801c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=761b30e50de31296 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:09.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.113+0000 7f11cf400640 1 -- 172.21.15.87:0/100012287 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b80b0070 con 0x7f11d006efc0 2024-05-27T06:29:09.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.113+0000 7f11cf400640 1 -- 172.21.15.87:0/100012287 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b8004230 con 0x7f11d006efc0 2024-05-27T06:29:09.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.113+0000 7f11cf400640 1 -- 172.21.15.87:0/100012287 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b8003620 con 0x7f11d006efc0 2024-05-27T06:29:09.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.113+0000 7f11d6c00640 1 -- 172.21.15.87:0/100012287 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11d006efc0 msgr2=0x7f11d006f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:09.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.113+0000 7f11d6c00640 1 --2- 172.21.15.87:0/100012287 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11d006efc0 0x7f11d006f3d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009870 tx=0x7f11b801c440 comp rx=0 tx=0).stop 2024-05-27T06:29:09.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.113+0000 7f11d6c00640 1 -- 172.21.15.87:0/100012287 shutdown_connections 2024-05-27T06:29:09.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.113+0000 7f11d6c00640 1 --2- 172.21.15.87:0/100012287 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11d006efc0 0x7f11d006f3d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:09.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.113+0000 7f11d6c00640 1 --2- 172.21.15.87:0/100012287 >> v2:172.21.15.149:3300/0 conn(0x7f11d00aec30 0x7f11d00702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:09.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.113+0000 7f11d6c00640 1 -- 172.21.15.87:0/100012287 >> 172.21.15.87:0/100012287 conn(0x7f11d00b2fb0 msgr2=0x7f11d00b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:09.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.113+0000 7f11d6c00640 1 -- 172.21.15.87:0/100012287 shutdown_connections 2024-05-27T06:29:09.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.113+0000 7f11d6c00640 1 -- 172.21.15.87:0/100012287 wait complete. 2024-05-27T06:29:09.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.113+0000 7f11d6c00640 1 Processor -- start 2024-05-27T06:29:09.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.113+0000 7f11d6c00640 1 -- start start 2024-05-27T06:29:09.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.117+0000 7f11d6c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11d006c720 0x7f11d01529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:09.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.117+0000 7f11d6c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11d006efc0 0x7f11d0146640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:09.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.117+0000 7f11d6c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11d00aec30 0x7f11d009a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:09.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.117+0000 7f11d6c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f11d006df40 con 0x7f11d006efc0 2024-05-27T06:29:09.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.117+0000 7f11d6c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f11d00af040 con 0x7f11d00aec30 2024-05-27T06:29:09.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.117+0000 7f11d6c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f11d006e0c0 con 0x7f11d006c720 2024-05-27T06:29:09.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.117+0000 7f11c7400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11d006efc0 0x7f11d0146640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:09.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.117+0000 7f11c7400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11d006efc0 0x7f11d0146640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51058/0 (socket says 172.21.15.87:51058) 2024-05-27T06:29:09.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.117+0000 7f11c7400640 1 -- 172.21.15.87:0/1639867096 learned_addr learned my addr 172.21.15.87:0/1639867096 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:09.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.117+0000 7f11cfe00640 1 --2- 172.21.15.87:0/1639867096 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11d006c720 0x7f11d01529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:09.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.117+0000 7f11d4c00640 1 --2- 172.21.15.87:0/1639867096 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11d00aec30 0x7f11d009a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:09.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.117+0000 7f11c7400640 1 -- 172.21.15.87:0/1639867096 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11d006c720 msgr2=0x7f11d01529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:09.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.117+0000 7f11c7400640 1 --2- 172.21.15.87:0/1639867096 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11d006c720 0x7f11d01529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:09.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.117+0000 7f11c7400640 1 -- 172.21.15.87:0/1639867096 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11d00aec30 msgr2=0x7f11d009a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:09.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.117+0000 7f11c7400640 1 --2- 172.21.15.87:0/1639867096 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11d00aec30 0x7f11d009a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:09.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.117+0000 7f11c7400640 1 -- 172.21.15.87:0/1639867096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d014bd00 con 0x7f11d006efc0 2024-05-27T06:29:09.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.117+0000 7f11c7400640 1 --2- 172.21.15.87:0/1639867096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11d006efc0 0x7f11d0146640 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f11b80ae040 tx=0x7f11b80191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:09.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.117+0000 7f11ccc00640 1 -- 172.21.15.87:0/1639867096 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b80b0040 con 0x7f11d006efc0 2024-05-27T06:29:09.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.117+0000 7f11ccc00640 1 -- 172.21.15.87:0/1639867096 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b8003db0 con 0x7f11d006efc0 2024-05-27T06:29:09.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.117+0000 7f11d6c00640 1 -- 172.21.15.87:0/1639867096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11d01535d0 con 0x7f11d006efc0 2024-05-27T06:29:09.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.117+0000 7f11ccc00640 1 -- 172.21.15.87:0/1639867096 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b80b6440 con 0x7f11d006efc0 2024-05-27T06:29:09.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.117+0000 7f11d6c00640 1 -- 172.21.15.87:0/1639867096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11d0153b90 con 0x7f11d006efc0 2024-05-27T06:29:09.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.117+0000 7f11d6c00640 1 -- 172.21.15.87:0/1639867096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11d006aa30 con 0x7f11d006efc0 2024-05-27T06:29:09.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.121+0000 7f11ccc00640 1 -- 172.21.15.87:0/1639867096 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f11b80bd060 con 0x7f11d006efc0 2024-05-27T06:29:09.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.121+0000 7f11ccc00640 1 --2- 172.21.15.87:0/1639867096 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f11ac06f400 0x7f11ac071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:09.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.121+0000 7f11ccc00640 1 -- 172.21.15.87:0/1639867096 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f11b8128c80 con 0x7f11d006efc0 2024-05-27T06:29:09.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.121+0000 7f11cfe00640 1 --2- 172.21.15.87:0/1639867096 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f11ac06f400 0x7f11ac071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:09.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.121+0000 7f11cfe00640 1 --2- 172.21.15.87:0/1639867096 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f11ac06f400 0x7f11ac071910 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f11c0009ac0 tx=0x7f11c0009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:09.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.125+0000 7f11ccc00640 1 -- 172.21.15.87:0/1639867096 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f11d014bd00 con 0x7f11d006efc0 2024-05-27T06:29:09.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.293+0000 7f11d6c00640 1 -- 172.21.15.87:0/1639867096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f11d0153360 con 0x7f11d006efc0 2024-05-27T06:29:09.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.293+0000 7f11ccc00640 1 -- 172.21.15.87:0/1639867096 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) ==== 80+0+0 (secure 0 0 0) 0x7f11b8016150 con 0x7f11d006efc0 2024-05-27T06:29:09.292 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2024-05-27T06:29:09.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.297+0000 7f11d6c00640 1 -- 172.21.15.87:0/1639867096 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f11ac06f400 msgr2=0x7f11ac071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:09.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.297+0000 7f11d6c00640 1 --2- 172.21.15.87:0/1639867096 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f11ac06f400 0x7f11ac071910 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f11c0009ac0 tx=0x7f11c0009190 comp rx=0 tx=0).stop 2024-05-27T06:29:09.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.297+0000 7f11d6c00640 1 -- 172.21.15.87:0/1639867096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11d006efc0 msgr2=0x7f11d0146640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:09.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.297+0000 7f11d6c00640 1 --2- 172.21.15.87:0/1639867096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11d006efc0 0x7f11d0146640 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f11b80ae040 tx=0x7f11b80191e0 comp rx=0 tx=0).stop 2024-05-27T06:29:09.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.297+0000 7f11d6c00640 1 -- 172.21.15.87:0/1639867096 shutdown_connections 2024-05-27T06:29:09.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.297+0000 7f11d6c00640 1 --2- 172.21.15.87:0/1639867096 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f11ac06f400 0x7f11ac071910 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:09.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.297+0000 7f11d6c00640 1 --2- 172.21.15.87:0/1639867096 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11d00aec30 0x7f11d009a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:09.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.297+0000 7f11d6c00640 1 --2- 172.21.15.87:0/1639867096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11d006efc0 0x7f11d0146640 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:09.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.297+0000 7f11d6c00640 1 --2- 172.21.15.87:0/1639867096 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11d006c720 0x7f11d01529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:09.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.297+0000 7f11d6c00640 1 -- 172.21.15.87:0/1639867096 >> 172.21.15.87:0/1639867096 conn(0x7f11d00b2fb0 msgr2=0x7f11d00b1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:09.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.297+0000 7f11d6c00640 1 -- 172.21.15.87:0/1639867096 shutdown_connections 2024-05-27T06:29:09.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.297+0000 7f11d6c00640 1 -- 172.21.15.87:0/1639867096 wait complete. 2024-05-27T06:29:09.314 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:29:09.314 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:29:09.323 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T06:29:09.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.517+0000 7f5091400640 1 Processor -- start 2024-05-27T06:29:09.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.521+0000 7f5091400640 1 -- start start 2024-05-27T06:29:09.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.521+0000 7f5091400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f508c0ae360 0x7f508c0ae770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:09.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.521+0000 7f5091400640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f508c164660 con 0x7f508c06db40 2024-05-27T06:29:09.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.521+0000 7f5091400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f508c06c970 con 0x7f508c06d730 2024-05-27T06:29:09.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.521+0000 7f5091400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f508c06c720 con 0x7f508c0ae360 2024-05-27T06:29:09.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.521+0000 7f508a800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f508c0ae360 0x7f508c0ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:09.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.521+0000 7f508b200640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f508c06db40 0x7f508c163f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48540/0 (socket says 172.21.15.87:48540) 2024-05-27T06:29:09.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.521+0000 7f508b200640 1 -- 172.21.15.87:0/3786163290 learned_addr learned my addr 172.21.15.87:0/3786163290 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:29:09.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.521+0000 7f508a800640 1 -- 172.21.15.87:0/3786163290 >> v1:172.21.15.149:6789/0 conn(0x7f508c06d730 legacy=0x7f508c163840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:09.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.521+0000 7f508a800640 1 -- 172.21.15.87:0/3786163290 >> v1:172.21.15.87:6789/0 conn(0x7f508c06db40 legacy=0x7f508c163f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:09.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.521+0000 7f5089e00640 1 -- 172.21.15.87:0/3786163290 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3446873404 0 0) 0x7f508c164660 con 0x7f508c06db40 2024-05-27T06:29:09.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.521+0000 7f508a800640 1 -- 172.21.15.87:0/3786163290 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508c06cc50 con 0x7f508c0ae360 2024-05-27T06:29:09.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.525+0000 7f508a800640 1 --2- 172.21.15.87:0/3786163290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f508c0ae360 0x7f508c0ae770 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f507c009d90 tx=0x7f507c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e8307b13ee3dbb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:09.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.525+0000 7f5089e00640 1 -- 172.21.15.87:0/3786163290 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c0b2070 con 0x7f508c0ae360 2024-05-27T06:29:09.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.525+0000 7f5089e00640 1 -- 172.21.15.87:0/3786163290 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f507c0a5800 con 0x7f508c0ae360 2024-05-27T06:29:09.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.525+0000 7f5089e00640 1 -- 172.21.15.87:0/3786163290 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c0a5bd0 con 0x7f508c0ae360 2024-05-27T06:29:09.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.525+0000 7f5091400640 1 -- 172.21.15.87:0/3786163290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f508c0ae360 msgr2=0x7f508c0ae770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:09.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.525+0000 7f5091400640 1 --2- 172.21.15.87:0/3786163290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f508c0ae360 0x7f508c0ae770 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f507c009d90 tx=0x7f507c01c850 comp rx=0 tx=0).stop 2024-05-27T06:29:09.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.525+0000 7f5091400640 1 -- 172.21.15.87:0/3786163290 shutdown_connections 2024-05-27T06:29:09.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.525+0000 7f5091400640 1 --2- 172.21.15.87:0/3786163290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f508c0ae360 0x7f508c0ae770 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:09.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.525+0000 7f5091400640 1 -- 172.21.15.87:0/3786163290 >> 172.21.15.87:0/3786163290 conn(0x7f508c0b2fb0 msgr2=0x7f508c0b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:09.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.525+0000 7f5091400640 1 -- 172.21.15.87:0/3786163290 shutdown_connections 2024-05-27T06:29:09.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.525+0000 7f5091400640 1 -- 172.21.15.87:0/3786163290 wait complete. 2024-05-27T06:29:09.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.529+0000 7f5091400640 1 Processor -- start 2024-05-27T06:29:09.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.529+0000 7f5091400640 1 -- start start 2024-05-27T06:29:09.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.529+0000 7f5091400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f508c06d730 0x7f508c1f9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:09.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.529+0000 7f5091400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f508c06db40 0x7f508c1fae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:09.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.529+0000 7f5091400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f508c0ae360 0x7f508c156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:09.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.529+0000 7f5091400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f508c16e400 con 0x7f508c06d730 2024-05-27T06:29:09.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.529+0000 7f5091400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f508c070640 con 0x7f508c06db40 2024-05-27T06:29:09.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.529+0000 7f5091400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f508c16e580 con 0x7f508c0ae360 2024-05-27T06:29:09.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.529+0000 7f508a800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f508c06d730 0x7f508c1f9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:09.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.529+0000 7f508a800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f508c06d730 0x7f508c1f9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51084/0 (socket says 172.21.15.87:51084) 2024-05-27T06:29:09.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.529+0000 7f508a800640 1 -- 172.21.15.87:0/3316208883 learned_addr learned my addr 172.21.15.87:0/3316208883 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:09.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.529+0000 7f508b200640 1 --2- 172.21.15.87:0/3316208883 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f508c0ae360 0x7f508c156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:09.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.529+0000 7f5081e00640 1 --2- 172.21.15.87:0/3316208883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f508c06db40 0x7f508c1fae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:09.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.529+0000 7f508a800640 1 -- 172.21.15.87:0/3316208883 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f508c0ae360 msgr2=0x7f508c156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:09.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.529+0000 7f508a800640 1 --2- 172.21.15.87:0/3316208883 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f508c0ae360 0x7f508c156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:09.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.529+0000 7f508a800640 1 -- 172.21.15.87:0/3316208883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f508c06db40 msgr2=0x7f508c1fae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:09.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.529+0000 7f508a800640 1 --2- 172.21.15.87:0/3316208883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f508c06db40 0x7f508c1fae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:09.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.529+0000 7f508a800640 1 -- 172.21.15.87:0/3316208883 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508c1fa630 con 0x7f508c06d730 2024-05-27T06:29:09.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.529+0000 7f508a800640 1 --2- 172.21.15.87:0/3316208883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f508c06d730 0x7f508c1f9cc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f507c0b0040 tx=0x7f507c0195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:09.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.529+0000 7f5083400640 1 -- 172.21.15.87:0/3316208883 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c0bd020 con 0x7f508c06d730 2024-05-27T06:29:09.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.529+0000 7f5083400640 1 -- 172.21.15.87:0/3316208883 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f507c0b8670 con 0x7f508c06d730 2024-05-27T06:29:09.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.529+0000 7f5083400640 1 -- 172.21.15.87:0/3316208883 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c0b2040 con 0x7f508c06d730 2024-05-27T06:29:09.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.529+0000 7f5091400640 1 -- 172.21.15.87:0/3316208883 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f508c1fa910 con 0x7f508c06d730 2024-05-27T06:29:09.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.529+0000 7f5091400640 1 -- 172.21.15.87:0/3316208883 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f508c1558a0 con 0x7f508c06d730 2024-05-27T06:29:09.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.533+0000 7f5091400640 1 -- 172.21.15.87:0/3316208883 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f508c06aa30 con 0x7f508c06d730 2024-05-27T06:29:09.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.533+0000 7f5083400640 1 -- 172.21.15.87:0/3316208883 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f507c0c0020 con 0x7f508c06d730 2024-05-27T06:29:09.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.533+0000 7f5083400640 1 --2- 172.21.15.87:0/3316208883 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f506806f400 0x7f5068071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:09.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.533+0000 7f5083400640 1 -- 172.21.15.87:0/3316208883 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f507c12aae0 con 0x7f508c06d730 2024-05-27T06:29:09.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.533+0000 7f5081e00640 1 --2- 172.21.15.87:0/3316208883 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f506806f400 0x7f5068071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:09.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.537+0000 7f5081e00640 1 --2- 172.21.15.87:0/3316208883 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f506806f400 0x7f5068071910 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f508c0b28e0 tx=0x7f5074009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:09.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.537+0000 7f5083400640 1 -- 172.21.15.87:0/3316208883 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f507c0c7030 con 0x7f508c06d730 2024-05-27T06:29:09.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.709+0000 7f5091400640 1 -- 172.21.15.87:0/3316208883 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f508c1635b0 con 0x7f508c06d730 2024-05-27T06:29:09.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.709+0000 7f5083400640 1 -- 172.21.15.87:0/3316208883 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) ==== 80+0+0 (secure 0 0 0) 0x7f507c016560 con 0x7f508c06d730 2024-05-27T06:29:09.707 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2024-05-27T06:29:09.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.709+0000 7f5091400640 1 -- 172.21.15.87:0/3316208883 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f506806f400 msgr2=0x7f5068071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:09.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.709+0000 7f5091400640 1 --2- 172.21.15.87:0/3316208883 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f506806f400 0x7f5068071910 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f508c0b28e0 tx=0x7f5074009040 comp rx=0 tx=0).stop 2024-05-27T06:29:09.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.709+0000 7f5091400640 1 -- 172.21.15.87:0/3316208883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f508c06d730 msgr2=0x7f508c1f9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:09.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.709+0000 7f5091400640 1 --2- 172.21.15.87:0/3316208883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f508c06d730 0x7f508c1f9cc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f507c0b0040 tx=0x7f507c0195f0 comp rx=0 tx=0).stop 2024-05-27T06:29:09.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.709+0000 7f5091400640 1 -- 172.21.15.87:0/3316208883 shutdown_connections 2024-05-27T06:29:09.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.709+0000 7f5091400640 1 --2- 172.21.15.87:0/3316208883 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f506806f400 0x7f5068071910 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:09.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.709+0000 7f5091400640 1 --2- 172.21.15.87:0/3316208883 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f508c0ae360 0x7f508c156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:09.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.709+0000 7f5091400640 1 --2- 172.21.15.87:0/3316208883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f508c06db40 0x7f508c1fae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:09.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.709+0000 7f5091400640 1 --2- 172.21.15.87:0/3316208883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f508c06d730 0x7f508c1f9cc0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:09.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.709+0000 7f5091400640 1 -- 172.21.15.87:0/3316208883 >> 172.21.15.87:0/3316208883 conn(0x7f508c0b2fb0 msgr2=0x7f508c06f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:09.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.709+0000 7f5091400640 1 -- 172.21.15.87:0/3316208883 shutdown_connections 2024-05-27T06:29:09.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:09.709+0000 7f5091400640 1 -- 172.21.15.87:0/3316208883 wait complete. 2024-05-27T06:29:09.729 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-05-27T06:29:09.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:09.729 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-27T06:29:09.747 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[37828]: fuse finished with error 0 and tester_r 0 2024-05-27T06:29:09.750 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:29:15.852 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-05-27T06:29:15.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:15.852 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-27T06:29:15.863 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2024-05-27T06:29:16.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.069+0000 7fe107e00640 1 Processor -- start 2024-05-27T06:29:16.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.069+0000 7fe107e00640 1 -- start start 2024-05-27T06:29:16.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe107e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe100157310 0x7fe10015dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:16.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe107e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1000d1700 0x7fe1000d1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:16.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe107e00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe10015e110 con 0x7fe10006c940 2024-05-27T06:29:16.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe107e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fe1000d0140 con 0x7fe100157310 2024-05-27T06:29:16.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe107e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe1000d2050 con 0x7fe1000d1700 2024-05-27T06:29:16.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe105e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe10006c940 0x7fe10006cd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57582/0 (socket says 172.21.15.87:57582) 2024-05-27T06:29:16.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe105e00640 1 -- 172.21.15.87:0/1332399391 learned_addr learned my addr 172.21.15.87:0/1332399391 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:29:16.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe105400640 1 --2- 172.21.15.87:0/1332399391 >> v2:172.21.15.149:3300/0 conn(0x7fe100157310 0x7fe10015dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:16.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe104a00640 1 --2- 172.21.15.87:0/1332399391 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1000d1700 0x7fe1000d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:16.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe0ffe00640 1 -- 172.21.15.87:0/1332399391 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4001133421 0 0) 0x7fe0f80014a0 con 0x7fe10006c940 2024-05-27T06:29:16.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe0ffe00640 1 -- 172.21.15.87:0/1332399391 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0e8003530 con 0x7fe10006c940 2024-05-27T06:29:16.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe0ffe00640 1 -- 172.21.15.87:0/1332399391 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2650199267 0 0) 0x7fe0e8003530 con 0x7fe10006c940 2024-05-27T06:29:16.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe0ffe00640 1 -- 172.21.15.87:0/1332399391 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1000d1700 msgr2=0x7fe1000d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:16.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe0ffe00640 1 --2- 172.21.15.87:0/1332399391 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1000d1700 0x7fe1000d1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:16.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe0ffe00640 1 -- 172.21.15.87:0/1332399391 >> v2:172.21.15.149:3300/0 conn(0x7fe100157310 msgr2=0x7fe10015dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:16.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe0ffe00640 1 --2- 172.21.15.87:0/1332399391 >> v2:172.21.15.149:3300/0 conn(0x7fe100157310 0x7fe10015dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:16.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe0ffe00640 1 -- 172.21.15.87:0/1332399391 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1000cf530 con 0x7fe10006c940 2024-05-27T06:29:16.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe0ffe00640 1 -- 172.21.15.87:0/1332399391 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7fe0f8001c50 con 0x7fe10006c940 2024-05-27T06:29:16.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe0ffe00640 1 -- 172.21.15.87:0/1332399391 >> v1:172.21.15.87:6789/0 conn(0x7fe10006c940 legacy=0x7fe10006cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:16.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe0ffe00640 1 --2- 172.21.15.87:0/1332399391 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0e8003a10 0x7fe0e8003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:16.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe0ffe00640 1 --2- 172.21.15.87:0/1332399391 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1000d1700 0x7fe0e8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:16.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe0ffe00640 1 --2- 172.21.15.87:0/1332399391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0e8004d50 0x7fe0e8005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:16.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe0ffe00640 1 -- 172.21.15.87:0/1332399391 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe1000d0140 con 0x7fe0e8004d50 2024-05-27T06:29:16.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe0ffe00640 1 -- 172.21.15.87:0/1332399391 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe1000d2050 con 0x7fe0e8003a10 2024-05-27T06:29:16.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe0ffe00640 1 -- 172.21.15.87:0/1332399391 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e800dcc0 con 0x7fe1000d1700 2024-05-27T06:29:16.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe105e00640 1 --2- 172.21.15.87:0/1332399391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0e8004d50 0x7fe0e8005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:16.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe105400640 1 --2- 172.21.15.87:0/1332399391 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0e8003a10 0x7fe0e8003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:16.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe104a00640 1 --2- 172.21.15.87:0/1332399391 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1000d1700 0x7fe0e8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:16.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe105e00640 1 -- 172.21.15.87:0/1332399391 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1000d1700 msgr2=0x7fe0e8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:16.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe105e00640 1 --2- 172.21.15.87:0/1332399391 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1000d1700 0x7fe0e8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:16.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe105e00640 1 -- 172.21.15.87:0/1332399391 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0e8003a10 msgr2=0x7fe0e8003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:16.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe105e00640 1 --2- 172.21.15.87:0/1332399391 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0e8003a10 0x7fe0e8003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:16.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.073+0000 7fe105e00640 1 -- 172.21.15.87:0/1332399391 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e8003530 con 0x7fe0e8004d50 2024-05-27T06:29:16.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.077+0000 7fe105e00640 1 --2- 172.21.15.87:0/1332399391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0e8004d50 0x7fe0e8005160 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe0f800aa40 tx=0x7fe0f801d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f170a53f6f230ca6 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:16.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.077+0000 7fe0ffe00640 1 -- 172.21.15.87:0/1332399391 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f800a690 con 0x7fe0e8004d50 2024-05-27T06:29:16.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.077+0000 7fe0ffe00640 1 -- 172.21.15.87:0/1332399391 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f80072d0 con 0x7fe0e8004d50 2024-05-27T06:29:16.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.077+0000 7fe0ffe00640 1 -- 172.21.15.87:0/1332399391 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f80076c0 con 0x7fe0e8004d50 2024-05-27T06:29:16.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.077+0000 7fe107e00640 1 -- 172.21.15.87:0/1332399391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0e8004d50 msgr2=0x7fe0e8005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:16.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.077+0000 7fe107e00640 1 --2- 172.21.15.87:0/1332399391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0e8004d50 0x7fe0e8005160 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe0f800aa40 tx=0x7fe0f801d2e0 comp rx=0 tx=0).stop 2024-05-27T06:29:16.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.077+0000 7fe105e00640 1 -- 172.21.15.87:0/1332399391 reap_dead start 2024-05-27T06:29:16.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.077+0000 7fe107e00640 1 -- 172.21.15.87:0/1332399391 shutdown_connections 2024-05-27T06:29:16.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.077+0000 7fe107e00640 1 -- 172.21.15.87:0/1332399391 >> 172.21.15.87:0/1332399391 conn(0x7fe1000b46b0 msgr2=0x7fe1000b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:16.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.077+0000 7fe107e00640 1 -- 172.21.15.87:0/1332399391 shutdown_connections 2024-05-27T06:29:16.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.077+0000 7fe107e00640 1 -- 172.21.15.87:0/1332399391 wait complete. 2024-05-27T06:29:16.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.081+0000 7fe107e00640 1 Processor -- start 2024-05-27T06:29:16.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.081+0000 7fe107e00640 1 -- start start 2024-05-27T06:29:16.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.081+0000 7fe107e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0e8004d50 0x7fe100152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:16.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.081+0000 7fe107e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe10009efa0 0x7fe10015bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:16.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.081+0000 7fe107e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe10015c070 0x7fe1000aff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:16.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.081+0000 7fe107e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe1000cfdd0 con 0x7fe0e8004d50 2024-05-27T06:29:16.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.081+0000 7fe107e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe1000cfaf0 con 0x7fe10015c070 2024-05-27T06:29:16.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.081+0000 7fe107e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe1000cf200 con 0x7fe10009efa0 2024-05-27T06:29:16.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.081+0000 7fe105400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0e8004d50 0x7fe100152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:16.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.081+0000 7fe105400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0e8004d50 0x7fe100152980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37962/0 (socket says 172.21.15.87:37962) 2024-05-27T06:29:16.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.081+0000 7fe105400640 1 -- 172.21.15.87:0/1462904792 learned_addr learned my addr 172.21.15.87:0/1462904792 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:16.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.081+0000 7fe105e00640 1 --2- 172.21.15.87:0/1462904792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe10015c070 0x7fe1000aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:16.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.081+0000 7fe105400640 1 -- 172.21.15.87:0/1462904792 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe10009efa0 msgr2=0x7fe10015bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:16.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.081+0000 7fe104a00640 1 --2- 172.21.15.87:0/1462904792 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe10009efa0 0x7fe10015bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:16.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.081+0000 7fe105400640 1 --2- 172.21.15.87:0/1462904792 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe10009efa0 0x7fe10015bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:16.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.081+0000 7fe105400640 1 -- 172.21.15.87:0/1462904792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe10015c070 msgr2=0x7fe1000aff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:16.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.081+0000 7fe105400640 1 --2- 172.21.15.87:0/1462904792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe10015c070 0x7fe1000aff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:16.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.081+0000 7fe105400640 1 -- 172.21.15.87:0/1462904792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10015c480 con 0x7fe0e8004d50 2024-05-27T06:29:16.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.085+0000 7fe104a00640 1 --2- 172.21.15.87:0/1462904792 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe10009efa0 0x7fe10015bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:29:16.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.085+0000 7fe105e00640 1 --2- 172.21.15.87:0/1462904792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe10015c070 0x7fe1000aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:29:16.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.085+0000 7fe105400640 1 --2- 172.21.15.87:0/1462904792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0e8004d50 0x7fe100152980 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe0f40118e0 tx=0x7fe0f4011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:16.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.085+0000 7fe0fd600640 1 -- 172.21.15.87:0/1462904792 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f400faf0 con 0x7fe0e8004d50 2024-05-27T06:29:16.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.085+0000 7fe0fd600640 1 -- 172.21.15.87:0/1462904792 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f400fc90 con 0x7fe0e8004d50 2024-05-27T06:29:16.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.085+0000 7fe0fd600640 1 -- 172.21.15.87:0/1462904792 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4014440 con 0x7fe0e8004d50 2024-05-27T06:29:16.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.085+0000 7fe107e00640 1 -- 172.21.15.87:0/1462904792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe10015e8b0 con 0x7fe0e8004d50 2024-05-27T06:29:16.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.085+0000 7fe107e00640 1 -- 172.21.15.87:0/1462904792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe10015ee70 con 0x7fe0e8004d50 2024-05-27T06:29:16.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.085+0000 7fe107e00640 1 -- 172.21.15.87:0/1462904792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe10006aa30 con 0x7fe0e8004d50 2024-05-27T06:29:16.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.085+0000 7fe0fd600640 1 -- 172.21.15.87:0/1462904792 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe0f4012040 con 0x7fe0e8004d50 2024-05-27T06:29:16.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.085+0000 7fe0fd600640 1 --2- 172.21.15.87:0/1462904792 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe0e406f430 0x7fe0e4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:16.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.085+0000 7fe0fd600640 1 -- 172.21.15.87:0/1462904792 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7fe0f408fdb0 con 0x7fe0e8004d50 2024-05-27T06:29:16.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.089+0000 7fe104a00640 1 --2- 172.21.15.87:0/1462904792 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe0e406f430 0x7fe0e4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:16.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.089+0000 7fe104a00640 1 --2- 172.21.15.87:0/1462904792 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe0e406f430 0x7fe0e4071940 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe10006ffa0 tx=0x7fe0f0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:16.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.093+0000 7fe0fd600640 1 -- 172.21.15.87:0/1462904792 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe0f4094070 con 0x7fe0e8004d50 2024-05-27T06:29:16.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.305+0000 7fe107e00640 1 -- 172.21.15.87:0/1462904792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) -- 0x7fe10006fcf0 con 0x7fe0e8004d50 2024-05-27T06:29:16.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.309+0000 7fe0fd600640 1 -- 172.21.15.87:0/1462904792 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v16) ==== 184+0+141 (secure 0 0 0) 0x7fe0f4019030 con 0x7fe0e8004d50 2024-05-27T06:29:16.305 INFO:teuthology.orchestra.run.smithi087.stdout:[client.0] 2024-05-27T06:29:16.306 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCfJ1RmAld8BxAAigqU2F3mGXtAfw0L9Bfp2A== 2024-05-27T06:29:16.306 INFO:teuthology.orchestra.run.smithi087.stdout: caps mds = "allow" 2024-05-27T06:29:16.306 INFO:teuthology.orchestra.run.smithi087.stdout: caps mon = "allow r" 2024-05-27T06:29:16.306 INFO:teuthology.orchestra.run.smithi087.stdout: caps osd = "allow rw pool=cephfs_data" 2024-05-27T06:29:16.306 INFO:teuthology.orchestra.run.smithi087.stderr:updated caps for client.0 2024-05-27T06:29:16.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.309+0000 7fe107e00640 1 -- 172.21.15.87:0/1462904792 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe0e406f430 msgr2=0x7fe0e4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:16.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.309+0000 7fe107e00640 1 --2- 172.21.15.87:0/1462904792 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe0e406f430 0x7fe0e4071940 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe10006ffa0 tx=0x7fe0f0008040 comp rx=0 tx=0).stop 2024-05-27T06:29:16.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.309+0000 7fe107e00640 1 -- 172.21.15.87:0/1462904792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0e8004d50 msgr2=0x7fe100152980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:16.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.309+0000 7fe107e00640 1 --2- 172.21.15.87:0/1462904792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0e8004d50 0x7fe100152980 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe0f40118e0 tx=0x7fe0f4011da0 comp rx=0 tx=0).stop 2024-05-27T06:29:16.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.309+0000 7fe107e00640 1 -- 172.21.15.87:0/1462904792 shutdown_connections 2024-05-27T06:29:16.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.309+0000 7fe107e00640 1 --2- 172.21.15.87:0/1462904792 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe0e406f430 0x7fe0e4071940 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:16.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.309+0000 7fe107e00640 1 --2- 172.21.15.87:0/1462904792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe10015c070 0x7fe1000aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:16.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.309+0000 7fe107e00640 1 --2- 172.21.15.87:0/1462904792 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe10009efa0 0x7fe10015bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:16.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.309+0000 7fe107e00640 1 --2- 172.21.15.87:0/1462904792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0e8004d50 0x7fe100152980 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:16.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.309+0000 7fe107e00640 1 -- 172.21.15.87:0/1462904792 >> 172.21.15.87:0/1462904792 conn(0x7fe1000b46b0 msgr2=0x7fe1000b2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:16.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.309+0000 7fe107e00640 1 -- 172.21.15.87:0/1462904792 shutdown_connections 2024-05-27T06:29:16.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.309+0000 7fe107e00640 1 -- 172.21.15.87:0/1462904792 wait complete. 2024-05-27T06:29:16.329 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-27T06:29:16.329 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-27T06:29:16.432 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-27T06:29:16.519 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-27T06:29:16.519 INFO:tasks.cephfs.mount:Terminating background process 2024-05-27T06:29:16.519 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:29:16.519 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:29:16.528 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8583 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274976k,nr_inodes=818744,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-27T06:29:16.528 INFO:tasks.cephfs.mount:Terminating background process 2024-05-27T06:29:16.528 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:29:16.528 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:29:16.538 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105064k,nr_inodes=2026266,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625948k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6550 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625944k,nr_inodes=406486,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625948k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-27T06:29:16.538 INFO:tasks.cephfs.mount:Terminating background process 2024-05-27T06:29:16.538 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:29:16.538 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:29:16.577 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8583 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274976k,nr_inodes=818744,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-27T06:29:16.577 INFO:tasks.cephfs.mount:Terminating background process 2024-05-27T06:29:16.577 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:29:16.577 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:29:16.588 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105064k,nr_inodes=2026266,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625948k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6550 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625944k,nr_inodes=406486,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625948k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-27T06:29:16.589 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T06:29:16.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.773+0000 7f0f1b400640 1 Processor -- start 2024-05-27T06:29:16.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.773+0000 7f0f1b400640 1 -- start start 2024-05-27T06:29:16.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.777+0000 7f0f1b400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f140cf820 0x7f0f140cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:16.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.777+0000 7f0f1b400640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f1406eb40 con 0x7f0f1406f5e0 2024-05-27T06:29:16.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.777+0000 7f0f1b400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f1406dd00 con 0x7f0f140c4310 2024-05-27T06:29:16.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.777+0000 7f0f1b400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0f1406ede0 con 0x7f0f140cf820 2024-05-27T06:29:16.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.777+0000 7f0f19400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f0f1406f5e0 0x7f0f1406f9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57588/0 (socket says 172.21.15.87:57588) 2024-05-27T06:29:16.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.777+0000 7f0f19400640 1 -- 172.21.15.87:0/3778100116 learned_addr learned my addr 172.21.15.87:0/3778100116 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:29:16.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.777+0000 7f0f18a00640 1 --2- 172.21.15.87:0/3778100116 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f140cf820 0x7f0f140cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:16.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.777+0000 7f0f18a00640 1 -- 172.21.15.87:0/3778100116 >> v1:172.21.15.149:6789/0 conn(0x7f0f140c4310 legacy=0x7f0f140c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:16.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.777+0000 7f0f18a00640 1 -- 172.21.15.87:0/3778100116 >> v1:172.21.15.87:6789/0 conn(0x7f0f1406f5e0 legacy=0x7f0f1406f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:16.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.777+0000 7f0f18a00640 1 -- 172.21.15.87:0/3778100116 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1406f0c0 con 0x7f0f140cf820 2024-05-27T06:29:16.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.781+0000 7f0f18a00640 1 --2- 172.21.15.87:0/3778100116 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f140cf820 0x7f0f140cfc30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0f040097f0 tx=0x7f0f0401c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3280f58f16efdf70 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:16.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.781+0000 7f0f13e00640 1 -- 172.21.15.87:0/3778100116 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f040aa680 con 0x7f0f140cf820 2024-05-27T06:29:16.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.781+0000 7f0f13e00640 1 -- 172.21.15.87:0/3778100116 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f040af070 con 0x7f0f140cf820 2024-05-27T06:29:16.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.781+0000 7f0f13e00640 1 -- 172.21.15.87:0/3778100116 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f040aaa40 con 0x7f0f140cf820 2024-05-27T06:29:16.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.785+0000 7f0f1b400640 1 -- 172.21.15.87:0/3778100116 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f140cf820 msgr2=0x7f0f140cfc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:16.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.785+0000 7f0f1b400640 1 --2- 172.21.15.87:0/3778100116 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f140cf820 0x7f0f140cfc30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0f040097f0 tx=0x7f0f0401c500 comp rx=0 tx=0).stop 2024-05-27T06:29:16.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.785+0000 7f0f1b400640 1 -- 172.21.15.87:0/3778100116 shutdown_connections 2024-05-27T06:29:16.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.785+0000 7f0f1b400640 1 --2- 172.21.15.87:0/3778100116 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f140cf820 0x7f0f140cfc30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:16.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.785+0000 7f0f1b400640 1 -- 172.21.15.87:0/3778100116 >> 172.21.15.87:0/3778100116 conn(0x7f0f140b46b0 msgr2=0x7f0f140b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:16.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.785+0000 7f0f1b400640 1 -- 172.21.15.87:0/3778100116 shutdown_connections 2024-05-27T06:29:16.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.785+0000 7f0f1b400640 1 -- 172.21.15.87:0/3778100116 wait complete. 2024-05-27T06:29:16.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.785+0000 7f0f1b400640 1 Processor -- start 2024-05-27T06:29:16.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.785+0000 7f0f1b400640 1 -- start start 2024-05-27T06:29:16.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.789+0000 7f0f1b400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f1406f5e0 0x7f0f14155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:16.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.789+0000 7f0f1b400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f140c4310 0x7f0f140af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:16.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.789+0000 7f0f1b400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f140cf820 0x7f0f140afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:16.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.789+0000 7f0f1b400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0f14171d70 con 0x7f0f1406f5e0 2024-05-27T06:29:16.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.789+0000 7f0f1b400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1406d9a0 con 0x7f0f140c4310 2024-05-27T06:29:16.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.789+0000 7f0f1b400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0f14171ef0 con 0x7f0f140cf820 2024-05-27T06:29:16.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.789+0000 7f0f18a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f1406f5e0 0x7f0f14155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:16.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.789+0000 7f0f18a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f1406f5e0 0x7f0f14155a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37974/0 (socket says 172.21.15.87:37974) 2024-05-27T06:29:16.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.789+0000 7f0f18a00640 1 -- 172.21.15.87:0/886591038 learned_addr learned my addr 172.21.15.87:0/886591038 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:16.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.789+0000 7f0f0be00640 1 --2- 172.21.15.87:0/886591038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f140c4310 0x7f0f140af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:16.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.789+0000 7f0f19400640 1 --2- 172.21.15.87:0/886591038 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f140cf820 0x7f0f140afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:16.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.789+0000 7f0f18a00640 1 -- 172.21.15.87:0/886591038 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f140cf820 msgr2=0x7f0f140afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:16.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.789+0000 7f0f18a00640 1 --2- 172.21.15.87:0/886591038 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f140cf820 0x7f0f140afc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:16.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.789+0000 7f0f18a00640 1 -- 172.21.15.87:0/886591038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f140c4310 msgr2=0x7f0f140af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:16.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.789+0000 7f0f18a00640 1 --2- 172.21.15.87:0/886591038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f140c4310 0x7f0f140af6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:16.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.789+0000 7f0f18a00640 1 -- 172.21.15.87:0/886591038 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1415fa80 con 0x7f0f1406f5e0 2024-05-27T06:29:16.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.789+0000 7f0f18a00640 1 --2- 172.21.15.87:0/886591038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f1406f5e0 0x7f0f14155a90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0f040097f0 tx=0x7f0f040192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:16.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.789+0000 7f0f11600640 1 -- 172.21.15.87:0/886591038 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f040be650 con 0x7f0f1406f5e0 2024-05-27T06:29:16.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.789+0000 7f0f11600640 1 -- 172.21.15.87:0/886591038 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f040aae50 con 0x7f0f1406f5e0 2024-05-27T06:29:16.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.789+0000 7f0f1b400640 1 -- 172.21.15.87:0/886591038 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f1415fd60 con 0x7f0f1406f5e0 2024-05-27T06:29:16.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.789+0000 7f0f11600640 1 -- 172.21.15.87:0/886591038 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f040bea50 con 0x7f0f1406f5e0 2024-05-27T06:29:16.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.789+0000 7f0f1b400640 1 -- 172.21.15.87:0/886591038 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f14160320 con 0x7f0f1406f5e0 2024-05-27T06:29:16.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.789+0000 7f0f1b400640 1 -- 172.21.15.87:0/886591038 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f1406aa30 con 0x7f0f1406f5e0 2024-05-27T06:29:16.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.793+0000 7f0f11600640 1 -- 172.21.15.87:0/886591038 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0f040a8050 con 0x7f0f1406f5e0 2024-05-27T06:29:16.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.793+0000 7f0f11600640 1 --2- 172.21.15.87:0/886591038 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0ef006f430 0x7f0ef0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:16.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.793+0000 7f0f11600640 1 -- 172.21.15.87:0/886591038 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f0f04129a00 con 0x7f0f1406f5e0 2024-05-27T06:29:16.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.793+0000 7f0f0be00640 1 --2- 172.21.15.87:0/886591038 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0ef006f430 0x7f0ef0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:16.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.793+0000 7f0f0be00640 1 --2- 172.21.15.87:0/886591038 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0ef006f430 0x7f0ef0071940 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0f140d2180 tx=0x7f0efc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:16.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.797+0000 7f0f11600640 1 -- 172.21.15.87:0/886591038 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f0f040c3060 con 0x7f0f1406f5e0 2024-05-27T06:29:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.985+0000 7f0f1b400640 1 -- 172.21.15.87:0/886591038 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f1406fda0 con 0x7f0f1406f5e0 2024-05-27T06:29:16.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.985+0000 7f0f11600640 1 -- 172.21.15.87:0/886591038 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5180 (secure 0 0 0) 0x7f0f040a6040 con 0x7f0f1406f5e0 2024-05-27T06:29:16.985 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:29:16.985 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/662047769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":662047769},{"type":"v1","addr":"172.21.15.87:6837","nonce":662047769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4861,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/553113849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":553113849},{"type":"v1","addr":"172.21.15.149:6834","nonce":553113849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/381728425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":381728425},{"type":"v1","addr":"172.21.15.149:6835","nonce":381728425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T06:28:41.065900+0000","modified":"2024-05-27T06:28:55.121337+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2661735568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2661735568},{"type":"v1","addr":"172.21.15.87:6835","nonce":2661735568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4920,"qdb_cluster":[4920]},"id":2}]} 2024-05-27T06:29:16.985 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 19 2024-05-27T06:29:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.989+0000 7f0f1b400640 1 -- 172.21.15.87:0/886591038 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0ef006f430 msgr2=0x7f0ef0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.989+0000 7f0f1b400640 1 --2- 172.21.15.87:0/886591038 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0ef006f430 0x7f0ef0071940 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0f140d2180 tx=0x7f0efc009040 comp rx=0 tx=0).stop 2024-05-27T06:29:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.989+0000 7f0f1b400640 1 -- 172.21.15.87:0/886591038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f1406f5e0 msgr2=0x7f0f14155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.989+0000 7f0f1b400640 1 --2- 172.21.15.87:0/886591038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f1406f5e0 0x7f0f14155a90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0f040097f0 tx=0x7f0f040192a0 comp rx=0 tx=0).stop 2024-05-27T06:29:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.989+0000 7f0f1b400640 1 -- 172.21.15.87:0/886591038 shutdown_connections 2024-05-27T06:29:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.989+0000 7f0f1b400640 1 --2- 172.21.15.87:0/886591038 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0ef006f430 0x7f0ef0071940 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.989+0000 7f0f1b400640 1 --2- 172.21.15.87:0/886591038 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f140cf820 0x7f0f140afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.989+0000 7f0f1b400640 1 --2- 172.21.15.87:0/886591038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f140c4310 0x7f0f140af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:16.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.989+0000 7f0f1b400640 1 --2- 172.21.15.87:0/886591038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f1406f5e0 0x7f0f14155a90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:16.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.989+0000 7f0f1b400640 1 -- 172.21.15.87:0/886591038 >> 172.21.15.87:0/886591038 conn(0x7f0f140b46b0 msgr2=0x7f0f140d09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:16.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.989+0000 7f0f1b400640 1 -- 172.21.15.87:0/886591038 shutdown_connections 2024-05-27T06:29:16.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:16.989+0000 7f0f1b400640 1 -- 172.21.15.87:0/886591038 wait complete. 2024-05-27T06:29:17.007 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T06:29:17.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.153+0000 7fe0e6a00640 1 Processor -- start 2024-05-27T06:29:17.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.153+0000 7fe0e6a00640 1 -- start start 2024-05-27T06:29:17.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.157+0000 7fe0e6a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe0e00b5a60 0x7fe0e00af550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:17.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.157+0000 7fe0e6a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0e00afa90 0x7fe0e0161690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:17.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.157+0000 7fe0e6a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0e015f060 con 0x7fe0e0161bd0 2024-05-27T06:29:17.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.157+0000 7fe0e6a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fe0e00b6d00 con 0x7fe0e00b5a60 2024-05-27T06:29:17.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.157+0000 7fe0e6a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e00b5e70 con 0x7fe0e00afa90 2024-05-27T06:29:17.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.157+0000 7fe0d7400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0e00afa90 0x7fe0e0161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:17.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.157+0000 7fe0dfe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe0e00b5a60 0x7fe0e00af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:17.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.157+0000 7fe0d7400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0e00afa90 0x7fe0e0161690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.87:59016/0 (socket says 172.21.15.87:59016) 2024-05-27T06:29:17.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.157+0000 7fe0d7400640 1 -- 172.21.15.87:0/2492702710 learned_addr learned my addr 172.21.15.87:0/2492702710 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:17.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.157+0000 7fe0dfe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe0e00b5a60 0x7fe0e00af550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:47336/0 (socket says 172.21.15.87:47336) 2024-05-27T06:29:17.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.157+0000 7fe0d7400640 1 -- 172.21.15.87:0/2492702710 >> v2:172.21.15.149:3300/0 conn(0x7fe0e00b5a60 msgr2=0x7fe0e00af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:17.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.157+0000 7fe0d7400640 1 --2- 172.21.15.87:0/2492702710 >> v2:172.21.15.149:3300/0 conn(0x7fe0e00b5a60 0x7fe0e00af550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:17.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.157+0000 7fe0d7400640 1 -- 172.21.15.87:0/2492702710 >> v1:172.21.15.149:6789/0 conn(0x7fe0e0161bd0 legacy=0x7fe0e006c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:17.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.157+0000 7fe0d7400640 1 -- 172.21.15.87:0/2492702710 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e00afea0 con 0x7fe0e00afa90 2024-05-27T06:29:17.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.161+0000 7fe0d7400640 1 --2- 172.21.15.87:0/2492702710 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0e00afa90 0x7fe0e0161690 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009870 tx=0x7fe0c801c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92f83ebe03dfbf38 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:17.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.161+0000 7fe0df400640 1 -- 172.21.15.87:0/2492702710 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c80b0070 con 0x7fe0e00afa90 2024-05-27T06:29:17.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.161+0000 7fe0df400640 1 -- 172.21.15.87:0/2492702710 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0c80ab600 con 0x7fe0e00afa90 2024-05-27T06:29:17.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.161+0000 7fe0df400640 1 -- 172.21.15.87:0/2492702710 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c80ab9d0 con 0x7fe0e00afa90 2024-05-27T06:29:17.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.161+0000 7fe0e6a00640 1 -- 172.21.15.87:0/2492702710 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0e00afa90 msgr2=0x7fe0e0161690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:17.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.161+0000 7fe0e6a00640 1 --2- 172.21.15.87:0/2492702710 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0e00afa90 0x7fe0e0161690 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009870 tx=0x7fe0c801c4d0 comp rx=0 tx=0).stop 2024-05-27T06:29:17.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.161+0000 7fe0e6a00640 1 -- 172.21.15.87:0/2492702710 shutdown_connections 2024-05-27T06:29:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.161+0000 7fe0e6a00640 1 --2- 172.21.15.87:0/2492702710 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0e00afa90 0x7fe0e0161690 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.161+0000 7fe0e6a00640 1 --2- 172.21.15.87:0/2492702710 >> v2:172.21.15.149:3300/0 conn(0x7fe0e00b5a60 0x7fe0e00af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.161+0000 7fe0e6a00640 1 -- 172.21.15.87:0/2492702710 >> 172.21.15.87:0/2492702710 conn(0x7fe0e00d1e70 msgr2=0x7fe0e00d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.161+0000 7fe0e6a00640 1 -- 172.21.15.87:0/2492702710 shutdown_connections 2024-05-27T06:29:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.161+0000 7fe0e6a00640 1 -- 172.21.15.87:0/2492702710 wait complete. 2024-05-27T06:29:17.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.165+0000 7fe0e6a00640 1 Processor -- start 2024-05-27T06:29:17.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.165+0000 7fe0e6a00640 1 -- start start 2024-05-27T06:29:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.165+0000 7fe0e6a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0e00afa90 0x7fe0e01416a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.165+0000 7fe0e6a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0e00b5a60 0x7fe0e0158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.165+0000 7fe0e6a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0e0161bd0 0x7fe0e00b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.165+0000 7fe0e6a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e00b6990 con 0x7fe0e00afa90 2024-05-27T06:29:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.165+0000 7fe0e6a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e00b15a0 con 0x7fe0e00b5a60 2024-05-27T06:29:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.165+0000 7fe0e6a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e00b7190 con 0x7fe0e0161bd0 2024-05-27T06:29:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.165+0000 7fe0dfe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0e00afa90 0x7fe0e01416a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.165+0000 7fe0dfe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0e00afa90 0x7fe0e01416a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37988/0 (socket says 172.21.15.87:37988) 2024-05-27T06:29:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.165+0000 7fe0dfe00640 1 -- 172.21.15.87:0/2178244067 learned_addr learned my addr 172.21.15.87:0/2178244067 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.165+0000 7fe0d7400640 1 --2- 172.21.15.87:0/2178244067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0e00b5a60 0x7fe0e0158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.165+0000 7fe0e4a00640 1 --2- 172.21.15.87:0/2178244067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0e0161bd0 0x7fe0e00b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.165+0000 7fe0dfe00640 1 -- 172.21.15.87:0/2178244067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0e0161bd0 msgr2=0x7fe0e00b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.165+0000 7fe0dfe00640 1 --2- 172.21.15.87:0/2178244067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0e0161bd0 0x7fe0e00b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.165+0000 7fe0dfe00640 1 -- 172.21.15.87:0/2178244067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0e00b5a60 msgr2=0x7fe0e0158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.165+0000 7fe0dfe00640 1 --2- 172.21.15.87:0/2178244067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0e00b5a60 0x7fe0e0158760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.165+0000 7fe0dfe00640 1 -- 172.21.15.87:0/2178244067 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e0141be0 con 0x7fe0e00afa90 2024-05-27T06:29:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.165+0000 7fe0d7400640 1 --2- 172.21.15.87:0/2178244067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0e00b5a60 0x7fe0e0158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:29:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.169+0000 7fe0dfe00640 1 --2- 172.21.15.87:0/2178244067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0e00afa90 0x7fe0e01416a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000e8a0 tx=0x7fe0d000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.169+0000 7fe0dcc00640 1 -- 172.21.15.87:0/2178244067 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0017070 con 0x7fe0e00afa90 2024-05-27T06:29:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.169+0000 7fe0dcc00640 1 -- 172.21.15.87:0/2178244067 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d000c940 con 0x7fe0e00afa90 2024-05-27T06:29:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.169+0000 7fe0e6a00640 1 -- 172.21.15.87:0/2178244067 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e0159200 con 0x7fe0e00afa90 2024-05-27T06:29:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.169+0000 7fe0dcc00640 1 -- 172.21.15.87:0/2178244067 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d000ccf0 con 0x7fe0e00afa90 2024-05-27T06:29:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.169+0000 7fe0e6a00640 1 -- 172.21.15.87:0/2178244067 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e01597c0 con 0x7fe0e00afa90 2024-05-27T06:29:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.169+0000 7fe0e6a00640 1 -- 172.21.15.87:0/2178244067 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0e006aa30 con 0x7fe0e00afa90 2024-05-27T06:29:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.169+0000 7fe0dcc00640 1 -- 172.21.15.87:0/2178244067 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe0d001a070 con 0x7fe0e00afa90 2024-05-27T06:29:17.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.169+0000 7fe0dcc00640 1 --2- 172.21.15.87:0/2178244067 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe0bc06f400 0x7fe0bc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:17.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.169+0000 7fe0dcc00640 1 -- 172.21.15.87:0/2178244067 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7fe0d008f930 con 0x7fe0e00afa90 2024-05-27T06:29:17.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.169+0000 7fe0d7400640 1 --2- 172.21.15.87:0/2178244067 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe0bc06f400 0x7fe0bc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:17.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.173+0000 7fe0d7400640 1 --2- 172.21.15.87:0/2178244067 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe0bc06f400 0x7fe0bc071910 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe0c80ad000 tx=0x7fe0c8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:17.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.173+0000 7fe0dcc00640 1 -- 172.21.15.87:0/2178244067 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe0d005c490 con 0x7fe0e00afa90 2024-05-27T06:29:17.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.369+0000 7fe0e6a00640 1 -- 172.21.15.87:0/2178244067 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0e00b5580 con 0x7fe0e00afa90 2024-05-27T06:29:17.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.369+0000 7fe0dcc00640 1 -- 172.21.15.87:0/2178244067 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5180 (secure 0 0 0) 0x7fe0d005bd90 con 0x7fe0e00afa90 2024-05-27T06:29:17.366 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:29:17.367 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/662047769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":662047769},{"type":"v1","addr":"172.21.15.87:6837","nonce":662047769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4861,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/553113849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":553113849},{"type":"v1","addr":"172.21.15.149:6834","nonce":553113849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/381728425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":381728425},{"type":"v1","addr":"172.21.15.149:6835","nonce":381728425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T06:28:41.065900+0000","modified":"2024-05-27T06:28:55.121337+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2661735568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2661735568},{"type":"v1","addr":"172.21.15.87:6835","nonce":2661735568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4920,"qdb_cluster":[4920]},"id":2}]} 2024-05-27T06:29:17.367 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 19 2024-05-27T06:29:17.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.369+0000 7fe0e6a00640 1 -- 172.21.15.87:0/2178244067 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe0bc06f400 msgr2=0x7fe0bc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:17.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.369+0000 7fe0e6a00640 1 --2- 172.21.15.87:0/2178244067 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe0bc06f400 0x7fe0bc071910 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe0c80ad000 tx=0x7fe0c8008040 comp rx=0 tx=0).stop 2024-05-27T06:29:17.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.369+0000 7fe0e6a00640 1 -- 172.21.15.87:0/2178244067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0e00afa90 msgr2=0x7fe0e01416a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:17.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.369+0000 7fe0e6a00640 1 --2- 172.21.15.87:0/2178244067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0e00afa90 0x7fe0e01416a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000e8a0 tx=0x7fe0d000eca0 comp rx=0 tx=0).stop 2024-05-27T06:29:17.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.369+0000 7fe0e6a00640 1 -- 172.21.15.87:0/2178244067 shutdown_connections 2024-05-27T06:29:17.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.369+0000 7fe0e6a00640 1 --2- 172.21.15.87:0/2178244067 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe0bc06f400 0x7fe0bc071910 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:17.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.369+0000 7fe0e6a00640 1 --2- 172.21.15.87:0/2178244067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0e0161bd0 0x7fe0e00b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:17.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.369+0000 7fe0e6a00640 1 --2- 172.21.15.87:0/2178244067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0e00b5a60 0x7fe0e0158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:17.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.369+0000 7fe0e6a00640 1 --2- 172.21.15.87:0/2178244067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0e00afa90 0x7fe0e01416a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:17.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.369+0000 7fe0e6a00640 1 -- 172.21.15.87:0/2178244067 >> 172.21.15.87:0/2178244067 conn(0x7fe0e00d1e70 msgr2=0x7fe0e006d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:17.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.369+0000 7fe0e6a00640 1 -- 172.21.15.87:0/2178244067 shutdown_connections 2024-05-27T06:29:17.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.369+0000 7fe0e6a00640 1 -- 172.21.15.87:0/2178244067 wait complete. 2024-05-27T06:29:17.388 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T06:29:17.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.537+0000 7f2ffca00640 1 Processor -- start 2024-05-27T06:29:17.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.537+0000 7f2ffca00640 1 -- start start 2024-05-27T06:29:17.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.537+0000 7f2ffca00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2ff8072aa0 0x7f2ff806d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:17.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.537+0000 7f2ffca00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ff80cd120 con 0x7f2ff8072eb0 2024-05-27T06:29:17.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.537+0000 7f2ffca00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ff80cd400 con 0x7f2ff80d1e50 2024-05-27T06:29:17.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.537+0000 7f2ffca00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f2ff80cdd30 con 0x7f2ff8072aa0 2024-05-27T06:29:17.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.537+0000 7f2fed400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f2ff8072eb0 0x7f2ff80d1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57594/0 (socket says 172.21.15.87:57594) 2024-05-27T06:29:17.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.537+0000 7f2fed400640 1 -- 172.21.15.87:0/1944214598 learned_addr learned my addr 172.21.15.87:0/1944214598 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:29:17.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.537+0000 7f2ff5e00640 1 --2- 172.21.15.87:0/1944214598 >> v2:172.21.15.149:3300/0 conn(0x7f2ff8072aa0 0x7f2ff806d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:17.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.541+0000 7f2ff5400640 1 -- 172.21.15.87:0/1944214598 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2951041057 0 0) 0x7f2ff80cd120 con 0x7f2ff8072eb0 2024-05-27T06:29:17.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.541+0000 7f2ff5400640 1 -- 172.21.15.87:0/1944214598 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fdc003530 con 0x7f2ff8072eb0 2024-05-27T06:29:17.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.541+0000 7f2ff5e00640 1 -- 172.21.15.87:0/1944214598 >> v1:172.21.15.149:6789/0 conn(0x7f2ff80d1e50 legacy=0x7f2ff80ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:17.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.541+0000 7f2ff5e00640 1 -- 172.21.15.87:0/1944214598 >> v1:172.21.15.87:6789/0 conn(0x7f2ff8072eb0 legacy=0x7f2ff80d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:17.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.541+0000 7f2ff5400640 1 -- 172.21.15.87:0/1944214598 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2337100678 0 0) 0x7f2fdc003530 con 0x7f2ff8072eb0 2024-05-27T06:29:17.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.541+0000 7f2ff5e00640 1 -- 172.21.15.87:0/1944214598 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff80cd6e0 con 0x7f2ff8072aa0 2024-05-27T06:29:17.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.541+0000 7f2ff5e00640 1 --2- 172.21.15.87:0/1944214598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ff8072aa0 0x7f2ff806d820 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80097c0 tx=0x7f2fe801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f66739db0c759930 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:17.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.545+0000 7f2ff5400640 1 -- 172.21.15.87:0/1944214598 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe80aa5f0 con 0x7f2ff8072aa0 2024-05-27T06:29:17.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.545+0000 7f2ff5400640 1 -- 172.21.15.87:0/1944214598 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe80af070 con 0x7f2ff8072aa0 2024-05-27T06:29:17.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.545+0000 7f2ff5400640 1 -- 172.21.15.87:0/1944214598 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe80aa9b0 con 0x7f2ff8072aa0 2024-05-27T06:29:17.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.545+0000 7f2ffca00640 1 -- 172.21.15.87:0/1944214598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ff8072aa0 msgr2=0x7f2ff806d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:17.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.545+0000 7f2ffca00640 1 --2- 172.21.15.87:0/1944214598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ff8072aa0 0x7f2ff806d820 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80097c0 tx=0x7f2fe801c470 comp rx=0 tx=0).stop 2024-05-27T06:29:17.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.545+0000 7f2ffca00640 1 -- 172.21.15.87:0/1944214598 shutdown_connections 2024-05-27T06:29:17.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.545+0000 7f2ffca00640 1 --2- 172.21.15.87:0/1944214598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ff8072aa0 0x7f2ff806d820 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:17.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.545+0000 7f2ffca00640 1 -- 172.21.15.87:0/1944214598 >> 172.21.15.87:0/1944214598 conn(0x7f2ff80b46b0 msgr2=0x7f2ff80b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:17.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.545+0000 7f2ffca00640 1 -- 172.21.15.87:0/1944214598 shutdown_connections 2024-05-27T06:29:17.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.545+0000 7f2ffca00640 1 -- 172.21.15.87:0/1944214598 wait complete. 2024-05-27T06:29:17.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.545+0000 7f2ffca00640 1 Processor -- start 2024-05-27T06:29:17.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.545+0000 7f2ffca00640 1 -- start start 2024-05-27T06:29:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.549+0000 7f2ffca00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ff8072aa0 0x7f2ff8158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.549+0000 7f2ffca00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ff8072eb0 0x7f2ff815afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.549+0000 7f2ffca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ff80d1e50 0x7f2ff80c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.549+0000 7f2ffca00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff816c450 con 0x7f2ff8072aa0 2024-05-27T06:29:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.549+0000 7f2ffca00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff816c2d0 con 0x7f2ff80d1e50 2024-05-27T06:29:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.549+0000 7f2ffca00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2ff816c5d0 con 0x7f2ff8072eb0 2024-05-27T06:29:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.549+0000 7f2ff5e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ff8072aa0 0x7f2ff8158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.549+0000 7f2ff5e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ff8072aa0 0x7f2ff8158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37994/0 (socket says 172.21.15.87:37994) 2024-05-27T06:29:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.549+0000 7f2ff5e00640 1 -- 172.21.15.87:0/2586526099 learned_addr learned my addr 172.21.15.87:0/2586526099 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.549+0000 7f2ff5e00640 1 -- 172.21.15.87:0/2586526099 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ff8072eb0 msgr2=0x7f2ff815afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.549+0000 7f2fed400640 1 --2- 172.21.15.87:0/2586526099 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ff8072eb0 0x7f2ff815afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:17.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.549+0000 7f2ff5e00640 1 --2- 172.21.15.87:0/2586526099 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ff8072eb0 0x7f2ff815afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:17.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.549+0000 7f2ff5e00640 1 -- 172.21.15.87:0/2586526099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ff80d1e50 msgr2=0x7f2ff80c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:17.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.549+0000 7f2ff5e00640 1 --2- 172.21.15.87:0/2586526099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ff80d1e50 0x7f2ff80c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:17.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.549+0000 7f2ff5e00640 1 -- 172.21.15.87:0/2586526099 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff815bd10 con 0x7f2ff8072aa0 2024-05-27T06:29:17.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.549+0000 7f2fed400640 1 --2- 172.21.15.87:0/2586526099 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ff8072eb0 0x7f2ff815afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:29:17.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.549+0000 7f2ff5e00640 1 --2- 172.21.15.87:0/2586526099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ff8072aa0 0x7f2ff8158e20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80097c0 tx=0x7f2fe801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.549+0000 7f2feea00640 1 -- 172.21.15.87:0/2586526099 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe80aae60 con 0x7f2ff8072aa0 2024-05-27T06:29:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.549+0000 7f2feea00640 1 -- 172.21.15.87:0/2586526099 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe80b4600 con 0x7f2ff8072aa0 2024-05-27T06:29:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.549+0000 7f2ffca00640 1 -- 172.21.15.87:0/2586526099 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ff815bfd0 con 0x7f2ff8072aa0 2024-05-27T06:29:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.549+0000 7f2feea00640 1 -- 172.21.15.87:0/2586526099 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe80b49f0 con 0x7f2ff8072aa0 2024-05-27T06:29:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.549+0000 7f2ffca00640 1 -- 172.21.15.87:0/2586526099 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ff815a4c0 con 0x7f2ff8072aa0 2024-05-27T06:29:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.549+0000 7f2ffca00640 1 -- 172.21.15.87:0/2586526099 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ff806aa30 con 0x7f2ff8072aa0 2024-05-27T06:29:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.553+0000 7f2feea00640 1 -- 172.21.15.87:0/2586526099 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2fe80bc070 con 0x7f2ff8072aa0 2024-05-27T06:29:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.553+0000 7f2feea00640 1 --2- 172.21.15.87:0/2586526099 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2fd406f430 0x7f2fd4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.553+0000 7f2feea00640 1 -- 172.21.15.87:0/2586526099 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f2fe8129cb0 con 0x7f2ff8072aa0 2024-05-27T06:29:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.553+0000 7f2fed400640 1 --2- 172.21.15.87:0/2586526099 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2fd406f430 0x7f2fd4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.553+0000 7f2fed400640 1 --2- 172.21.15.87:0/2586526099 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2fd406f430 0x7f2fd4071940 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2ff815a3d0 tx=0x7f2fe0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:17.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.557+0000 7f2feea00640 1 -- 172.21.15.87:0/2586526099 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f2fe8016090 con 0x7f2ff8072aa0 2024-05-27T06:29:17.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.717+0000 7f2ffca00640 1 -- 172.21.15.87:0/2586526099 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ff80b37d0 con 0x7f2ff8072aa0 2024-05-27T06:29:17.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.717+0000 7f2feea00640 1 -- 172.21.15.87:0/2586526099 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+18742 (secure 0 0 0) 0x7f2fe80f61c0 con 0x7f2ff8072aa0 2024-05-27T06:29:17.716 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:29:17.716 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":41,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:28:56.726853+0000","last_up_change":"2024-05-27T06:27:25.988592+0000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T06:27:26.590191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-27T06:28:39.228886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-27T06:28:40.012993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2024-05-27T06:28:54.140490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6801","nonce":3674824716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6803","nonce":3674824716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6807","nonce":3674824716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6805","nonce":3674824716}]},"public_addr":"172.21.15.87:6801/3674824716","cluster_addr":"172.21.15.87:6803/3674824716","heartbeat_back_addr":"172.21.15.87:6807/3674824716","heartbeat_front_addr":"172.21.15.87:6805/3674824716","state":["exists","up"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6809","nonce":2443981288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6811","nonce":2443981288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6815","nonce":2443981288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6813","nonce":2443981288}]},"public_addr":"172.21.15.87:6809/2443981288","cluster_addr":"172.21.15.87:6811/2443981288","heartbeat_back_addr":"172.21.15.87:6815/2443981288","heartbeat_front_addr":"172.21.15.87:6813/2443981288","state":["exists","up"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6819","nonce":1441249238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6823","nonce":1441249238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6831","nonce":1441249238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6825","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6827","nonce":1441249238}]},"public_addr":"172.21.15.87:6819/1441249238","cluster_addr":"172.21.15.87:6823/1441249238","heartbeat_back_addr":"172.21.15.87:6831/1441249238","heartbeat_front_addr":"172.21.15.87:6827/1441249238","state":["exists","up"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6818","nonce":1173805234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6822","nonce":1173805234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6829","nonce":1173805234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6826","nonce":1173805234}]},"public_addr":"172.21.15.87:6818/1173805234","cluster_addr":"172.21.15.87:6822/1173805234","heartbeat_back_addr":"172.21.15.87:6829/1173805234","heartbeat_front_addr":"172.21.15.87:6826/1173805234","state":["exists","up"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6819","nonce":1551871079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6823","nonce":1551871079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6831","nonce":1551871079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6827","nonce":1551871079}]},"public_addr":"172.21.15.149:6819/1551871079","cluster_addr":"172.21.15.149:6823/1551871079","heartbeat_back_addr":"172.21.15.149:6831/1551871079","heartbeat_front_addr":"172.21.15.149:6827/1551871079","state":["exists","up"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6818","nonce":582864816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6822","nonce":582864816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6830","nonce":582864816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6826","nonce":582864816}]},"public_addr":"172.21.15.149:6818/582864816","cluster_addr":"172.21.15.149:6822/582864816","heartbeat_back_addr":"172.21.15.149:6830/582864816","heartbeat_front_addr":"172.21.15.149:6826/582864816","state":["exists","up"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6801","nonce":531351314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6803","nonce":531351314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6807","nonce":531351314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6805","nonce":531351314}]},"public_addr":"172.21.15.149:6801/531351314","cluster_addr":"172.21.15.149:6803/531351314","heartbeat_back_addr":"172.21.15.149:6807/531351314","heartbeat_front_addr":"172.21.15.149:6805/531351314","state":["exists","up"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6809","nonce":1171039913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6811","nonce":1171039913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6815","nonce":1171039913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6813","nonce":1171039913}]},"public_addr":"172.21.15.149:6809/1171039913","cluster_addr":"172.21.15.149:6811/1171039913","heartbeat_back_addr":"172.21.15.149:6815/1171039913","heartbeat_front_addr":"172.21.15.149:6813/1171039913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.589776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.819787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.767566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.683842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.038885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.120319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.687007+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.812832+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:29:17.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.721+0000 7f2ffca00640 1 -- 172.21.15.87:0/2586526099 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2fd406f430 msgr2=0x7f2fd4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:17.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.721+0000 7f2ffca00640 1 --2- 172.21.15.87:0/2586526099 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2fd406f430 0x7f2fd4071940 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2ff815a3d0 tx=0x7f2fe0009040 comp rx=0 tx=0).stop 2024-05-27T06:29:17.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.721+0000 7f2ffca00640 1 -- 172.21.15.87:0/2586526099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ff8072aa0 msgr2=0x7f2ff8158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:17.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.721+0000 7f2ffca00640 1 --2- 172.21.15.87:0/2586526099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ff8072aa0 0x7f2ff8158e20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80097c0 tx=0x7f2fe801acb0 comp rx=0 tx=0).stop 2024-05-27T06:29:17.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.721+0000 7f2ffca00640 1 -- 172.21.15.87:0/2586526099 shutdown_connections 2024-05-27T06:29:17.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.721+0000 7f2ffca00640 1 --2- 172.21.15.87:0/2586526099 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2fd406f430 0x7f2fd4071940 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:17.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.721+0000 7f2ffca00640 1 --2- 172.21.15.87:0/2586526099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ff80d1e50 0x7f2ff80c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:17.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.721+0000 7f2ffca00640 1 --2- 172.21.15.87:0/2586526099 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ff8072eb0 0x7f2ff815afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:17.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.721+0000 7f2ffca00640 1 --2- 172.21.15.87:0/2586526099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ff8072aa0 0x7f2ff8158e20 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:17.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.721+0000 7f2ffca00640 1 -- 172.21.15.87:0/2586526099 >> 172.21.15.87:0/2586526099 conn(0x7f2ff80b46b0 msgr2=0x7f2ff80686b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:17.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.721+0000 7f2ffca00640 1 -- 172.21.15.87:0/2586526099 shutdown_connections 2024-05-27T06:29:17.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.721+0000 7f2ffca00640 1 -- 172.21.15.87:0/2586526099 wait complete. 2024-05-27T06:29:17.740 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-27T06:29:17.740 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T06:29:17.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.889+0000 7fa6a5a00640 1 Processor -- start 2024-05-27T06:29:17.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.889+0000 7fa6a5a00640 1 -- start start 2024-05-27T06:29:17.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.893+0000 7fa6a5a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa6a0072eb0 0x7fa6a00d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:17.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.893+0000 7fa6a5a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6a00d1c80 0x7fa6a00ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:17.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.893+0000 7fa6a5a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6a00d2090 con 0x7fa6a0072aa0 2024-05-27T06:29:17.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.893+0000 7fa6a5a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fa6a00cdd30 con 0x7fa6a0072eb0 2024-05-27T06:29:17.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.893+0000 7fa6a5a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa6a00cd120 con 0x7fa6a00d1c80 2024-05-27T06:29:17.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.893+0000 7fa696000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa6a0072eb0 0x7fa6a00d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:17.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.893+0000 7fa69f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6a00d1c80 0x7fa6a00ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:17.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.893+0000 7fa696000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa6a0072eb0 0x7fa6a00d1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:47368/0 (socket says 172.21.15.87:47368) 2024-05-27T06:29:17.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.893+0000 7fa696000640 1 -- 172.21.15.87:0/3525892160 learned_addr learned my addr 172.21.15.87:0/3525892160 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:17.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.893+0000 7fa69f400640 1 -- 172.21.15.87:0/3525892160 >> v2:172.21.15.149:3300/0 conn(0x7fa6a0072eb0 msgr2=0x7fa6a00d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:17.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.893+0000 7fa69f400640 1 --2- 172.21.15.87:0/3525892160 >> v2:172.21.15.149:3300/0 conn(0x7fa6a0072eb0 0x7fa6a00d1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:17.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.893+0000 7fa69f400640 1 -- 172.21.15.87:0/3525892160 >> v1:172.21.15.149:6789/0 conn(0x7fa6a0072aa0 legacy=0x7fa6a006d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:17.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.893+0000 7fa69f400640 1 -- 172.21.15.87:0/3525892160 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a00cd400 con 0x7fa6a00d1c80 2024-05-27T06:29:17.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.897+0000 7fa69f400640 1 --2- 172.21.15.87:0/3525892160 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6a00d1c80 0x7fa6a00ce1c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa698009d90 tx=0x7fa69801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3139b869c40e426f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:17.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.897+0000 7fa69e000640 1 -- 172.21.15.87:0/3525892160 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6980b2070 con 0x7fa6a00d1c80 2024-05-27T06:29:17.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.897+0000 7fa69e000640 1 -- 172.21.15.87:0/3525892160 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6980a5a00 con 0x7fa6a00d1c80 2024-05-27T06:29:17.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.897+0000 7fa69e000640 1 -- 172.21.15.87:0/3525892160 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6980a5dd0 con 0x7fa6a00d1c80 2024-05-27T06:29:17.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.897+0000 7fa6a5a00640 1 -- 172.21.15.87:0/3525892160 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6a00d1c80 msgr2=0x7fa6a00ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:17.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.897+0000 7fa6a5a00640 1 --2- 172.21.15.87:0/3525892160 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6a00d1c80 0x7fa6a00ce1c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa698009d90 tx=0x7fa69801c940 comp rx=0 tx=0).stop 2024-05-27T06:29:17.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.897+0000 7fa6a5a00640 1 -- 172.21.15.87:0/3525892160 shutdown_connections 2024-05-27T06:29:17.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.897+0000 7fa6a5a00640 1 --2- 172.21.15.87:0/3525892160 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6a00d1c80 0x7fa6a00ce1c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:17.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.897+0000 7fa6a5a00640 1 --2- 172.21.15.87:0/3525892160 >> v2:172.21.15.149:3300/0 conn(0x7fa6a0072eb0 0x7fa6a00d1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:17.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.897+0000 7fa6a5a00640 1 -- 172.21.15.87:0/3525892160 >> 172.21.15.87:0/3525892160 conn(0x7fa6a00b46b0 msgr2=0x7fa6a00b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:17.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.897+0000 7fa6a5a00640 1 -- 172.21.15.87:0/3525892160 shutdown_connections 2024-05-27T06:29:17.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.897+0000 7fa6a5a00640 1 -- 172.21.15.87:0/3525892160 wait complete. 2024-05-27T06:29:17.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.901+0000 7fa6a5a00640 1 Processor -- start 2024-05-27T06:29:17.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.901+0000 7fa6a5a00640 1 -- start start 2024-05-27T06:29:17.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.901+0000 7fa6a5a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6a0072aa0 0x7fa6a015af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:17.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.901+0000 7fa6a5a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6a0072eb0 0x7fa6a0157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:17.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.901+0000 7fa6a5a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6a00d1c80 0x7fa6a015f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:17.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.901+0000 7fa6a5a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a00cccb0 con 0x7fa6a0072eb0 2024-05-27T06:29:17.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.901+0000 7fa6a5a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a006df30 con 0x7fa6a0072aa0 2024-05-27T06:29:17.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.901+0000 7fa6a5a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa6a00cce30 con 0x7fa6a00d1c80 2024-05-27T06:29:17.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.901+0000 7fa696000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6a0072eb0 0x7fa6a0157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:17.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.901+0000 7fa696000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6a0072eb0 0x7fa6a0157190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38010/0 (socket says 172.21.15.87:38010) 2024-05-27T06:29:17.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.901+0000 7fa696000640 1 -- 172.21.15.87:0/2250798480 learned_addr learned my addr 172.21.15.87:0/2250798480 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:17.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.901+0000 7fa69f400640 1 --2- 172.21.15.87:0/2250798480 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6a00d1c80 0x7fa6a015f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:17.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.901+0000 7fa69ea00640 1 --2- 172.21.15.87:0/2250798480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6a0072aa0 0x7fa6a015af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:17.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.901+0000 7fa696000640 1 -- 172.21.15.87:0/2250798480 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6a00d1c80 msgr2=0x7fa6a015f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:17.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.901+0000 7fa696000640 1 --2- 172.21.15.87:0/2250798480 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6a00d1c80 0x7fa6a015f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:17.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.901+0000 7fa696000640 1 -- 172.21.15.87:0/2250798480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6a0072aa0 msgr2=0x7fa6a015af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:17.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.901+0000 7fa696000640 1 --2- 172.21.15.87:0/2250798480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6a0072aa0 0x7fa6a015af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:17.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.901+0000 7fa696000640 1 -- 172.21.15.87:0/2250798480 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a015c8f0 con 0x7fa6a0072eb0 2024-05-27T06:29:17.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.901+0000 7fa69ea00640 1 --2- 172.21.15.87:0/2250798480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6a0072aa0 0x7fa6a015af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:29:17.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.901+0000 7fa696000640 1 --2- 172.21.15.87:0/2250798480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6a0072eb0 0x7fa6a0157190 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa68800e820 tx=0x7fa68800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:17.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.901+0000 7fa697400640 1 -- 172.21.15.87:0/2250798480 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa688017070 con 0x7fa6a0072eb0 2024-05-27T06:29:17.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.901+0000 7fa697400640 1 -- 172.21.15.87:0/2250798480 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa68800c940 con 0x7fa6a0072eb0 2024-05-27T06:29:17.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.901+0000 7fa6a5a00640 1 -- 172.21.15.87:0/2250798480 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6a015cbd0 con 0x7fa6a0072eb0 2024-05-27T06:29:17.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.901+0000 7fa697400640 1 -- 172.21.15.87:0/2250798480 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68800cd30 con 0x7fa6a0072eb0 2024-05-27T06:29:17.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.901+0000 7fa6a5a00640 1 -- 172.21.15.87:0/2250798480 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6a01576d0 con 0x7fa6a0072eb0 2024-05-27T06:29:17.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.901+0000 7fa6a5a00640 1 -- 172.21.15.87:0/2250798480 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6a006aa30 con 0x7fa6a0072eb0 2024-05-27T06:29:17.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.905+0000 7fa697400640 1 -- 172.21.15.87:0/2250798480 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa68801a070 con 0x7fa6a0072eb0 2024-05-27T06:29:17.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.905+0000 7fa697400640 1 --2- 172.21.15.87:0/2250798480 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa67c06f400 0x7fa67c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:17.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.905+0000 7fa697400640 1 -- 172.21.15.87:0/2250798480 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7fa68808f990 con 0x7fa6a0072eb0 2024-05-27T06:29:17.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.905+0000 7fa69ea00640 1 --2- 172.21.15.87:0/2250798480 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa67c06f400 0x7fa67c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:17.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.905+0000 7fa69ea00640 1 --2- 172.21.15.87:0/2250798480 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa67c06f400 0x7fa67c071910 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa690001630 tx=0x7fa690009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:17.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:17.909+0000 7fa697400640 1 -- 172.21.15.87:0/2250798480 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa68805c470 con 0x7fa6a0072eb0 2024-05-27T06:29:18.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.101+0000 7fa6a5a00640 1 -- 172.21.15.87:0/2250798480 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6a0159ca0 con 0x7fa6a0072eb0 2024-05-27T06:29:18.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.101+0000 7fa697400640 1 -- 172.21.15.87:0/2250798480 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5180 (secure 0 0 0) 0x7fa68805bd70 con 0x7fa6a0072eb0 2024-05-27T06:29:18.099 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:29:18.100 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/662047769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":662047769},{"type":"v1","addr":"172.21.15.87:6837","nonce":662047769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4861,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/553113849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":553113849},{"type":"v1","addr":"172.21.15.149:6834","nonce":553113849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/381728425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":381728425},{"type":"v1","addr":"172.21.15.149:6835","nonce":381728425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T06:28:41.065900+0000","modified":"2024-05-27T06:28:55.121337+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2661735568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2661735568},{"type":"v1","addr":"172.21.15.87:6835","nonce":2661735568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4920,"qdb_cluster":[4920]},"id":2}]} 2024-05-27T06:29:18.100 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 19 2024-05-27T06:29:18.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.101+0000 7fa6a5a00640 1 -- 172.21.15.87:0/2250798480 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa67c06f400 msgr2=0x7fa67c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:18.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.101+0000 7fa6a5a00640 1 --2- 172.21.15.87:0/2250798480 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa67c06f400 0x7fa67c071910 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa690001630 tx=0x7fa690009040 comp rx=0 tx=0).stop 2024-05-27T06:29:18.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.101+0000 7fa6a5a00640 1 -- 172.21.15.87:0/2250798480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6a0072eb0 msgr2=0x7fa6a0157190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:18.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.101+0000 7fa6a5a00640 1 --2- 172.21.15.87:0/2250798480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6a0072eb0 0x7fa6a0157190 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa68800e820 tx=0x7fa68800ece0 comp rx=0 tx=0).stop 2024-05-27T06:29:18.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.101+0000 7fa6a5a00640 1 -- 172.21.15.87:0/2250798480 shutdown_connections 2024-05-27T06:29:18.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.101+0000 7fa6a5a00640 1 --2- 172.21.15.87:0/2250798480 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa67c06f400 0x7fa67c071910 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:18.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.101+0000 7fa6a5a00640 1 --2- 172.21.15.87:0/2250798480 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6a00d1c80 0x7fa6a015f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:18.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.101+0000 7fa6a5a00640 1 --2- 172.21.15.87:0/2250798480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6a0072eb0 0x7fa6a0157190 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:18.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.101+0000 7fa6a5a00640 1 --2- 172.21.15.87:0/2250798480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6a0072aa0 0x7fa6a015af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:18.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.101+0000 7fa6a5a00640 1 -- 172.21.15.87:0/2250798480 >> 172.21.15.87:0/2250798480 conn(0x7fa6a00b46b0 msgr2=0x7fa6a00af510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:18.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.101+0000 7fa6a5a00640 1 -- 172.21.15.87:0/2250798480 shutdown_connections 2024-05-27T06:29:18.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.101+0000 7fa6a5a00640 1 -- 172.21.15.87:0/2250798480 wait complete. 2024-05-27T06:29:18.123 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T06:29:18.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.273+0000 7fbf84200640 1 Processor -- start 2024-05-27T06:29:18.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.273+0000 7fbf84200640 1 -- start start 2024-05-27T06:29:18.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.273+0000 7fbf84200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf7c074130 0x7fbf7c0cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:18.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.273+0000 7fbf84200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbf7c06cfb0 0x7fbf7c15e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:18.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.273+0000 7fbf84200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf7c161c90 con 0x7fbf7c06d3c0 2024-05-27T06:29:18.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.273+0000 7fbf84200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fbf7c161f70 con 0x7fbf7c06cfb0 2024-05-27T06:29:18.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.273+0000 7fbf84200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbf7c162250 con 0x7fbf7c074130 2024-05-27T06:29:18.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.273+0000 7fbf82200640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fbf7c06d3c0 0x7fbf7c0d17c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57600/0 (socket says 172.21.15.87:57600) 2024-05-27T06:29:18.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.273+0000 7fbf82200640 1 -- 172.21.15.87:0/2497311947 learned_addr learned my addr 172.21.15.87:0/2497311947 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:29:18.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.273+0000 7fbf81800640 1 --2- 172.21.15.87:0/2497311947 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf7c074130 0x7fbf7c0cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:18.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.273+0000 7fbf80e00640 1 --2- 172.21.15.87:0/2497311947 >> v2:172.21.15.149:3300/0 conn(0x7fbf7c06cfb0 0x7fbf7c15e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:18.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.273+0000 7fbf7be00640 1 -- 172.21.15.87:0/2497311947 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1364893053 0 0) 0x7fbf7c161c90 con 0x7fbf7c06d3c0 2024-05-27T06:29:18.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.277+0000 7fbf7be00640 1 -- 172.21.15.87:0/2497311947 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf64003530 con 0x7fbf7c06d3c0 2024-05-27T06:29:18.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.277+0000 7fbf81800640 1 -- 172.21.15.87:0/2497311947 >> v2:172.21.15.149:3300/0 conn(0x7fbf7c06cfb0 msgr2=0x7fbf7c15e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:18.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.277+0000 7fbf81800640 1 --2- 172.21.15.87:0/2497311947 >> v2:172.21.15.149:3300/0 conn(0x7fbf7c06cfb0 0x7fbf7c15e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:18.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.277+0000 7fbf81800640 1 -- 172.21.15.87:0/2497311947 >> v1:172.21.15.87:6789/0 conn(0x7fbf7c06d3c0 legacy=0x7fbf7c0d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:18.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.277+0000 7fbf81800640 1 -- 172.21.15.87:0/2497311947 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf7c162530 con 0x7fbf7c074130 2024-05-27T06:29:18.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.277+0000 7fbf81800640 1 --2- 172.21.15.87:0/2497311947 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf7c074130 0x7fbf7c0cfc70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbf700097c0 tx=0x7fbf7001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca2cc16657eabb00 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:18.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.277+0000 7fbf7be00640 1 -- 172.21.15.87:0/2497311947 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf700b0070 con 0x7fbf7c074130 2024-05-27T06:29:18.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.277+0000 7fbf7be00640 1 -- 172.21.15.87:0/2497311947 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf700ab600 con 0x7fbf7c074130 2024-05-27T06:29:18.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.277+0000 7fbf7be00640 1 -- 172.21.15.87:0/2497311947 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf700ab9d0 con 0x7fbf7c074130 2024-05-27T06:29:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.281+0000 7fbf84200640 1 -- 172.21.15.87:0/2497311947 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf7c074130 msgr2=0x7fbf7c0cfc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.281+0000 7fbf84200640 1 --2- 172.21.15.87:0/2497311947 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf7c074130 0x7fbf7c0cfc70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbf700097c0 tx=0x7fbf7001c4a0 comp rx=0 tx=0).stop 2024-05-27T06:29:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.281+0000 7fbf84200640 1 -- 172.21.15.87:0/2497311947 shutdown_connections 2024-05-27T06:29:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.281+0000 7fbf84200640 1 --2- 172.21.15.87:0/2497311947 >> v2:172.21.15.149:3300/0 conn(0x7fbf7c06cfb0 0x7fbf7c15e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.281+0000 7fbf84200640 1 --2- 172.21.15.87:0/2497311947 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf7c074130 0x7fbf7c0cfc70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.281+0000 7fbf84200640 1 -- 172.21.15.87:0/2497311947 >> 172.21.15.87:0/2497311947 conn(0x7fbf7c0700d0 msgr2=0x7fbf7c0704e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.281+0000 7fbf84200640 1 -- 172.21.15.87:0/2497311947 shutdown_connections 2024-05-27T06:29:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.281+0000 7fbf84200640 1 -- 172.21.15.87:0/2497311947 wait complete. 2024-05-27T06:29:18.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.281+0000 7fbf84200640 1 Processor -- start 2024-05-27T06:29:18.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.281+0000 7fbf84200640 1 -- start start 2024-05-27T06:29:18.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.285+0000 7fbf84200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf7c06cfb0 0x7fbf7c149760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:18.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.285+0000 7fbf84200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf7c06d3c0 0x7fbf7c1472d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:18.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.285+0000 7fbf84200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf7c074130 0x7fbf7c147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:18.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.285+0000 7fbf84200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c16b240 con 0x7fbf7c074130 2024-05-27T06:29:18.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.285+0000 7fbf84200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c16b0c0 con 0x7fbf7c06cfb0 2024-05-27T06:29:18.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.285+0000 7fbf84200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbf7c16b3c0 con 0x7fbf7c06d3c0 2024-05-27T06:29:18.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.285+0000 7fbf82200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf7c074130 0x7fbf7c147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:18.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.285+0000 7fbf82200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf7c074130 0x7fbf7c147810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38024/0 (socket says 172.21.15.87:38024) 2024-05-27T06:29:18.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.285+0000 7fbf82200640 1 -- 172.21.15.87:0/1623425121 learned_addr learned my addr 172.21.15.87:0/1623425121 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:18.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.285+0000 7fbf80e00640 1 --2- 172.21.15.87:0/1623425121 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf7c06d3c0 0x7fbf7c1472d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:18.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.285+0000 7fbf81800640 1 --2- 172.21.15.87:0/1623425121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf7c06cfb0 0x7fbf7c149760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:18.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.285+0000 7fbf82200640 1 -- 172.21.15.87:0/1623425121 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf7c06d3c0 msgr2=0x7fbf7c1472d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:18.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.285+0000 7fbf82200640 1 --2- 172.21.15.87:0/1623425121 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf7c06d3c0 0x7fbf7c1472d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:18.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.285+0000 7fbf82200640 1 -- 172.21.15.87:0/1623425121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf7c06cfb0 msgr2=0x7fbf7c149760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:18.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.285+0000 7fbf82200640 1 --2- 172.21.15.87:0/1623425121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf7c06cfb0 0x7fbf7c149760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:18.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.285+0000 7fbf82200640 1 -- 172.21.15.87:0/1623425121 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf7c150530 con 0x7fbf7c074130 2024-05-27T06:29:18.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.285+0000 7fbf82200640 1 --2- 172.21.15.87:0/1623425121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf7c074130 0x7fbf7c147810 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbf7400ca70 tx=0x7fbf7400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:18.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.285+0000 7fbf79600640 1 -- 172.21.15.87:0/1623425121 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf7400abd0 con 0x7fbf7c074130 2024-05-27T06:29:18.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.285+0000 7fbf79600640 1 -- 172.21.15.87:0/1623425121 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf7400ad70 con 0x7fbf7c074130 2024-05-27T06:29:18.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.285+0000 7fbf84200640 1 -- 172.21.15.87:0/1623425121 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf7c150810 con 0x7fbf7c074130 2024-05-27T06:29:18.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.285+0000 7fbf79600640 1 -- 172.21.15.87:0/1623425121 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf74012620 con 0x7fbf7c074130 2024-05-27T06:29:18.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.285+0000 7fbf84200640 1 -- 172.21.15.87:0/1623425121 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf7c1559f0 con 0x7fbf7c074130 2024-05-27T06:29:18.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.285+0000 7fbf84200640 1 -- 172.21.15.87:0/1623425121 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf7c14b540 con 0x7fbf7c074130 2024-05-27T06:29:18.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.285+0000 7fbf79600640 1 -- 172.21.15.87:0/1623425121 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbf740127c0 con 0x7fbf7c074130 2024-05-27T06:29:18.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.289+0000 7fbf79600640 1 --2- 172.21.15.87:0/1623425121 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbf5c06f400 0x7fbf5c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:18.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.289+0000 7fbf79600640 1 -- 172.21.15.87:0/1623425121 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7fbf7408fa80 con 0x7fbf7c074130 2024-05-27T06:29:18.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.289+0000 7fbf81800640 1 --2- 172.21.15.87:0/1623425121 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbf5c06f400 0x7fbf5c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:18.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.289+0000 7fbf81800640 1 --2- 172.21.15.87:0/1623425121 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbf5c06f400 0x7fbf5c071910 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbf700ad000 tx=0x7fbf700a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:18.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.293+0000 7fbf79600640 1 -- 172.21.15.87:0/1623425121 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fbf7c14b540 con 0x7fbf7c074130 2024-05-27T06:29:18.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.481+0000 7fbf84200640 1 -- 172.21.15.87:0/1623425121 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf7c06aa30 con 0x7fbf7c074130 2024-05-27T06:29:18.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.481+0000 7fbf79600640 1 -- 172.21.15.87:0/1623425121 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5180 (secure 0 0 0) 0x7fbf74091e20 con 0x7fbf7c074130 2024-05-27T06:29:18.481 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:29:18.481 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/662047769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":662047769},{"type":"v1","addr":"172.21.15.87:6837","nonce":662047769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4861,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/553113849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":553113849},{"type":"v1","addr":"172.21.15.149:6834","nonce":553113849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/381728425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":381728425},{"type":"v1","addr":"172.21.15.149:6835","nonce":381728425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T06:28:41.065900+0000","modified":"2024-05-27T06:28:55.121337+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2661735568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2661735568},{"type":"v1","addr":"172.21.15.87:6835","nonce":2661735568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4920,"qdb_cluster":[4920]},"id":2}]} 2024-05-27T06:29:18.481 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 19 2024-05-27T06:29:18.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.485+0000 7fbf84200640 1 -- 172.21.15.87:0/1623425121 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbf5c06f400 msgr2=0x7fbf5c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:18.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.485+0000 7fbf84200640 1 --2- 172.21.15.87:0/1623425121 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbf5c06f400 0x7fbf5c071910 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbf700ad000 tx=0x7fbf700a6000 comp rx=0 tx=0).stop 2024-05-27T06:29:18.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.485+0000 7fbf84200640 1 -- 172.21.15.87:0/1623425121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf7c074130 msgr2=0x7fbf7c147810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:18.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.485+0000 7fbf84200640 1 --2- 172.21.15.87:0/1623425121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf7c074130 0x7fbf7c147810 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbf7400ca70 tx=0x7fbf7400cf30 comp rx=0 tx=0).stop 2024-05-27T06:29:18.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.485+0000 7fbf84200640 1 -- 172.21.15.87:0/1623425121 shutdown_connections 2024-05-27T06:29:18.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.485+0000 7fbf84200640 1 --2- 172.21.15.87:0/1623425121 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbf5c06f400 0x7fbf5c071910 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:18.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.485+0000 7fbf84200640 1 --2- 172.21.15.87:0/1623425121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf7c074130 0x7fbf7c147810 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:18.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.485+0000 7fbf84200640 1 --2- 172.21.15.87:0/1623425121 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf7c06d3c0 0x7fbf7c1472d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:18.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.485+0000 7fbf84200640 1 --2- 172.21.15.87:0/1623425121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf7c06cfb0 0x7fbf7c149760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:18.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.485+0000 7fbf84200640 1 -- 172.21.15.87:0/1623425121 >> 172.21.15.87:0/1623425121 conn(0x7fbf7c0700d0 msgr2=0x7fbf7c0b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:18.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.485+0000 7fbf84200640 1 -- 172.21.15.87:0/1623425121 shutdown_connections 2024-05-27T06:29:18.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.485+0000 7fbf84200640 1 -- 172.21.15.87:0/1623425121 wait complete. 2024-05-27T06:29:18.503 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T06:29:18.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.653+0000 7fb462c00640 1 Processor -- start 2024-05-27T06:29:18.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.653+0000 7fb462c00640 1 -- start start 2024-05-27T06:29:18.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.653+0000 7fb462c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb45c0cdf50 0x7fb45c0b6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:18.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.653+0000 7fb462c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb45c1617a0 0x7fb45c161bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.653+0000 7fb462c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb45c0cef90 con 0x7fb45c070fc0 2024-05-27T06:29:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.653+0000 7fb462c00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fb45c0b6e60 con 0x7fb45c0cdf50 2024-05-27T06:29:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.653+0000 7fb462c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb45c1620f0 con 0x7fb45c1617a0 2024-05-27T06:29:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.653+0000 7fb45be00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb45c0cdf50 0x7fb45c0b6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.653+0000 7fb45be00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb45c0cdf50 0x7fb45c0b6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38034/0 (socket says 172.21.15.87:38034) 2024-05-27T06:29:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.653+0000 7fb45be00640 1 -- 172.21.15.87:0/731812666 learned_addr learned my addr 172.21.15.87:0/731812666 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.653+0000 7fb45be00640 1 -- 172.21.15.87:0/731812666 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb45c1617a0 msgr2=0x7fb45c161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.653+0000 7fb453400640 1 --2- 172.21.15.87:0/731812666 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb45c1617a0 0x7fb45c161bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.653+0000 7fb45be00640 1 --2- 172.21.15.87:0/731812666 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb45c1617a0 0x7fb45c161bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.653+0000 7fb45be00640 1 -- 172.21.15.87:0/731812666 >> v1:172.21.15.149:6789/0 conn(0x7fb45c070fc0 legacy=0x7fb45c0713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:18.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.653+0000 7fb45be00640 1 -- 172.21.15.87:0/731812666 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb45c0b8cf0 con 0x7fb45c0cdf50 2024-05-27T06:29:18.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.653+0000 7fb453400640 1 --2- 172.21.15.87:0/731812666 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb45c1617a0 0x7fb45c161bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:29:18.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.657+0000 7fb45be00640 1 --2- 172.21.15.87:0/731812666 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb45c0cdf50 0x7fb45c0b6920 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb44c009870 tx=0x7fb44c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1459f855ec4301e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:18.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.657+0000 7fb45b400640 1 -- 172.21.15.87:0/731812666 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c0b1070 con 0x7fb45c0cdf50 2024-05-27T06:29:18.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.657+0000 7fb45b400640 1 -- 172.21.15.87:0/731812666 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb44c0ac410 con 0x7fb45c0cdf50 2024-05-27T06:29:18.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.657+0000 7fb45b400640 1 -- 172.21.15.87:0/731812666 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c0ac7e0 con 0x7fb45c0cdf50 2024-05-27T06:29:18.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.657+0000 7fb462c00640 1 -- 172.21.15.87:0/731812666 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb45c0cdf50 msgr2=0x7fb45c0b6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:18.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.657+0000 7fb462c00640 1 --2- 172.21.15.87:0/731812666 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb45c0cdf50 0x7fb45c0b6920 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb44c009870 tx=0x7fb44c01c500 comp rx=0 tx=0).stop 2024-05-27T06:29:18.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.657+0000 7fb462c00640 1 -- 172.21.15.87:0/731812666 shutdown_connections 2024-05-27T06:29:18.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.657+0000 7fb462c00640 1 --2- 172.21.15.87:0/731812666 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb45c1617a0 0x7fb45c161bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:18.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.657+0000 7fb462c00640 1 --2- 172.21.15.87:0/731812666 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb45c0cdf50 0x7fb45c0b6920 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:18.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.657+0000 7fb462c00640 1 -- 172.21.15.87:0/731812666 >> 172.21.15.87:0/731812666 conn(0x7fb45c0d36f0 msgr2=0x7fb45c0d3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:18.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.657+0000 7fb462c00640 1 -- 172.21.15.87:0/731812666 shutdown_connections 2024-05-27T06:29:18.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.657+0000 7fb462c00640 1 -- 172.21.15.87:0/731812666 wait complete. 2024-05-27T06:29:18.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.661+0000 7fb462c00640 1 Processor -- start 2024-05-27T06:29:18.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.661+0000 7fb462c00640 1 -- start start 2024-05-27T06:29:18.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.661+0000 7fb462c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb45c070fc0 0x7fb45c0cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:18.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.661+0000 7fb462c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb45c0cdf50 0x7fb45c160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:18.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.661+0000 7fb462c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb45c1617a0 0x7fb45c0cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:18.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.661+0000 7fb462c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c071ae0 con 0x7fb45c070fc0 2024-05-27T06:29:18.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.661+0000 7fb462c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c0d2f60 con 0x7fb45c1617a0 2024-05-27T06:29:18.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.661+0000 7fb462c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb45c071c60 con 0x7fb45c0cdf50 2024-05-27T06:29:18.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.661+0000 7fb45be00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb45c070fc0 0x7fb45c0cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:18.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.661+0000 7fb45be00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb45c070fc0 0x7fb45c0cbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38044/0 (socket says 172.21.15.87:38044) 2024-05-27T06:29:18.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.661+0000 7fb45be00640 1 -- 172.21.15.87:0/1649537165 learned_addr learned my addr 172.21.15.87:0/1649537165 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:18.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.665+0000 7fb453400640 1 --2- 172.21.15.87:0/1649537165 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb45c0cdf50 0x7fb45c160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:18.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.665+0000 7fb45be00640 1 -- 172.21.15.87:0/1649537165 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb45c0cdf50 msgr2=0x7fb45c160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:18.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.665+0000 7fb45be00640 1 --2- 172.21.15.87:0/1649537165 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb45c0cdf50 0x7fb45c160ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:18.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.665+0000 7fb45be00640 1 -- 172.21.15.87:0/1649537165 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb45c1617a0 msgr2=0x7fb45c0cd5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-27T06:29:18.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.665+0000 7fb45be00640 1 --2- 172.21.15.87:0/1649537165 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb45c1617a0 0x7fb45c0cd5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:18.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.665+0000 7fb45be00640 1 -- 172.21.15.87:0/1649537165 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb45c0cc520 con 0x7fb45c070fc0 2024-05-27T06:29:18.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.665+0000 7fb45be00640 1 --2- 172.21.15.87:0/1649537165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb45c070fc0 0x7fb45c0cbcd0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb44c01ac10 tx=0x7fb44c019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:18.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.665+0000 7fb458c00640 1 -- 172.21.15.87:0/1649537165 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c0b1040 con 0x7fb45c070fc0 2024-05-27T06:29:18.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.665+0000 7fb458c00640 1 -- 172.21.15.87:0/1649537165 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb44c0ba070 con 0x7fb45c070fc0 2024-05-27T06:29:18.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.665+0000 7fb462c00640 1 -- 172.21.15.87:0/1649537165 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb45c0cc800 con 0x7fb45c070fc0 2024-05-27T06:29:18.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.665+0000 7fb458c00640 1 -- 172.21.15.87:0/1649537165 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c0b5440 con 0x7fb45c070fc0 2024-05-27T06:29:18.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.665+0000 7fb462c00640 1 -- 172.21.15.87:0/1649537165 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb45c0ccdc0 con 0x7fb45c070fc0 2024-05-27T06:29:18.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.665+0000 7fb462c00640 1 -- 172.21.15.87:0/1649537165 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb45c06aa30 con 0x7fb45c070fc0 2024-05-27T06:29:18.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.665+0000 7fb458c00640 1 -- 172.21.15.87:0/1649537165 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb44c0b55e0 con 0x7fb45c070fc0 2024-05-27T06:29:18.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.665+0000 7fb458c00640 1 --2- 172.21.15.87:0/1649537165 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb43806f430 0x7fb438071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:18.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.669+0000 7fb458c00640 1 -- 172.21.15.87:0/1649537165 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7fb44c1292a0 con 0x7fb45c070fc0 2024-05-27T06:29:18.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.669+0000 7fb453400640 1 --2- 172.21.15.87:0/1649537165 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb43806f430 0x7fb438071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:18.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.669+0000 7fb453400640 1 --2- 172.21.15.87:0/1649537165 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb43806f430 0x7fb438071940 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb444006fd0 tx=0x7fb444008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:18.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.673+0000 7fb458c00640 1 -- 172.21.15.87:0/1649537165 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb44c016150 con 0x7fb45c070fc0 2024-05-27T06:29:18.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.833+0000 7fb462c00640 1 -- 172.21.15.87:0/1649537165 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb45c0721f0 con 0x7fb45c070fc0 2024-05-27T06:29:18.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.833+0000 7fb458c00640 1 -- 172.21.15.87:0/1649537165 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+18742 (secure 0 0 0) 0x7fb44c0f5e00 con 0x7fb45c070fc0 2024-05-27T06:29:18.833 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:29:18.833 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":41,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:28:56.726853+0000","last_up_change":"2024-05-27T06:27:25.988592+0000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T06:27:26.590191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-27T06:28:39.228886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-27T06:28:40.012993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2024-05-27T06:28:54.140490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6801","nonce":3674824716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6803","nonce":3674824716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6807","nonce":3674824716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6805","nonce":3674824716}]},"public_addr":"172.21.15.87:6801/3674824716","cluster_addr":"172.21.15.87:6803/3674824716","heartbeat_back_addr":"172.21.15.87:6807/3674824716","heartbeat_front_addr":"172.21.15.87:6805/3674824716","state":["exists","up"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6809","nonce":2443981288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6811","nonce":2443981288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6815","nonce":2443981288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6813","nonce":2443981288}]},"public_addr":"172.21.15.87:6809/2443981288","cluster_addr":"172.21.15.87:6811/2443981288","heartbeat_back_addr":"172.21.15.87:6815/2443981288","heartbeat_front_addr":"172.21.15.87:6813/2443981288","state":["exists","up"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6819","nonce":1441249238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6823","nonce":1441249238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6831","nonce":1441249238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6825","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6827","nonce":1441249238}]},"public_addr":"172.21.15.87:6819/1441249238","cluster_addr":"172.21.15.87:6823/1441249238","heartbeat_back_addr":"172.21.15.87:6831/1441249238","heartbeat_front_addr":"172.21.15.87:6827/1441249238","state":["exists","up"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6818","nonce":1173805234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6822","nonce":1173805234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6829","nonce":1173805234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6826","nonce":1173805234}]},"public_addr":"172.21.15.87:6818/1173805234","cluster_addr":"172.21.15.87:6822/1173805234","heartbeat_back_addr":"172.21.15.87:6829/1173805234","heartbeat_front_addr":"172.21.15.87:6826/1173805234","state":["exists","up"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6819","nonce":1551871079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6823","nonce":1551871079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6831","nonce":1551871079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6827","nonce":1551871079}]},"public_addr":"172.21.15.149:6819/1551871079","cluster_addr":"172.21.15.149:6823/1551871079","heartbeat_back_addr":"172.21.15.149:6831/1551871079","heartbeat_front_addr":"172.21.15.149:6827/1551871079","state":["exists","up"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6818","nonce":582864816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6822","nonce":582864816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6830","nonce":582864816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6826","nonce":582864816}]},"public_addr":"172.21.15.149:6818/582864816","cluster_addr":"172.21.15.149:6822/582864816","heartbeat_back_addr":"172.21.15.149:6830/582864816","heartbeat_front_addr":"172.21.15.149:6826/582864816","state":["exists","up"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6801","nonce":531351314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6803","nonce":531351314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6807","nonce":531351314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6805","nonce":531351314}]},"public_addr":"172.21.15.149:6801/531351314","cluster_addr":"172.21.15.149:6803/531351314","heartbeat_back_addr":"172.21.15.149:6807/531351314","heartbeat_front_addr":"172.21.15.149:6805/531351314","state":["exists","up"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6809","nonce":1171039913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6811","nonce":1171039913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6815","nonce":1171039913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6813","nonce":1171039913}]},"public_addr":"172.21.15.149:6809/1171039913","cluster_addr":"172.21.15.149:6811/1171039913","heartbeat_back_addr":"172.21.15.149:6815/1171039913","heartbeat_front_addr":"172.21.15.149:6813/1171039913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.589776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.819787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.767566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.683842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.038885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.120319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.687007+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.812832+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:29:18.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.837+0000 7fb462c00640 1 -- 172.21.15.87:0/1649537165 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb43806f430 msgr2=0x7fb438071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:18.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.837+0000 7fb462c00640 1 --2- 172.21.15.87:0/1649537165 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb43806f430 0x7fb438071940 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb444006fd0 tx=0x7fb444008040 comp rx=0 tx=0).stop 2024-05-27T06:29:18.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.837+0000 7fb462c00640 1 -- 172.21.15.87:0/1649537165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb45c070fc0 msgr2=0x7fb45c0cbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:18.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.837+0000 7fb462c00640 1 --2- 172.21.15.87:0/1649537165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb45c070fc0 0x7fb45c0cbcd0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb44c01ac10 tx=0x7fb44c019300 comp rx=0 tx=0).stop 2024-05-27T06:29:18.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.837+0000 7fb462c00640 1 -- 172.21.15.87:0/1649537165 shutdown_connections 2024-05-27T06:29:18.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.837+0000 7fb462c00640 1 --2- 172.21.15.87:0/1649537165 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb43806f430 0x7fb438071940 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:18.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.837+0000 7fb462c00640 1 --2- 172.21.15.87:0/1649537165 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb45c1617a0 0x7fb45c0cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:18.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.837+0000 7fb462c00640 1 --2- 172.21.15.87:0/1649537165 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb45c0cdf50 0x7fb45c160ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:18.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.837+0000 7fb462c00640 1 --2- 172.21.15.87:0/1649537165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb45c070fc0 0x7fb45c0cbcd0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:18.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.837+0000 7fb462c00640 1 -- 172.21.15.87:0/1649537165 >> 172.21.15.87:0/1649537165 conn(0x7fb45c0d36f0 msgr2=0x7fb45c0c7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:18.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.837+0000 7fb462c00640 1 -- 172.21.15.87:0/1649537165 shutdown_connections 2024-05-27T06:29:18.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:18.837+0000 7fb462c00640 1 -- 172.21.15.87:0/1649537165 wait complete. 2024-05-27T06:29:18.855 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-27T06:29:19.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.005+0000 7fb126400640 1 Processor -- start 2024-05-27T06:29:19.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.005+0000 7fb126400640 1 -- start start 2024-05-27T06:29:19.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.005+0000 7fb126400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1200b4690 0x7fb1200cf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:19.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.005+0000 7fb126400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb120164150 0x7fb12015d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:19.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.005+0000 7fb126400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1200ce2c0 con 0x7fb1200d1ba0 2024-05-27T06:29:19.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.009+0000 7fb126400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fb1200b4aa0 con 0x7fb120164150 2024-05-27T06:29:19.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.009+0000 7fb126400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb1200ce090 con 0x7fb1200b4690 2024-05-27T06:29:19.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.009+0000 7fb125a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb120164150 0x7fb12015d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:19.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.009+0000 7fb125a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb120164150 0x7fb12015d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38046/0 (socket says 172.21.15.87:38046) 2024-05-27T06:29:19.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.009+0000 7fb125a00640 1 -- 172.21.15.87:0/1338061953 learned_addr learned my addr 172.21.15.87:0/1338061953 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:19.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.009+0000 7fb125000640 1 --2- 172.21.15.87:0/1338061953 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1200b4690 0x7fb1200cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:19.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.009+0000 7fb125a00640 1 -- 172.21.15.87:0/1338061953 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1200b4690 msgr2=0x7fb1200cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:19.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.009+0000 7fb125a00640 1 --2- 172.21.15.87:0/1338061953 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1200b4690 0x7fb1200cf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:19.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.009+0000 7fb125a00640 1 -- 172.21.15.87:0/1338061953 >> v1:172.21.15.149:6789/0 conn(0x7fb1200d1ba0 legacy=0x7fb120163a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:19.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.009+0000 7fb125a00640 1 -- 172.21.15.87:0/1338061953 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1200ce5a0 con 0x7fb120164150 2024-05-27T06:29:19.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.009+0000 7fb125a00640 1 --2- 172.21.15.87:0/1338061953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb120164150 0x7fb12015d210 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb118009e50 tx=0x7fb11801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=834585ce059369be server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:19.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.009+0000 7fb11fe00640 1 -- 172.21.15.87:0/1338061953 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1180a55f0 con 0x7fb120164150 2024-05-27T06:29:19.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.009+0000 7fb11fe00640 1 -- 172.21.15.87:0/1338061953 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1180a5790 con 0x7fb120164150 2024-05-27T06:29:19.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.009+0000 7fb11fe00640 1 -- 172.21.15.87:0/1338061953 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1180a5b60 con 0x7fb120164150 2024-05-27T06:29:19.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.013+0000 7fb126400640 1 -- 172.21.15.87:0/1338061953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb120164150 msgr2=0x7fb12015d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:19.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.013+0000 7fb126400640 1 --2- 172.21.15.87:0/1338061953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb120164150 0x7fb12015d210 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb118009e50 tx=0x7fb11801ca30 comp rx=0 tx=0).stop 2024-05-27T06:29:19.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.013+0000 7fb126400640 1 -- 172.21.15.87:0/1338061953 shutdown_connections 2024-05-27T06:29:19.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.013+0000 7fb126400640 1 --2- 172.21.15.87:0/1338061953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb120164150 0x7fb12015d210 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:19.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.013+0000 7fb126400640 1 --2- 172.21.15.87:0/1338061953 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1200b4690 0x7fb1200cf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:19.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.013+0000 7fb126400640 1 -- 172.21.15.87:0/1338061953 >> 172.21.15.87:0/1338061953 conn(0x7fb1200d35c0 msgr2=0x7fb1200d39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:19.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.013+0000 7fb126400640 1 -- 172.21.15.87:0/1338061953 shutdown_connections 2024-05-27T06:29:19.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.013+0000 7fb126400640 1 -- 172.21.15.87:0/1338061953 wait complete. 2024-05-27T06:29:19.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.013+0000 7fb126400640 1 Processor -- start 2024-05-27T06:29:19.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.013+0000 7fb126400640 1 -- start start 2024-05-27T06:29:19.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.017+0000 7fb126400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1200b4690 0x7fb1200c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:19.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.017+0000 7fb126400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1200d1ba0 0x7fb1200b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:19.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.017+0000 7fb126400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1200cd1e0 0x7fb120157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:19.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.017+0000 7fb126400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb12006f0d0 con 0x7fb1200cd1e0 2024-05-27T06:29:19.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.017+0000 7fb126400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb12006ef50 con 0x7fb1200d1ba0 2024-05-27T06:29:19.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.017+0000 7fb126400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb12006f250 con 0x7fb1200b4690 2024-05-27T06:29:19.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.017+0000 7fb125a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1200cd1e0 0x7fb120157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:19.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.017+0000 7fb125a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1200cd1e0 0x7fb120157e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38060/0 (socket says 172.21.15.87:38060) 2024-05-27T06:29:19.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.017+0000 7fb125a00640 1 -- 172.21.15.87:0/720381552 learned_addr learned my addr 172.21.15.87:0/720381552 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:19.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.017+0000 7fb117e00640 1 --2- 172.21.15.87:0/720381552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1200d1ba0 0x7fb1200b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:19.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.017+0000 7fb125000640 1 --2- 172.21.15.87:0/720381552 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1200b4690 0x7fb1200c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:19.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.017+0000 7fb125a00640 1 -- 172.21.15.87:0/720381552 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1200b4690 msgr2=0x7fb1200c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:19.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.017+0000 7fb125a00640 1 --2- 172.21.15.87:0/720381552 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1200b4690 0x7fb1200c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:19.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.017+0000 7fb125a00640 1 -- 172.21.15.87:0/720381552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1200d1ba0 msgr2=0x7fb1200b8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:19.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.017+0000 7fb125a00640 1 --2- 172.21.15.87:0/720381552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1200d1ba0 0x7fb1200b8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:19.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.017+0000 7fb125a00640 1 -- 172.21.15.87:0/720381552 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1200b9070 con 0x7fb1200cd1e0 2024-05-27T06:29:19.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.017+0000 7fb117e00640 1 --2- 172.21.15.87:0/720381552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1200d1ba0 0x7fb1200b8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:29:19.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.017+0000 7fb125000640 1 --2- 172.21.15.87:0/720381552 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1200b4690 0x7fb1200c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:29:19.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.017+0000 7fb125a00640 1 --2- 172.21.15.87:0/720381552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1200cd1e0 0x7fb120157e40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb11801a660 tx=0x7fb1180197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:19.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.017+0000 7fb11d600640 1 -- 172.21.15.87:0/720381552 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb118009510 con 0x7fb1200cd1e0 2024-05-27T06:29:19.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.017+0000 7fb11d600640 1 -- 172.21.15.87:0/720381552 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1180be070 con 0x7fb1200cd1e0 2024-05-27T06:29:19.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.017+0000 7fb126400640 1 -- 172.21.15.87:0/720381552 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1200c70f0 con 0x7fb1200cd1e0 2024-05-27T06:29:19.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.017+0000 7fb11d600640 1 -- 172.21.15.87:0/720381552 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1180b88b0 con 0x7fb1200cd1e0 2024-05-27T06:29:19.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.017+0000 7fb126400640 1 -- 172.21.15.87:0/720381552 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1200c76b0 con 0x7fb1200cd1e0 2024-05-27T06:29:19.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.017+0000 7fb126400640 1 -- 172.21.15.87:0/720381552 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1200508e0 con 0x7fb1200cd1e0 2024-05-27T06:29:19.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.021+0000 7fb11d600640 1 -- 172.21.15.87:0/720381552 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb1180b8a50 con 0x7fb1200cd1e0 2024-05-27T06:29:19.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.021+0000 7fb11d600640 1 --2- 172.21.15.87:0/720381552 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb0fc06f400 0x7fb0fc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:19.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.021+0000 7fb11d600640 1 -- 172.21.15.87:0/720381552 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7fb11812aee0 con 0x7fb1200cd1e0 2024-05-27T06:29:19.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.021+0000 7fb125000640 1 --2- 172.21.15.87:0/720381552 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb0fc06f400 0x7fb0fc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:19.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.021+0000 7fb125000640 1 --2- 172.21.15.87:0/720381552 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb0fc06f400 0x7fb0fc071910 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb1200743b0 tx=0x7fb110008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:19.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.025+0000 7fb11d600640 1 -- 172.21.15.87:0/720381552 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb1200b9070 con 0x7fb1200cd1e0 2024-05-27T06:29:19.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.217+0000 7fb126400640 1 -- 172.21.15.87:0/720381552 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb12006e610 con 0x7fb1200cd1e0 2024-05-27T06:29:19.215 INFO:tasks.ceph.mon.a.smithi087.stderr:2024-05-27T06:29:19.217+0000 7f7cc0e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-27T06:29:19.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.217+0000 7fb11d600640 1 -- 172.21.15.87:0/720381552 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) ==== 161+0+0 (secure 0 0 0) 0x7fb118016620 con 0x7fb1200cd1e0 2024-05-27T06:29:19.217 INFO:teuthology.orchestra.run.smithi087.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-27T06:29:19.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.221+0000 7fb126400640 1 -- 172.21.15.87:0/720381552 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb0fc06f400 msgr2=0x7fb0fc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:19.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.221+0000 7fb126400640 1 --2- 172.21.15.87:0/720381552 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb0fc06f400 0x7fb0fc071910 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb1200743b0 tx=0x7fb110008040 comp rx=0 tx=0).stop 2024-05-27T06:29:19.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.221+0000 7fb126400640 1 -- 172.21.15.87:0/720381552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1200cd1e0 msgr2=0x7fb120157e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:19.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.221+0000 7fb126400640 1 --2- 172.21.15.87:0/720381552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1200cd1e0 0x7fb120157e40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb11801a660 tx=0x7fb1180197d0 comp rx=0 tx=0).stop 2024-05-27T06:29:19.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.221+0000 7fb126400640 1 -- 172.21.15.87:0/720381552 shutdown_connections 2024-05-27T06:29:19.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.221+0000 7fb126400640 1 --2- 172.21.15.87:0/720381552 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb0fc06f400 0x7fb0fc071910 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:19.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.221+0000 7fb126400640 1 --2- 172.21.15.87:0/720381552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1200cd1e0 0x7fb120157e40 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:19.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.221+0000 7fb126400640 1 --2- 172.21.15.87:0/720381552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1200d1ba0 0x7fb1200b8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:19.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.221+0000 7fb126400640 1 --2- 172.21.15.87:0/720381552 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1200b4690 0x7fb1200c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:19.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.221+0000 7fb126400640 1 -- 172.21.15.87:0/720381552 >> 172.21.15.87:0/720381552 conn(0x7fb1200d35c0 msgr2=0x7fb120071620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:19.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.221+0000 7fb126400640 1 -- 172.21.15.87:0/720381552 shutdown_connections 2024-05-27T06:29:19.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.221+0000 7fb126400640 1 -- 172.21.15.87:0/720381552 wait complete. 2024-05-27T06:29:19.228 INFO:tasks.ceph.mds.a.smithi087.stderr: -3438> 2024-05-27T06:28:45.625+0000 7ff3c6600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-27T06:29:19.242 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-27T06:29:19.347 INFO:tasks.ceph.mds.a.smithi087.stdout:starting mds.a at 2024-05-27T06:29:19.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.397+0000 7f80a5200640 1 Processor -- start 2024-05-27T06:29:19.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.397+0000 7f80a5200640 1 -- start start 2024-05-27T06:29:19.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.397+0000 7f80a5200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f80a0160b90 0x7f80a0160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:19.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.397+0000 7f80a5200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f80a0073bd0 0x7f80a0073fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:19.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.397+0000 7f80a5200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80a0074520 con 0x7f80a00d1b80 2024-05-27T06:29:19.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.397+0000 7f80a5200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f80a00d1210 con 0x7f80a0160b90 2024-05-27T06:29:19.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.397+0000 7f80a5200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f80a01614e0 con 0x7f80a0073bd0 2024-05-27T06:29:19.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.401+0000 7f8095400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f80a0160b90 0x7f80a0160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:19.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.401+0000 7f809de00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f80a00d1b80 0x7f80a00d0b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57620/0 (socket says 172.21.15.87:57620) 2024-05-27T06:29:19.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.401+0000 7f809de00640 1 -- 172.21.15.87:0/1261428529 learned_addr learned my addr 172.21.15.87:0/1261428529 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:29:19.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.401+0000 7f809e800640 1 --2- 172.21.15.87:0/1261428529 >> v2:172.21.15.149:3300/0 conn(0x7f80a0073bd0 0x7f80a0073fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:19.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.401+0000 7f8095400640 1 -- 172.21.15.87:0/1261428529 >> v2:172.21.15.149:3300/0 conn(0x7f80a0073bd0 msgr2=0x7f80a0073fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:19.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.401+0000 7f8095400640 1 --2- 172.21.15.87:0/1261428529 >> v2:172.21.15.149:3300/0 conn(0x7f80a0073bd0 0x7f80a0073fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:19.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.401+0000 7f8095400640 1 -- 172.21.15.87:0/1261428529 >> v1:172.21.15.87:6789/0 conn(0x7f80a00d1b80 legacy=0x7f80a00d0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:19.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.401+0000 7f8095400640 1 -- 172.21.15.87:0/1261428529 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a00b5ea0 con 0x7f80a0160b90 2024-05-27T06:29:19.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.401+0000 7f8095400640 1 --2- 172.21.15.87:0/1261428529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a0160b90 0x7f80a0160fa0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f80a00b6fc0 tx=0x7f808801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6dfe6568f9a34fd server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:19.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.401+0000 7f809d400640 1 -- 172.21.15.87:0/1261428529 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80880b0070 con 0x7f80a0160b90 2024-05-27T06:29:19.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.401+0000 7f809d400640 1 -- 172.21.15.87:0/1261428529 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80880ab600 con 0x7f80a0160b90 2024-05-27T06:29:19.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.401+0000 7f809d400640 1 -- 172.21.15.87:0/1261428529 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80880ab9d0 con 0x7f80a0160b90 2024-05-27T06:29:19.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.405+0000 7f80a5200640 1 -- 172.21.15.87:0/1261428529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a0160b90 msgr2=0x7f80a0160fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:19.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.405+0000 7f80a5200640 1 --2- 172.21.15.87:0/1261428529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a0160b90 0x7f80a0160fa0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f80a00b6fc0 tx=0x7f808801c480 comp rx=0 tx=0).stop 2024-05-27T06:29:19.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.405+0000 7f80a5200640 1 -- 172.21.15.87:0/1261428529 shutdown_connections 2024-05-27T06:29:19.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.405+0000 7f80a5200640 1 --2- 172.21.15.87:0/1261428529 >> v2:172.21.15.149:3300/0 conn(0x7f80a0073bd0 0x7f80a0073fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:19.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.405+0000 7f80a5200640 1 --2- 172.21.15.87:0/1261428529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a0160b90 0x7f80a0160fa0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:19.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.405+0000 7f80a5200640 1 -- 172.21.15.87:0/1261428529 >> 172.21.15.87:0/1261428529 conn(0x7f80a006fe10 msgr2=0x7f80a0070220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:19.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.405+0000 7f80a5200640 1 -- 172.21.15.87:0/1261428529 shutdown_connections 2024-05-27T06:29:19.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.405+0000 7f80a5200640 1 -- 172.21.15.87:0/1261428529 wait complete. 2024-05-27T06:29:19.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.405+0000 7f80a5200640 1 Processor -- start 2024-05-27T06:29:19.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.405+0000 7f80a5200640 1 -- start start 2024-05-27T06:29:19.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.409+0000 7f80a5200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80a0073bd0 0x7f80a00b3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:19.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.409+0000 7f80a5200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a00d1b80 0x7f80a01462a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:19.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.409+0000 7f80a5200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80a0160b90 0x7f80a00b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:19.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.409+0000 7f80a5200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f80a01646e0 con 0x7f80a00d1b80 2024-05-27T06:29:19.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.409+0000 7f80a5200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f80a0164560 con 0x7f80a0160b90 2024-05-27T06:29:19.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.409+0000 7f80a5200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f80a00b6460 con 0x7f80a0073bd0 2024-05-27T06:29:19.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.409+0000 7f8095400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a00d1b80 0x7f80a01462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:19.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.409+0000 7f8095400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a00d1b80 0x7f80a01462a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38086/0 (socket says 172.21.15.87:38086) 2024-05-27T06:29:19.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.409+0000 7f8095400640 1 -- 172.21.15.87:0/1175575255 learned_addr learned my addr 172.21.15.87:0/1175575255 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:19.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.409+0000 7f809de00640 1 --2- 172.21.15.87:0/1175575255 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80a0073bd0 0x7f80a00b3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:19.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.409+0000 7f809e800640 1 --2- 172.21.15.87:0/1175575255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80a0160b90 0x7f80a00b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:19.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.409+0000 7f8095400640 1 -- 172.21.15.87:0/1175575255 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80a0073bd0 msgr2=0x7f80a00b3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:19.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.409+0000 7f8095400640 1 --2- 172.21.15.87:0/1175575255 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80a0073bd0 0x7f80a00b3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:19.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.409+0000 7f8095400640 1 -- 172.21.15.87:0/1175575255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80a0160b90 msgr2=0x7f80a00b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:19.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.409+0000 7f8095400640 1 --2- 172.21.15.87:0/1175575255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80a0160b90 0x7f80a00b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:19.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.409+0000 7f8095400640 1 -- 172.21.15.87:0/1175575255 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a0162140 con 0x7f80a00d1b80 2024-05-27T06:29:19.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.409+0000 7f809e800640 1 --2- 172.21.15.87:0/1175575255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80a0160b90 0x7f80a00b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:29:19.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.409+0000 7f8095400640 1 --2- 172.21.15.87:0/1175575255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a00d1b80 0x7f80a01462a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f80880ae040 tx=0x7f8088019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:19.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.409+0000 7f8096a00640 1 -- 172.21.15.87:0/1175575255 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80880b8020 con 0x7f80a00d1b80 2024-05-27T06:29:19.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.409+0000 7f8096a00640 1 -- 172.21.15.87:0/1175575255 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80880b4630 con 0x7f80a00d1b80 2024-05-27T06:29:19.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.409+0000 7f8096a00640 1 -- 172.21.15.87:0/1175575255 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80880b0040 con 0x7f80a00d1b80 2024-05-27T06:29:19.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.409+0000 7f80a5200640 1 -- 172.21.15.87:0/1175575255 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80a0163250 con 0x7f80a00d1b80 2024-05-27T06:29:19.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.409+0000 7f80a5200640 1 -- 172.21.15.87:0/1175575255 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80a01626c0 con 0x7f80a00d1b80 2024-05-27T06:29:19.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.409+0000 7f80a5200640 1 -- 172.21.15.87:0/1175575255 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80a006aa30 con 0x7f80a00d1b80 2024-05-27T06:29:19.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.409+0000 7f8096a00640 1 -- 172.21.15.87:0/1175575255 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f80880bb020 con 0x7f80a00d1b80 2024-05-27T06:29:19.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.413+0000 7f8096a00640 1 --2- 172.21.15.87:0/1175575255 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f807c06f400 0x7f807c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:19.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.413+0000 7f8096a00640 1 -- 172.21.15.87:0/1175575255 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6611+0+0 (secure 0 0 0) 0x7f8088128f00 con 0x7f80a00d1b80 2024-05-27T06:29:19.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.413+0000 7f809de00640 1 --2- 172.21.15.87:0/1175575255 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f807c06f400 0x7f807c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:19.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.413+0000 7f809de00640 1 --2- 172.21.15.87:0/1175575255 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f807c06f400 0x7f807c071910 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8090000f70 tx=0x7f8090009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:19.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.417+0000 7f8096a00640 1 -- 172.21.15.87:0/1175575255 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f80880c2070 con 0x7f80a00d1b80 2024-05-27T06:29:19.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:19.609+0000 7f80a5200640 1 -- 172.21.15.87:0/1175575255 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f80a0162f70 con 0x7f80a00d1b80 2024-05-27T06:29:20.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.221+0000 7f8096a00640 1 -- 172.21.15.87:0/1175575255 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7f8088016070 con 0x7f80a00d1b80 2024-05-27T06:29:20.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.225+0000 7f80a5200640 1 -- 172.21.15.87:0/1175575255 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f807c06f400 msgr2=0x7f807c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:20.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.225+0000 7f80a5200640 1 --2- 172.21.15.87:0/1175575255 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f807c06f400 0x7f807c071910 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8090000f70 tx=0x7f8090009040 comp rx=0 tx=0).stop 2024-05-27T06:29:20.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.225+0000 7f80a5200640 1 -- 172.21.15.87:0/1175575255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a00d1b80 msgr2=0x7f80a01462a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:20.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.225+0000 7f80a5200640 1 --2- 172.21.15.87:0/1175575255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a00d1b80 0x7f80a01462a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f80880ae040 tx=0x7f8088019220 comp rx=0 tx=0).stop 2024-05-27T06:29:20.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.225+0000 7f80a5200640 1 -- 172.21.15.87:0/1175575255 shutdown_connections 2024-05-27T06:29:20.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.225+0000 7f80a5200640 1 --2- 172.21.15.87:0/1175575255 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f807c06f400 0x7f807c071910 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:20.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.225+0000 7f80a5200640 1 --2- 172.21.15.87:0/1175575255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80a0160b90 0x7f80a00b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:20.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.225+0000 7f80a5200640 1 --2- 172.21.15.87:0/1175575255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a00d1b80 0x7f80a01462a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:20.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.225+0000 7f80a5200640 1 --2- 172.21.15.87:0/1175575255 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80a0073bd0 0x7f80a00b3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:20.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.225+0000 7f80a5200640 1 -- 172.21.15.87:0/1175575255 >> 172.21.15.87:0/1175575255 conn(0x7f80a006fe10 msgr2=0x7f80a015fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:20.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.225+0000 7f80a5200640 1 -- 172.21.15.87:0/1175575255 shutdown_connections 2024-05-27T06:29:20.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.225+0000 7f80a5200640 1 -- 172.21.15.87:0/1175575255 wait complete. 2024-05-27T06:29:20.248 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-27T06:29:20.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.401+0000 7f48bba00640 1 Processor -- start 2024-05-27T06:29:20.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.401+0000 7f48bba00640 1 -- start start 2024-05-27T06:29:20.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.401+0000 7f48bba00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f48b415fc90 0x7f48b40d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:20.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.401+0000 7f48bba00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48b406fd40 0x7f48b40cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:20.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.401+0000 7f48bba00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48b40b6790 con 0x7f48b40d1940 2024-05-27T06:29:20.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.401+0000 7f48bba00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f48b40d1d50 con 0x7f48b415fc90 2024-05-27T06:29:20.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.401+0000 7f48bba00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f48b40ce1e0 con 0x7f48b406fd40 2024-05-27T06:29:20.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.401+0000 7f48b9000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f48b415fc90 0x7f48b40d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:20.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.401+0000 7f48b9000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f48b415fc90 0x7f48b40d1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38088/0 (socket says 172.21.15.87:38088) 2024-05-27T06:29:20.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.401+0000 7f48b9000640 1 -- 172.21.15.87:0/2296354195 learned_addr learned my addr 172.21.15.87:0/2296354195 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:20.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.405+0000 7f48b9a00640 1 --2- 172.21.15.87:0/2296354195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48b406fd40 0x7f48b40cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:20.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.405+0000 7f48b9000640 1 -- 172.21.15.87:0/2296354195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48b406fd40 msgr2=0x7f48b40cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:20.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.405+0000 7f48b9000640 1 --2- 172.21.15.87:0/2296354195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48b406fd40 0x7f48b40cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:20.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.405+0000 7f48b9000640 1 -- 172.21.15.87:0/2296354195 >> v1:172.21.15.149:6789/0 conn(0x7f48b40d1940 legacy=0x7f48b406f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:20.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.405+0000 7f48b9000640 1 -- 172.21.15.87:0/2296354195 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48b40ce4c0 con 0x7f48b415fc90 2024-05-27T06:29:20.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.405+0000 7f48b9000640 1 --2- 172.21.15.87:0/2296354195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48b415fc90 0x7f48b40d1400 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f48a4009870 tx=0x7f48a401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6217b928fe9d2db7 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:20.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.405+0000 7f48b3400640 1 -- 172.21.15.87:0/2296354195 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a40ab650 con 0x7f48b415fc90 2024-05-27T06:29:20.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.405+0000 7f48b3400640 1 -- 172.21.15.87:0/2296354195 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48a40b0070 con 0x7f48b415fc90 2024-05-27T06:29:20.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.405+0000 7f48b3400640 1 -- 172.21.15.87:0/2296354195 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a40aba10 con 0x7f48b415fc90 2024-05-27T06:29:20.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.409+0000 7f48bba00640 1 -- 172.21.15.87:0/2296354195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48b415fc90 msgr2=0x7f48b40d1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:20.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.409+0000 7f48bba00640 1 --2- 172.21.15.87:0/2296354195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48b415fc90 0x7f48b40d1400 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f48a4009870 tx=0x7f48a401c560 comp rx=0 tx=0).stop 2024-05-27T06:29:20.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.409+0000 7f48bba00640 1 -- 172.21.15.87:0/2296354195 shutdown_connections 2024-05-27T06:29:20.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.409+0000 7f48bba00640 1 --2- 172.21.15.87:0/2296354195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48b406fd40 0x7f48b40cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:20.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.409+0000 7f48bba00640 1 --2- 172.21.15.87:0/2296354195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48b415fc90 0x7f48b40d1400 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:20.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.409+0000 7f48bba00640 1 -- 172.21.15.87:0/2296354195 >> 172.21.15.87:0/2296354195 conn(0x7f48b40cffa0 msgr2=0x7f48b40d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:20.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.409+0000 7f48bba00640 1 -- 172.21.15.87:0/2296354195 shutdown_connections 2024-05-27T06:29:20.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.409+0000 7f48bba00640 1 -- 172.21.15.87:0/2296354195 wait complete. 2024-05-27T06:29:20.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.409+0000 7f48bba00640 1 Processor -- start 2024-05-27T06:29:20.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.409+0000 7f48bba00640 1 -- start start 2024-05-27T06:29:20.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.413+0000 7f48bba00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48b406fd40 0x7f48b4159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:20.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.413+0000 7f48bba00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48b40d1940 0x7f48b4071430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:20.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.413+0000 7f48bba00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48b415fc90 0x7f48b41508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:20.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.413+0000 7f48bba00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f48b4160220 con 0x7f48b406fd40 2024-05-27T06:29:20.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.413+0000 7f48bba00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f48b41600a0 con 0x7f48b40d1940 2024-05-27T06:29:20.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.413+0000 7f48bba00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f48b416cc50 con 0x7f48b415fc90 2024-05-27T06:29:20.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.413+0000 7f48b9000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48b406fd40 0x7f48b4159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:20.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.413+0000 7f48b9000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48b406fd40 0x7f48b4159f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38104/0 (socket says 172.21.15.87:38104) 2024-05-27T06:29:20.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.413+0000 7f48b9000640 1 -- 172.21.15.87:0/161560817 learned_addr learned my addr 172.21.15.87:0/161560817 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:20.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.413+0000 7f48b9a00640 1 --2- 172.21.15.87:0/161560817 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48b415fc90 0x7f48b41508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:20.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.413+0000 7f48b3e00640 1 --2- 172.21.15.87:0/161560817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48b40d1940 0x7f48b4071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:20.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.413+0000 7f48b9000640 1 -- 172.21.15.87:0/161560817 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48b415fc90 msgr2=0x7f48b41508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:20.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.413+0000 7f48b9000640 1 --2- 172.21.15.87:0/161560817 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48b415fc90 0x7f48b41508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:20.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.413+0000 7f48b9000640 1 -- 172.21.15.87:0/161560817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48b40d1940 msgr2=0x7f48b4071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:20.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.413+0000 7f48b9000640 1 --2- 172.21.15.87:0/161560817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48b40d1940 0x7f48b4071430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:20.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.413+0000 7f48b9000640 1 -- 172.21.15.87:0/161560817 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48b41574b0 con 0x7f48b406fd40 2024-05-27T06:29:20.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.413+0000 7f48b9000640 1 --2- 172.21.15.87:0/161560817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48b406fd40 0x7f48b4159f20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f48a40ad040 tx=0x7f48a401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:20.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.413+0000 7f48b0c00640 1 -- 172.21.15.87:0/161560817 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a40be5f0 con 0x7f48b406fd40 2024-05-27T06:29:20.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.413+0000 7f48b0c00640 1 -- 172.21.15.87:0/161560817 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48a40be7b0 con 0x7f48b406fd40 2024-05-27T06:29:20.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.413+0000 7f48bba00640 1 -- 172.21.15.87:0/161560817 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48b40b82b0 con 0x7f48b406fd40 2024-05-27T06:29:20.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.413+0000 7f48b0c00640 1 -- 172.21.15.87:0/161560817 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a40beba0 con 0x7f48b406fd40 2024-05-27T06:29:20.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.413+0000 7f48bba00640 1 -- 172.21.15.87:0/161560817 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48b4157990 con 0x7f48b406fd40 2024-05-27T06:29:20.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.413+0000 7f48bba00640 1 -- 172.21.15.87:0/161560817 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48b406aa30 con 0x7f48b406fd40 2024-05-27T06:29:20.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.413+0000 7f48b0c00640 1 -- 172.21.15.87:0/161560817 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f48a40b43f0 con 0x7f48b406fd40 2024-05-27T06:29:20.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.417+0000 7f48b0c00640 1 --2- 172.21.15.87:0/161560817 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f489406f400 0x7f4894071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:20.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.417+0000 7f48b0c00640 1 -- 172.21.15.87:0/161560817 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6611+0+0 (secure 0 0 0) 0x7f48a4129f70 con 0x7f48b406fd40 2024-05-27T06:29:20.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.417+0000 7f48b3e00640 1 --2- 172.21.15.87:0/161560817 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f489406f400 0x7f4894071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:20.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.417+0000 7f48b3e00640 1 --2- 172.21.15.87:0/161560817 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f489406f400 0x7f4894071910 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f48b4159b80 tx=0x7f48a0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:20.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.421+0000 7f48b0c00640 1 -- 172.21.15.87:0/161560817 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f48a40c4060 con 0x7f48b406fd40 2024-05-27T06:29:20.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:20.577+0000 7f48bba00640 1 -- 172.21.15.87:0/161560817 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f48b40b87d0 con 0x7f48b406fd40 2024-05-27T06:29:21.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.233+0000 7f48b0c00640 1 -- 172.21.15.87:0/161560817 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v44) ==== 181+0+0 (secure 0 0 0) 0x7f48a4016150 con 0x7f48b406fd40 2024-05-27T06:29:21.232 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_metadata' removed 2024-05-27T06:29:21.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.237+0000 7f48bba00640 1 -- 172.21.15.87:0/161560817 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f489406f400 msgr2=0x7f4894071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:21.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.237+0000 7f48bba00640 1 --2- 172.21.15.87:0/161560817 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f489406f400 0x7f4894071910 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f48b4159b80 tx=0x7f48a0009040 comp rx=0 tx=0).stop 2024-05-27T06:29:21.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.237+0000 7f48bba00640 1 -- 172.21.15.87:0/161560817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48b406fd40 msgr2=0x7f48b4159f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:21.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.237+0000 7f48bba00640 1 --2- 172.21.15.87:0/161560817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48b406fd40 0x7f48b4159f20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f48a40ad040 tx=0x7f48a401ada0 comp rx=0 tx=0).stop 2024-05-27T06:29:21.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.237+0000 7f48bba00640 1 -- 172.21.15.87:0/161560817 shutdown_connections 2024-05-27T06:29:21.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.237+0000 7f48bba00640 1 --2- 172.21.15.87:0/161560817 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f489406f400 0x7f4894071910 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:21.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.237+0000 7f48bba00640 1 --2- 172.21.15.87:0/161560817 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f48b415fc90 0x7f48b41508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:21.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.237+0000 7f48bba00640 1 --2- 172.21.15.87:0/161560817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48b40d1940 0x7f48b4071430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:21.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.237+0000 7f48bba00640 1 --2- 172.21.15.87:0/161560817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48b406fd40 0x7f48b4159f20 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:21.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.237+0000 7f48bba00640 1 -- 172.21.15.87:0/161560817 >> 172.21.15.87:0/161560817 conn(0x7f48b40cffa0 msgr2=0x7f48b4152580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:21.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.237+0000 7f48bba00640 1 -- 172.21.15.87:0/161560817 shutdown_connections 2024-05-27T06:29:21.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.237+0000 7f48bba00640 1 -- 172.21.15.87:0/161560817 wait complete. 2024-05-27T06:29:21.257 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-27T06:29:21.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.417+0000 7fd2c9800640 1 Processor -- start 2024-05-27T06:29:21.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.417+0000 7fd2c9800640 1 -- start start 2024-05-27T06:29:21.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.417+0000 7fd2c9800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd2c40d1610 0x7fd2c406f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:21.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.417+0000 7fd2c9800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd2c40d2270 0x7fd2c40b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:21.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.417+0000 7fd2c9800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2c40ce3e0 con 0x7fd2c40cf130 2024-05-27T06:29:21.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.417+0000 7fd2c9800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fd2c40d1410 con 0x7fd2c40d1610 2024-05-27T06:29:21.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.417+0000 7fd2c9800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd2c40ce650 con 0x7fd2c40d2270 2024-05-27T06:29:21.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.417+0000 7fd2c2a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd2c40d1610 0x7fd2c406f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:21.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.417+0000 7fd2c2a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd2c40d1610 0x7fd2c406f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38120/0 (socket says 172.21.15.87:38120) 2024-05-27T06:29:21.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.417+0000 7fd2c2a00640 1 -- 172.21.15.87:0/1612563262 learned_addr learned my addr 172.21.15.87:0/1612563262 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:21.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.417+0000 7fd2c3400640 1 --2- 172.21.15.87:0/1612563262 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd2c40d2270 0x7fd2c40b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:21.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.417+0000 7fd2c2a00640 1 -- 172.21.15.87:0/1612563262 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd2c40d2270 msgr2=0x7fd2c40b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:21.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.417+0000 7fd2c2a00640 1 --2- 172.21.15.87:0/1612563262 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd2c40d2270 0x7fd2c40b2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:21.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.421+0000 7fd2c2a00640 1 -- 172.21.15.87:0/1612563262 >> v1:172.21.15.149:6789/0 conn(0x7fd2c40cf130 legacy=0x7fd2c40d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:21.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.421+0000 7fd2c2a00640 1 -- 172.21.15.87:0/1612563262 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c40ce930 con 0x7fd2c40d1610 2024-05-27T06:29:21.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.421+0000 7fd2c2a00640 1 --2- 172.21.15.87:0/1612563262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c40d1610 0x7fd2c406f920 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4009870 tx=0x7fd2b401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d710a0312ccb0fe7 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:21.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.421+0000 7fd2c1600640 1 -- 172.21.15.87:0/1612563262 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b40a9640 con 0x7fd2c40d1610 2024-05-27T06:29:21.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.421+0000 7fd2c1600640 1 -- 172.21.15.87:0/1612563262 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2b40a97e0 con 0x7fd2c40d1610 2024-05-27T06:29:21.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.421+0000 7fd2c1600640 1 -- 172.21.15.87:0/1612563262 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b40a9bb0 con 0x7fd2c40d1610 2024-05-27T06:29:21.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.421+0000 7fd2c9800640 1 -- 172.21.15.87:0/1612563262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c40d1610 msgr2=0x7fd2c406f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:21.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.421+0000 7fd2c9800640 1 --2- 172.21.15.87:0/1612563262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c40d1610 0x7fd2c406f920 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4009870 tx=0x7fd2b401c560 comp rx=0 tx=0).stop 2024-05-27T06:29:21.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.421+0000 7fd2c9800640 1 -- 172.21.15.87:0/1612563262 shutdown_connections 2024-05-27T06:29:21.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.421+0000 7fd2c9800640 1 --2- 172.21.15.87:0/1612563262 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd2c40d2270 0x7fd2c40b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:21.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.421+0000 7fd2c9800640 1 --2- 172.21.15.87:0/1612563262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c40d1610 0x7fd2c406f920 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:21.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.421+0000 7fd2c9800640 1 -- 172.21.15.87:0/1612563262 >> 172.21.15.87:0/1612563262 conn(0x7fd2c40d3580 msgr2=0x7fd2c40d3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:21.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.421+0000 7fd2c9800640 1 -- 172.21.15.87:0/1612563262 shutdown_connections 2024-05-27T06:29:21.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.421+0000 7fd2c9800640 1 -- 172.21.15.87:0/1612563262 wait complete. 2024-05-27T06:29:21.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.425+0000 7fd2c9800640 1 Processor -- start 2024-05-27T06:29:21.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.425+0000 7fd2c9800640 1 -- start start 2024-05-27T06:29:21.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.425+0000 7fd2c9800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2c40cf130 0x7fd2c4157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:21.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.425+0000 7fd2c9800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c40d1610 0x7fd2c4154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:21.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.425+0000 7fd2c9800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd2c4154fd0 0x7fd2c41fc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:21.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.425+0000 7fd2c9800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c416d160 con 0x7fd2c40d1610 2024-05-27T06:29:21.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.425+0000 7fd2c9800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c416cfe0 con 0x7fd2c40cf130 2024-05-27T06:29:21.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.425+0000 7fd2c9800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd2c416d2e0 con 0x7fd2c4154fd0 2024-05-27T06:29:21.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.425+0000 7fd2c2000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c40d1610 0x7fd2c4154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:21.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.425+0000 7fd2c2000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c40d1610 0x7fd2c4154520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38126/0 (socket says 172.21.15.87:38126) 2024-05-27T06:29:21.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.425+0000 7fd2c2000640 1 -- 172.21.15.87:0/3408766434 learned_addr learned my addr 172.21.15.87:0/3408766434 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:21.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.429+0000 7fd2c2a00640 1 --2- 172.21.15.87:0/3408766434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2c40cf130 0x7fd2c4157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:21.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.429+0000 7fd2c3400640 1 --2- 172.21.15.87:0/3408766434 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd2c4154fd0 0x7fd2c41fc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:21.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.429+0000 7fd2c2000640 1 -- 172.21.15.87:0/3408766434 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd2c4154fd0 msgr2=0x7fd2c41fc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:21.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.429+0000 7fd2c2000640 1 --2- 172.21.15.87:0/3408766434 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd2c4154fd0 0x7fd2c41fc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:21.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.429+0000 7fd2c2000640 1 -- 172.21.15.87:0/3408766434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2c40cf130 msgr2=0x7fd2c4157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:21.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.429+0000 7fd2c2000640 1 --2- 172.21.15.87:0/3408766434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2c40cf130 0x7fd2c4157020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:21.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.429+0000 7fd2c2000640 1 -- 172.21.15.87:0/3408766434 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c4157870 con 0x7fd2c40d1610 2024-05-27T06:29:21.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.429+0000 7fd2c2000640 1 --2- 172.21.15.87:0/3408766434 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c40d1610 0x7fd2c4154520 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000c370 tx=0x7fd2b000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:21.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.429+0000 7fd2baa00640 1 -- 172.21.15.87:0/3408766434 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0017070 con 0x7fd2c40d1610 2024-05-27T06:29:21.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.429+0000 7fd2baa00640 1 -- 172.21.15.87:0/3408766434 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2b00052d0 con 0x7fd2c40d1610 2024-05-27T06:29:21.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.429+0000 7fd2c9800640 1 -- 172.21.15.87:0/3408766434 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2c4157b50 con 0x7fd2c40d1610 2024-05-27T06:29:21.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.429+0000 7fd2baa00640 1 -- 172.21.15.87:0/3408766434 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0003650 con 0x7fd2c40d1610 2024-05-27T06:29:21.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.429+0000 7fd2c9800640 1 -- 172.21.15.87:0/3408766434 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2c4158110 con 0x7fd2c40d1610 2024-05-27T06:29:21.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.429+0000 7fd2c9800640 1 -- 172.21.15.87:0/3408766434 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2c406aa30 con 0x7fd2c40d1610 2024-05-27T06:29:21.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.429+0000 7fd2baa00640 1 -- 172.21.15.87:0/3408766434 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd2b001a070 con 0x7fd2c40d1610 2024-05-27T06:29:21.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.433+0000 7fd2baa00640 1 --2- 172.21.15.87:0/3408766434 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd2a406f400 0x7fd2a4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:21.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.433+0000 7fd2baa00640 1 -- 172.21.15.87:0/3408766434 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6173+0+0 (secure 0 0 0) 0x7fd2b008e6c0 con 0x7fd2c40d1610 2024-05-27T06:29:21.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.433+0000 7fd2c2a00640 1 --2- 172.21.15.87:0/3408766434 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd2a406f400 0x7fd2a4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:21.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.433+0000 7fd2c2a00640 1 --2- 172.21.15.87:0/3408766434 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd2a406f400 0x7fd2a4071910 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40ae000 tx=0x7fd2b40b3040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:21.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.437+0000 7fd2baa00640 1 -- 172.21.15.87:0/3408766434 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fd2b005ae20 con 0x7fd2c40d1610 2024-05-27T06:29:21.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:21.593+0000 7fd2c9800640 1 -- 172.21.15.87:0/3408766434 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd2c4157600 con 0x7fd2c40d1610 2024-05-27T06:29:22.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.245+0000 7fd2baa00640 1 -- 172.21.15.87:0/3408766434 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v45) ==== 169+0+0 (secure 0 0 0) 0x7fd2b005f120 con 0x7fd2c40d1610 2024-05-27T06:29:22.242 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_data' removed 2024-05-27T06:29:22.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.245+0000 7fd2c9800640 1 -- 172.21.15.87:0/3408766434 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd2a406f400 msgr2=0x7fd2a4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:22.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.245+0000 7fd2c9800640 1 --2- 172.21.15.87:0/3408766434 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd2a406f400 0x7fd2a4071910 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40ae000 tx=0x7fd2b40b3040 comp rx=0 tx=0).stop 2024-05-27T06:29:22.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.245+0000 7fd2c9800640 1 -- 172.21.15.87:0/3408766434 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c40d1610 msgr2=0x7fd2c4154520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:22.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.245+0000 7fd2c9800640 1 --2- 172.21.15.87:0/3408766434 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c40d1610 0x7fd2c4154520 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000c370 tx=0x7fd2b000c830 comp rx=0 tx=0).stop 2024-05-27T06:29:22.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.245+0000 7fd2c9800640 1 -- 172.21.15.87:0/3408766434 shutdown_connections 2024-05-27T06:29:22.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.245+0000 7fd2c9800640 1 --2- 172.21.15.87:0/3408766434 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd2a406f400 0x7fd2a4071910 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:22.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.245+0000 7fd2c9800640 1 --2- 172.21.15.87:0/3408766434 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd2c4154fd0 0x7fd2c41fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:22.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.245+0000 7fd2c9800640 1 --2- 172.21.15.87:0/3408766434 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c40d1610 0x7fd2c4154520 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:22.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.245+0000 7fd2c9800640 1 --2- 172.21.15.87:0/3408766434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2c40cf130 0x7fd2c4157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:22.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.245+0000 7fd2c9800640 1 -- 172.21.15.87:0/3408766434 >> 172.21.15.87:0/3408766434 conn(0x7fd2c40d3580 msgr2=0x7fd2c40b76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:22.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.245+0000 7fd2c9800640 1 -- 172.21.15.87:0/3408766434 shutdown_connections 2024-05-27T06:29:22.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.245+0000 7fd2c9800640 1 -- 172.21.15.87:0/3408766434 wait complete. 2024-05-27T06:29:22.271 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm data_new data_new --yes-i-really-really-mean-it 2024-05-27T06:29:22.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.425+0000 7f9b0ec00640 1 Processor -- start 2024-05-27T06:29:22.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.425+0000 7f9b0ec00640 1 -- start start 2024-05-27T06:29:22.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.425+0000 7f9b0ec00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9b08070b00 0x7f9b0815fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:22.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.425+0000 7f9b0ec00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9b0806d780 0x7f9b0806db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:22.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.425+0000 7f9b0ec00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b0806f7f0 con 0x7f9b0806e0d0 2024-05-27T06:29:22.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.425+0000 7f9b0ec00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f9b080afea0 con 0x7f9b08070b00 2024-05-27T06:29:22.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.425+0000 7f9b0ec00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f9b0806fa60 con 0x7f9b0806d780 2024-05-27T06:29:22.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.425+0000 7f9b07e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9b08070b00 0x7f9b0815fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:22.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.425+0000 7f9b07e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9b08070b00 0x7f9b0815fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38128/0 (socket says 172.21.15.87:38128) 2024-05-27T06:29:22.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.425+0000 7f9b07e00640 1 -- 172.21.15.87:0/3409350378 learned_addr learned my addr 172.21.15.87:0/3409350378 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:22.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.425+0000 7f9aff400640 1 --2- 172.21.15.87:0/3409350378 >> v2:172.21.15.149:3300/0 conn(0x7f9b0806d780 0x7f9b0806db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:22.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.425+0000 7f9b07e00640 1 -- 172.21.15.87:0/3409350378 >> v2:172.21.15.149:3300/0 conn(0x7f9b0806d780 msgr2=0x7f9b0806db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:22.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.425+0000 7f9b07e00640 1 --2- 172.21.15.87:0/3409350378 >> v2:172.21.15.149:3300/0 conn(0x7f9b0806d780 0x7f9b0806db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:22.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.425+0000 7f9b07e00640 1 -- 172.21.15.87:0/3409350378 >> v1:172.21.15.149:6789/0 conn(0x7f9b0806e0d0 legacy=0x7f9b081638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:22.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.425+0000 7f9b07e00640 1 -- 172.21.15.87:0/3409350378 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0806fd40 con 0x7f9b08070b00 2024-05-27T06:29:22.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.429+0000 7f9b07e00640 1 --2- 172.21.15.87:0/3409350378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b08070b00 0x7f9b0815fd50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9b0806cac0 tx=0x7f9af801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dadad5c7beaa94cb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:22.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.429+0000 7f9b07400640 1 -- 172.21.15.87:0/3409350378 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af80b0070 con 0x7f9b08070b00 2024-05-27T06:29:22.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.429+0000 7f9b07400640 1 -- 172.21.15.87:0/3409350378 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9af80ab600 con 0x7f9b08070b00 2024-05-27T06:29:22.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.429+0000 7f9b07400640 1 -- 172.21.15.87:0/3409350378 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af80ab9d0 con 0x7f9b08070b00 2024-05-27T06:29:22.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.429+0000 7f9b0ec00640 1 -- 172.21.15.87:0/3409350378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b08070b00 msgr2=0x7f9b0815fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:22.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.429+0000 7f9b0ec00640 1 --2- 172.21.15.87:0/3409350378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b08070b00 0x7f9b0815fd50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9b0806cac0 tx=0x7f9af801c460 comp rx=0 tx=0).stop 2024-05-27T06:29:22.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.429+0000 7f9b0ec00640 1 -- 172.21.15.87:0/3409350378 shutdown_connections 2024-05-27T06:29:22.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.429+0000 7f9b0ec00640 1 --2- 172.21.15.87:0/3409350378 >> v2:172.21.15.149:3300/0 conn(0x7f9b0806d780 0x7f9b0806db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:22.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.429+0000 7f9b0ec00640 1 --2- 172.21.15.87:0/3409350378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b08070b00 0x7f9b0815fd50 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:22.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.429+0000 7f9b0ec00640 1 -- 172.21.15.87:0/3409350378 >> 172.21.15.87:0/3409350378 conn(0x7f9b080d1be0 msgr2=0x7f9b080d1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:22.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.429+0000 7f9b0ec00640 1 -- 172.21.15.87:0/3409350378 shutdown_connections 2024-05-27T06:29:22.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.429+0000 7f9b0ec00640 1 -- 172.21.15.87:0/3409350378 wait complete. 2024-05-27T06:29:22.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.433+0000 7f9b0ec00640 1 Processor -- start 2024-05-27T06:29:22.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.433+0000 7f9b0ec00640 1 -- start start 2024-05-27T06:29:22.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.433+0000 7f9b0ec00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b0806d780 0x7f9b0815ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:22.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.433+0000 7f9b0ec00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b0806e0d0 0x7f9b0815d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:22.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.433+0000 7f9b0ec00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9b08070b00 0x7f9b081496c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:22.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.433+0000 7f9b0ec00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0806e4e0 con 0x7f9b0806e0d0 2024-05-27T06:29:22.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.433+0000 7f9b0ec00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0806cf80 con 0x7f9b0806d780 2024-05-27T06:29:22.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.433+0000 7f9b0ec00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9b0816ca30 con 0x7f9b08070b00 2024-05-27T06:29:22.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.433+0000 7f9aff400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b0806e0d0 0x7f9b0815d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:22.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.433+0000 7f9aff400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b0806e0d0 0x7f9b0815d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38144/0 (socket says 172.21.15.87:38144) 2024-05-27T06:29:22.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.433+0000 7f9aff400640 1 -- 172.21.15.87:0/1414962300 learned_addr learned my addr 172.21.15.87:0/1414962300 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:22.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.437+0000 7f9b0cc00640 1 --2- 172.21.15.87:0/1414962300 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9b08070b00 0x7f9b081496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:22.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.437+0000 7f9b07e00640 1 --2- 172.21.15.87:0/1414962300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b0806d780 0x7f9b0815ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:22.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.437+0000 7f9aff400640 1 -- 172.21.15.87:0/1414962300 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9b08070b00 msgr2=0x7f9b081496c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:22.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.437+0000 7f9aff400640 1 --2- 172.21.15.87:0/1414962300 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9b08070b00 0x7f9b081496c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:22.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.437+0000 7f9aff400640 1 -- 172.21.15.87:0/1414962300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b0806d780 msgr2=0x7f9b0815ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:22.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.437+0000 7f9aff400640 1 --2- 172.21.15.87:0/1414962300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b0806d780 0x7f9b0815ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:22.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.437+0000 7f9aff400640 1 -- 172.21.15.87:0/1414962300 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0815f730 con 0x7f9b0806e0d0 2024-05-27T06:29:22.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.437+0000 7f9b07e00640 1 --2- 172.21.15.87:0/1414962300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b0806d780 0x7f9b0815ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:29:22.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.437+0000 7f9aff400640 1 --2- 172.21.15.87:0/1414962300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b0806e0d0 0x7f9b0815d570 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9af000d5c0 tx=0x7f9af000da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:22.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.437+0000 7f9b04c00640 1 -- 172.21.15.87:0/1414962300 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af0004240 con 0x7f9b0806e0d0 2024-05-27T06:29:22.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.437+0000 7f9b04c00640 1 -- 172.21.15.87:0/1414962300 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9af00043e0 con 0x7f9b0806e0d0 2024-05-27T06:29:22.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.437+0000 7f9b04c00640 1 -- 172.21.15.87:0/1414962300 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af0003840 con 0x7f9b0806e0d0 2024-05-27T06:29:22.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.437+0000 7f9b0ec00640 1 -- 172.21.15.87:0/1414962300 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b08148be0 con 0x7f9b0806e0d0 2024-05-27T06:29:22.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.437+0000 7f9b0ec00640 1 -- 172.21.15.87:0/1414962300 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b08149c00 con 0x7f9b0806e0d0 2024-05-27T06:29:22.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.437+0000 7f9b0ec00640 1 -- 172.21.15.87:0/1414962300 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b0806aa30 con 0x7f9b0806e0d0 2024-05-27T06:29:22.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.437+0000 7f9b04c00640 1 -- 172.21.15.87:0/1414962300 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9af00039e0 con 0x7f9b0806e0d0 2024-05-27T06:29:22.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.441+0000 7f9b04c00640 1 --2- 172.21.15.87:0/1414962300 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9ae406f400 0x7f9ae4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:22.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.441+0000 7f9b04c00640 1 -- 172.21.15.87:0/1414962300 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5730+0+0 (secure 0 0 0) 0x7f9af008f680 con 0x7f9b0806e0d0 2024-05-27T06:29:22.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.441+0000 7f9b07e00640 1 --2- 172.21.15.87:0/1414962300 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9ae406f400 0x7f9ae4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:22.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.441+0000 7f9b07e00640 1 --2- 172.21.15.87:0/1414962300 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9ae406f400 0x7f9ae4071910 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9b080aea00 tx=0x7f9af8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:22.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.445+0000 7f9b04c00640 1 -- 172.21.15.87:0/1414962300 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f9af005c4c0 con 0x7f9b0806e0d0 2024-05-27T06:29:22.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:22.605+0000 7f9b0ec00640 1 -- 172.21.15.87:0/1414962300 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9b0815f4c0 con 0x7f9b0806e0d0 2024-05-27T06:29:23.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.253+0000 7f9b04c00640 1 -- 172.21.15.87:0/1414962300 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true}]=0 pool 'data_new' removed v46) ==== 160+0+0 (secure 0 0 0) 0x7f9af005bdc0 con 0x7f9b0806e0d0 2024-05-27T06:29:23.250 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'data_new' removed 2024-05-27T06:29:23.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.253+0000 7f9b0ec00640 1 -- 172.21.15.87:0/1414962300 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9ae406f400 msgr2=0x7f9ae4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:23.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.253+0000 7f9b0ec00640 1 --2- 172.21.15.87:0/1414962300 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9ae406f400 0x7f9ae4071910 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9b080aea00 tx=0x7f9af8008040 comp rx=0 tx=0).stop 2024-05-27T06:29:23.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.253+0000 7f9b0ec00640 1 -- 172.21.15.87:0/1414962300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b0806e0d0 msgr2=0x7f9b0815d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:23.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.253+0000 7f9b0ec00640 1 --2- 172.21.15.87:0/1414962300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b0806e0d0 0x7f9b0815d570 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9af000d5c0 tx=0x7f9af000da80 comp rx=0 tx=0).stop 2024-05-27T06:29:23.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.253+0000 7f9b0ec00640 1 -- 172.21.15.87:0/1414962300 shutdown_connections 2024-05-27T06:29:23.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.253+0000 7f9b0ec00640 1 --2- 172.21.15.87:0/1414962300 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f9ae406f400 0x7f9ae4071910 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:23.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.253+0000 7f9b0ec00640 1 --2- 172.21.15.87:0/1414962300 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9b08070b00 0x7f9b081496c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:23.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.253+0000 7f9b0ec00640 1 --2- 172.21.15.87:0/1414962300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b0806e0d0 0x7f9b0815d570 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:23.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.253+0000 7f9b0ec00640 1 --2- 172.21.15.87:0/1414962300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b0806d780 0x7f9b0815ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:23.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.253+0000 7f9b0ec00640 1 -- 172.21.15.87:0/1414962300 >> 172.21.15.87:0/1414962300 conn(0x7f9b080d1be0 msgr2=0x7f9b080b19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:23.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.253+0000 7f9b0ec00640 1 -- 172.21.15.87:0/1414962300 shutdown_connections 2024-05-27T06:29:23.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.253+0000 7f9b0ec00640 1 -- 172.21.15.87:0/1414962300 wait complete. 2024-05-27T06:29:23.277 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-27T06:29:23.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.429+0000 7f99e8200640 1 Processor -- start 2024-05-27T06:29:23.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.429+0000 7f99e8200640 1 -- start start 2024-05-27T06:29:23.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.429+0000 7f99e8200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f99e0157310 0x7f99e015dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:23.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.429+0000 7f99e8200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f99e00d1700 0x7f99e00d1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:23.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.429+0000 7f99e8200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99e015e110 con 0x7f99e006c940 2024-05-27T06:29:23.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.429+0000 7f99e8200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f99e00d0140 con 0x7f99e0157310 2024-05-27T06:29:23.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.429+0000 7f99e8200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f99e00d2050 con 0x7f99e00d1700 2024-05-27T06:29:23.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.429+0000 7f99e5800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f99e0157310 0x7f99e015dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:23.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.429+0000 7f99e5800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f99e0157310 0x7f99e015dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38156/0 (socket says 172.21.15.87:38156) 2024-05-27T06:29:23.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.429+0000 7f99e5800640 1 -- 172.21.15.87:0/3003187544 learned_addr learned my addr 172.21.15.87:0/3003187544 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:23.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.429+0000 7f99e4e00640 1 --2- 172.21.15.87:0/3003187544 >> v2:172.21.15.149:3300/0 conn(0x7f99e00d1700 0x7f99e00d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:23.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.429+0000 7f99e5800640 1 -- 172.21.15.87:0/3003187544 >> v2:172.21.15.149:3300/0 conn(0x7f99e00d1700 msgr2=0x7f99e00d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:23.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.429+0000 7f99e5800640 1 --2- 172.21.15.87:0/3003187544 >> v2:172.21.15.149:3300/0 conn(0x7f99e00d1700 0x7f99e00d1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:23.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.429+0000 7f99e5800640 1 -- 172.21.15.87:0/3003187544 >> v1:172.21.15.149:6789/0 conn(0x7f99e006c940 legacy=0x7f99e006cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:23.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.429+0000 7f99e5800640 1 -- 172.21.15.87:0/3003187544 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e00cf530 con 0x7f99e0157310 2024-05-27T06:29:23.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.429+0000 7f99e4e00640 1 --2- 172.21.15.87:0/3003187544 >> v2:172.21.15.149:3300/0 conn(0x7f99e00d1700 0x7f99e00d1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:29:23.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.433+0000 7f99e5800640 1 --2- 172.21.15.87:0/3003187544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99e0157310 0x7f99e015dbd0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f99d4009870 tx=0x7f99d401c2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9d90af7a991611 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:23.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.433+0000 7f99dfe00640 1 -- 172.21.15.87:0/3003187544 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d40b0070 con 0x7f99e0157310 2024-05-27T06:29:23.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.433+0000 7f99dfe00640 1 -- 172.21.15.87:0/3003187544 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d40ab600 con 0x7f99e0157310 2024-05-27T06:29:23.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.433+0000 7f99dfe00640 1 -- 172.21.15.87:0/3003187544 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d40ab9d0 con 0x7f99e0157310 2024-05-27T06:29:23.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.433+0000 7f99e8200640 1 -- 172.21.15.87:0/3003187544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99e0157310 msgr2=0x7f99e015dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:23.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.433+0000 7f99e8200640 1 --2- 172.21.15.87:0/3003187544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99e0157310 0x7f99e015dbd0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f99d4009870 tx=0x7f99d401c2b0 comp rx=0 tx=0).stop 2024-05-27T06:29:23.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.433+0000 7f99e8200640 1 -- 172.21.15.87:0/3003187544 shutdown_connections 2024-05-27T06:29:23.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.433+0000 7f99e8200640 1 --2- 172.21.15.87:0/3003187544 >> v2:172.21.15.149:3300/0 conn(0x7f99e00d1700 0x7f99e00d1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:23.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.433+0000 7f99e8200640 1 --2- 172.21.15.87:0/3003187544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99e0157310 0x7f99e015dbd0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:23.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.433+0000 7f99e8200640 1 -- 172.21.15.87:0/3003187544 >> 172.21.15.87:0/3003187544 conn(0x7f99e00b46b0 msgr2=0x7f99e00b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:23.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.433+0000 7f99e8200640 1 -- 172.21.15.87:0/3003187544 shutdown_connections 2024-05-27T06:29:23.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.433+0000 7f99e8200640 1 -- 172.21.15.87:0/3003187544 wait complete. 2024-05-27T06:29:23.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.437+0000 7f99e8200640 1 Processor -- start 2024-05-27T06:29:23.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.437+0000 7f99e8200640 1 -- start start 2024-05-27T06:29:23.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.437+0000 7f99e8200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99e006c940 0x7f99e015e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:23.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.437+0000 7f99e8200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99e00d1700 0x7f99e0141570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:23.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.437+0000 7f99e8200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99e0157310 0x7f99e015f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:23.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.437+0000 7f99e8200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f99e0070660 con 0x7f99e0157310 2024-05-27T06:29:23.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.437+0000 7f99e8200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f99e00cf200 con 0x7f99e00d1700 2024-05-27T06:29:23.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.437+0000 7f99e8200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f99e00707e0 con 0x7f99e006c940 2024-05-27T06:29:23.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.437+0000 7f99e6200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99e0157310 0x7f99e015f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:23.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.437+0000 7f99e6200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99e0157310 0x7f99e015f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38172/0 (socket says 172.21.15.87:38172) 2024-05-27T06:29:23.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.437+0000 7f99e6200640 1 -- 172.21.15.87:0/2055483319 learned_addr learned my addr 172.21.15.87:0/2055483319 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:23.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.437+0000 7f99e4e00640 1 --2- 172.21.15.87:0/2055483319 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99e00d1700 0x7f99e0141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:23.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.437+0000 7f99e5800640 1 --2- 172.21.15.87:0/2055483319 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99e006c940 0x7f99e015e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:23.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.437+0000 7f99e6200640 1 -- 172.21.15.87:0/2055483319 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99e006c940 msgr2=0x7f99e015e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:23.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.437+0000 7f99e6200640 1 --2- 172.21.15.87:0/2055483319 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99e006c940 0x7f99e015e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:23.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.437+0000 7f99e6200640 1 -- 172.21.15.87:0/2055483319 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99e00d1700 msgr2=0x7f99e0141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:23.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.437+0000 7f99e6200640 1 --2- 172.21.15.87:0/2055483319 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99e00d1700 0x7f99e0141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:23.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.437+0000 7f99e6200640 1 -- 172.21.15.87:0/2055483319 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e0161660 con 0x7f99e0157310 2024-05-27T06:29:23.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.437+0000 7f99e6200640 1 --2- 172.21.15.87:0/2055483319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99e0157310 0x7f99e015f050 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f99d800b970 tx=0x7f99d800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:23.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.437+0000 7f99dd600640 1 -- 172.21.15.87:0/2055483319 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d8019070 con 0x7f99e0157310 2024-05-27T06:29:23.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.441+0000 7f99dd600640 1 -- 172.21.15.87:0/2055483319 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d800cb40 con 0x7f99e0157310 2024-05-27T06:29:23.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.441+0000 7f99e8200640 1 -- 172.21.15.87:0/2055483319 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99e0074350 con 0x7f99e0157310 2024-05-27T06:29:23.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.441+0000 7f99dd600640 1 -- 172.21.15.87:0/2055483319 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d8014440 con 0x7f99e0157310 2024-05-27T06:29:23.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.441+0000 7f99e8200640 1 -- 172.21.15.87:0/2055483319 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99e0074070 con 0x7f99e0157310 2024-05-27T06:29:23.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.441+0000 7f99e8200640 1 -- 172.21.15.87:0/2055483319 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99e006aa30 con 0x7f99e0157310 2024-05-27T06:29:23.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.441+0000 7f99dd600640 1 -- 172.21.15.87:0/2055483319 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f99d801c070 con 0x7f99e0157310 2024-05-27T06:29:23.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.441+0000 7f99dd600640 1 --2- 172.21.15.87:0/2055483319 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f99c006f400 0x7f99c0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:23.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.441+0000 7f99dd600640 1 -- 172.21.15.87:0/2055483319 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7f99d808ed50 con 0x7f99e0157310 2024-05-27T06:29:23.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.441+0000 7f99e5800640 1 --2- 172.21.15.87:0/2055483319 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f99c006f400 0x7f99c0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:23.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.445+0000 7f99e5800640 1 --2- 172.21.15.87:0/2055483319 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f99c006f400 0x7f99c0071910 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f99d40ad000 tx=0x7f99d4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:23.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.445+0000 7f99dd600640 1 -- 172.21.15.87:0/2055483319 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f99d805b6c0 con 0x7f99e0157310 2024-05-27T06:29:23.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.609+0000 7f99e8200640 1 -- 172.21.15.87:0/2055483319 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f99e0075e90 con 0x7f99e0157310 2024-05-27T06:29:23.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.613+0000 7f99dd600640 1 -- 172.21.15.87:0/2055483319 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f99d805f9c0 con 0x7f99e0157310 2024-05-27T06:29:23.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.613+0000 7f99e8200640 1 -- 172.21.15.87:0/2055483319 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f99c006f400 msgr2=0x7f99c0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:23.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.613+0000 7f99e8200640 1 --2- 172.21.15.87:0/2055483319 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f99c006f400 0x7f99c0071910 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f99d40ad000 tx=0x7f99d4008040 comp rx=0 tx=0).stop 2024-05-27T06:29:23.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.613+0000 7f99e8200640 1 -- 172.21.15.87:0/2055483319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99e0157310 msgr2=0x7f99e015f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:23.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.613+0000 7f99e8200640 1 --2- 172.21.15.87:0/2055483319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99e0157310 0x7f99e015f050 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f99d800b970 tx=0x7f99d800be30 comp rx=0 tx=0).stop 2024-05-27T06:29:23.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.613+0000 7f99e8200640 1 -- 172.21.15.87:0/2055483319 shutdown_connections 2024-05-27T06:29:23.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.613+0000 7f99e8200640 1 --2- 172.21.15.87:0/2055483319 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f99c006f400 0x7f99c0071910 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:23.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.613+0000 7f99e8200640 1 --2- 172.21.15.87:0/2055483319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99e0157310 0x7f99e015f050 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:23.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.613+0000 7f99e8200640 1 --2- 172.21.15.87:0/2055483319 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99e00d1700 0x7f99e0141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:23.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.613+0000 7f99e8200640 1 --2- 172.21.15.87:0/2055483319 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99e006c940 0x7f99e015e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:23.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.613+0000 7f99e8200640 1 -- 172.21.15.87:0/2055483319 >> 172.21.15.87:0/2055483319 conn(0x7f99e00b46b0 msgr2=0x7f99e0154e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:23.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.613+0000 7f99e8200640 1 -- 172.21.15.87:0/2055483319 shutdown_connections 2024-05-27T06:29:23.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.613+0000 7f99e8200640 1 -- 172.21.15.87:0/2055483319 wait complete. 2024-05-27T06:29:23.633 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2024-05-27T06:29:23.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.781+0000 7fcfbf200640 1 Processor -- start 2024-05-27T06:29:23.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.781+0000 7fcfbf200640 1 -- start start 2024-05-27T06:29:23.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.785+0000 7fcfbf200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcfb80b5540 0x7fcfb8163270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:23.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.785+0000 7fcfbf200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcfb8074290 0x7fcfb80b6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:23.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.785+0000 7fcfbf200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfb80b5ac0 con 0x7fcfb8160d80 2024-05-27T06:29:23.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.785+0000 7fcfbf200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fcfb80b6770 con 0x7fcfb80b5540 2024-05-27T06:29:23.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.785+0000 7fcfbf200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcfb80b5da0 con 0x7fcfb8074290 2024-05-27T06:29:23.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.785+0000 7fcfb7e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcfb80b5540 0x7fcfb8163270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:23.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.785+0000 7fcfb7e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcfb80b5540 0x7fcfb8163270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38178/0 (socket says 172.21.15.87:38178) 2024-05-27T06:29:23.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.785+0000 7fcfb7e00640 1 -- 172.21.15.87:0/2112231131 learned_addr learned my addr 172.21.15.87:0/2112231131 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:23.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.785+0000 7fcfbd200640 1 --2- 172.21.15.87:0/2112231131 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcfb8074290 0x7fcfb80b6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:23.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.785+0000 7fcfb7e00640 1 -- 172.21.15.87:0/2112231131 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcfb8074290 msgr2=0x7fcfb80b6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:23.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.785+0000 7fcfb7e00640 1 --2- 172.21.15.87:0/2112231131 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcfb8074290 0x7fcfb80b6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:23.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.785+0000 7fcfb7e00640 1 -- 172.21.15.87:0/2112231131 >> v1:172.21.15.149:6789/0 conn(0x7fcfb8160d80 legacy=0x7fcfb8073b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:23.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.785+0000 7fcfb7e00640 1 -- 172.21.15.87:0/2112231131 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb80b6080 con 0x7fcfb80b5540 2024-05-27T06:29:23.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.789+0000 7fcfb7e00640 1 --2- 172.21.15.87:0/2112231131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfb80b5540 0x7fcfb8163270 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8009870 tx=0x7fcfa801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b590aeb7867025 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:23.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.789+0000 7fcfb6a00640 1 -- 172.21.15.87:0/2112231131 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa80ab650 con 0x7fcfb80b5540 2024-05-27T06:29:23.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.789+0000 7fcfb6a00640 1 -- 172.21.15.87:0/2112231131 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa80b0070 con 0x7fcfb80b5540 2024-05-27T06:29:23.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.789+0000 7fcfb6a00640 1 -- 172.21.15.87:0/2112231131 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa80aba10 con 0x7fcfb80b5540 2024-05-27T06:29:23.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.789+0000 7fcfbf200640 1 -- 172.21.15.87:0/2112231131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfb80b5540 msgr2=0x7fcfb8163270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:23.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.789+0000 7fcfbf200640 1 --2- 172.21.15.87:0/2112231131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfb80b5540 0x7fcfb8163270 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8009870 tx=0x7fcfa801c530 comp rx=0 tx=0).stop 2024-05-27T06:29:23.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.789+0000 7fcfbf200640 1 -- 172.21.15.87:0/2112231131 shutdown_connections 2024-05-27T06:29:23.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.789+0000 7fcfbf200640 1 --2- 172.21.15.87:0/2112231131 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcfb8074290 0x7fcfb80b6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:23.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.789+0000 7fcfbf200640 1 --2- 172.21.15.87:0/2112231131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfb80b5540 0x7fcfb8163270 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:23.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.789+0000 7fcfbf200640 1 -- 172.21.15.87:0/2112231131 >> 172.21.15.87:0/2112231131 conn(0x7fcfb80700d0 msgr2=0x7fcfb80704e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:23.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.789+0000 7fcfbf200640 1 -- 172.21.15.87:0/2112231131 shutdown_connections 2024-05-27T06:29:23.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.789+0000 7fcfbf200640 1 -- 172.21.15.87:0/2112231131 wait complete. 2024-05-27T06:29:23.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.789+0000 7fcfbf200640 1 Processor -- start 2024-05-27T06:29:23.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.789+0000 7fcfbf200640 1 -- start start 2024-05-27T06:29:23.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.793+0000 7fcfbf200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfb80b5540 0x7fcfb80d1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:23.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.793+0000 7fcfbf200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfb8160d80 0x7fcfb81426d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:23.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.793+0000 7fcfbf200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcfb80d1660 0x7fcfb815dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:23.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.793+0000 7fcfbf200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb816ccd0 con 0x7fcfb80b5540 2024-05-27T06:29:23.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.793+0000 7fcfbf200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb816cb50 con 0x7fcfb8160d80 2024-05-27T06:29:23.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.793+0000 7fcfbf200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcfb816ce50 con 0x7fcfb80d1660 2024-05-27T06:29:23.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.793+0000 7fcfb7e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfb80b5540 0x7fcfb80d1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:23.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.793+0000 7fcfb7e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfb80b5540 0x7fcfb80d1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38180/0 (socket says 172.21.15.87:38180) 2024-05-27T06:29:23.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.793+0000 7fcfb7e00640 1 -- 172.21.15.87:0/1523598943 learned_addr learned my addr 172.21.15.87:0/1523598943 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:23.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.793+0000 7fcfbd200640 1 --2- 172.21.15.87:0/1523598943 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcfb80d1660 0x7fcfb815dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:23.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.793+0000 7fcfb7400640 1 --2- 172.21.15.87:0/1523598943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfb8160d80 0x7fcfb81426d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:23.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.793+0000 7fcfb7e00640 1 -- 172.21.15.87:0/1523598943 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcfb80d1660 msgr2=0x7fcfb815dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:23.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.793+0000 7fcfb7e00640 1 --2- 172.21.15.87:0/1523598943 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcfb80d1660 0x7fcfb815dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:23.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.793+0000 7fcfb7e00640 1 -- 172.21.15.87:0/1523598943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfb8160d80 msgr2=0x7fcfb81426d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:23.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.793+0000 7fcfb7e00640 1 --2- 172.21.15.87:0/1523598943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfb8160d80 0x7fcfb81426d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:23.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.793+0000 7fcfb7e00640 1 -- 172.21.15.87:0/1523598943 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb80cf6f0 con 0x7fcfb80b5540 2024-05-27T06:29:23.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.793+0000 7fcfbd200640 1 --2- 172.21.15.87:0/1523598943 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcfb80d1660 0x7fcfb815dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:29:23.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.793+0000 7fcfb7e00640 1 --2- 172.21.15.87:0/1523598943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfb80b5540 0x7fcfb80d1120 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80ad040 tx=0x7fcfa801ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:23.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.793+0000 7fcfafe00640 1 -- 172.21.15.87:0/1523598943 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa80be5f0 con 0x7fcfb80b5540 2024-05-27T06:29:23.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.793+0000 7fcfafe00640 1 -- 172.21.15.87:0/1523598943 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa80be7b0 con 0x7fcfb80b5540 2024-05-27T06:29:23.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.793+0000 7fcfbf200640 1 -- 172.21.15.87:0/1523598943 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfb80cf9d0 con 0x7fcfb80b5540 2024-05-27T06:29:23.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.793+0000 7fcfafe00640 1 -- 172.21.15.87:0/1523598943 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa80beba0 con 0x7fcfb80b5540 2024-05-27T06:29:23.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.793+0000 7fcfbf200640 1 -- 172.21.15.87:0/1523598943 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfb80cff90 con 0x7fcfb80b5540 2024-05-27T06:29:23.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.793+0000 7fcfbf200640 1 -- 172.21.15.87:0/1523598943 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfb80d0370 con 0x7fcfb80b5540 2024-05-27T06:29:23.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.797+0000 7fcfafe00640 1 -- 172.21.15.87:0/1523598943 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fcfa80b43f0 con 0x7fcfb80b5540 2024-05-27T06:29:23.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.797+0000 7fcfafe00640 1 --2- 172.21.15.87:0/1523598943 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fcf9806f400 0x7fcf98071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:23.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.797+0000 7fcfafe00640 1 -- 172.21.15.87:0/1523598943 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7fcfa812a0a0 con 0x7fcfb80b5540 2024-05-27T06:29:23.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.797+0000 7fcfb7400640 1 --2- 172.21.15.87:0/1523598943 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fcf9806f400 0x7fcf98071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:23.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.797+0000 7fcfb7400640 1 --2- 172.21.15.87:0/1523598943 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fcf9806f400 0x7fcf98071910 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80ce4f0 tx=0x7fcfa4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:23.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:23.801+0000 7fcfafe00640 1 -- 172.21.15.87:0/1523598943 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fcfb80d0370 con 0x7fcfb80b5540 2024-05-27T06:29:24.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.013+0000 7fcfbf200640 1 -- 172.21.15.87:0/1523598943 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) -- 0x7fcfb806aa30 con 0x7fcfb80b5540 2024-05-27T06:29:24.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.253+0000 7fcfafe00640 1 -- 172.21.15.87:0/1523598943 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v110) ==== 147+0+0 (secure 0 0 0) 0x7fcfa80c4060 con 0x7fcfb80b5540 2024-05-27T06:29:24.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.257+0000 7fcfbf200640 1 -- 172.21.15.87:0/1523598943 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fcf9806f400 msgr2=0x7fcf98071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:24.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.257+0000 7fcfbf200640 1 --2- 172.21.15.87:0/1523598943 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fcf9806f400 0x7fcf98071910 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80ce4f0 tx=0x7fcfa4009040 comp rx=0 tx=0).stop 2024-05-27T06:29:24.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.257+0000 7fcfbf200640 1 -- 172.21.15.87:0/1523598943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfb80b5540 msgr2=0x7fcfb80d1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:24.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.257+0000 7fcfbf200640 1 --2- 172.21.15.87:0/1523598943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfb80b5540 0x7fcfb80d1120 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80ad040 tx=0x7fcfa801ad70 comp rx=0 tx=0).stop 2024-05-27T06:29:24.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.257+0000 7fcfbf200640 1 -- 172.21.15.87:0/1523598943 shutdown_connections 2024-05-27T06:29:24.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.257+0000 7fcfbf200640 1 --2- 172.21.15.87:0/1523598943 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fcf9806f400 0x7fcf98071910 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:24.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.257+0000 7fcfbf200640 1 --2- 172.21.15.87:0/1523598943 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcfb80d1660 0x7fcfb815dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:24.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.257+0000 7fcfbf200640 1 --2- 172.21.15.87:0/1523598943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfb8160d80 0x7fcfb81426d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:24.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.257+0000 7fcfbf200640 1 --2- 172.21.15.87:0/1523598943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfb80b5540 0x7fcfb80d1120 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:24.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.257+0000 7fcfbf200640 1 -- 172.21.15.87:0/1523598943 >> 172.21.15.87:0/1523598943 conn(0x7fcfb80700d0 msgr2=0x7fcfb80b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:24.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.257+0000 7fcfbf200640 1 -- 172.21.15.87:0/1523598943 shutdown_connections 2024-05-27T06:29:24.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.257+0000 7fcfbf200640 1 -- 172.21.15.87:0/1523598943 wait complete. 2024-05-27T06:29:24.274 INFO:tasks.cephfs_test_runner:That a client who does not have the capability for setting ... ok 2024-05-27T06:29:24.275 INFO:tasks.cephfs_test_runner:Starting test: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-05-27T06:29:24.275 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T06:29:24.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.421+0000 7f4696400640 1 Processor -- start 2024-05-27T06:29:24.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.421+0000 7f4696400640 1 -- start start 2024-05-27T06:29:24.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f4696400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f46900cbf90 0x7f469006cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:24.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f4696400640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f469015dbb0 con 0x7f469015d6f0 2024-05-27T06:29:24.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f4696400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f469015de90 con 0x7f469006d500 2024-05-27T06:29:24.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f4696400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f469006d910 con 0x7f46900cbf90 2024-05-27T06:29:24.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f468fe00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f469015d6f0 0x7f46900d1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57622/0 (socket says 172.21.15.87:57622) 2024-05-27T06:29:24.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f468fe00640 1 -- 172.21.15.87:0/2060118450 learned_addr learned my addr 172.21.15.87:0/2060118450 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:29:24.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f468f400640 1 --2- 172.21.15.87:0/2060118450 >> v2:172.21.15.149:3300/0 conn(0x7f46900cbf90 0x7f469006cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:24.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f468ea00640 1 -- 172.21.15.87:0/2060118450 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4137346883 0 0) 0x7f469015dbb0 con 0x7f469015d6f0 2024-05-27T06:29:24.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f468ea00640 1 -- 172.21.15.87:0/2060118450 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4674005740 con 0x7f469015d6f0 2024-05-27T06:29:24.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f468ea00640 1 -- 172.21.15.87:0/2060118450 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3491138920 0 0) 0x7f469015de90 con 0x7f469006d500 2024-05-27T06:29:24.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f468ea00640 1 -- 172.21.15.87:0/2060118450 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f469015dbb0 con 0x7f469006d500 2024-05-27T06:29:24.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f468ea00640 1 -- 172.21.15.87:0/2060118450 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 464888732 0 0) 0x7f4674005740 con 0x7f469015d6f0 2024-05-27T06:29:24.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f468ea00640 1 -- 172.21.15.87:0/2060118450 >> v2:172.21.15.149:3300/0 conn(0x7f46900cbf90 msgr2=0x7f469006cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:24.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f468ea00640 1 --2- 172.21.15.87:0/2060118450 >> v2:172.21.15.149:3300/0 conn(0x7f46900cbf90 0x7f469006cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:24.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f468ea00640 1 -- 172.21.15.87:0/2060118450 >> v1:172.21.15.149:6789/0 conn(0x7f469006d500 legacy=0x7f469015cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:24.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f468ea00640 1 -- 172.21.15.87:0/2060118450 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f469006c7c0 con 0x7f469015d6f0 2024-05-27T06:29:24.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f468ea00640 1 -- 172.21.15.87:0/2060118450 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7f4688001720 con 0x7f469015d6f0 2024-05-27T06:29:24.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f468ea00640 1 -- 172.21.15.87:0/2060118450 >> v1:172.21.15.87:6789/0 conn(0x7f469015d6f0 legacy=0x7f46900d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:24.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f468ea00640 1 --2- 172.21.15.87:0/2060118450 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4674005ec0 0x7f4674006310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:24.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f468ea00640 1 --2- 172.21.15.87:0/2060118450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4674006a20 0x7f4674006eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:24.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f468ea00640 1 --2- 172.21.15.87:0/2060118450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4674007520 0x7f467400dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:24.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f468ea00640 1 -- 172.21.15.87:0/2060118450 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f469006d910 con 0x7f4674007520 2024-05-27T06:29:24.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f468ea00640 1 -- 172.21.15.87:0/2060118450 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f467400e420 con 0x7f4674006a20 2024-05-27T06:29:24.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f468ea00640 1 -- 172.21.15.87:0/2060118450 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f467400e620 con 0x7f4674005ec0 2024-05-27T06:29:24.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f468fe00640 1 --2- 172.21.15.87:0/2060118450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4674007520 0x7f467400dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:24.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f468f400640 1 --2- 172.21.15.87:0/2060118450 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4674005ec0 0x7f4674006310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:24.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f4686a00640 1 --2- 172.21.15.87:0/2060118450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4674006a20 0x7f4674006eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:24.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f468fe00640 1 -- 172.21.15.87:0/2060118450 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4674005ec0 msgr2=0x7f4674006310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:24.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f468fe00640 1 --2- 172.21.15.87:0/2060118450 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4674005ec0 0x7f4674006310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:24.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f468fe00640 1 -- 172.21.15.87:0/2060118450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4674006a20 msgr2=0x7f4674006eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:24.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f468fe00640 1 --2- 172.21.15.87:0/2060118450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4674006a20 0x7f4674006eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:24.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.425+0000 7f468fe00640 1 -- 172.21.15.87:0/2060118450 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4674005740 con 0x7f4674007520 2024-05-27T06:29:24.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.429+0000 7f468fe00640 1 -- 172.21.15.87:0/2060118450 reap_dead start 2024-05-27T06:29:24.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.429+0000 7f468fe00640 1 --2- 172.21.15.87:0/2060118450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4674007520 0x7f467400dbe0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f46900c83c0 tx=0x7f468801cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b36306e1874f632 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:24.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.429+0000 7f468ea00640 1 -- 172.21.15.87:0/2060118450 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4688007d00 con 0x7f4674007520 2024-05-27T06:29:24.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.429+0000 7f468ea00640 1 -- 172.21.15.87:0/2060118450 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46880a9070 con 0x7f4674007520 2024-05-27T06:29:24.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.429+0000 7f468ea00640 1 -- 172.21.15.87:0/2060118450 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4688005d40 con 0x7f4674007520 2024-05-27T06:29:24.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.429+0000 7f4696400640 1 -- 172.21.15.87:0/2060118450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4674007520 msgr2=0x7f467400dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:24.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.429+0000 7f4696400640 1 --2- 172.21.15.87:0/2060118450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4674007520 0x7f467400dbe0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f46900c83c0 tx=0x7f468801cb00 comp rx=0 tx=0).stop 2024-05-27T06:29:24.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.429+0000 7f4696400640 1 -- 172.21.15.87:0/2060118450 shutdown_connections 2024-05-27T06:29:24.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.429+0000 7f4696400640 1 --2- 172.21.15.87:0/2060118450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4674007520 0x7f467400dbe0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:24.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.429+0000 7f4696400640 1 -- 172.21.15.87:0/2060118450 >> 172.21.15.87:0/2060118450 conn(0x7f46900b46b0 msgr2=0x7f46900b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:24.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.429+0000 7f4696400640 1 -- 172.21.15.87:0/2060118450 shutdown_connections 2024-05-27T06:29:24.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.429+0000 7f4696400640 1 -- 172.21.15.87:0/2060118450 wait complete. 2024-05-27T06:29:24.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.433+0000 7f4696400640 1 Processor -- start 2024-05-27T06:29:24.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.433+0000 7f4696400640 1 -- start start 2024-05-27T06:29:24.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.433+0000 7f4696400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4674007520 0x7f46901f5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:24.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.433+0000 7f4696400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46900c7260 0x7f46900c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:24.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.433+0000 7f4696400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f469015a450 0x7f469015a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:24.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.433+0000 7f4696400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f46900cc3a0 con 0x7f46900c7260 2024-05-27T06:29:24.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.433+0000 7f4696400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f469015e170 con 0x7f4674007520 2024-05-27T06:29:24.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.433+0000 7f4696400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f469006ec50 con 0x7f469015a450 2024-05-27T06:29:24.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.433+0000 7f4686a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46900c7260 0x7f46900c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:24.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.433+0000 7f4686a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46900c7260 0x7f46900c7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38210/0 (socket says 172.21.15.87:38210) 2024-05-27T06:29:24.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.433+0000 7f4686a00640 1 -- 172.21.15.87:0/3995444674 learned_addr learned my addr 172.21.15.87:0/3995444674 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:24.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.433+0000 7f468f400640 1 --2- 172.21.15.87:0/3995444674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4674007520 0x7f46901f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:24.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.433+0000 7f468fe00640 1 --2- 172.21.15.87:0/3995444674 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f469015a450 0x7f469015a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:24.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.433+0000 7f4686a00640 1 -- 172.21.15.87:0/3995444674 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f469015a450 msgr2=0x7f469015a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:24.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.433+0000 7f4686a00640 1 --2- 172.21.15.87:0/3995444674 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f469015a450 0x7f469015a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:24.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.433+0000 7f4686a00640 1 -- 172.21.15.87:0/3995444674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4674007520 msgr2=0x7f46901f5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:24.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.433+0000 7f4686a00640 1 --2- 172.21.15.87:0/3995444674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4674007520 0x7f46901f5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:24.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.433+0000 7f4686a00640 1 -- 172.21.15.87:0/3995444674 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46901f5c80 con 0x7f46900c7260 2024-05-27T06:29:24.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.437+0000 7f4686a00640 1 --2- 172.21.15.87:0/3995444674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46900c7260 0x7f46900c7670 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f467800e7b0 tx=0x7f467800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:24.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.437+0000 7f4687e00640 1 -- 172.21.15.87:0/3995444674 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4678001d40 con 0x7f46900c7260 2024-05-27T06:29:24.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.437+0000 7f4687e00640 1 -- 172.21.15.87:0/3995444674 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46780050d0 con 0x7f46900c7260 2024-05-27T06:29:24.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.437+0000 7f4696400640 1 -- 172.21.15.87:0/3995444674 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f469015ada0 con 0x7f46900c7260 2024-05-27T06:29:24.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.437+0000 7f4687e00640 1 -- 172.21.15.87:0/3995444674 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46780052c0 con 0x7f46900c7260 2024-05-27T06:29:24.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.437+0000 7f4696400640 1 -- 172.21.15.87:0/3995444674 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46901f97a0 con 0x7f46900c7260 2024-05-27T06:29:24.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.437+0000 7f4696400640 1 -- 172.21.15.87:0/3995444674 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f469006aa30 con 0x7f46900c7260 2024-05-27T06:29:24.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.437+0000 7f4687e00640 1 -- 172.21.15.87:0/3995444674 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f467801a020 con 0x7f46900c7260 2024-05-27T06:29:24.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.437+0000 7f4687e00640 1 --2- 172.21.15.87:0/3995444674 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f466c06f5d0 0x7f466c071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:24.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.437+0000 7f4687e00640 1 -- 172.21.15.87:0/3995444674 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7f467808e590 con 0x7f46900c7260 2024-05-27T06:29:24.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.437+0000 7f468f400640 1 --2- 172.21.15.87:0/3995444674 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f466c06f5d0 0x7f466c071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:24.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.441+0000 7f468f400640 1 --2- 172.21.15.87:0/3995444674 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f466c06f5d0 0x7f466c071ae0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4680003b90 tx=0x7f468000b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:24.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.441+0000 7f4687e00640 1 -- 172.21.15.87:0/3995444674 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f4678021020 con 0x7f46900c7260 2024-05-27T06:29:24.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.605+0000 7f4696400640 1 -- 172.21.15.87:0/3995444674 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f46900cd800 con 0x7f46900c7260 2024-05-27T06:29:24.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.609+0000 7f4687e00640 1 -- 172.21.15.87:0/3995444674 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+13281 (secure 0 0 0) 0x7f469015ada0 con 0x7f46900c7260 2024-05-27T06:29:24.606 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:29:24.606 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":46,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:29:23.248299+0000","last_up_change":"2024-05-27T06:27:25.988592+0000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T06:27:26.590191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6801","nonce":3674824716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6803","nonce":3674824716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6807","nonce":3674824716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6805","nonce":3674824716}]},"public_addr":"172.21.15.87:6801/3674824716","cluster_addr":"172.21.15.87:6803/3674824716","heartbeat_back_addr":"172.21.15.87:6807/3674824716","heartbeat_front_addr":"172.21.15.87:6805/3674824716","state":["exists","up"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6809","nonce":2443981288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6811","nonce":2443981288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6815","nonce":2443981288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6813","nonce":2443981288}]},"public_addr":"172.21.15.87:6809/2443981288","cluster_addr":"172.21.15.87:6811/2443981288","heartbeat_back_addr":"172.21.15.87:6815/2443981288","heartbeat_front_addr":"172.21.15.87:6813/2443981288","state":["exists","up"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6819","nonce":1441249238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6823","nonce":1441249238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6831","nonce":1441249238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6825","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6827","nonce":1441249238}]},"public_addr":"172.21.15.87:6819/1441249238","cluster_addr":"172.21.15.87:6823/1441249238","heartbeat_back_addr":"172.21.15.87:6831/1441249238","heartbeat_front_addr":"172.21.15.87:6827/1441249238","state":["exists","up"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6818","nonce":1173805234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6822","nonce":1173805234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6829","nonce":1173805234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6826","nonce":1173805234}]},"public_addr":"172.21.15.87:6818/1173805234","cluster_addr":"172.21.15.87:6822/1173805234","heartbeat_back_addr":"172.21.15.87:6829/1173805234","heartbeat_front_addr":"172.21.15.87:6826/1173805234","state":["exists","up"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6819","nonce":1551871079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6823","nonce":1551871079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6831","nonce":1551871079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6827","nonce":1551871079}]},"public_addr":"172.21.15.149:6819/1551871079","cluster_addr":"172.21.15.149:6823/1551871079","heartbeat_back_addr":"172.21.15.149:6831/1551871079","heartbeat_front_addr":"172.21.15.149:6827/1551871079","state":["exists","up"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6818","nonce":582864816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6822","nonce":582864816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6830","nonce":582864816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6826","nonce":582864816}]},"public_addr":"172.21.15.149:6818/582864816","cluster_addr":"172.21.15.149:6822/582864816","heartbeat_back_addr":"172.21.15.149:6830/582864816","heartbeat_front_addr":"172.21.15.149:6826/582864816","state":["exists","up"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6801","nonce":531351314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6803","nonce":531351314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6807","nonce":531351314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6805","nonce":531351314}]},"public_addr":"172.21.15.149:6801/531351314","cluster_addr":"172.21.15.149:6803/531351314","heartbeat_back_addr":"172.21.15.149:6807/531351314","heartbeat_front_addr":"172.21.15.149:6805/531351314","state":["exists","up"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6809","nonce":1171039913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6811","nonce":1171039913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6815","nonce":1171039913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6813","nonce":1171039913}]},"public_addr":"172.21.15.149:6809/1171039913","cluster_addr":"172.21.15.149:6811/1171039913","heartbeat_back_addr":"172.21.15.149:6815/1171039913","heartbeat_front_addr":"172.21.15.149:6813/1171039913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.589776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.819787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.767566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.683842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.038885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.120319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.687007+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.812832+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:6835/2661735568":"2024-05-28T06:29:19.220703+0000","172.21.15.87:6834/2661735568":"2024-05-28T06:29:19.220703+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:29:24.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.609+0000 7f4696400640 1 -- 172.21.15.87:0/3995444674 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f466c06f5d0 msgr2=0x7f466c071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:24.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.609+0000 7f4696400640 1 --2- 172.21.15.87:0/3995444674 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f466c06f5d0 0x7f466c071ae0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4680003b90 tx=0x7f468000b040 comp rx=0 tx=0).stop 2024-05-27T06:29:24.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.609+0000 7f4696400640 1 -- 172.21.15.87:0/3995444674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46900c7260 msgr2=0x7f46900c7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:24.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.609+0000 7f4696400640 1 --2- 172.21.15.87:0/3995444674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46900c7260 0x7f46900c7670 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f467800e7b0 tx=0x7f467800ec70 comp rx=0 tx=0).stop 2024-05-27T06:29:24.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.609+0000 7f4696400640 1 -- 172.21.15.87:0/3995444674 shutdown_connections 2024-05-27T06:29:24.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.609+0000 7f4696400640 1 --2- 172.21.15.87:0/3995444674 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f466c06f5d0 0x7f466c071ae0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:24.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.609+0000 7f4696400640 1 --2- 172.21.15.87:0/3995444674 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f469015a450 0x7f469015a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:24.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.609+0000 7f4696400640 1 --2- 172.21.15.87:0/3995444674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46900c7260 0x7f46900c7670 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:24.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.609+0000 7f4696400640 1 --2- 172.21.15.87:0/3995444674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4674007520 0x7f46901f5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:24.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.609+0000 7f4696400640 1 -- 172.21.15.87:0/3995444674 >> 172.21.15.87:0/3995444674 conn(0x7f46900b46b0 msgr2=0x7f469015c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:24.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.609+0000 7f4696400640 1 -- 172.21.15.87:0/3995444674 shutdown_connections 2024-05-27T06:29:24.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.609+0000 7f4696400640 1 -- 172.21.15.87:0/3995444674 wait complete. 2024-05-27T06:29:24.628 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T06:27:26.590191+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T06:29:24.628 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T06:29:24.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.781+0000 7f86f4e00640 1 Processor -- start 2024-05-27T06:29:24.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.781+0000 7f86f4e00640 1 -- start start 2024-05-27T06:29:24.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.781+0000 7f86f4e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86f00d1700 0x7f86f00d1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:24.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.781+0000 7f86f4e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f86f0073640 0x7f86f0073a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:24.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.781+0000 7f86f4e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86f0160250 con 0x7f86f006eb20 2024-05-27T06:29:24.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.781+0000 7f86f4e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f86f00731b0 con 0x7f86f0073640 2024-05-27T06:29:24.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.781+0000 7f86f4e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f86f00d2050 con 0x7f86f00d1700 2024-05-27T06:29:24.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.781+0000 7f86ee800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f86f0073640 0x7f86f0073a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:24.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.781+0000 7f86e5400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86f00d1700 0x7f86f00d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:24.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.781+0000 7f86ee800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f86f0073640 0x7f86f0073a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:43070/0 (socket says 172.21.15.87:43070) 2024-05-27T06:29:24.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.781+0000 7f86ee800640 1 -- 172.21.15.87:0/4048489921 learned_addr learned my addr 172.21.15.87:0/4048489921 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:24.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.781+0000 7f86ede00640 1 --1- 172.21.15.87:0/4048489921 >> v1:172.21.15.149:6789/0 conn(0x7f86f006eb20 0x7f86f006d810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.87:52362/0 (socket says 172.21.15.87:52362) 2024-05-27T06:29:24.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.781+0000 7f86ee800640 1 -- 172.21.15.87:0/4048489921 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86f00d1700 msgr2=0x7f86f00d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:24.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.781+0000 7f86ee800640 1 --2- 172.21.15.87:0/4048489921 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86f00d1700 0x7f86f00d1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:24.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.781+0000 7f86ee800640 1 -- 172.21.15.87:0/4048489921 >> v1:172.21.15.149:6789/0 conn(0x7f86f006eb20 legacy=0x7f86f006d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:24.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.781+0000 7f86ee800640 1 -- 172.21.15.87:0/4048489921 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f00b0790 con 0x7f86f0073640 2024-05-27T06:29:24.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.781+0000 7f86e5400640 1 --2- 172.21.15.87:0/4048489921 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86f00d1700 0x7f86f00d1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:29:24.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.785+0000 7f86ee800640 1 --2- 172.21.15.87:0/4048489921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86f0073640 0x7f86f0073a50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f86e8009870 tx=0x7f86e801c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4604a5ea9e4043b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:24.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.785+0000 7f86ed400640 1 -- 172.21.15.87:0/4048489921 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e80a95f0 con 0x7f86f0073640 2024-05-27T06:29:24.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.785+0000 7f86ed400640 1 -- 172.21.15.87:0/4048489921 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86e80a9790 con 0x7f86f0073640 2024-05-27T06:29:24.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.785+0000 7f86ed400640 1 -- 172.21.15.87:0/4048489921 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e80a9b60 con 0x7f86f0073640 2024-05-27T06:29:24.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.785+0000 7f86f4e00640 1 -- 172.21.15.87:0/4048489921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86f0073640 msgr2=0x7f86f0073a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:24.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.785+0000 7f86f4e00640 1 --2- 172.21.15.87:0/4048489921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86f0073640 0x7f86f0073a50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f86e8009870 tx=0x7f86e801c530 comp rx=0 tx=0).stop 2024-05-27T06:29:24.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.785+0000 7f86f4e00640 1 -- 172.21.15.87:0/4048489921 shutdown_connections 2024-05-27T06:29:24.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.785+0000 7f86f4e00640 1 --2- 172.21.15.87:0/4048489921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86f0073640 0x7f86f0073a50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:24.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.785+0000 7f86f4e00640 1 --2- 172.21.15.87:0/4048489921 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86f00d1700 0x7f86f00d1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:24.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.785+0000 7f86f4e00640 1 -- 172.21.15.87:0/4048489921 >> 172.21.15.87:0/4048489921 conn(0x7f86f00b46b0 msgr2=0x7f86f00b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:24.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.785+0000 7f86f4e00640 1 -- 172.21.15.87:0/4048489921 shutdown_connections 2024-05-27T06:29:24.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.785+0000 7f86f4e00640 1 -- 172.21.15.87:0/4048489921 wait complete. 2024-05-27T06:29:24.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.789+0000 7f86f4e00640 1 Processor -- start 2024-05-27T06:29:24.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.789+0000 7f86f4e00640 1 -- start start 2024-05-27T06:29:24.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.789+0000 7f86f4e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f006eb20 0x7f86f01475f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:24.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.789+0000 7f86f4e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86f0073640 0x7f86f0158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.789+0000 7f86f4e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86f00d1700 0x7f86f0158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.789+0000 7f86f4e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f86f006ef30 con 0x7f86f006eb20 2024-05-27T06:29:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.789+0000 7f86f4e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f86f00b0460 con 0x7f86f0073640 2024-05-27T06:29:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.789+0000 7f86f4e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f86f006d1d0 con 0x7f86f00d1700 2024-05-27T06:29:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.789+0000 7f86ede00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f006eb20 0x7f86f01475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.789+0000 7f86ede00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f006eb20 0x7f86f01475f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41284/0 (socket says 172.21.15.87:41284) 2024-05-27T06:29:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.789+0000 7f86ede00640 1 -- 172.21.15.87:0/3093506916 learned_addr learned my addr 172.21.15.87:0/3093506916 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.789+0000 7f86ee800640 1 --2- 172.21.15.87:0/3093506916 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86f00d1700 0x7f86f0158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.789+0000 7f86e5400640 1 --2- 172.21.15.87:0/3093506916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86f0073640 0x7f86f0158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.793+0000 7f86ede00640 1 -- 172.21.15.87:0/3093506916 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86f00d1700 msgr2=0x7f86f0158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.793+0000 7f86ede00640 1 --2- 172.21.15.87:0/3093506916 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86f00d1700 0x7f86f0158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.793+0000 7f86ede00640 1 -- 172.21.15.87:0/3093506916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86f0073640 msgr2=0x7f86f0158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:24.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.793+0000 7f86ede00640 1 --2- 172.21.15.87:0/3093506916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86f0073640 0x7f86f0158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:24.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.793+0000 7f86ede00640 1 -- 172.21.15.87:0/3093506916 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f015a760 con 0x7f86f006eb20 2024-05-27T06:29:24.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.793+0000 7f86ede00640 1 --2- 172.21.15.87:0/3093506916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f006eb20 0x7f86f01475f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f86e000c730 tx=0x7f86e000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:24.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.793+0000 7f86e6a00640 1 -- 172.21.15.87:0/3093506916 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e0017070 con 0x7f86f006eb20 2024-05-27T06:29:24.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.793+0000 7f86e6a00640 1 -- 172.21.15.87:0/3093506916 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86e000ce40 con 0x7f86f006eb20 2024-05-27T06:29:24.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.793+0000 7f86e6a00640 1 -- 172.21.15.87:0/3093506916 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e000a840 con 0x7f86f006eb20 2024-05-27T06:29:24.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.793+0000 7f86f4e00640 1 -- 172.21.15.87:0/3093506916 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f015aa40 con 0x7f86f006eb20 2024-05-27T06:29:24.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.793+0000 7f86f4e00640 1 -- 172.21.15.87:0/3093506916 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f015b000 con 0x7f86f006eb20 2024-05-27T06:29:24.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.793+0000 7f86f4e00640 1 -- 172.21.15.87:0/3093506916 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86f006aa30 con 0x7f86f006eb20 2024-05-27T06:29:24.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.793+0000 7f86e6a00640 1 -- 172.21.15.87:0/3093506916 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f86e001a070 con 0x7f86f006eb20 2024-05-27T06:29:24.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.797+0000 7f86e6a00640 1 --2- 172.21.15.87:0/3093506916 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f86cc06f430 0x7f86cc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:24.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.797+0000 7f86e6a00640 1 -- 172.21.15.87:0/3093506916 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7f86e008e730 con 0x7f86f006eb20 2024-05-27T06:29:24.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.797+0000 7f86e5400640 1 --2- 172.21.15.87:0/3093506916 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f86cc06f430 0x7f86cc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:24.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.797+0000 7f86e5400640 1 --2- 172.21.15.87:0/3093506916 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f86cc06f430 0x7f86cc071940 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f86f015cb60 tx=0x7f86d8009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:24.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.801+0000 7f86e6a00640 1 -- 172.21.15.87:0/3093506916 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f86f0160250 con 0x7f86f006eb20 2024-05-27T06:29:24.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.953+0000 7f86f4e00640 1 -- 172.21.15.87:0/3093506916 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f86f00aef20 con 0x7f86f006eb20 2024-05-27T06:29:24.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.957+0000 7f86e6a00640 1 -- 172.21.15.87:0/3093506916 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) ==== 93+0+10 (secure 0 0 0) 0x7f86e005b0a0 con 0x7f86f006eb20 2024-05-27T06:29:24.954 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-05-27T06:29:24.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.957+0000 7f86f4e00640 1 -- 172.21.15.87:0/3093506916 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f86cc06f430 msgr2=0x7f86cc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:24.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.957+0000 7f86f4e00640 1 --2- 172.21.15.87:0/3093506916 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f86cc06f430 0x7f86cc071940 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f86f015cb60 tx=0x7f86d8009190 comp rx=0 tx=0).stop 2024-05-27T06:29:24.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.957+0000 7f86f4e00640 1 -- 172.21.15.87:0/3093506916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f006eb20 msgr2=0x7f86f01475f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:24.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.957+0000 7f86f4e00640 1 --2- 172.21.15.87:0/3093506916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f006eb20 0x7f86f01475f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f86e000c730 tx=0x7f86e000cbf0 comp rx=0 tx=0).stop 2024-05-27T06:29:24.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.957+0000 7f86f4e00640 1 -- 172.21.15.87:0/3093506916 shutdown_connections 2024-05-27T06:29:24.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.957+0000 7f86f4e00640 1 --2- 172.21.15.87:0/3093506916 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f86cc06f430 0x7f86cc071940 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:24.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.957+0000 7f86f4e00640 1 --2- 172.21.15.87:0/3093506916 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86f00d1700 0x7f86f0158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:24.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.957+0000 7f86f4e00640 1 --2- 172.21.15.87:0/3093506916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86f0073640 0x7f86f0158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:24.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.957+0000 7f86f4e00640 1 --2- 172.21.15.87:0/3093506916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f006eb20 0x7f86f01475f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:24.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.957+0000 7f86f4e00640 1 -- 172.21.15.87:0/3093506916 >> 172.21.15.87:0/3093506916 conn(0x7f86f00b46b0 msgr2=0x7f86f00743a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:24.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.957+0000 7f86f4e00640 1 -- 172.21.15.87:0/3093506916 shutdown_connections 2024-05-27T06:29:24.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:24.957+0000 7f86f4e00640 1 -- 172.21.15.87:0/3093506916 wait complete. 2024-05-27T06:29:24.975 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2024-05-27T06:29:25.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.125+0000 7f0bc6200640 1 Processor -- start 2024-05-27T06:29:25.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.125+0000 7f0bc6200640 1 -- start start 2024-05-27T06:29:25.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.125+0000 7f0bc6200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0bc006cfb0 0x7f0bc006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:25.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.125+0000 7f0bc6200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bc0162590 con 0x7f0bc006ff10 2024-05-27T06:29:25.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.125+0000 7f0bc6200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bc01617d0 con 0x7f0bc00b63c0 2024-05-27T06:29:25.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.125+0000 7f0bc6200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f0bc0161ab0 con 0x7f0bc006cfb0 2024-05-27T06:29:25.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.125+0000 7f0bbf400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0bc006cfb0 0x7f0bc006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:25.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.125+0000 7f0bb6a00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f0bc006ff10 0x7f0bc0070320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:38032/0 (socket says 172.21.15.87:38032) 2024-05-27T06:29:25.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.125+0000 7f0bb6a00640 1 -- 172.21.15.87:0/2108349505 learned_addr learned my addr 172.21.15.87:0/2108349505 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:29:25.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.125+0000 7f0bbf400640 1 -- 172.21.15.87:0/2108349505 >> v1:172.21.15.149:6789/0 conn(0x7f0bc00b63c0 legacy=0x7f0bc00b67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:25.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.125+0000 7f0bbf400640 1 -- 172.21.15.87:0/2108349505 >> v1:172.21.15.87:6789/0 conn(0x7f0bc006ff10 legacy=0x7f0bc0070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:25.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.125+0000 7f0bbf400640 1 -- 172.21.15.87:0/2108349505 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc0161d90 con 0x7f0bc006cfb0 2024-05-27T06:29:25.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.125+0000 7f0bbea00640 1 -- 172.21.15.87:0/2108349505 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 778380835 0 0) 0x7f0bc0162590 con 0x7f0bc006ff10 2024-05-27T06:29:25.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.129+0000 7f0bbf400640 1 --2- 172.21.15.87:0/2108349505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bc006cfb0 0x7f0bc006d3c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00097c0 tx=0x7f0bb001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8206b2d703760811 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:25.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.129+0000 7f0bbea00640 1 -- 172.21.15.87:0/2108349505 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00b1070 con 0x7f0bc006cfb0 2024-05-27T06:29:25.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.129+0000 7f0bbea00640 1 -- 172.21.15.87:0/2108349505 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bb00ac600 con 0x7f0bc006cfb0 2024-05-27T06:29:25.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.129+0000 7f0bbea00640 1 -- 172.21.15.87:0/2108349505 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00ac9d0 con 0x7f0bc006cfb0 2024-05-27T06:29:25.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.129+0000 7f0bc6200640 1 -- 172.21.15.87:0/2108349505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bc006cfb0 msgr2=0x7f0bc006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:25.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.129+0000 7f0bc6200640 1 --2- 172.21.15.87:0/2108349505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bc006cfb0 0x7f0bc006d3c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00097c0 tx=0x7f0bb001c3e0 comp rx=0 tx=0).stop 2024-05-27T06:29:25.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.129+0000 7f0bc6200640 1 -- 172.21.15.87:0/2108349505 shutdown_connections 2024-05-27T06:29:25.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.129+0000 7f0bc6200640 1 --2- 172.21.15.87:0/2108349505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bc006cfb0 0x7f0bc006d3c0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:25.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.129+0000 7f0bc6200640 1 -- 172.21.15.87:0/2108349505 >> 172.21.15.87:0/2108349505 conn(0x7f0bc00cf160 msgr2=0x7f0bc00cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:25.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.129+0000 7f0bc6200640 1 -- 172.21.15.87:0/2108349505 shutdown_connections 2024-05-27T06:29:25.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.129+0000 7f0bc6200640 1 -- 172.21.15.87:0/2108349505 wait complete. 2024-05-27T06:29:25.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.133+0000 7f0bc6200640 1 Processor -- start 2024-05-27T06:29:25.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.133+0000 7f0bc6200640 1 -- start start 2024-05-27T06:29:25.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.133+0000 7f0bc6200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bc006cfb0 0x7f0bc00cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:25.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.133+0000 7f0bc6200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bc006ff10 0x7f0bc0141f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:25.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.133+0000 7f0bc6200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0bc00b63c0 0x7f0bc00cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:25.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.133+0000 7f0bc6200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc00b7470 con 0x7f0bc006ff10 2024-05-27T06:29:25.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.133+0000 7f0bc6200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc00b72f0 con 0x7f0bc006cfb0 2024-05-27T06:29:25.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.133+0000 7f0bc6200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0bc016c690 con 0x7f0bc00b63c0 2024-05-27T06:29:25.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.133+0000 7f0bb6a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bc006ff10 0x7f0bc0141f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:25.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.133+0000 7f0bb6a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bc006ff10 0x7f0bc0141f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41306/0 (socket says 172.21.15.87:41306) 2024-05-27T06:29:25.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.133+0000 7f0bb6a00640 1 -- 172.21.15.87:0/1459994134 learned_addr learned my addr 172.21.15.87:0/1459994134 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:25.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.133+0000 7f0bbf400640 1 --2- 172.21.15.87:0/1459994134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bc006cfb0 0x7f0bc00cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:25.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.133+0000 7f0bbfe00640 1 --2- 172.21.15.87:0/1459994134 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0bc00b63c0 0x7f0bc00cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:25.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.137+0000 7f0bb6a00640 1 -- 172.21.15.87:0/1459994134 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0bc00b63c0 msgr2=0x7f0bc00cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:25.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.137+0000 7f0bb6a00640 1 --2- 172.21.15.87:0/1459994134 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0bc00b63c0 0x7f0bc00cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:25.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.137+0000 7f0bb6a00640 1 -- 172.21.15.87:0/1459994134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bc006cfb0 msgr2=0x7f0bc00cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:25.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.137+0000 7f0bb6a00640 1 --2- 172.21.15.87:0/1459994134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bc006cfb0 0x7f0bc00cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:25.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.137+0000 7f0bb6a00640 1 -- 172.21.15.87:0/1459994134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc00c7f60 con 0x7f0bc006ff10 2024-05-27T06:29:25.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.137+0000 7f0bbf400640 1 --2- 172.21.15.87:0/1459994134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bc006cfb0 0x7f0bc00cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:29:25.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.137+0000 7f0bb6a00640 1 --2- 172.21.15.87:0/1459994134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bc006ff10 0x7f0bc0141f50 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0ba800c430 tx=0x7f0ba800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:25.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.137+0000 7f0bb7e00640 1 -- 172.21.15.87:0/1459994134 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba80074e0 con 0x7f0bc006ff10 2024-05-27T06:29:25.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.137+0000 7f0bb7e00640 1 -- 172.21.15.87:0/1459994134 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba80047f0 con 0x7f0bc006ff10 2024-05-27T06:29:25.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.137+0000 7f0bc6200640 1 -- 172.21.15.87:0/1459994134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bc00c8240 con 0x7f0bc006ff10 2024-05-27T06:29:25.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.137+0000 7f0bb7e00640 1 -- 172.21.15.87:0/1459994134 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8004be0 con 0x7f0bc006ff10 2024-05-27T06:29:25.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.137+0000 7f0bc6200640 1 -- 172.21.15.87:0/1459994134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bc01f8450 con 0x7f0bc006ff10 2024-05-27T06:29:25.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.137+0000 7f0bc6200640 1 -- 172.21.15.87:0/1459994134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bc006aa30 con 0x7f0bc006ff10 2024-05-27T06:29:25.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.137+0000 7f0bb7e00640 1 -- 172.21.15.87:0/1459994134 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0ba8011070 con 0x7f0bc006ff10 2024-05-27T06:29:25.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.141+0000 7f0bb7e00640 1 --2- 172.21.15.87:0/1459994134 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0b9c06f430 0x7f0b9c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:25.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.141+0000 7f0bb7e00640 1 -- 172.21.15.87:0/1459994134 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7f0ba808f210 con 0x7f0bc006ff10 2024-05-27T06:29:25.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.141+0000 7f0bbf400640 1 --2- 172.21.15.87:0/1459994134 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0b9c06f430 0x7f0b9c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:25.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.141+0000 7f0bbf400640 1 --2- 172.21.15.87:0/1459994134 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0b9c06f430 0x7f0b9c071940 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00ae000 tx=0x7f0bb00a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:25.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.145+0000 7f0bb7e00640 1 -- 172.21.15.87:0/1459994134 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f0ba805c3e0 con 0x7f0bc006ff10 2024-05-27T06:29:25.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:25.361+0000 7f0bc6200640 1 -- 172.21.15.87:0/1459994134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) -- 0x7f0bc00b5c50 con 0x7f0bc006ff10 2024-05-27T06:29:26.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.260+0000 7f0bb7e00640 1 -- 172.21.15.87:0/1459994134 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v112) ==== 137+0+0 (secure 0 0 0) 0x7f0ba805bce0 con 0x7f0bc006ff10 2024-05-27T06:29:26.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.264+0000 7f0bc6200640 1 -- 172.21.15.87:0/1459994134 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0b9c06f430 msgr2=0x7f0b9c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:26.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.264+0000 7f0bc6200640 1 --2- 172.21.15.87:0/1459994134 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0b9c06f430 0x7f0b9c071940 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00ae000 tx=0x7f0bb00a7000 comp rx=0 tx=0).stop 2024-05-27T06:29:26.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.264+0000 7f0bc6200640 1 -- 172.21.15.87:0/1459994134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bc006ff10 msgr2=0x7f0bc0141f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:26.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.264+0000 7f0bc6200640 1 --2- 172.21.15.87:0/1459994134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bc006ff10 0x7f0bc0141f50 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0ba800c430 tx=0x7f0ba800c8f0 comp rx=0 tx=0).stop 2024-05-27T06:29:26.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.264+0000 7f0bc6200640 1 -- 172.21.15.87:0/1459994134 shutdown_connections 2024-05-27T06:29:26.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.264+0000 7f0bc6200640 1 --2- 172.21.15.87:0/1459994134 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0b9c06f430 0x7f0b9c071940 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:26.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.264+0000 7f0bc6200640 1 --2- 172.21.15.87:0/1459994134 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0bc00b63c0 0x7f0bc00cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:26.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.264+0000 7f0bc6200640 1 --2- 172.21.15.87:0/1459994134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bc006ff10 0x7f0bc0141f50 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:26.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.264+0000 7f0bc6200640 1 --2- 172.21.15.87:0/1459994134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0bc006cfb0 0x7f0bc00cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:26.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.264+0000 7f0bc6200640 1 -- 172.21.15.87:0/1459994134 >> 172.21.15.87:0/1459994134 conn(0x7f0bc00cf160 msgr2=0x7f0bc00b67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:26.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.264+0000 7f0bc6200640 1 -- 172.21.15.87:0/1459994134 shutdown_connections 2024-05-27T06:29:26.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.264+0000 7f0bc6200640 1 -- 172.21.15.87:0/1459994134 wait complete. 2024-05-27T06:29:26.283 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-27T06:29:26.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f372fc00640 1 Processor -- start 2024-05-27T06:29:26.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f372fc00640 1 -- start start 2024-05-27T06:29:26.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f372fc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37280b43b0 0x7f37280b69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:26.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f372fc00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f372815e370 con 0x7f37280b47c0 2024-05-27T06:29:26.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f372fc00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37280b3310 con 0x7f37280ce100 2024-05-27T06:29:26.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f372fc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f37280b35f0 con 0x7f37280b43b0 2024-05-27T06:29:26.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f371fe00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f37280b47c0 0x7f37280b6f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:38048/0 (socket says 172.21.15.87:38048) 2024-05-27T06:29:26.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f371fe00640 1 -- 172.21.15.87:0/3622811446 learned_addr learned my addr 172.21.15.87:0/3622811446 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:29:26.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f372d200640 1 --2- 172.21.15.87:0/3622811446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37280b43b0 0x7f37280b69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:26.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f3727e00640 1 -- 172.21.15.87:0/3622811446 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4260654238 0 0) 0x7f372815e370 con 0x7f37280b47c0 2024-05-27T06:29:26.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f3727e00640 1 -- 172.21.15.87:0/3622811446 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f370c003530 con 0x7f37280b47c0 2024-05-27T06:29:26.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f3727e00640 1 -- 172.21.15.87:0/3622811446 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 929007331 0 0) 0x7f37280b3310 con 0x7f37280ce100 2024-05-27T06:29:26.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f3727e00640 1 -- 172.21.15.87:0/3622811446 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f372815e370 con 0x7f37280ce100 2024-05-27T06:29:26.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f3727e00640 1 -- 172.21.15.87:0/3622811446 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1553205991 0 0) 0x7f370c003530 con 0x7f37280b47c0 2024-05-27T06:29:26.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f3727e00640 1 -- 172.21.15.87:0/3622811446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37280b43b0 msgr2=0x7f37280b69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:26.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f3727e00640 1 --2- 172.21.15.87:0/3622811446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37280b43b0 0x7f37280b69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:26.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f3727e00640 1 -- 172.21.15.87:0/3622811446 >> v1:172.21.15.149:6789/0 conn(0x7f37280ce100 legacy=0x7f37280ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:26.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f3727e00640 1 -- 172.21.15.87:0/3622811446 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37280b38d0 con 0x7f37280b47c0 2024-05-27T06:29:26.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f372d200640 1 --2- 172.21.15.87:0/3622811446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37280b43b0 0x7f37280b69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:29:26.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f3727e00640 1 -- 172.21.15.87:0/3622811446 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7f3710001880 con 0x7f37280b47c0 2024-05-27T06:29:26.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f3727e00640 1 -- 172.21.15.87:0/3622811446 >> v1:172.21.15.87:6789/0 conn(0x7f37280b47c0 legacy=0x7f37280b6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:26.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f3727e00640 1 --2- 172.21.15.87:0/3622811446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37280b43b0 0x7f370c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:26.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f3727e00640 1 --2- 172.21.15.87:0/3622811446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f370c0041d0 0x7f370c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:26.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f3727e00640 1 --2- 172.21.15.87:0/3622811446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f370c004da0 0x7f370c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:26.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f3727e00640 1 -- 172.21.15.87:0/3622811446 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f37280b35f0 con 0x7f370c0041d0 2024-05-27T06:29:26.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f3727e00640 1 -- 172.21.15.87:0/3622811446 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f370c00bcd0 con 0x7f370c004da0 2024-05-27T06:29:26.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f3727e00640 1 -- 172.21.15.87:0/3622811446 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f370c00bed0 con 0x7f37280b43b0 2024-05-27T06:29:26.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f371fe00640 1 --2- 172.21.15.87:0/3622811446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f370c0041d0 0x7f370c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:26.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f372d200640 1 --2- 172.21.15.87:0/3622811446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37280b43b0 0x7f370c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:26.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f372dc00640 1 --2- 172.21.15.87:0/3622811446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f370c004da0 0x7f370c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:26.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f371fe00640 1 -- 172.21.15.87:0/3622811446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37280b43b0 msgr2=0x7f370c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:26.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f371fe00640 1 --2- 172.21.15.87:0/3622811446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37280b43b0 0x7f370c003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:26.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f371fe00640 1 -- 172.21.15.87:0/3622811446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f370c004da0 msgr2=0x7f370c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:26.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f371fe00640 1 --2- 172.21.15.87:0/3622811446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f370c004da0 0x7f370c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:26.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f371fe00640 1 -- 172.21.15.87:0/3622811446 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f370c003530 con 0x7f370c0041d0 2024-05-27T06:29:26.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.436+0000 7f372dc00640 1 --2- 172.21.15.87:0/3622811446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f370c004da0 0x7f370c005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:29:26.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.440+0000 7f371fe00640 1 --2- 172.21.15.87:0/3622811446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f370c0041d0 0x7f370c004810 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3728073df0 tx=0x7f371001cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ae654e704388ad server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:26.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.440+0000 7f3727e00640 1 -- 172.21.15.87:0/3622811446 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3710007cd0 con 0x7f370c0041d0 2024-05-27T06:29:26.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.440+0000 7f3727e00640 1 -- 172.21.15.87:0/3622811446 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37100a9070 con 0x7f370c0041d0 2024-05-27T06:29:26.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.440+0000 7f3727e00640 1 -- 172.21.15.87:0/3622811446 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37100074f0 con 0x7f370c0041d0 2024-05-27T06:29:26.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.440+0000 7f372fc00640 1 -- 172.21.15.87:0/3622811446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f370c0041d0 msgr2=0x7f370c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:26.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.440+0000 7f372fc00640 1 --2- 172.21.15.87:0/3622811446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f370c0041d0 0x7f370c004810 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3728073df0 tx=0x7f371001cb00 comp rx=0 tx=0).stop 2024-05-27T06:29:26.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.440+0000 7f372dc00640 1 -- 172.21.15.87:0/3622811446 reap_dead start 2024-05-27T06:29:26.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.440+0000 7f372fc00640 1 -- 172.21.15.87:0/3622811446 shutdown_connections 2024-05-27T06:29:26.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.440+0000 7f372fc00640 1 -- 172.21.15.87:0/3622811446 >> 172.21.15.87:0/3622811446 conn(0x7f37280d3580 msgr2=0x7f37280d3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:26.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.440+0000 7f372fc00640 1 -- 172.21.15.87:0/3622811446 shutdown_connections 2024-05-27T06:29:26.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.440+0000 7f372fc00640 1 -- 172.21.15.87:0/3622811446 wait complete. 2024-05-27T06:29:26.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.444+0000 7f372fc00640 1 Processor -- start 2024-05-27T06:29:26.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.444+0000 7f372fc00640 1 -- start start 2024-05-27T06:29:26.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.444+0000 7f372fc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f370c0041d0 0x7f37281f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:26.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.444+0000 7f372fc00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37280cc640 0x7f3728159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:26.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.444+0000 7f372fc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f372815a0b0 0x7f372815fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:26.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.444+0000 7f372fc00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f372816a750 con 0x7f37280cc640 2024-05-27T06:29:26.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.444+0000 7f372fc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f372816a5d0 con 0x7f370c0041d0 2024-05-27T06:29:26.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.444+0000 7f372fc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f372816a8d0 con 0x7f372815a0b0 2024-05-27T06:29:26.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.444+0000 7f371fe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37280cc640 0x7f3728159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:26.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.448+0000 7f371fe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37280cc640 0x7f3728159b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41336/0 (socket says 172.21.15.87:41336) 2024-05-27T06:29:26.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.448+0000 7f371fe00640 1 -- 172.21.15.87:0/1802641496 learned_addr learned my addr 172.21.15.87:0/1802641496 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:26.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.448+0000 7f372dc00640 1 --2- 172.21.15.87:0/1802641496 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f372815a0b0 0x7f372815fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:26.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.448+0000 7f372d200640 1 --2- 172.21.15.87:0/1802641496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f370c0041d0 0x7f37281f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:26.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.448+0000 7f371fe00640 1 -- 172.21.15.87:0/1802641496 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f372815a0b0 msgr2=0x7f372815fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:26.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.448+0000 7f371fe00640 1 --2- 172.21.15.87:0/1802641496 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f372815a0b0 0x7f372815fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:26.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.448+0000 7f371fe00640 1 -- 172.21.15.87:0/1802641496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f370c0041d0 msgr2=0x7f37281f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:26.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.448+0000 7f371fe00640 1 --2- 172.21.15.87:0/1802641496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f370c0041d0 0x7f37281f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:26.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.448+0000 7f371fe00640 1 -- 172.21.15.87:0/1802641496 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37280cd090 con 0x7f37280cc640 2024-05-27T06:29:26.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.448+0000 7f372d200640 1 --2- 172.21.15.87:0/1802641496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f370c0041d0 0x7f37281f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:29:26.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.448+0000 7f371fe00640 1 --2- 172.21.15.87:0/1802641496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37280cc640 0x7f3728159b70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f371001b200 tx=0x7f370c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:26.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.448+0000 7f3725600640 1 -- 172.21.15.87:0/1802641496 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3710000f80 con 0x7f37280cc640 2024-05-27T06:29:26.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.448+0000 7f3725600640 1 -- 172.21.15.87:0/1802641496 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37100070a0 con 0x7f37280cc640 2024-05-27T06:29:26.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.448+0000 7f372fc00640 1 -- 172.21.15.87:0/1802641496 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37280cd370 con 0x7f37280cc640 2024-05-27T06:29:26.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.448+0000 7f3725600640 1 -- 172.21.15.87:0/1802641496 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3710007450 con 0x7f37280cc640 2024-05-27T06:29:26.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.448+0000 7f372fc00640 1 -- 172.21.15.87:0/1802641496 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37281f7ff0 con 0x7f37280cc640 2024-05-27T06:29:26.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.448+0000 7f372fc00640 1 -- 172.21.15.87:0/1802641496 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37280cce00 con 0x7f37280cc640 2024-05-27T06:29:26.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.448+0000 7f3725600640 1 -- 172.21.15.87:0/1802641496 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f37100057b0 con 0x7f37280cc640 2024-05-27T06:29:26.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.452+0000 7f3725600640 1 --2- 172.21.15.87:0/1802641496 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f370406f400 0x7f3704071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:26.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.452+0000 7f3725600640 1 -- 172.21.15.87:0/1802641496 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7f37101289e0 con 0x7f37280cc640 2024-05-27T06:29:26.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.452+0000 7f372d200640 1 --2- 172.21.15.87:0/1802641496 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f370406f400 0x7f3704071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:26.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.452+0000 7f372d200640 1 --2- 172.21.15.87:0/1802641496 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f370406f400 0x7f3704071910 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3718009a90 tx=0x7f3718008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:26.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.456+0000 7f3725600640 1 -- 172.21.15.87:0/1802641496 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f37100bf060 con 0x7f37280cc640 2024-05-27T06:29:26.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.612+0000 7f372fc00640 1 -- 172.21.15.87:0/1802641496 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f372806aa30 con 0x7f37280cc640 2024-05-27T06:29:26.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.616+0000 7f3725600640 1 -- 172.21.15.87:0/1802641496 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f37100168b0 con 0x7f37280cc640 2024-05-27T06:29:26.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.620+0000 7f372fc00640 1 -- 172.21.15.87:0/1802641496 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f370406f400 msgr2=0x7f3704071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:26.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.620+0000 7f372fc00640 1 --2- 172.21.15.87:0/1802641496 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f370406f400 0x7f3704071910 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3718009a90 tx=0x7f3718008040 comp rx=0 tx=0).stop 2024-05-27T06:29:26.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.620+0000 7f372fc00640 1 -- 172.21.15.87:0/1802641496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37280cc640 msgr2=0x7f3728159b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:26.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.620+0000 7f372fc00640 1 --2- 172.21.15.87:0/1802641496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37280cc640 0x7f3728159b70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f371001b200 tx=0x7f370c005840 comp rx=0 tx=0).stop 2024-05-27T06:29:26.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.620+0000 7f372fc00640 1 -- 172.21.15.87:0/1802641496 shutdown_connections 2024-05-27T06:29:26.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.620+0000 7f372fc00640 1 --2- 172.21.15.87:0/1802641496 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f370406f400 0x7f3704071910 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:26.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.620+0000 7f372fc00640 1 --2- 172.21.15.87:0/1802641496 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f372815a0b0 0x7f372815fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:26.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.620+0000 7f372fc00640 1 --2- 172.21.15.87:0/1802641496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37280cc640 0x7f3728159b70 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:26.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.620+0000 7f372fc00640 1 --2- 172.21.15.87:0/1802641496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f370c0041d0 0x7f37281f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:26.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.620+0000 7f372fc00640 1 -- 172.21.15.87:0/1802641496 >> 172.21.15.87:0/1802641496 conn(0x7f37280d3580 msgr2=0x7f3728071780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:26.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.620+0000 7f372fc00640 1 -- 172.21.15.87:0/1802641496 shutdown_connections 2024-05-27T06:29:26.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:26.620+0000 7f372fc00640 1 -- 172.21.15.87:0/1802641496 wait complete. 2024-05-27T06:29:26.639 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-27T06:29:26.639 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-27T06:29:26.736 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-27T06:29:26.799 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-27T06:29:26.800 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:29:26.800 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:29:26.808 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8583 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274976k,nr_inodes=818744,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-27T06:29:26.808 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:29:26.809 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:29:26.817 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105064k,nr_inodes=2026266,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625948k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6550 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625944k,nr_inodes=406486,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625948k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-27T06:29:26.818 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:29:26.818 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:29:26.861 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8583 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274976k,nr_inodes=818744,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-27T06:29:26.861 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:29:26.861 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:29:26.870 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105064k,nr_inodes=2026266,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625948k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6550 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625944k,nr_inodes=406486,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625948k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-27T06:29:26.870 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-27T06:29:26.870 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T06:29:27.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.052+0000 7f0438000640 1 Processor -- start 2024-05-27T06:29:27.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.052+0000 7f0438000640 1 -- start start 2024-05-27T06:29:27.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.052+0000 7f0438000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f04300d1740 0x7f04300d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:27.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.052+0000 7f0438000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04300d2090 con 0x7f043015cfe0 2024-05-27T06:29:27.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.052+0000 7f0438000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f043015dbb0 con 0x7f04300cbf90 2024-05-27T06:29:27.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.052+0000 7f0438000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f043015de90 con 0x7f04300d1740 2024-05-27T06:29:27.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.056+0000 7f0436000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f04300d1740 0x7f04300d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:27.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.056+0000 7f0434c00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f043015cfe0 0x7f043015d3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:38064/0 (socket says 172.21.15.87:38064) 2024-05-27T06:29:27.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.056+0000 7f0434c00640 1 -- 172.21.15.87:0/2171482520 learned_addr learned my addr 172.21.15.87:0/2171482520 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:29:27.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.056+0000 7f0436000640 1 -- 172.21.15.87:0/2171482520 >> v1:172.21.15.149:6789/0 conn(0x7f04300cbf90 legacy=0x7f043006cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:27.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.056+0000 7f0436000640 1 -- 172.21.15.87:0/2171482520 >> v1:172.21.15.87:6789/0 conn(0x7f043015cfe0 legacy=0x7f043015d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:27.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.056+0000 7f0436000640 1 -- 172.21.15.87:0/2171482520 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f043006c7c0 con 0x7f04300d1740 2024-05-27T06:29:27.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.056+0000 7f042fe00640 1 -- 172.21.15.87:0/2171482520 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2863510975 0 0) 0x7f041c001120 con 0x7f043015cfe0 2024-05-27T06:29:27.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.056+0000 7f0436000640 1 --2- 172.21.15.87:0/2171482520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04300d1740 0x7f04300d1b50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0428009d90 tx=0x7f042801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ab8208ef20fd3e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:27.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.056+0000 7f042fe00640 1 -- 172.21.15.87:0/2171482520 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04280b4070 con 0x7f04300d1740 2024-05-27T06:29:27.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.056+0000 7f042fe00640 1 -- 172.21.15.87:0/2171482520 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04280af600 con 0x7f04300d1740 2024-05-27T06:29:27.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.056+0000 7f042fe00640 1 -- 172.21.15.87:0/2171482520 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04280af9d0 con 0x7f04300d1740 2024-05-27T06:29:27.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.060+0000 7f0438000640 1 -- 172.21.15.87:0/2171482520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04300d1740 msgr2=0x7f04300d1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:27.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.060+0000 7f0438000640 1 --2- 172.21.15.87:0/2171482520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04300d1740 0x7f04300d1b50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0428009d90 tx=0x7f042801f150 comp rx=0 tx=0).stop 2024-05-27T06:29:27.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.060+0000 7f0438000640 1 -- 172.21.15.87:0/2171482520 shutdown_connections 2024-05-27T06:29:27.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.060+0000 7f0438000640 1 --2- 172.21.15.87:0/2171482520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04300d1740 0x7f04300d1b50 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:27.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.060+0000 7f0438000640 1 -- 172.21.15.87:0/2171482520 >> 172.21.15.87:0/2171482520 conn(0x7f04300b46b0 msgr2=0x7f04300b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:27.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.060+0000 7f0438000640 1 -- 172.21.15.87:0/2171482520 shutdown_connections 2024-05-27T06:29:27.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.060+0000 7f0438000640 1 -- 172.21.15.87:0/2171482520 wait complete. 2024-05-27T06:29:27.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.060+0000 7f0438000640 1 Processor -- start 2024-05-27T06:29:27.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.060+0000 7f0438000640 1 -- start start 2024-05-27T06:29:27.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.064+0000 7f0438000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04300cbf90 0x7f04301f4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:27.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.064+0000 7f0438000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04300d1740 0x7f04301fa310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:27.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.064+0000 7f0438000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f043015cfe0 0x7f04301fa850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:27.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.064+0000 7f0438000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f04300cc3a0 con 0x7f04300cbf90 2024-05-27T06:29:27.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.064+0000 7f0438000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f043015e170 con 0x7f04300d1740 2024-05-27T06:29:27.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.064+0000 7f0438000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f043006ec50 con 0x7f043015cfe0 2024-05-27T06:29:27.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.064+0000 7f0435600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04300cbf90 0x7f04301f4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:27.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.064+0000 7f0435600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04300cbf90 0x7f04301f4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41350/0 (socket says 172.21.15.87:41350) 2024-05-27T06:29:27.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.064+0000 7f0435600640 1 -- 172.21.15.87:0/3456223461 learned_addr learned my addr 172.21.15.87:0/3456223461 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:27.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.064+0000 7f0434c00640 1 --2- 172.21.15.87:0/3456223461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04300d1740 0x7f04301fa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:27.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.064+0000 7f0436000640 1 --2- 172.21.15.87:0/3456223461 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f043015cfe0 0x7f04301fa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:27.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.064+0000 7f0435600640 1 -- 172.21.15.87:0/3456223461 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f043015cfe0 msgr2=0x7f04301fa850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:27.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.064+0000 7f0435600640 1 --2- 172.21.15.87:0/3456223461 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f043015cfe0 0x7f04301fa850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:27.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.064+0000 7f0435600640 1 -- 172.21.15.87:0/3456223461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04300d1740 msgr2=0x7f04301fa310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:27.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.064+0000 7f0435600640 1 --2- 172.21.15.87:0/3456223461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04300d1740 0x7f04301fa310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:27.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.064+0000 7f0435600640 1 -- 172.21.15.87:0/3456223461 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04300c8fc0 con 0x7f04300cbf90 2024-05-27T06:29:27.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.064+0000 7f0435600640 1 --2- 172.21.15.87:0/3456223461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04300cbf90 0x7f04301f4010 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f042400c420 tx=0x7f042400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:27.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.064+0000 7f042d600640 1 -- 172.21.15.87:0/3456223461 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0424017070 con 0x7f04300cbf90 2024-05-27T06:29:27.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.064+0000 7f042d600640 1 -- 172.21.15.87:0/3456223461 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04240052d0 con 0x7f04300cbf90 2024-05-27T06:29:27.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.064+0000 7f0438000640 1 -- 172.21.15.87:0/3456223461 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04300c92a0 con 0x7f04300cbf90 2024-05-27T06:29:27.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.064+0000 7f042d600640 1 -- 172.21.15.87:0/3456223461 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0424003820 con 0x7f04300cbf90 2024-05-27T06:29:27.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.064+0000 7f0438000640 1 -- 172.21.15.87:0/3456223461 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04300c9860 con 0x7f04300cbf90 2024-05-27T06:29:27.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.064+0000 7f0438000640 1 -- 172.21.15.87:0/3456223461 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f043006aa30 con 0x7f04300cbf90 2024-05-27T06:29:27.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.068+0000 7f042d600640 1 -- 172.21.15.87:0/3456223461 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f042401a070 con 0x7f04300cbf90 2024-05-27T06:29:27.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.068+0000 7f042d600640 1 --2- 172.21.15.87:0/3456223461 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f041006f400 0x7f0410071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:27.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.068+0000 7f042d600640 1 -- 172.21.15.87:0/3456223461 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7f042408e440 con 0x7f04300cbf90 2024-05-27T06:29:27.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.068+0000 7f0434c00640 1 --2- 172.21.15.87:0/3456223461 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f041006f400 0x7f0410071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:27.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.068+0000 7f0434c00640 1 --2- 172.21.15.87:0/3456223461 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f041006f400 0x7f0410071910 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f041c007c40 tx=0x7f041c007b90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:27.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.072+0000 7f042d600640 1 -- 172.21.15.87:0/3456223461 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f0424005480 con 0x7f04300cbf90 2024-05-27T06:29:27.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.264+0000 7f0438000640 1 -- 172.21.15.87:0/3456223461 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04300b06e0 con 0x7f04300cbf90 2024-05-27T06:29:27.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.264+0000 7f042d600640 1 -- 172.21.15.87:0/3456223461 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+3866 (secure 0 0 0) 0x7f042405ae50 con 0x7f04300cbf90 2024-05-27T06:29:27.263 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:29:27.264 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/662047769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":662047769},{"type":"v1","addr":"172.21.15.87:6837","nonce":662047769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4861,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/553113849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":553113849},{"type":"v1","addr":"172.21.15.149:6834","nonce":553113849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/381728425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":381728425},{"type":"v1","addr":"172.21.15.149:6835","nonce":381728425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5286,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4162099001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4162099001},{"type":"v1","addr":"172.21.15.87:6835","nonce":4162099001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[]} 2024-05-27T06:29:27.264 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 21 2024-05-27T06:29:27.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.268+0000 7f0438000640 1 -- 172.21.15.87:0/3456223461 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f041006f400 msgr2=0x7f0410071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:27.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.268+0000 7f0438000640 1 --2- 172.21.15.87:0/3456223461 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f041006f400 0x7f0410071910 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f041c007c40 tx=0x7f041c007b90 comp rx=0 tx=0).stop 2024-05-27T06:29:27.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.268+0000 7f0438000640 1 -- 172.21.15.87:0/3456223461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04300cbf90 msgr2=0x7f04301f4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:27.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.268+0000 7f0438000640 1 --2- 172.21.15.87:0/3456223461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04300cbf90 0x7f04301f4010 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f042400c420 tx=0x7f042400c8e0 comp rx=0 tx=0).stop 2024-05-27T06:29:27.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.268+0000 7f0438000640 1 -- 172.21.15.87:0/3456223461 shutdown_connections 2024-05-27T06:29:27.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.268+0000 7f0438000640 1 --2- 172.21.15.87:0/3456223461 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f041006f400 0x7f0410071910 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:27.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.268+0000 7f0438000640 1 --2- 172.21.15.87:0/3456223461 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f043015cfe0 0x7f04301fa850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:27.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.268+0000 7f0438000640 1 --2- 172.21.15.87:0/3456223461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04300d1740 0x7f04301fa310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:27.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.268+0000 7f0438000640 1 --2- 172.21.15.87:0/3456223461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04300cbf90 0x7f04301f4010 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:27.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.268+0000 7f0438000640 1 -- 172.21.15.87:0/3456223461 >> 172.21.15.87:0/3456223461 conn(0x7f04300b46b0 msgr2=0x7f04300b0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:27.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.268+0000 7f0438000640 1 -- 172.21.15.87:0/3456223461 shutdown_connections 2024-05-27T06:29:27.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.268+0000 7f0438000640 1 -- 172.21.15.87:0/3456223461 wait complete. 2024-05-27T06:29:27.286 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-27T06:29:27.287 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-27T06:29:27.287 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-27T06:29:27.287 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:29:27.287 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-27T06:29:27.287 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-27T06:29:27.287 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-27T06:29:27.287 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:29:27.288 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-27T06:29:27.288 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-27T06:29:27.288 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-27T06:29:27.288 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:29:27.288 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-27T06:29:27.288 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-27T06:29:27.288 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-27T06:29:27.288 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:29:27.302 INFO:tasks.ceph.mds.c:Stopped 2024-05-27T06:29:27.302 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-27T06:29:27.303 INFO:tasks.ceph.mds.d:Stopped 2024-05-27T06:29:27.303 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-27T06:29:27.304 INFO:tasks.ceph.mds.b:Stopped 2024-05-27T06:29:27.304 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-27T06:29:27.310 INFO:tasks.ceph.mds.a:Stopped 2024-05-27T06:29:27.310 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-27T06:29:27.351 INFO:tasks.ceph.mds.d:Started 2024-05-27T06:29:27.351 DEBUG:teuthology.parallel:result is None 2024-05-27T06:29:27.352 INFO:tasks.ceph.mds.b:Started 2024-05-27T06:29:27.352 DEBUG:teuthology.parallel:result is None 2024-05-27T06:29:27.355 INFO:tasks.ceph.mds.c:Started 2024-05-27T06:29:27.355 DEBUG:teuthology.parallel:result is None 2024-05-27T06:29:27.357 INFO:tasks.ceph.mds.a:Started 2024-05-27T06:29:27.357 DEBUG:teuthology.parallel:result is None 2024-05-27T06:29:27.358 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-27T06:29:27.454 INFO:tasks.ceph.mds.c.smithi087.stdout:starting mds.c at 2024-05-27T06:29:27.456 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-05-27T06:29:27.456 INFO:tasks.ceph.mds.a.smithi087.stdout:starting mds.a at 2024-05-27T06:29:27.457 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-05-27T06:29:27.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.512+0000 7f2760a00640 1 Processor -- start 2024-05-27T06:29:27.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.512+0000 7f2760a00640 1 -- start start 2024-05-27T06:29:27.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.516+0000 7f2760a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f275c163f70 0x7f275c0b6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:27.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.516+0000 7f2760a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f275c162820 0x7f275c162c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:27.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.516+0000 7f2760a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f275c0b6d90 con 0x7f275c15deb0 2024-05-27T06:29:27.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.516+0000 7f2760a00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f275c162390 con 0x7f275c163f70 2024-05-27T06:29:27.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.516+0000 7f2760a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f275c161780 con 0x7f275c162820 2024-05-27T06:29:27.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.516+0000 7f2759400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f275c163f70 0x7f275c0b6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:27.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.516+0000 7f2759400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f275c163f70 0x7f275c0b6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41384/0 (socket says 172.21.15.87:41384) 2024-05-27T06:29:27.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.516+0000 7f2759400640 1 -- 172.21.15.87:0/1202517005 learned_addr learned my addr 172.21.15.87:0/1202517005 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:27.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.516+0000 7f275a800640 1 --2- 172.21.15.87:0/1202517005 >> v2:172.21.15.149:3300/0 conn(0x7f275c162820 0x7f275c162c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:27.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.516+0000 7f2759400640 1 -- 172.21.15.87:0/1202517005 >> v2:172.21.15.149:3300/0 conn(0x7f275c162820 msgr2=0x7f275c162c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:27.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.516+0000 7f2759400640 1 --2- 172.21.15.87:0/1202517005 >> v2:172.21.15.149:3300/0 conn(0x7f275c162820 0x7f275c162c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:27.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.516+0000 7f2759400640 1 -- 172.21.15.87:0/1202517005 >> v1:172.21.15.149:6789/0 conn(0x7f275c15deb0 legacy=0x7f275c163860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:27.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.516+0000 7f2759400640 1 -- 172.21.15.87:0/1202517005 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f275c161a60 con 0x7f275c163f70 2024-05-27T06:29:27.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.520+0000 7f2759400640 1 --2- 172.21.15.87:0/1202517005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f275c163f70 0x7f275c0b6850 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f275c15a900 tx=0x7f274801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad3160f85522266 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:27.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.520+0000 7f2758a00640 1 -- 172.21.15.87:0/1202517005 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27480b0070 con 0x7f275c163f70 2024-05-27T06:29:27.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.520+0000 7f2758a00640 1 -- 172.21.15.87:0/1202517005 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27480ab600 con 0x7f275c163f70 2024-05-27T06:29:27.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.520+0000 7f2758a00640 1 -- 172.21.15.87:0/1202517005 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27480ab9d0 con 0x7f275c163f70 2024-05-27T06:29:27.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.520+0000 7f2760a00640 1 -- 172.21.15.87:0/1202517005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f275c163f70 msgr2=0x7f275c0b6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:27.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.520+0000 7f2760a00640 1 --2- 172.21.15.87:0/1202517005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f275c163f70 0x7f275c0b6850 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f275c15a900 tx=0x7f274801c520 comp rx=0 tx=0).stop 2024-05-27T06:29:27.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.520+0000 7f2760a00640 1 -- 172.21.15.87:0/1202517005 shutdown_connections 2024-05-27T06:29:27.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.520+0000 7f2760a00640 1 --2- 172.21.15.87:0/1202517005 >> v2:172.21.15.149:3300/0 conn(0x7f275c162820 0x7f275c162c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:27.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.520+0000 7f2760a00640 1 --2- 172.21.15.87:0/1202517005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f275c163f70 0x7f275c0b6850 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:27.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.520+0000 7f2760a00640 1 -- 172.21.15.87:0/1202517005 >> 172.21.15.87:0/1202517005 conn(0x7f275c0712e0 msgr2=0x7f275c0716f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:27.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.520+0000 7f2760a00640 1 -- 172.21.15.87:0/1202517005 shutdown_connections 2024-05-27T06:29:27.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.520+0000 7f2760a00640 1 -- 172.21.15.87:0/1202517005 wait complete. 2024-05-27T06:29:27.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.524+0000 7f2760a00640 1 Processor -- start 2024-05-27T06:29:27.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.524+0000 7f2760a00640 1 -- start start 2024-05-27T06:29:27.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.524+0000 7f2760a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f275c15deb0 0x7f275c06d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:27.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.524+0000 7f2760a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f275c162820 0x7f275c1533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:27.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.524+0000 7f2760a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f275c0b0270 0x7f275c0b0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:27.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.524+0000 7f2760a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f275c15fdd0 con 0x7f275c162820 2024-05-27T06:29:27.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.524+0000 7f2760a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f275c15fc50 con 0x7f275c15deb0 2024-05-27T06:29:27.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.524+0000 7f2760a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f275c15ff50 con 0x7f275c0b0270 2024-05-27T06:29:27.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.524+0000 7f2759400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f275c162820 0x7f275c1533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:27.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.524+0000 7f2759400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f275c162820 0x7f275c1533f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41400/0 (socket says 172.21.15.87:41400) 2024-05-27T06:29:27.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.524+0000 7f2759400640 1 -- 172.21.15.87:0/1066914413 learned_addr learned my addr 172.21.15.87:0/1066914413 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:27.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.524+0000 7f275a800640 1 --2- 172.21.15.87:0/1066914413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f275c0b0270 0x7f275c0b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:27.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.524+0000 7f2759e00640 1 --2- 172.21.15.87:0/1066914413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f275c15deb0 0x7f275c06d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:27.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.524+0000 7f2759400640 1 -- 172.21.15.87:0/1066914413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f275c0b0270 msgr2=0x7f275c0b0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:27.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.524+0000 7f2759400640 1 --2- 172.21.15.87:0/1066914413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f275c0b0270 0x7f275c0b0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:27.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.524+0000 7f2759400640 1 -- 172.21.15.87:0/1066914413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f275c15deb0 msgr2=0x7f275c06d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:27.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.524+0000 7f2759400640 1 --2- 172.21.15.87:0/1066914413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f275c15deb0 0x7f275c06d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:27.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.524+0000 7f2759400640 1 -- 172.21.15.87:0/1066914413 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f275c0b0bc0 con 0x7f275c162820 2024-05-27T06:29:27.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.524+0000 7f275a800640 1 --2- 172.21.15.87:0/1066914413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f275c0b0270 0x7f275c0b0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:29:27.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.524+0000 7f2759e00640 1 --2- 172.21.15.87:0/1066914413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f275c15deb0 0x7f275c06d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:29:27.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.524+0000 7f2759400640 1 --2- 172.21.15.87:0/1066914413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f275c162820 0x7f275c1533f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f274801ca00 tx=0x7f27480192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:27.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.524+0000 7f2752000640 1 -- 172.21.15.87:0/1066914413 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27480ba070 con 0x7f275c162820 2024-05-27T06:29:27.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.524+0000 7f2752000640 1 -- 172.21.15.87:0/1066914413 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27480b4430 con 0x7f275c162820 2024-05-27T06:29:27.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.524+0000 7f2752000640 1 -- 172.21.15.87:0/1066914413 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27480b0040 con 0x7f275c162820 2024-05-27T06:29:27.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.524+0000 7f2760a00640 1 -- 172.21.15.87:0/1066914413 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f275c1565b0 con 0x7f275c162820 2024-05-27T06:29:27.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.524+0000 7f2760a00640 1 -- 172.21.15.87:0/1066914413 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f275c070570 con 0x7f275c162820 2024-05-27T06:29:27.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.528+0000 7f2760a00640 1 -- 172.21.15.87:0/1066914413 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f275c070000 con 0x7f275c162820 2024-05-27T06:29:27.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.528+0000 7f2752000640 1 -- 172.21.15.87:0/1066914413 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f27480b4800 con 0x7f275c162820 2024-05-27T06:29:27.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.528+0000 7f2752000640 1 --2- 172.21.15.87:0/1066914413 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f273c06f400 0x7f273c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:27.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.528+0000 7f2752000640 1 -- 172.21.15.87:0/1066914413 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7f2748128290 con 0x7f275c162820 2024-05-27T06:29:27.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.528+0000 7f2759e00640 1 --2- 172.21.15.87:0/1066914413 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f273c06f400 0x7f273c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:27.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.528+0000 7f2759e00640 1 --2- 172.21.15.87:0/1066914413 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f273c06f400 0x7f273c071910 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f275c0b7850 tx=0x7f274c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:27.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.532+0000 7f2752000640 1 -- 172.21.15.87:0/1066914413 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f27480eef50 con 0x7f275c162820 2024-05-27T06:29:27.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:27.704+0000 7f2760a00640 1 -- 172.21.15.87:0/1066914413 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f275c06aa30 con 0x7f275c162820 2024-05-27T06:29:28.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.280+0000 7f2752000640 1 -- 172.21.15.87:0/1066914413 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v48) ==== 97+0+0 (secure 0 0 0) 0x7f275c0b0bc0 con 0x7f275c162820 2024-05-27T06:29:28.280 INFO:teuthology.orchestra.run.smithi087.stderr: removed all blocklist entries 2024-05-27T06:29:28.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.284+0000 7f2760a00640 1 -- 172.21.15.87:0/1066914413 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f273c06f400 msgr2=0x7f273c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:28.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.284+0000 7f2760a00640 1 --2- 172.21.15.87:0/1066914413 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f273c06f400 0x7f273c071910 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f275c0b7850 tx=0x7f274c009040 comp rx=0 tx=0).stop 2024-05-27T06:29:28.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.284+0000 7f2760a00640 1 -- 172.21.15.87:0/1066914413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f275c162820 msgr2=0x7f275c1533f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:28.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.284+0000 7f2760a00640 1 --2- 172.21.15.87:0/1066914413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f275c162820 0x7f275c1533f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f274801ca00 tx=0x7f27480192c0 comp rx=0 tx=0).stop 2024-05-27T06:29:28.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.284+0000 7f2760a00640 1 -- 172.21.15.87:0/1066914413 shutdown_connections 2024-05-27T06:29:28.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.284+0000 7f2760a00640 1 --2- 172.21.15.87:0/1066914413 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f273c06f400 0x7f273c071910 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:28.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.284+0000 7f2760a00640 1 --2- 172.21.15.87:0/1066914413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f275c0b0270 0x7f275c0b0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:28.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.284+0000 7f2760a00640 1 --2- 172.21.15.87:0/1066914413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f275c162820 0x7f275c1533f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:28.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.284+0000 7f2760a00640 1 --2- 172.21.15.87:0/1066914413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f275c15deb0 0x7f275c06d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:28.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.284+0000 7f2760a00640 1 -- 172.21.15.87:0/1066914413 >> 172.21.15.87:0/1066914413 conn(0x7f275c0712e0 msgr2=0x7f275c0b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:28.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.284+0000 7f2760a00640 1 -- 172.21.15.87:0/1066914413 shutdown_connections 2024-05-27T06:29:28.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.284+0000 7f2760a00640 1 -- 172.21.15.87:0/1066914413 wait complete. 2024-05-27T06:29:28.306 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-27T06:29:28.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.456+0000 7f7a43e00640 1 Processor -- start 2024-05-27T06:29:28.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.456+0000 7f7a43e00640 1 -- start start 2024-05-27T06:29:28.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.456+0000 7f7a43e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7a440b7900 0x7f7a440b7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:28.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.456+0000 7f7a43e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a440cefe0 0x7f7a44169760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:28.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.456+0000 7f7a43e00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a440b6d60 con 0x7f7a440d2040 2024-05-27T06:29:28.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.456+0000 7f7a43e00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f7a440b7040 con 0x7f7a440b7900 2024-05-27T06:29:28.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.456+0000 7f7a43e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7a440b7320 con 0x7f7a440cefe0 2024-05-27T06:29:28.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.456+0000 7f7a42000640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f7a440d2040 0x7f7a440d2450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:38092/0 (socket says 172.21.15.87:38092) 2024-05-27T06:29:28.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.456+0000 7f7a42000640 1 -- 172.21.15.87:0/3679048220 learned_addr learned my addr 172.21.15.87:0/3679048220 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:29:28.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.456+0000 7f7a42a00640 1 --2- 172.21.15.87:0/3679048220 >> v2:172.21.15.87:3300/0 conn(0x7f7a440b7900 0x7f7a440b7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:28.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.456+0000 7f7a43400640 1 --2- 172.21.15.87:0/3679048220 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a440cefe0 0x7f7a44169760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:28.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.456+0000 7f7a41600640 1 -- 172.21.15.87:0/3679048220 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2542495177 0 0) 0x7f7a440b6d60 con 0x7f7a440d2040 2024-05-27T06:29:28.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.456+0000 7f7a42a00640 1 -- 172.21.15.87:0/3679048220 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a440cefe0 msgr2=0x7f7a44169760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:28.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.456+0000 7f7a42a00640 1 --2- 172.21.15.87:0/3679048220 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a440cefe0 0x7f7a44169760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:28.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.456+0000 7f7a42a00640 1 -- 172.21.15.87:0/3679048220 >> v1:172.21.15.87:6789/0 conn(0x7f7a440d2040 legacy=0x7f7a440d2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:28.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.456+0000 7f7a42a00640 1 -- 172.21.15.87:0/3679048220 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a440b7600 con 0x7f7a440b7900 2024-05-27T06:29:28.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.456+0000 7f7a43400640 1 --2- 172.21.15.87:0/3679048220 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a440cefe0 0x7f7a44169760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:29:28.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.460+0000 7f7a42a00640 1 --2- 172.21.15.87:0/3679048220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a440b7900 0x7f7a440b7d10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009d90 tx=0x7f7a3401f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2616886f0a54e774 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:28.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.460+0000 7f7a41600640 1 -- 172.21.15.87:0/3679048220 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a340b4070 con 0x7f7a440b7900 2024-05-27T06:29:28.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.460+0000 7f7a41600640 1 -- 172.21.15.87:0/3679048220 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a340af600 con 0x7f7a440b7900 2024-05-27T06:29:28.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.460+0000 7f7a41600640 1 -- 172.21.15.87:0/3679048220 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a340af9d0 con 0x7f7a440b7900 2024-05-27T06:29:28.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.460+0000 7f7a43e00640 1 -- 172.21.15.87:0/3679048220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a440b7900 msgr2=0x7f7a440b7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:28.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.460+0000 7f7a43e00640 1 --2- 172.21.15.87:0/3679048220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a440b7900 0x7f7a440b7d10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009d90 tx=0x7f7a3401f150 comp rx=0 tx=0).stop 2024-05-27T06:29:28.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.460+0000 7f7a43e00640 1 -- 172.21.15.87:0/3679048220 shutdown_connections 2024-05-27T06:29:28.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.460+0000 7f7a43e00640 1 --2- 172.21.15.87:0/3679048220 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a440cefe0 0x7f7a44169760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:28.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.460+0000 7f7a43e00640 1 --2- 172.21.15.87:0/3679048220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a440b7900 0x7f7a440b7d10 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:28.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.460+0000 7f7a43e00640 1 -- 172.21.15.87:0/3679048220 >> 172.21.15.87:0/3679048220 conn(0x7f7a440cfee0 msgr2=0x7f7a440d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:28.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.460+0000 7f7a43e00640 1 -- 172.21.15.87:0/3679048220 shutdown_connections 2024-05-27T06:29:28.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.460+0000 7f7a43e00640 1 -- 172.21.15.87:0/3679048220 wait complete. 2024-05-27T06:29:28.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.464+0000 7f7a43e00640 1 Processor -- start 2024-05-27T06:29:28.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.464+0000 7f7a43e00640 1 -- start start 2024-05-27T06:29:28.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.464+0000 7f7a43e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a440b7900 0x7f7a44159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:28.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.464+0000 7f7a43e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a440cefe0 0x7f7a440cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:28.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.464+0000 7f7a43e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a440d2040 0x7f7a440cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:28.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.464+0000 7f7a43e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7a44169ca0 con 0x7f7a440cefe0 2024-05-27T06:29:28.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.464+0000 7f7a43e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7a440b2c10 con 0x7f7a440d2040 2024-05-27T06:29:28.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.464+0000 7f7a43e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7a44169e20 con 0x7f7a440b7900 2024-05-27T06:29:28.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.464+0000 7f7a42000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a440cefe0 0x7f7a440cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:28.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.464+0000 7f7a42000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a440cefe0 0x7f7a440cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41422/0 (socket says 172.21.15.87:41422) 2024-05-27T06:29:28.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.464+0000 7f7a42000640 1 -- 172.21.15.87:0/3434515508 learned_addr learned my addr 172.21.15.87:0/3434515508 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:28.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.464+0000 7f7a42a00640 1 --2- 172.21.15.87:0/3434515508 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a440b7900 0x7f7a44159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:28.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.464+0000 7f7a43400640 1 --2- 172.21.15.87:0/3434515508 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a440d2040 0x7f7a440cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:28.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.468+0000 7f7a42000640 1 -- 172.21.15.87:0/3434515508 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a440b7900 msgr2=0x7f7a44159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:28.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.468+0000 7f7a42000640 1 --2- 172.21.15.87:0/3434515508 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a440b7900 0x7f7a44159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:28.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.468+0000 7f7a42000640 1 -- 172.21.15.87:0/3434515508 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a440d2040 msgr2=0x7f7a440cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:28.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.468+0000 7f7a42000640 1 --2- 172.21.15.87:0/3434515508 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a440d2040 0x7f7a440cbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:28.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.468+0000 7f7a42000640 1 -- 172.21.15.87:0/3434515508 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a4415a290 con 0x7f7a440cefe0 2024-05-27T06:29:28.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.468+0000 7f7a42000640 1 --2- 172.21.15.87:0/3434515508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a440cefe0 0x7f7a440cbaa0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7a3000c430 tx=0x7f7a3000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:28.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.468+0000 7f7a3aa00640 1 -- 172.21.15.87:0/3434515508 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a300074e0 con 0x7f7a440cefe0 2024-05-27T06:29:28.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.468+0000 7f7a3aa00640 1 -- 172.21.15.87:0/3434515508 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a300047f0 con 0x7f7a440cefe0 2024-05-27T06:29:28.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.468+0000 7f7a3aa00640 1 -- 172.21.15.87:0/3434515508 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a30004be0 con 0x7f7a440cefe0 2024-05-27T06:29:28.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.468+0000 7f7a43e00640 1 -- 172.21.15.87:0/3434515508 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a4415a570 con 0x7f7a440cefe0 2024-05-27T06:29:28.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.468+0000 7f7a43e00640 1 -- 172.21.15.87:0/3434515508 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a440ccb20 con 0x7f7a440cefe0 2024-05-27T06:29:28.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.468+0000 7f7a43e00640 1 -- 172.21.15.87:0/3434515508 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a44159b30 con 0x7f7a440cefe0 2024-05-27T06:29:28.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.468+0000 7f7a3aa00640 1 -- 172.21.15.87:0/3434515508 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7a30011070 con 0x7f7a440cefe0 2024-05-27T06:29:28.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.468+0000 7f7a3aa00640 1 --2- 172.21.15.87:0/3434515508 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7a2406f400 0x7f7a24071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:28.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.472+0000 7f7a3aa00640 1 -- 172.21.15.87:0/3434515508 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5249+0+0 (secure 0 0 0) 0x7f7a3008ebd0 con 0x7f7a440cefe0 2024-05-27T06:29:28.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.472+0000 7f7a42a00640 1 --2- 172.21.15.87:0/3434515508 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7a2406f400 0x7f7a24071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:28.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.472+0000 7f7a42a00640 1 --2- 172.21.15.87:0/3434515508 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7a2406f400 0x7f7a24071910 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7a340b1000 tx=0x7f7a340aa000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:28.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.476+0000 7f7a3aa00640 1 -- 172.21.15.87:0/3434515508 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7a3005b630 con 0x7f7a440cefe0 2024-05-27T06:29:28.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.688+0000 7f7a43e00640 1 -- 172.21.15.87:0/3434515508 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f7a4406aa30 con 0x7f7a440cefe0 2024-05-27T06:29:28.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.688+0000 7f7a3aa00640 1 -- 172.21.15.87:0/3434515508 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5298 (secure 0 0 0) 0x7f7a3005f930 con 0x7f7a440cefe0 2024-05-27T06:29:28.687 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:29:28.687 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-27T06:29:28.687 INFO:teuthology.orchestra.run.smithi087.stdout: "auth_dump": [ 2024-05-27T06:29:28.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:29:28.688 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "mds.a", 2024-05-27T06:29:28.688 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCeJ1RmervxKBAAoI8i952fjbs3eqb1PTsgIw==", 2024-05-27T06:29:28.688 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:29:28.688 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow", 2024-05-27T06:29:28.688 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow *", 2024-05-27T06:29:28.688 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow *", 2024-05-27T06:29:28.688 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:29:28.688 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:29:28.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:28.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:29:28.688 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "mds.b", 2024-05-27T06:29:28.688 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCeJ1RmUgx4NhAAG6bWGMQa3nvZwlrIuqIoPw==", 2024-05-27T06:29:28.689 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:29:28.689 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow", 2024-05-27T06:29:28.689 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow *", 2024-05-27T06:29:28.689 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow *", 2024-05-27T06:29:28.689 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:29:28.689 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:29:28.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:28.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:29:28.689 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "mds.c", 2024-05-27T06:29:28.689 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCeJ1RmHqu/MBAAL1h8SSHzJkmv2qutGkSlpw==", 2024-05-27T06:29:28.689 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:29:28.689 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow", 2024-05-27T06:29:28.689 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow *", 2024-05-27T06:29:28.689 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow *", 2024-05-27T06:29:28.690 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:29:28.690 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:29:28.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:28.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:29:28.690 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "mds.d", 2024-05-27T06:29:28.690 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCfJ1RmkhfMAhAAh2P/KsxH6TjNuN1lcdi34g==", 2024-05-27T06:29:28.690 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:29:28.690 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow", 2024-05-27T06:29:28.690 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow *", 2024-05-27T06:29:28.690 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow *", 2024-05-27T06:29:28.690 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:29:28.690 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:29:28.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:28.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:29:28.691 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "osd.0", 2024-05-27T06:29:28.691 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCiJ1RmVDNWBhAA1OmU3UT0GCj5L+VKhDGH7g==", 2024-05-27T06:29:28.691 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:29:28.691 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow profile osd", 2024-05-27T06:29:28.691 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile osd", 2024-05-27T06:29:28.691 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:29:28.691 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:29:28.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:28.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:29:28.691 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "osd.1", 2024-05-27T06:29:28.691 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQClJ1RmoDbTEhAAUG495eGC9Oj4rJ6FUu8fuw==", 2024-05-27T06:29:28.691 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:29:28.691 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow profile osd", 2024-05-27T06:29:28.692 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile osd", 2024-05-27T06:29:28.692 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:29:28.692 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:29:28.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:28.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:29:28.692 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "osd.2", 2024-05-27T06:29:28.692 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCoJ1RmKRaYHRAAxvkg0738G5fXJkSs7Op5hg==", 2024-05-27T06:29:28.692 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:29:28.692 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow profile osd", 2024-05-27T06:29:28.692 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile osd", 2024-05-27T06:29:28.692 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:29:28.692 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:29:28.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:28.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:29:28.693 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "osd.3", 2024-05-27T06:29:28.693 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCrJ1RmILNKKRAAnZgVA/Egm8DHMZ/2YQqmHA==", 2024-05-27T06:29:28.693 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:29:28.693 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow profile osd", 2024-05-27T06:29:28.693 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile osd", 2024-05-27T06:29:28.693 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:29:28.693 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:29:28.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:28.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:29:28.693 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "osd.4", 2024-05-27T06:29:28.693 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCxJ1RmlldAIRAAE7xPqjOhCXGBy8R8SetoAQ==", 2024-05-27T06:29:28.693 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:29:28.693 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow profile osd", 2024-05-27T06:29:28.693 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile osd", 2024-05-27T06:29:28.694 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:29:28.694 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:29:28.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:28.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:29:28.694 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "osd.5", 2024-05-27T06:29:28.694 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQC0J1RmctJ5LRAAJNyV09Axs44PTvNsplmyjg==", 2024-05-27T06:29:28.694 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:29:28.694 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow profile osd", 2024-05-27T06:29:28.694 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile osd", 2024-05-27T06:29:28.694 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:29:28.694 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:29:28.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:28.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:29:28.695 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "osd.6", 2024-05-27T06:29:28.695 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQC3J1RmMU3QOBAAxSaigZ2H/6Rh/9zzFjD2EQ==", 2024-05-27T06:29:28.695 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:29:28.695 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow profile osd", 2024-05-27T06:29:28.695 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile osd", 2024-05-27T06:29:28.695 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:29:28.695 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:29:28.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:28.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:29:28.695 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "osd.7", 2024-05-27T06:29:28.695 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQC7J1RmhVUWCBAAsehamp4zjDXhU3shpMkqrQ==", 2024-05-27T06:29:28.695 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:29:28.695 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow profile osd", 2024-05-27T06:29:28.695 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile osd", 2024-05-27T06:29:28.696 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:29:28.696 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:29:28.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:28.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:29:28.696 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "client.0", 2024-05-27T06:29:28.696 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCfJ1RmAld8BxAAigqU2F3mGXtAfw0L9Bfp2A==", 2024-05-27T06:29:28.696 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:29:28.696 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow", 2024-05-27T06:29:28.696 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow r", 2024-05-27T06:29:28.696 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow rw pool=cephfs_data" 2024-05-27T06:29:28.696 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:29:28.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:28.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:29:28.696 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "client.1", 2024-05-27T06:29:28.697 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCfJ1RmZDSHDxAAv5a4tqOVEtCQpM2NLf/Hhw==", 2024-05-27T06:29:28.697 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:29:28.697 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow", 2024-05-27T06:29:28.697 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow r", 2024-05-27T06:29:28.697 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow rw", 2024-05-27T06:29:28.697 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow rwx" 2024-05-27T06:29:28.697 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:29:28.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:28.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:29:28.697 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "client.2", 2024-05-27T06:29:28.697 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCfJ1RmUByHCxAASgfa8jGPseHppkHqVMb++Q==", 2024-05-27T06:29:28.697 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:29:28.697 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow", 2024-05-27T06:29:28.697 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow r", 2024-05-27T06:29:28.698 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow rw", 2024-05-27T06:29:28.698 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow rwx" 2024-05-27T06:29:28.698 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:29:28.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:28.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:29:28.698 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "client.3", 2024-05-27T06:29:28.698 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCfJ1Rm2gSgExAAzkY0fRetTrfU8VqBpP3GJQ==", 2024-05-27T06:29:28.698 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:29:28.698 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow", 2024-05-27T06:29:28.698 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow r", 2024-05-27T06:29:28.698 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow rw", 2024-05-27T06:29:28.698 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow rwx" 2024-05-27T06:29:28.698 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:29:28.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:28.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:29:28.699 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "client.admin", 2024-05-27T06:29:28.699 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCeJ1Rm6DrNCBAAE7UK9ea59/Ferleyl8efMQ==", 2024-05-27T06:29:28.699 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:29:28.699 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow *", 2024-05-27T06:29:28.699 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow *", 2024-05-27T06:29:28.699 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow *", 2024-05-27T06:29:28.699 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:29:28.699 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:29:28.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:28.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:29:28.699 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "mgr.x", 2024-05-27T06:29:28.700 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCeJ1Rmf+/gIxAA4Spz0TeMdwjCMfsfGi1+lQ==", 2024-05-27T06:29:28.700 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:29:28.700 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow *", 2024-05-27T06:29:28.700 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile mgr", 2024-05-27T06:29:28.700 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:29:28.700 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:29:28.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:28.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:29:28.700 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "mgr.y", 2024-05-27T06:29:28.700 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQCeJ1RmMh1fHxAAV0EJocBVjB0EIzmInIZFVw==", 2024-05-27T06:29:28.700 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2024-05-27T06:29:28.700 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow *", 2024-05-27T06:29:28.700 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile mgr", 2024-05-27T06:29:28.700 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2024-05-27T06:29:28.700 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:29:28.701 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:29:28.701 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-05-27T06:29:28.701 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-27T06:29:28.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.688+0000 7f7a43e00640 1 -- 172.21.15.87:0/3434515508 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7a2406f400 msgr2=0x7f7a24071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:28.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.688+0000 7f7a43e00640 1 --2- 172.21.15.87:0/3434515508 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7a2406f400 0x7f7a24071910 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7a340b1000 tx=0x7f7a340aa000 comp rx=0 tx=0).stop 2024-05-27T06:29:28.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.688+0000 7f7a43e00640 1 -- 172.21.15.87:0/3434515508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a440cefe0 msgr2=0x7f7a440cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:28.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.688+0000 7f7a43e00640 1 --2- 172.21.15.87:0/3434515508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a440cefe0 0x7f7a440cbaa0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7a3000c430 tx=0x7f7a3000c8f0 comp rx=0 tx=0).stop 2024-05-27T06:29:28.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.688+0000 7f7a43e00640 1 -- 172.21.15.87:0/3434515508 shutdown_connections 2024-05-27T06:29:28.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.688+0000 7f7a43e00640 1 --2- 172.21.15.87:0/3434515508 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7a2406f400 0x7f7a24071910 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:28.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.688+0000 7f7a43e00640 1 --2- 172.21.15.87:0/3434515508 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a440d2040 0x7f7a440cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:28.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.688+0000 7f7a43e00640 1 --2- 172.21.15.87:0/3434515508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a440cefe0 0x7f7a440cbaa0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:28.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.688+0000 7f7a43e00640 1 --2- 172.21.15.87:0/3434515508 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7a440b7900 0x7f7a44159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:28.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.688+0000 7f7a43e00640 1 -- 172.21.15.87:0/3434515508 >> 172.21.15.87:0/3434515508 conn(0x7f7a440cfee0 msgr2=0x7f7a440c8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:28.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.692+0000 7f7a43e00640 1 -- 172.21.15.87:0/3434515508 shutdown_connections 2024-05-27T06:29:28.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.692+0000 7f7a43e00640 1 -- 172.21.15.87:0/3434515508 wait complete. 2024-05-27T06:29:28.710 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-27T06:29:28.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.856+0000 7f8bac800640 1 Processor -- start 2024-05-27T06:29:28.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.856+0000 7f8bac800640 1 -- start start 2024-05-27T06:29:28.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.860+0000 7f8bac800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8ba4072eb0 0x7f8ba40d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:28.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.860+0000 7f8bac800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ba40d1c80 0x7f8ba40ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:28.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.860+0000 7f8bac800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ba40d2090 con 0x7f8ba4072aa0 2024-05-27T06:29:28.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.860+0000 7f8bac800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f8ba40cdd30 con 0x7f8ba4072eb0 2024-05-27T06:29:28.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.860+0000 7f8bac800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8ba40cd120 con 0x7f8ba40d1c80 2024-05-27T06:29:28.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.860+0000 7f8ba9e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8ba4072aa0 0x7f8ba406d820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:38098/0 (socket says 172.21.15.87:38098) 2024-05-27T06:29:28.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.860+0000 7f8ba9e00640 1 -- 172.21.15.87:0/3959829188 learned_addr learned my addr 172.21.15.87:0/3959829188 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:29:28.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.860+0000 7f8ba9400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8ba4072eb0 0x7f8ba40d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:28.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.860+0000 7f8baa800640 1 --2- 172.21.15.87:0/3959829188 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ba40d1c80 0x7f8ba40ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:28.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.860+0000 7f8ba8a00640 1 -- 172.21.15.87:0/3959829188 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2056081101 0 0) 0x7f8ba40d2090 con 0x7f8ba4072aa0 2024-05-27T06:29:28.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.860+0000 7f8ba8a00640 1 -- 172.21.15.87:0/3959829188 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b8c003530 con 0x7f8ba4072aa0 2024-05-27T06:29:28.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.860+0000 7f8ba9400640 1 -- 172.21.15.87:0/3959829188 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ba40d1c80 msgr2=0x7f8ba40ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:28.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.860+0000 7f8ba9400640 1 --2- 172.21.15.87:0/3959829188 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ba40d1c80 0x7f8ba40ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:28.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.860+0000 7f8ba9400640 1 -- 172.21.15.87:0/3959829188 >> v1:172.21.15.87:6789/0 conn(0x7f8ba4072aa0 legacy=0x7f8ba406d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:28.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.860+0000 7f8ba9400640 1 -- 172.21.15.87:0/3959829188 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba40cd400 con 0x7f8ba4072eb0 2024-05-27T06:29:28.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.864+0000 7f8ba9400640 1 --2- 172.21.15.87:0/3959829188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ba4072eb0 0x7f8ba40d1740 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8b940097c0 tx=0x7f8b9401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838e99a7ffdbb50d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:28.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.864+0000 7f8ba8a00640 1 -- 172.21.15.87:0/3959829188 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b940a7070 con 0x7f8ba4072eb0 2024-05-27T06:29:28.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.864+0000 7f8ba8a00640 1 -- 172.21.15.87:0/3959829188 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b940b0070 con 0x7f8ba4072eb0 2024-05-27T06:29:28.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.864+0000 7f8ba8a00640 1 -- 172.21.15.87:0/3959829188 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b940ab870 con 0x7f8ba4072eb0 2024-05-27T06:29:28.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.864+0000 7f8bac800640 1 -- 172.21.15.87:0/3959829188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ba4072eb0 msgr2=0x7f8ba40d1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:28.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.864+0000 7f8bac800640 1 --2- 172.21.15.87:0/3959829188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ba4072eb0 0x7f8ba40d1740 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8b940097c0 tx=0x7f8b9401c470 comp rx=0 tx=0).stop 2024-05-27T06:29:28.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.864+0000 7f8bac800640 1 -- 172.21.15.87:0/3959829188 shutdown_connections 2024-05-27T06:29:28.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.864+0000 7f8bac800640 1 --2- 172.21.15.87:0/3959829188 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ba40d1c80 0x7f8ba40ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:28.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.864+0000 7f8bac800640 1 --2- 172.21.15.87:0/3959829188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ba4072eb0 0x7f8ba40d1740 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:28.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.864+0000 7f8bac800640 1 -- 172.21.15.87:0/3959829188 >> 172.21.15.87:0/3959829188 conn(0x7f8ba40b46b0 msgr2=0x7f8ba40b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:28.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.864+0000 7f8bac800640 1 -- 172.21.15.87:0/3959829188 shutdown_connections 2024-05-27T06:29:28.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.864+0000 7f8bac800640 1 -- 172.21.15.87:0/3959829188 wait complete. 2024-05-27T06:29:28.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.868+0000 7f8bac800640 1 Processor -- start 2024-05-27T06:29:28.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.868+0000 7f8bac800640 1 -- start start 2024-05-27T06:29:28.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.868+0000 7f8bac800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ba4072aa0 0x7f8ba41600a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:28.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.868+0000 7f8bac800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ba4072eb0 0x7f8ba415d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:28.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.868+0000 7f8bac800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ba40d1c80 0x7f8ba415c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:28.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.868+0000 7f8bac800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba40cccb0 con 0x7f8ba40d1c80 2024-05-27T06:29:28.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.868+0000 7f8bac800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba406df30 con 0x7f8ba4072aa0 2024-05-27T06:29:28.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.868+0000 7f8bac800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8ba40cce30 con 0x7f8ba4072eb0 2024-05-27T06:29:28.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.868+0000 7f8baa800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ba40d1c80 0x7f8ba415c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:28.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.868+0000 7f8baa800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ba40d1c80 0x7f8ba415c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41442/0 (socket says 172.21.15.87:41442) 2024-05-27T06:29:28.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.868+0000 7f8baa800640 1 -- 172.21.15.87:0/2891268155 learned_addr learned my addr 172.21.15.87:0/2891268155 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:28.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.868+0000 7f8ba9e00640 1 --2- 172.21.15.87:0/2891268155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ba4072aa0 0x7f8ba41600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:28.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.868+0000 7f8ba9400640 1 --2- 172.21.15.87:0/2891268155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ba4072eb0 0x7f8ba415d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:28.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.868+0000 7f8baa800640 1 -- 172.21.15.87:0/2891268155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ba4072eb0 msgr2=0x7f8ba415d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:28.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.868+0000 7f8baa800640 1 --2- 172.21.15.87:0/2891268155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ba4072eb0 0x7f8ba415d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:28.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.868+0000 7f8baa800640 1 -- 172.21.15.87:0/2891268155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ba4072aa0 msgr2=0x7f8ba41600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:28.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.868+0000 7f8baa800640 1 --2- 172.21.15.87:0/2891268155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ba4072aa0 0x7f8ba41600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:28.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.868+0000 7f8baa800640 1 -- 172.21.15.87:0/2891268155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba415e310 con 0x7f8ba40d1c80 2024-05-27T06:29:28.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.868+0000 7f8baa800640 1 --2- 172.21.15.87:0/2891268155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ba40d1c80 0x7f8ba415c030 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0007e60 tx=0x7f8ba000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:28.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.868+0000 7f8b9e000640 1 -- 172.21.15.87:0/2891268155 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0014420 con 0x7f8ba40d1c80 2024-05-27T06:29:28.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.868+0000 7f8b9e000640 1 -- 172.21.15.87:0/2891268155 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba0019070 con 0x7f8ba40d1c80 2024-05-27T06:29:28.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.868+0000 7f8bac800640 1 -- 172.21.15.87:0/2891268155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba41605e0 con 0x7f8ba40d1c80 2024-05-27T06:29:28.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.868+0000 7f8b9e000640 1 -- 172.21.15.87:0/2891268155 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0014820 con 0x7f8ba40d1c80 2024-05-27T06:29:28.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.868+0000 7f8bac800640 1 -- 172.21.15.87:0/2891268155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba4161000 con 0x7f8ba40d1c80 2024-05-27T06:29:28.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.872+0000 7f8bac800640 1 -- 172.21.15.87:0/2891268155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba4160d70 con 0x7f8ba40d1c80 2024-05-27T06:29:28.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.872+0000 7f8b9e000640 1 -- 172.21.15.87:0/2891268155 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8ba00149c0 con 0x7f8ba40d1c80 2024-05-27T06:29:28.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.872+0000 7f8b9e000640 1 --2- 172.21.15.87:0/2891268155 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f8b8806f400 0x7f8b88071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:28.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.872+0000 7f8b9e000640 1 -- 172.21.15.87:0/2891268155 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5249+0+0 (secure 0 0 0) 0x7f8ba008f8c0 con 0x7f8ba40d1c80 2024-05-27T06:29:28.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.872+0000 7f8ba9e00640 1 --2- 172.21.15.87:0/2891268155 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f8b8806f400 0x7f8b88071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:28.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.872+0000 7f8ba9e00640 1 --2- 172.21.15.87:0/2891268155 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f8b8806f400 0x7f8b88071910 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8b98007a70 tx=0x7f8b980079c0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:28.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:28.876+0000 7f8b9e000640 1 -- 172.21.15.87:0/2891268155 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f8ba005c280 con 0x7f8ba40d1c80 2024-05-27T06:29:29.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.036+0000 7f8bac800640 1 -- 172.21.15.87:0/2891268155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8ba406d950 con 0x7f8ba40d1c80 2024-05-27T06:29:29.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.036+0000 7f8b9e000640 1 -- 172.21.15.87:0/2891268155 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v50) ==== 84+0+65 (secure 0 0 0) 0x7f8ba0060580 con 0x7f8ba40d1c80 2024-05-27T06:29:29.035 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:29:29.035 INFO:teuthology.orchestra.run.smithi087.stdout:[ 2024-05-27T06:29:29.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-27T06:29:29.036 INFO:teuthology.orchestra.run.smithi087.stdout: "poolnum": 1, 2024-05-27T06:29:29.036 INFO:teuthology.orchestra.run.smithi087.stdout: "poolname": ".mgr" 2024-05-27T06:29:29.036 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:29:29.036 INFO:teuthology.orchestra.run.smithi087.stdout:] 2024-05-27T06:29:29.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.036+0000 7f8bac800640 1 -- 172.21.15.87:0/2891268155 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f8b8806f400 msgr2=0x7f8b88071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:29.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.036+0000 7f8bac800640 1 --2- 172.21.15.87:0/2891268155 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f8b8806f400 0x7f8b88071910 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8b98007a70 tx=0x7f8b980079c0 comp rx=0 tx=0).stop 2024-05-27T06:29:29.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.036+0000 7f8bac800640 1 -- 172.21.15.87:0/2891268155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ba40d1c80 msgr2=0x7f8ba415c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:29.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.036+0000 7f8bac800640 1 --2- 172.21.15.87:0/2891268155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ba40d1c80 0x7f8ba415c030 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0007e60 tx=0x7f8ba000e4b0 comp rx=0 tx=0).stop 2024-05-27T06:29:29.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.036+0000 7f8bac800640 1 -- 172.21.15.87:0/2891268155 shutdown_connections 2024-05-27T06:29:29.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.036+0000 7f8bac800640 1 --2- 172.21.15.87:0/2891268155 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f8b8806f400 0x7f8b88071910 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:29.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.036+0000 7f8bac800640 1 --2- 172.21.15.87:0/2891268155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ba40d1c80 0x7f8ba415c030 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:29.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.036+0000 7f8bac800640 1 --2- 172.21.15.87:0/2891268155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ba4072eb0 0x7f8ba415d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:29.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.036+0000 7f8bac800640 1 --2- 172.21.15.87:0/2891268155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ba4072aa0 0x7f8ba41600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:29.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.036+0000 7f8bac800640 1 -- 172.21.15.87:0/2891268155 >> 172.21.15.87:0/2891268155 conn(0x7f8ba40b46b0 msgr2=0x7f8ba4167ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:29.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.036+0000 7f8bac800640 1 -- 172.21.15.87:0/2891268155 shutdown_connections 2024-05-27T06:29:29.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.036+0000 7f8bac800640 1 -- 172.21.15.87:0/2891268155 wait complete. 2024-05-27T06:29:29.057 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-27T06:29:29.057 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-27T06:29:29.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.208+0000 7f76d9e00640 1 Processor -- start 2024-05-27T06:29:29.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.208+0000 7f76d9e00640 1 -- start start 2024-05-27T06:29:29.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.208+0000 7f76d9e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f76d40b43b0 0x7f76d40b69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:29.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.208+0000 7f76d9e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f76d40b47c0 0x7f76d40b6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:29.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.208+0000 7f76d9e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76d415e370 con 0x7f76d40d1fe0 2024-05-27T06:29:29.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.208+0000 7f76d9e00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f76d40b3310 con 0x7f76d40b43b0 2024-05-27T06:29:29.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.208+0000 7f76d9e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f76d40b35f0 con 0x7f76d40b47c0 2024-05-27T06:29:29.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.208+0000 7f76d2a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f76d40b43b0 0x7f76d40b69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:29.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.208+0000 7f76d2a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f76d40b43b0 0x7f76d40b69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41450/0 (socket says 172.21.15.87:41450) 2024-05-27T06:29:29.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.208+0000 7f76d2a00640 1 -- 172.21.15.87:0/905212971 learned_addr learned my addr 172.21.15.87:0/905212971 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:29.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.212+0000 7f76ca000640 1 --2- 172.21.15.87:0/905212971 >> v2:172.21.15.149:3300/0 conn(0x7f76d40b47c0 0x7f76d40b6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:29.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.212+0000 7f76d2a00640 1 -- 172.21.15.87:0/905212971 >> v2:172.21.15.149:3300/0 conn(0x7f76d40b47c0 msgr2=0x7f76d40b6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:29.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.212+0000 7f76d2a00640 1 --2- 172.21.15.87:0/905212971 >> v2:172.21.15.149:3300/0 conn(0x7f76d40b47c0 0x7f76d40b6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:29.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.212+0000 7f76d2a00640 1 -- 172.21.15.87:0/905212971 >> v1:172.21.15.149:6789/0 conn(0x7f76d40d1fe0 legacy=0x7f76d40d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:29.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.212+0000 7f76d2a00640 1 -- 172.21.15.87:0/905212971 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d40b38d0 con 0x7f76d40b43b0 2024-05-27T06:29:29.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.212+0000 7f76d2a00640 1 --2- 172.21.15.87:0/905212971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76d40b43b0 0x7f76d40b69f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f76d4073df0 tx=0x7f76c401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934cef93f2d85f6b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:29.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.212+0000 7f76d2000640 1 -- 172.21.15.87:0/905212971 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c40b0070 con 0x7f76d40b43b0 2024-05-27T06:29:29.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.212+0000 7f76d2000640 1 -- 172.21.15.87:0/905212971 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76c40ab600 con 0x7f76d40b43b0 2024-05-27T06:29:29.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.212+0000 7f76d2000640 1 -- 172.21.15.87:0/905212971 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c40ab9d0 con 0x7f76d40b43b0 2024-05-27T06:29:29.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.216+0000 7f76d9e00640 1 -- 172.21.15.87:0/905212971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76d40b43b0 msgr2=0x7f76d40b69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:29.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.216+0000 7f76d9e00640 1 --2- 172.21.15.87:0/905212971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76d40b43b0 0x7f76d40b69f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f76d4073df0 tx=0x7f76c401c490 comp rx=0 tx=0).stop 2024-05-27T06:29:29.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.216+0000 7f76d9e00640 1 -- 172.21.15.87:0/905212971 shutdown_connections 2024-05-27T06:29:29.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.216+0000 7f76d9e00640 1 --2- 172.21.15.87:0/905212971 >> v2:172.21.15.149:3300/0 conn(0x7f76d40b47c0 0x7f76d40b6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:29.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.216+0000 7f76d9e00640 1 --2- 172.21.15.87:0/905212971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76d40b43b0 0x7f76d40b69f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:29.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.216+0000 7f76d9e00640 1 -- 172.21.15.87:0/905212971 >> 172.21.15.87:0/905212971 conn(0x7f76d40d3580 msgr2=0x7f76d40d3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:29.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.216+0000 7f76d9e00640 1 -- 172.21.15.87:0/905212971 shutdown_connections 2024-05-27T06:29:29.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.216+0000 7f76d9e00640 1 -- 172.21.15.87:0/905212971 wait complete. 2024-05-27T06:29:29.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.216+0000 7f76d9e00640 1 Processor -- start 2024-05-27T06:29:29.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.216+0000 7f76d9e00640 1 -- start start 2024-05-27T06:29:29.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.220+0000 7f76d9e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76d40b43b0 0x7f76d4168010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:29.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.220+0000 7f76d9e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76d40b47c0 0x7f76d40cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:29.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.220+0000 7f76d9e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76d40d1fe0 0x7f76d415e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:29.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.220+0000 7f76d9e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f76d4162930 con 0x7f76d40b43b0 2024-05-27T06:29:29.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.220+0000 7f76d9e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f76d41627b0 con 0x7f76d40b47c0 2024-05-27T06:29:29.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.220+0000 7f76d9e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f76d416b5d0 con 0x7f76d40d1fe0 2024-05-27T06:29:29.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.220+0000 7f76d2a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76d40b43b0 0x7f76d4168010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:29.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.220+0000 7f76d2a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76d40b43b0 0x7f76d4168010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41466/0 (socket says 172.21.15.87:41466) 2024-05-27T06:29:29.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.220+0000 7f76d2a00640 1 -- 172.21.15.87:0/2782966432 learned_addr learned my addr 172.21.15.87:0/2782966432 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:29.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.220+0000 7f76ca000640 1 --2- 172.21.15.87:0/2782966432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76d40b47c0 0x7f76d40cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:29.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.220+0000 7f76d3400640 1 --2- 172.21.15.87:0/2782966432 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76d40d1fe0 0x7f76d415e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:29.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.220+0000 7f76d2a00640 1 -- 172.21.15.87:0/2782966432 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76d40d1fe0 msgr2=0x7f76d415e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:29.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.220+0000 7f76d2a00640 1 --2- 172.21.15.87:0/2782966432 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76d40d1fe0 0x7f76d415e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:29.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.220+0000 7f76d2a00640 1 -- 172.21.15.87:0/2782966432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76d40b47c0 msgr2=0x7f76d40cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:29.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.220+0000 7f76d2a00640 1 --2- 172.21.15.87:0/2782966432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76d40b47c0 0x7f76d40cc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:29.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.220+0000 7f76d2a00640 1 -- 172.21.15.87:0/2782966432 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d4158ba0 con 0x7f76d40b43b0 2024-05-27T06:29:29.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.220+0000 7f76d2a00640 1 --2- 172.21.15.87:0/2782966432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76d40b43b0 0x7f76d4168010 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f76c40ae040 tx=0x7f76c401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:29.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.220+0000 7f76cbe00640 1 -- 172.21.15.87:0/2782966432 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c40b0040 con 0x7f76d40b43b0 2024-05-27T06:29:29.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.220+0000 7f76cbe00640 1 -- 172.21.15.87:0/2782966432 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76c40bc070 con 0x7f76d40b43b0 2024-05-27T06:29:29.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.220+0000 7f76cbe00640 1 -- 172.21.15.87:0/2782966432 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c40b6880 con 0x7f76d40b43b0 2024-05-27T06:29:29.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.220+0000 7f76d9e00640 1 -- 172.21.15.87:0/2782966432 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76d41590d0 con 0x7f76d40b43b0 2024-05-27T06:29:29.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.220+0000 7f76d9e00640 1 -- 172.21.15.87:0/2782966432 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76d4159690 con 0x7f76d40b43b0 2024-05-27T06:29:29.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.220+0000 7f76d9e00640 1 -- 172.21.15.87:0/2782966432 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76d406aa30 con 0x7f76d40b43b0 2024-05-27T06:29:29.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.220+0000 7f76cbe00640 1 -- 172.21.15.87:0/2782966432 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f76c40ab4c0 con 0x7f76d40b43b0 2024-05-27T06:29:29.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.224+0000 7f76cbe00640 1 --2- 172.21.15.87:0/2782966432 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f76b006f430 0x7f76b0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:29.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.224+0000 7f76cbe00640 1 -- 172.21.15.87:0/2782966432 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5249+0+0 (secure 0 0 0) 0x7f76c4129350 con 0x7f76d40b43b0 2024-05-27T06:29:29.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.224+0000 7f76ca000640 1 --2- 172.21.15.87:0/2782966432 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f76b006f430 0x7f76b0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:29.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.224+0000 7f76ca000640 1 --2- 172.21.15.87:0/2782966432 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f76b006f430 0x7f76b0071940 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f76d415f2b0 tx=0x7f76bc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:29.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.228+0000 7f76cbe00640 1 -- 172.21.15.87:0/2782966432 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f76c4016110 con 0x7f76d40b43b0 2024-05-27T06:29:29.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:29.388+0000 7f76d9e00640 1 -- 172.21.15.87:0/2782966432 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f76d40d1870 con 0x7f76d40b43b0 2024-05-27T06:29:30.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.292+0000 7f76cbe00640 1 -- 172.21.15.87:0/2782966432 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v51) ==== 138+0+0 (secure 0 0 0) 0x7f76c40f5d10 con 0x7f76d40b43b0 2024-05-27T06:29:30.293 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_metadata' created 2024-05-27T06:29:30.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.296+0000 7f76d9e00640 1 -- 172.21.15.87:0/2782966432 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f76b006f430 msgr2=0x7f76b0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:30.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.296+0000 7f76d9e00640 1 --2- 172.21.15.87:0/2782966432 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f76b006f430 0x7f76b0071940 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f76d415f2b0 tx=0x7f76bc008040 comp rx=0 tx=0).stop 2024-05-27T06:29:30.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.296+0000 7f76d9e00640 1 -- 172.21.15.87:0/2782966432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76d40b43b0 msgr2=0x7f76d4168010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:30.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.296+0000 7f76d9e00640 1 --2- 172.21.15.87:0/2782966432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76d40b43b0 0x7f76d4168010 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f76c40ae040 tx=0x7f76c401acd0 comp rx=0 tx=0).stop 2024-05-27T06:29:30.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.296+0000 7f76d9e00640 1 -- 172.21.15.87:0/2782966432 shutdown_connections 2024-05-27T06:29:30.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.296+0000 7f76d9e00640 1 --2- 172.21.15.87:0/2782966432 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f76b006f430 0x7f76b0071940 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:30.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.296+0000 7f76d9e00640 1 --2- 172.21.15.87:0/2782966432 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76d40d1fe0 0x7f76d415e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:30.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.296+0000 7f76d9e00640 1 --2- 172.21.15.87:0/2782966432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76d40b47c0 0x7f76d40cc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:30.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.296+0000 7f76d9e00640 1 --2- 172.21.15.87:0/2782966432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76d40b43b0 0x7f76d4168010 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:30.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.296+0000 7f76d9e00640 1 -- 172.21.15.87:0/2782966432 >> 172.21.15.87:0/2782966432 conn(0x7f76d40d3580 msgr2=0x7f76d4160550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:30.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.296+0000 7f76d9e00640 1 -- 172.21.15.87:0/2782966432 shutdown_connections 2024-05-27T06:29:30.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.296+0000 7f76d9e00640 1 -- 172.21.15.87:0/2782966432 wait complete. 2024-05-27T06:29:30.325 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-27T06:29:30.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.480+0000 7ff532200640 1 Processor -- start 2024-05-27T06:29:30.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.480+0000 7ff532200640 1 -- start start 2024-05-27T06:29:30.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.484+0000 7ff532200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff52c0d1700 0x7ff52c0d1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:30.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.484+0000 7ff532200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff52c06eb20 0x7ff52c06ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:30.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.484+0000 7ff532200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff52c0d1130 con 0x7ff52c1610c0 2024-05-27T06:29:30.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.484+0000 7ff532200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7ff52c0d2050 con 0x7ff52c06eb20 2024-05-27T06:29:30.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.484+0000 7ff532200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7ff52c0d0e50 con 0x7ff52c0d1700 2024-05-27T06:29:30.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.484+0000 7ff52be00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff52c06eb20 0x7ff52c06ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:30.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.484+0000 7ff52be00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff52c06eb20 0x7ff52c06ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41476/0 (socket says 172.21.15.87:41476) 2024-05-27T06:29:30.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.484+0000 7ff52be00640 1 -- 172.21.15.87:0/2610229593 learned_addr learned my addr 172.21.15.87:0/2610229593 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:30.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.484+0000 7ff522a00640 1 --2- 172.21.15.87:0/2610229593 >> v2:172.21.15.149:3300/0 conn(0x7ff52c0d1700 0x7ff52c0d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:30.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.484+0000 7ff52be00640 1 -- 172.21.15.87:0/2610229593 >> v2:172.21.15.149:3300/0 conn(0x7ff52c0d1700 msgr2=0x7ff52c0d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:30.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.484+0000 7ff52be00640 1 --2- 172.21.15.87:0/2610229593 >> v2:172.21.15.149:3300/0 conn(0x7ff52c0d1700 0x7ff52c0d1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:30.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.484+0000 7ff52be00640 1 -- 172.21.15.87:0/2610229593 >> v1:172.21.15.149:6789/0 conn(0x7ff52c1610c0 legacy=0x7ff52c0d02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:30.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.484+0000 7ff52be00640 1 -- 172.21.15.87:0/2610229593 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff52c161a00 con 0x7ff52c06eb20 2024-05-27T06:29:30.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.488+0000 7ff52be00640 1 --2- 172.21.15.87:0/2610229593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff52c06eb20 0x7ff52c06ef30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff52c0b0df0 tx=0x7ff52401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f72d90a84435d9e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:30.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.488+0000 7ff52aa00640 1 -- 172.21.15.87:0/2610229593 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5240a58b0 con 0x7ff52c06eb20 2024-05-27T06:29:30.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.488+0000 7ff52aa00640 1 -- 172.21.15.87:0/2610229593 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5240a5a50 con 0x7ff52c06eb20 2024-05-27T06:29:30.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.488+0000 7ff52aa00640 1 -- 172.21.15.87:0/2610229593 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5240a5e20 con 0x7ff52c06eb20 2024-05-27T06:29:30.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.488+0000 7ff532200640 1 -- 172.21.15.87:0/2610229593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff52c06eb20 msgr2=0x7ff52c06ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:30.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.488+0000 7ff532200640 1 --2- 172.21.15.87:0/2610229593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff52c06eb20 0x7ff52c06ef30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff52c0b0df0 tx=0x7ff52401c9f0 comp rx=0 tx=0).stop 2024-05-27T06:29:30.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.488+0000 7ff532200640 1 -- 172.21.15.87:0/2610229593 shutdown_connections 2024-05-27T06:29:30.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.488+0000 7ff532200640 1 --2- 172.21.15.87:0/2610229593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff52c06eb20 0x7ff52c06ef30 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:30.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.488+0000 7ff532200640 1 --2- 172.21.15.87:0/2610229593 >> v2:172.21.15.149:3300/0 conn(0x7ff52c0d1700 0x7ff52c0d1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:30.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.488+0000 7ff532200640 1 -- 172.21.15.87:0/2610229593 >> 172.21.15.87:0/2610229593 conn(0x7ff52c0b46b0 msgr2=0x7ff52c0b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:30.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.488+0000 7ff532200640 1 -- 172.21.15.87:0/2610229593 shutdown_connections 2024-05-27T06:29:30.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.488+0000 7ff532200640 1 -- 172.21.15.87:0/2610229593 wait complete. 2024-05-27T06:29:30.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.492+0000 7ff532200640 1 Processor -- start 2024-05-27T06:29:30.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.492+0000 7ff532200640 1 -- start start 2024-05-27T06:29:30.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.492+0000 7ff532200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff52c06eb20 0x7ff52c154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:30.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.492+0000 7ff532200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff52c0d1700 0x7ff52c1fb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:30.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.492+0000 7ff532200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff52c1610c0 0x7ff52c1fbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:30.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.492+0000 7ff532200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff52c1614d0 con 0x7ff52c1610c0 2024-05-27T06:29:30.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.492+0000 7ff532200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff52c147a30 con 0x7ff52c0d1700 2024-05-27T06:29:30.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.492+0000 7ff532200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff52c161650 con 0x7ff52c06eb20 2024-05-27T06:29:30.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.492+0000 7ff52be00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff52c1610c0 0x7ff52c1fbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:30.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.492+0000 7ff52be00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff52c1610c0 0x7ff52c1fbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41478/0 (socket says 172.21.15.87:41478) 2024-05-27T06:29:30.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.492+0000 7ff52be00640 1 -- 172.21.15.87:0/617821637 learned_addr learned my addr 172.21.15.87:0/617821637 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:30.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.492+0000 7ff52b400640 1 --2- 172.21.15.87:0/617821637 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff52c06eb20 0x7ff52c154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:30.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.492+0000 7ff522a00640 1 --2- 172.21.15.87:0/617821637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff52c0d1700 0x7ff52c1fb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:30.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.492+0000 7ff52be00640 1 -- 172.21.15.87:0/617821637 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff52c06eb20 msgr2=0x7ff52c154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:30.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.492+0000 7ff52be00640 1 --2- 172.21.15.87:0/617821637 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff52c06eb20 0x7ff52c154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:30.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.492+0000 7ff52be00640 1 -- 172.21.15.87:0/617821637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff52c0d1700 msgr2=0x7ff52c1fb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:30.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.492+0000 7ff52be00640 1 --2- 172.21.15.87:0/617821637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff52c0d1700 0x7ff52c1fb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:30.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.492+0000 7ff52be00640 1 -- 172.21.15.87:0/617821637 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff52c146b30 con 0x7ff52c1610c0 2024-05-27T06:29:30.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.492+0000 7ff52be00640 1 --2- 172.21.15.87:0/617821637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff52c1610c0 0x7ff52c1fbae0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff524019600 tx=0x7ff524019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:30.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.492+0000 7ff523e00640 1 -- 172.21.15.87:0/617821637 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5240a58b0 con 0x7ff52c1610c0 2024-05-27T06:29:30.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.492+0000 7ff523e00640 1 -- 172.21.15.87:0/617821637 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5240be070 con 0x7ff52c1610c0 2024-05-27T06:29:30.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.492+0000 7ff532200640 1 -- 172.21.15.87:0/617821637 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff52c1468c0 con 0x7ff52c1610c0 2024-05-27T06:29:30.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.492+0000 7ff523e00640 1 -- 172.21.15.87:0/617821637 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff524009510 con 0x7ff52c1610c0 2024-05-27T06:29:30.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.492+0000 7ff532200640 1 -- 172.21.15.87:0/617821637 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff52c1595b0 con 0x7ff52c1610c0 2024-05-27T06:29:30.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.496+0000 7ff532200640 1 -- 172.21.15.87:0/617821637 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff52c146da0 con 0x7ff52c1610c0 2024-05-27T06:29:30.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.496+0000 7ff523e00640 1 -- 172.21.15.87:0/617821637 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff5240b8470 con 0x7ff52c1610c0 2024-05-27T06:29:30.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.496+0000 7ff523e00640 1 --2- 172.21.15.87:0/617821637 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff50806f430 0x7ff508071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:30.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.496+0000 7ff523e00640 1 -- 172.21.15.87:0/617821637 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5619+0+0 (secure 0 0 0) 0x7ff52412afe0 con 0x7ff52c1610c0 2024-05-27T06:29:30.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.496+0000 7ff52b400640 1 --2- 172.21.15.87:0/617821637 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff50806f430 0x7ff508071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:30.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.500+0000 7ff52b400640 1 --2- 172.21.15.87:0/617821637 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff50806f430 0x7ff508071940 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff51c007fd0 tx=0x7ff51c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:30.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.500+0000 7ff523e00640 1 -- 172.21.15.87:0/617821637 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff5240165e0 con 0x7ff52c1610c0 2024-05-27T06:29:30.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:30.660+0000 7ff532200640 1 -- 172.21.15.87:0/617821637 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff52c06aa30 con 0x7ff52c1610c0 2024-05-27T06:29:31.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.304+0000 7ff523e00640 1 -- 172.21.15.87:0/617821637 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v52) ==== 170+0+0 (secure 0 0 0) 0x7ff5240f7b00 con 0x7ff52c1610c0 2024-05-27T06:29:31.303 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_data' created 2024-05-27T06:29:31.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.308+0000 7ff532200640 1 -- 172.21.15.87:0/617821637 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff50806f430 msgr2=0x7ff508071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:31.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.308+0000 7ff532200640 1 --2- 172.21.15.87:0/617821637 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff50806f430 0x7ff508071940 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff51c007fd0 tx=0x7ff51c009040 comp rx=0 tx=0).stop 2024-05-27T06:29:31.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.308+0000 7ff532200640 1 -- 172.21.15.87:0/617821637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff52c1610c0 msgr2=0x7ff52c1fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:31.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.308+0000 7ff532200640 1 --2- 172.21.15.87:0/617821637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff52c1610c0 0x7ff52c1fbae0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff524019600 tx=0x7ff524019790 comp rx=0 tx=0).stop 2024-05-27T06:29:31.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.308+0000 7ff532200640 1 -- 172.21.15.87:0/617821637 shutdown_connections 2024-05-27T06:29:31.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.308+0000 7ff532200640 1 --2- 172.21.15.87:0/617821637 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff50806f430 0x7ff508071940 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:31.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.308+0000 7ff532200640 1 --2- 172.21.15.87:0/617821637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff52c1610c0 0x7ff52c1fbae0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:31.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.308+0000 7ff532200640 1 --2- 172.21.15.87:0/617821637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff52c0d1700 0x7ff52c1fb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:31.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.308+0000 7ff532200640 1 --2- 172.21.15.87:0/617821637 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff52c06eb20 0x7ff52c154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:31.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.308+0000 7ff532200640 1 -- 172.21.15.87:0/617821637 >> 172.21.15.87:0/617821637 conn(0x7ff52c0b46b0 msgr2=0x7ff52c159d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:31.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.308+0000 7ff532200640 1 -- 172.21.15.87:0/617821637 shutdown_connections 2024-05-27T06:29:31.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.308+0000 7ff532200640 1 -- 172.21.15.87:0/617821637 wait complete. 2024-05-27T06:29:31.348 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-27T06:29:31.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.500+0000 7f83aa600640 1 Processor -- start 2024-05-27T06:29:31.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.500+0000 7f83aa600640 1 -- start start 2024-05-27T06:29:31.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.500+0000 7f83aa600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f83a4070b00 0x7f83a415fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:31.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.500+0000 7f83aa600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f83a406e2a0 0x7f83a40aee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:31.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.500+0000 7f83aa600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83a406f7f0 con 0x7f83a406d780 2024-05-27T06:29:31.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.500+0000 7f83aa600640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f83a406fa60 con 0x7f83a4070b00 2024-05-27T06:29:31.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.500+0000 7f83aa600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f83a406fd40 con 0x7f83a406e2a0 2024-05-27T06:29:31.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.500+0000 7f83a3400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f83a4070b00 0x7f83a415fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:31.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.500+0000 7f83a3400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f83a4070b00 0x7f83a415fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41484/0 (socket says 172.21.15.87:41484) 2024-05-27T06:29:31.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.500+0000 7f83a3400640 1 -- 172.21.15.87:0/3901433294 learned_addr learned my addr 172.21.15.87:0/3901433294 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:31.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.500+0000 7f83a3e00640 1 --2- 172.21.15.87:0/3901433294 >> v2:172.21.15.149:3300/0 conn(0x7f83a406e2a0 0x7f83a40aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:31.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.500+0000 7f83a3400640 1 -- 172.21.15.87:0/3901433294 >> v2:172.21.15.149:3300/0 conn(0x7f83a406e2a0 msgr2=0x7f83a40aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:31.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.500+0000 7f83a3400640 1 --2- 172.21.15.87:0/3901433294 >> v2:172.21.15.149:3300/0 conn(0x7f83a406e2a0 0x7f83a40aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:31.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.500+0000 7f83a3400640 1 -- 172.21.15.87:0/3901433294 >> v1:172.21.15.149:6789/0 conn(0x7f83a406d780 legacy=0x7f83a406db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:31.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.500+0000 7f83a3400640 1 -- 172.21.15.87:0/3901433294 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a4070020 con 0x7f83a4070b00 2024-05-27T06:29:31.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.500+0000 7f83a3e00640 1 --2- 172.21.15.87:0/3901433294 >> v2:172.21.15.149:3300/0 conn(0x7f83a406e2a0 0x7f83a40aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:29:31.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.504+0000 7f83a3400640 1 --2- 172.21.15.87:0/3901433294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83a4070b00 0x7f83a415fd50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f83a40aea00 tx=0x7f839401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de1f226e23a1f3c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:31.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.504+0000 7f83a2a00640 1 -- 172.21.15.87:0/3901433294 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83940ab620 con 0x7f83a4070b00 2024-05-27T06:29:31.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.504+0000 7f83a2a00640 1 -- 172.21.15.87:0/3901433294 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83940b0070 con 0x7f83a4070b00 2024-05-27T06:29:31.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.504+0000 7f83a2a00640 1 -- 172.21.15.87:0/3901433294 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83940ab9e0 con 0x7f83a4070b00 2024-05-27T06:29:31.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.504+0000 7f83aa600640 1 -- 172.21.15.87:0/3901433294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83a4070b00 msgr2=0x7f83a415fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:31.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.504+0000 7f83aa600640 1 --2- 172.21.15.87:0/3901433294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83a4070b00 0x7f83a415fd50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f83a40aea00 tx=0x7f839401c460 comp rx=0 tx=0).stop 2024-05-27T06:29:31.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.504+0000 7f83aa600640 1 -- 172.21.15.87:0/3901433294 shutdown_connections 2024-05-27T06:29:31.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.504+0000 7f83aa600640 1 --2- 172.21.15.87:0/3901433294 >> v2:172.21.15.149:3300/0 conn(0x7f83a406e2a0 0x7f83a40aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:31.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.504+0000 7f83aa600640 1 --2- 172.21.15.87:0/3901433294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83a4070b00 0x7f83a415fd50 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:31.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.504+0000 7f83aa600640 1 -- 172.21.15.87:0/3901433294 >> 172.21.15.87:0/3901433294 conn(0x7f83a40d1be0 msgr2=0x7f83a40d1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:31.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.504+0000 7f83aa600640 1 -- 172.21.15.87:0/3901433294 shutdown_connections 2024-05-27T06:29:31.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.504+0000 7f83aa600640 1 -- 172.21.15.87:0/3901433294 wait complete. 2024-05-27T06:29:31.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.508+0000 7f83aa600640 1 Processor -- start 2024-05-27T06:29:31.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.508+0000 7f83aa600640 1 -- start start 2024-05-27T06:29:31.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.508+0000 7f83aa600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83a406d780 0x7f83a4151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:31.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.508+0000 7f83aa600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83a406e2a0 0x7f83a415a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:31.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.508+0000 7f83aa600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83a4070b00 0x7f83a415e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:31.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.508+0000 7f83aa600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f83a40afd60 con 0x7f83a406e2a0 2024-05-27T06:29:31.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.508+0000 7f83aa600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f83a40afbe0 con 0x7f83a406d780 2024-05-27T06:29:31.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.508+0000 7f83aa600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f83a40afee0 con 0x7f83a4070b00 2024-05-27T06:29:31.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.508+0000 7f839aa00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83a406e2a0 0x7f83a415a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:31.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.508+0000 7f839aa00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83a406e2a0 0x7f83a415a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41492/0 (socket says 172.21.15.87:41492) 2024-05-27T06:29:31.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.508+0000 7f839aa00640 1 -- 172.21.15.87:0/3391406192 learned_addr learned my addr 172.21.15.87:0/3391406192 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:31.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.508+0000 7f83a3400640 1 --2- 172.21.15.87:0/3391406192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83a406d780 0x7f83a4151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:31.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.508+0000 7f83a3e00640 1 --2- 172.21.15.87:0/3391406192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83a4070b00 0x7f83a415e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:31.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.508+0000 7f839aa00640 1 -- 172.21.15.87:0/3391406192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83a4070b00 msgr2=0x7f83a415e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:31.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.508+0000 7f839aa00640 1 --2- 172.21.15.87:0/3391406192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83a4070b00 0x7f83a415e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:31.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.508+0000 7f839aa00640 1 -- 172.21.15.87:0/3391406192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83a406d780 msgr2=0x7f83a4151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:31.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.508+0000 7f839aa00640 1 --2- 172.21.15.87:0/3391406192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83a406d780 0x7f83a4151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:31.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.508+0000 7f839aa00640 1 -- 172.21.15.87:0/3391406192 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a4150c10 con 0x7f83a406e2a0 2024-05-27T06:29:31.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.508+0000 7f83a3e00640 1 --2- 172.21.15.87:0/3391406192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83a4070b00 0x7f83a415e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:29:31.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.512+0000 7f839aa00640 1 --2- 172.21.15.87:0/3391406192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83a406e2a0 0x7f83a415a330 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f838c00b3c0 tx=0x7f838c00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:31.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.512+0000 7f839be00640 1 -- 172.21.15.87:0/3391406192 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c015020 con 0x7f83a406e2a0 2024-05-27T06:29:31.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.512+0000 7f839be00640 1 -- 172.21.15.87:0/3391406192 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f838c011830 con 0x7f83a406e2a0 2024-05-27T06:29:31.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.512+0000 7f839be00640 1 -- 172.21.15.87:0/3391406192 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c011c40 con 0x7f83a406e2a0 2024-05-27T06:29:31.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.512+0000 7f83aa600640 1 -- 172.21.15.87:0/3391406192 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83a4150ef0 con 0x7f83a406e2a0 2024-05-27T06:29:31.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.512+0000 7f83aa600640 1 -- 172.21.15.87:0/3391406192 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a41514b0 con 0x7f83a406e2a0 2024-05-27T06:29:31.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.512+0000 7f83aa600640 1 -- 172.21.15.87:0/3391406192 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83a406aa30 con 0x7f83a406e2a0 2024-05-27T06:29:31.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.512+0000 7f839be00640 1 -- 172.21.15.87:0/3391406192 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f838c018020 con 0x7f83a406e2a0 2024-05-27T06:29:31.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.512+0000 7f839be00640 1 --2- 172.21.15.87:0/3391406192 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f838006f400 0x7f8380071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:31.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.512+0000 7f839be00640 1 -- 172.21.15.87:0/3391406192 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6001+0+0 (secure 0 0 0) 0x7f838c08f880 con 0x7f83a406e2a0 2024-05-27T06:29:31.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.516+0000 7f83a3400640 1 --2- 172.21.15.87:0/3391406192 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f838006f400 0x7f8380071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:31.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.516+0000 7f83a3400640 1 --2- 172.21.15.87:0/3391406192 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f838006f400 0x7f8380071910 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f83940af000 tx=0x7f83940a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:31.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.516+0000 7f839be00640 1 -- 172.21.15.87:0/3391406192 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f838c01f020 con 0x7f83a406e2a0 2024-05-27T06:29:31.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:31.708+0000 7f83aa600640 1 -- 172.21.15.87:0/3391406192 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f83a4069e00 con 0x7f83a406e2a0 2024-05-27T06:29:32.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.308+0000 7f839be00640 1 -- 172.21.15.87:0/3391406192 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v24) ==== 172+0+0 (secure 0 0 0) 0x7f838c05c620 con 0x7f83a406e2a0 2024-05-27T06:29:32.306 INFO:teuthology.orchestra.run.smithi087.stderr:new fs with metadata pool 8 and data pool 9 2024-05-27T06:29:32.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.312+0000 7f83aa600640 1 -- 172.21.15.87:0/3391406192 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f838006f400 msgr2=0x7f8380071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:32.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.312+0000 7f83aa600640 1 --2- 172.21.15.87:0/3391406192 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f838006f400 0x7f8380071910 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f83940af000 tx=0x7f83940a7000 comp rx=0 tx=0).stop 2024-05-27T06:29:32.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.312+0000 7f83aa600640 1 -- 172.21.15.87:0/3391406192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83a406e2a0 msgr2=0x7f83a415a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:32.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.312+0000 7f83aa600640 1 --2- 172.21.15.87:0/3391406192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83a406e2a0 0x7f83a415a330 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f838c00b3c0 tx=0x7f838c00b880 comp rx=0 tx=0).stop 2024-05-27T06:29:32.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.312+0000 7f83aa600640 1 -- 172.21.15.87:0/3391406192 shutdown_connections 2024-05-27T06:29:32.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.312+0000 7f83aa600640 1 --2- 172.21.15.87:0/3391406192 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f838006f400 0x7f8380071910 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:32.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.312+0000 7f83aa600640 1 --2- 172.21.15.87:0/3391406192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83a4070b00 0x7f83a415e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:32.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.312+0000 7f83aa600640 1 --2- 172.21.15.87:0/3391406192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83a406e2a0 0x7f83a415a330 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:32.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.312+0000 7f83aa600640 1 --2- 172.21.15.87:0/3391406192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83a406d780 0x7f83a4151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:32.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.312+0000 7f83aa600640 1 -- 172.21.15.87:0/3391406192 >> 172.21.15.87:0/3391406192 conn(0x7f83a40d1be0 msgr2=0x7f83a4156b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:32.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.312+0000 7f83aa600640 1 -- 172.21.15.87:0/3391406192 shutdown_connections 2024-05-27T06:29:32.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.312+0000 7f83aa600640 1 -- 172.21.15.87:0/3391406192 wait complete. 2024-05-27T06:29:32.355 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T06:29:32.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.504+0000 7f0f09c00640 1 Processor -- start 2024-05-27T06:29:32.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.504+0000 7f0f09c00640 1 -- start start 2024-05-27T06:29:32.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.504+0000 7f0f09c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0f040d1e50 0x7f0f04072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:32.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.504+0000 7f0f09c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0f0406d0b0 0x7f0f0406f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:32.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.504+0000 7f0f09c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f0406ec40 con 0x7f0f0415fe80 2024-05-27T06:29:32.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.504+0000 7f0f09c00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f0f04070960 con 0x7f0f0406d0b0 2024-05-27T06:29:32.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.504+0000 7f0f09c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f0f0406d4c0 con 0x7f0f040d1e50 2024-05-27T06:29:32.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.504+0000 7f0f03400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0f0406d0b0 0x7f0f0406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:32.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.504+0000 7f0f03400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0f0406d0b0 0x7f0f0406f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41498/0 (socket says 172.21.15.87:41498) 2024-05-27T06:29:32.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.504+0000 7f0f03400640 1 -- 172.21.15.87:0/3992913738 learned_addr learned my addr 172.21.15.87:0/3992913738 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:32.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.504+0000 7f0efa000640 1 --2- 172.21.15.87:0/3992913738 >> v2:172.21.15.149:3300/0 conn(0x7f0f040d1e50 0x7f0f04072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:32.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.504+0000 7f0f03400640 1 -- 172.21.15.87:0/3992913738 >> v2:172.21.15.149:3300/0 conn(0x7f0f040d1e50 msgr2=0x7f0f04072aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:32.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.504+0000 7f0f03400640 1 --2- 172.21.15.87:0/3992913738 >> v2:172.21.15.149:3300/0 conn(0x7f0f040d1e50 0x7f0f04072aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:32.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.508+0000 7f0f03400640 1 -- 172.21.15.87:0/3992913738 >> v1:172.21.15.149:6789/0 conn(0x7f0f0415fe80 legacy=0x7f0f040d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:32.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.508+0000 7f0f03400640 1 -- 172.21.15.87:0/3992913738 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f040703a0 con 0x7f0f0406d0b0 2024-05-27T06:29:32.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.508+0000 7f0f03400640 1 --2- 172.21.15.87:0/3992913738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f0406d0b0 0x7f0f0406f120 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0f04071cb0 tx=0x7f0efc01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5cceb34699a60c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:32.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.508+0000 7f0f02000640 1 -- 172.21.15.87:0/3992913738 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0efc0a5590 con 0x7f0f0406d0b0 2024-05-27T06:29:32.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.508+0000 7f0f02000640 1 -- 172.21.15.87:0/3992913738 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0efc0a5730 con 0x7f0f0406d0b0 2024-05-27T06:29:32.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.508+0000 7f0f02000640 1 -- 172.21.15.87:0/3992913738 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0efc0a5b00 con 0x7f0f0406d0b0 2024-05-27T06:29:32.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.508+0000 7f0f09c00640 1 -- 172.21.15.87:0/3992913738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f0406d0b0 msgr2=0x7f0f0406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:32.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.508+0000 7f0f09c00640 1 --2- 172.21.15.87:0/3992913738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f0406d0b0 0x7f0f0406f120 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0f04071cb0 tx=0x7f0efc01c960 comp rx=0 tx=0).stop 2024-05-27T06:29:32.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.508+0000 7f0f09c00640 1 -- 172.21.15.87:0/3992913738 shutdown_connections 2024-05-27T06:29:32.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.508+0000 7f0f09c00640 1 --2- 172.21.15.87:0/3992913738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f0406d0b0 0x7f0f0406f120 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:32.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.508+0000 7f0f09c00640 1 --2- 172.21.15.87:0/3992913738 >> v2:172.21.15.149:3300/0 conn(0x7f0f040d1e50 0x7f0f04072aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:32.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.508+0000 7f0f09c00640 1 -- 172.21.15.87:0/3992913738 >> 172.21.15.87:0/3992913738 conn(0x7f0f040b46b0 msgr2=0x7f0f040b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:32.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.512+0000 7f0f09c00640 1 -- 172.21.15.87:0/3992913738 shutdown_connections 2024-05-27T06:29:32.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.512+0000 7f0f09c00640 1 -- 172.21.15.87:0/3992913738 wait complete. 2024-05-27T06:29:32.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.512+0000 7f0f09c00640 1 Processor -- start 2024-05-27T06:29:32.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.512+0000 7f0f09c00640 1 -- start start 2024-05-27T06:29:32.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.512+0000 7f0f09c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f0406d0b0 0x7f0f04162a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:32.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.512+0000 7f0f09c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f0415fe80 0x7f0f0409edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:32.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.512+0000 7f0f09c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f040ca830 0x7f0f040cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:32.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.512+0000 7f0f09c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0f0416ccd0 con 0x7f0f0415fe80 2024-05-27T06:29:32.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.512+0000 7f0f09c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0f0416cb50 con 0x7f0f040ca830 2024-05-27T06:29:32.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.512+0000 7f0f09c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0f0416ce50 con 0x7f0f0406d0b0 2024-05-27T06:29:32.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.512+0000 7f0efa000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f0415fe80 0x7f0f0409edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:32.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.516+0000 7f0efa000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f0415fe80 0x7f0f0409edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41502/0 (socket says 172.21.15.87:41502) 2024-05-27T06:29:32.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.516+0000 7f0f03400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f040ca830 0x7f0f040cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:32.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.516+0000 7f0efa000640 1 -- 172.21.15.87:0/449312071 learned_addr learned my addr 172.21.15.87:0/449312071 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:32.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.516+0000 7f0f02a00640 1 --2- 172.21.15.87:0/449312071 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f0406d0b0 0x7f0f04162a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:32.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.516+0000 7f0efa000640 1 -- 172.21.15.87:0/449312071 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f0406d0b0 msgr2=0x7f0f04162a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:32.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.516+0000 7f0efa000640 1 --2- 172.21.15.87:0/449312071 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f0406d0b0 0x7f0f04162a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:32.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.516+0000 7f0efa000640 1 -- 172.21.15.87:0/449312071 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f040ca830 msgr2=0x7f0f040cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:32.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.516+0000 7f0efa000640 1 --2- 172.21.15.87:0/449312071 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f040ca830 0x7f0f040cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:32.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.516+0000 7f0efa000640 1 -- 172.21.15.87:0/449312071 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f0409bf20 con 0x7f0f0415fe80 2024-05-27T06:29:32.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.516+0000 7f0f03400640 1 --2- 172.21.15.87:0/449312071 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f040ca830 0x7f0f040cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:29:32.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.516+0000 7f0efa000640 1 --2- 172.21.15.87:0/449312071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f0415fe80 0x7f0f0409edf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0eec00e840 tx=0x7f0eec00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:32.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.516+0000 7f0efb400640 1 -- 172.21.15.87:0/449312071 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec017070 con 0x7f0f0415fe80 2024-05-27T06:29:32.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.516+0000 7f0efb400640 1 -- 172.21.15.87:0/449312071 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eec00ee90 con 0x7f0f0415fe80 2024-05-27T06:29:32.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.516+0000 7f0efb400640 1 -- 172.21.15.87:0/449312071 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec00cb80 con 0x7f0f0415fe80 2024-05-27T06:29:32.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.516+0000 7f0f09c00640 1 -- 172.21.15.87:0/449312071 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f0409b4f0 con 0x7f0f0415fe80 2024-05-27T06:29:32.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.516+0000 7f0f09c00640 1 -- 172.21.15.87:0/449312071 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f0409bab0 con 0x7f0f0415fe80 2024-05-27T06:29:32.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.516+0000 7f0f09c00640 1 -- 172.21.15.87:0/449312071 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f04162fa0 con 0x7f0f0415fe80 2024-05-27T06:29:32.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.520+0000 7f0efb400640 1 -- 172.21.15.87:0/449312071 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0eec01a070 con 0x7f0f0415fe80 2024-05-27T06:29:32.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.520+0000 7f0efb400640 1 --2- 172.21.15.87:0/449312071 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0ee006f400 0x7f0ee0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:32.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.520+0000 7f0efb400640 1 -- 172.21.15.87:0/449312071 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7f0eec08f9d0 con 0x7f0f0415fe80 2024-05-27T06:29:32.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.520+0000 7f0f02a00640 1 --2- 172.21.15.87:0/449312071 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0ee006f400 0x7f0ee0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:32.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.520+0000 7f0f02a00640 1 --2- 172.21.15.87:0/449312071 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0ee006f400 0x7f0ee0071910 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4007fd0 tx=0x7f0ef4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:32.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.524+0000 7f0efb400640 1 -- 172.21.15.87:0/449312071 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f0eec05c1e0 con 0x7f0f0415fe80 2024-05-27T06:29:32.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.684+0000 7f0f09c00640 1 -- 172.21.15.87:0/449312071 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f0406aa30 con 0x7f0f0415fe80 2024-05-27T06:29:32.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.688+0000 7f0efb400640 1 -- 172.21.15.87:0/449312071 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+16939 (secure 0 0 0) 0x7f0eec0604e0 con 0x7f0f0415fe80 2024-05-27T06:29:32.686 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:29:32.686 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":53,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:29:31.715668+0000","last_up_change":"2024-05-27T06:27:25.988592+0000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T06:27:26.590191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-27T06:29:29.402801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-27T06:29:30.674019+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6801","nonce":3674824716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6803","nonce":3674824716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6807","nonce":3674824716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6805","nonce":3674824716}]},"public_addr":"172.21.15.87:6801/3674824716","cluster_addr":"172.21.15.87:6803/3674824716","heartbeat_back_addr":"172.21.15.87:6807/3674824716","heartbeat_front_addr":"172.21.15.87:6805/3674824716","state":["exists","up"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6809","nonce":2443981288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6811","nonce":2443981288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6815","nonce":2443981288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6813","nonce":2443981288}]},"public_addr":"172.21.15.87:6809/2443981288","cluster_addr":"172.21.15.87:6811/2443981288","heartbeat_back_addr":"172.21.15.87:6815/2443981288","heartbeat_front_addr":"172.21.15.87:6813/2443981288","state":["exists","up"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6819","nonce":1441249238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6823","nonce":1441249238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6831","nonce":1441249238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6825","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6827","nonce":1441249238}]},"public_addr":"172.21.15.87:6819/1441249238","cluster_addr":"172.21.15.87:6823/1441249238","heartbeat_back_addr":"172.21.15.87:6831/1441249238","heartbeat_front_addr":"172.21.15.87:6827/1441249238","state":["exists","up"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6818","nonce":1173805234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6822","nonce":1173805234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6829","nonce":1173805234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6826","nonce":1173805234}]},"public_addr":"172.21.15.87:6818/1173805234","cluster_addr":"172.21.15.87:6822/1173805234","heartbeat_back_addr":"172.21.15.87:6829/1173805234","heartbeat_front_addr":"172.21.15.87:6826/1173805234","state":["exists","up"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6819","nonce":1551871079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6823","nonce":1551871079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6831","nonce":1551871079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6827","nonce":1551871079}]},"public_addr":"172.21.15.149:6819/1551871079","cluster_addr":"172.21.15.149:6823/1551871079","heartbeat_back_addr":"172.21.15.149:6831/1551871079","heartbeat_front_addr":"172.21.15.149:6827/1551871079","state":["exists","up"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6818","nonce":582864816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6822","nonce":582864816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6830","nonce":582864816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6826","nonce":582864816}]},"public_addr":"172.21.15.149:6818/582864816","cluster_addr":"172.21.15.149:6822/582864816","heartbeat_back_addr":"172.21.15.149:6830/582864816","heartbeat_front_addr":"172.21.15.149:6826/582864816","state":["exists","up"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6801","nonce":531351314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6803","nonce":531351314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6807","nonce":531351314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6805","nonce":531351314}]},"public_addr":"172.21.15.149:6801/531351314","cluster_addr":"172.21.15.149:6803/531351314","heartbeat_back_addr":"172.21.15.149:6807/531351314","heartbeat_front_addr":"172.21.15.149:6805/531351314","state":["exists","up"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6809","nonce":1171039913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6811","nonce":1171039913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6815","nonce":1171039913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6813","nonce":1171039913}]},"public_addr":"172.21.15.149:6809/1171039913","cluster_addr":"172.21.15.149:6811/1171039913","heartbeat_back_addr":"172.21.15.149:6815/1171039913","heartbeat_front_addr":"172.21.15.149:6813/1171039913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.589776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.819787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.767566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.683842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.038885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.120319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.687007+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.812832+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:29:32.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.688+0000 7f0f09c00640 1 -- 172.21.15.87:0/449312071 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0ee006f400 msgr2=0x7f0ee0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:32.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.688+0000 7f0f09c00640 1 --2- 172.21.15.87:0/449312071 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0ee006f400 0x7f0ee0071910 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4007fd0 tx=0x7f0ef4009040 comp rx=0 tx=0).stop 2024-05-27T06:29:32.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.688+0000 7f0f09c00640 1 -- 172.21.15.87:0/449312071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f0415fe80 msgr2=0x7f0f0409edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:32.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.688+0000 7f0f09c00640 1 --2- 172.21.15.87:0/449312071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f0415fe80 0x7f0f0409edf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0eec00e840 tx=0x7f0eec00ec40 comp rx=0 tx=0).stop 2024-05-27T06:29:32.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.688+0000 7f0f09c00640 1 -- 172.21.15.87:0/449312071 shutdown_connections 2024-05-27T06:29:32.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.688+0000 7f0f09c00640 1 --2- 172.21.15.87:0/449312071 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f0ee006f400 0x7f0ee0071910 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:32.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.688+0000 7f0f09c00640 1 --2- 172.21.15.87:0/449312071 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f040ca830 0x7f0f040cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:32.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.688+0000 7f0f09c00640 1 --2- 172.21.15.87:0/449312071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f0415fe80 0x7f0f0409edf0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:32.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.688+0000 7f0f09c00640 1 --2- 172.21.15.87:0/449312071 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f0406d0b0 0x7f0f04162a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:32.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.688+0000 7f0f09c00640 1 -- 172.21.15.87:0/449312071 >> 172.21.15.87:0/449312071 conn(0x7f0f040b46b0 msgr2=0x7f0f040ae200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:32.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.688+0000 7f0f09c00640 1 -- 172.21.15.87:0/449312071 shutdown_connections 2024-05-27T06:29:32.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.688+0000 7f0f09c00640 1 -- 172.21.15.87:0/449312071 wait complete. 2024-05-27T06:29:32.707 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T06:29:32.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.856+0000 7f2c72400640 1 Processor -- start 2024-05-27T06:29:32.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.856+0000 7f2c72400640 1 -- start start 2024-05-27T06:29:32.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.856+0000 7f2c72400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c6c15cfe0 0x7f2c6c15d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:32.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.856+0000 7f2c72400640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c6c15d930 con 0x7f2c6c0d1740 2024-05-27T06:29:32.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.856+0000 7f2c72400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c6c15dbb0 con 0x7f2c6c0cbf90 2024-05-27T06:29:32.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.856+0000 7f2c72400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2c6c15de90 con 0x7f2c6c15cfe0 2024-05-27T06:29:32.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.856+0000 7f2c6be00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f2c6c0d1740 0x7f2c6c0d1b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:38104/0 (socket says 172.21.15.87:38104) 2024-05-27T06:29:32.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.856+0000 7f2c6be00640 1 -- 172.21.15.87:0/122577051 learned_addr learned my addr 172.21.15.87:0/122577051 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:29:32.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.856+0000 7f2c6aa00640 1 --2- 172.21.15.87:0/122577051 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c6c15cfe0 0x7f2c6c15d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:32.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.856+0000 7f2c6a000640 1 -- 172.21.15.87:0/122577051 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2231889435 0 0) 0x7f2c640014a0 con 0x7f2c6c0d1740 2024-05-27T06:29:32.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.856+0000 7f2c6a000640 1 -- 172.21.15.87:0/122577051 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c50005740 con 0x7f2c6c0d1740 2024-05-27T06:29:32.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.856+0000 7f2c6a000640 1 -- 172.21.15.87:0/122577051 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1790295168 0 0) 0x7f2c6c15dbb0 con 0x7f2c6c0cbf90 2024-05-27T06:29:32.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.856+0000 7f2c6a000640 1 -- 172.21.15.87:0/122577051 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c640014a0 con 0x7f2c6c0cbf90 2024-05-27T06:29:32.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.856+0000 7f2c6aa00640 1 -- 172.21.15.87:0/122577051 >> v1:172.21.15.149:6789/0 conn(0x7f2c6c0cbf90 legacy=0x7f2c6c06cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:32.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.856+0000 7f2c6aa00640 1 -- 172.21.15.87:0/122577051 >> v1:172.21.15.87:6789/0 conn(0x7f2c6c0d1740 legacy=0x7f2c6c0d1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:32.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.856+0000 7f2c6aa00640 1 -- 172.21.15.87:0/122577051 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c6c06c7c0 con 0x7f2c6c15cfe0 2024-05-27T06:29:32.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.860+0000 7f2c6aa00640 1 --2- 172.21.15.87:0/122577051 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c6c15cfe0 0x7f2c6c15d3f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2c580097f0 tx=0x7f2c5801ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44fc9e1d35efd8be server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:32.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.860+0000 7f2c6a000640 1 -- 172.21.15.87:0/122577051 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c580b5070 con 0x7f2c6c15cfe0 2024-05-27T06:29:32.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.860+0000 7f2c6a000640 1 -- 172.21.15.87:0/122577051 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c580a89d0 con 0x7f2c6c15cfe0 2024-05-27T06:29:32.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.860+0000 7f2c6a000640 1 -- 172.21.15.87:0/122577051 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c580a8da0 con 0x7f2c6c15cfe0 2024-05-27T06:29:32.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.860+0000 7f2c72400640 1 -- 172.21.15.87:0/122577051 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c6c15cfe0 msgr2=0x7f2c6c15d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:32.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.860+0000 7f2c72400640 1 --2- 172.21.15.87:0/122577051 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c6c15cfe0 0x7f2c6c15d3f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2c580097f0 tx=0x7f2c5801ecd0 comp rx=0 tx=0).stop 2024-05-27T06:29:32.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.860+0000 7f2c72400640 1 -- 172.21.15.87:0/122577051 shutdown_connections 2024-05-27T06:29:32.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.860+0000 7f2c72400640 1 --2- 172.21.15.87:0/122577051 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c6c15cfe0 0x7f2c6c15d3f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:32.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.860+0000 7f2c72400640 1 -- 172.21.15.87:0/122577051 >> 172.21.15.87:0/122577051 conn(0x7f2c6c0b46b0 msgr2=0x7f2c6c0b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:32.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.860+0000 7f2c72400640 1 -- 172.21.15.87:0/122577051 shutdown_connections 2024-05-27T06:29:32.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.860+0000 7f2c72400640 1 -- 172.21.15.87:0/122577051 wait complete. 2024-05-27T06:29:32.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.864+0000 7f2c72400640 1 Processor -- start 2024-05-27T06:29:32.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.864+0000 7f2c72400640 1 -- start start 2024-05-27T06:29:32.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.864+0000 7f2c72400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c6c0cbf90 0x7f2c6c0cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:32.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.864+0000 7f2c72400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c6c0d1740 0x7f2c6c09a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:32.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.864+0000 7f2c72400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c6c15cfe0 0x7f2c6c15a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:32.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.864+0000 7f2c72400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c0cc3a0 con 0x7f2c6c0cbf90 2024-05-27T06:29:32.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.864+0000 7f2c72400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c15e170 con 0x7f2c6c15cfe0 2024-05-27T06:29:32.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.864+0000 7f2c72400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2c6c06ec50 con 0x7f2c6c0d1740 2024-05-27T06:29:32.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.864+0000 7f2c6b400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c6c0cbf90 0x7f2c6c0cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:32.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.864+0000 7f2c6b400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c6c0cbf90 0x7f2c6c0cadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41516/0 (socket says 172.21.15.87:41516) 2024-05-27T06:29:32.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.864+0000 7f2c6b400640 1 -- 172.21.15.87:0/3298744297 learned_addr learned my addr 172.21.15.87:0/3298744297 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:32.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.864+0000 7f2c6aa00640 1 --2- 172.21.15.87:0/3298744297 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c6c0d1740 0x7f2c6c09a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:32.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.864+0000 7f2c6be00640 1 --2- 172.21.15.87:0/3298744297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c6c15cfe0 0x7f2c6c15a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:32.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.868+0000 7f2c6b400640 1 -- 172.21.15.87:0/3298744297 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c6c0d1740 msgr2=0x7f2c6c09a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:32.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.868+0000 7f2c6b400640 1 --2- 172.21.15.87:0/3298744297 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c6c0d1740 0x7f2c6c09a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:32.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.868+0000 7f2c6b400640 1 -- 172.21.15.87:0/3298744297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c6c15cfe0 msgr2=0x7f2c6c15a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:32.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.868+0000 7f2c6b400640 1 --2- 172.21.15.87:0/3298744297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c6c15cfe0 0x7f2c6c15a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:32.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.868+0000 7f2c6b400640 1 -- 172.21.15.87:0/3298744297 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c6c0c91a0 con 0x7f2c6c0cbf90 2024-05-27T06:29:32.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.868+0000 7f2c6b400640 1 --2- 172.21.15.87:0/3298744297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c6c0cbf90 0x7f2c6c0cadc0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00c390 tx=0x7f2c5c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:32.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.868+0000 7f2c63400640 1 -- 172.21.15.87:0/3298744297 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c017070 con 0x7f2c6c0cbf90 2024-05-27T06:29:32.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.868+0000 7f2c63400640 1 -- 172.21.15.87:0/3298744297 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c5c0052d0 con 0x7f2c6c0cbf90 2024-05-27T06:29:32.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.868+0000 7f2c63400640 1 -- 172.21.15.87:0/3298744297 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c003840 con 0x7f2c6c0cbf90 2024-05-27T06:29:32.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.868+0000 7f2c72400640 1 -- 172.21.15.87:0/3298744297 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c6c0c9480 con 0x7f2c6c0cbf90 2024-05-27T06:29:32.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.868+0000 7f2c72400640 1 -- 172.21.15.87:0/3298744297 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c6c158660 con 0x7f2c6c0cbf90 2024-05-27T06:29:32.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.868+0000 7f2c72400640 1 -- 172.21.15.87:0/3298744297 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c6c06aa30 con 0x7f2c6c0cbf90 2024-05-27T06:29:32.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.868+0000 7f2c63400640 1 -- 172.21.15.87:0/3298744297 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2c5c01a070 con 0x7f2c6c0cbf90 2024-05-27T06:29:32.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.872+0000 7f2c63400640 1 --2- 172.21.15.87:0/3298744297 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2c4c06f400 0x7f2c4c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:32.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.872+0000 7f2c63400640 1 -- 172.21.15.87:0/3298744297 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7f2c5c08e830 con 0x7f2c6c0cbf90 2024-05-27T06:29:32.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.872+0000 7f2c6aa00640 1 --2- 172.21.15.87:0/3298744297 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2c4c06f400 0x7f2c4c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:32.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.872+0000 7f2c6aa00640 1 --2- 172.21.15.87:0/3298744297 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2c4c06f400 0x7f2c4c071910 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2c580b2000 tx=0x7f2c58008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:32.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:32.876+0000 7f2c63400640 1 -- 172.21.15.87:0/3298744297 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f2c5c005480 con 0x7f2c6c0cbf90 2024-05-27T06:29:33.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.032+0000 7f2c72400640 1 -- 172.21.15.87:0/3298744297 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2c6c0b06e0 con 0x7f2c6c0cbf90 2024-05-27T06:29:33.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.032+0000 7f2c63400640 1 -- 172.21.15.87:0/3298744297 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+16939 (secure 0 0 0) 0x7f2c5c05aea0 con 0x7f2c6c0cbf90 2024-05-27T06:29:33.031 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:29:33.031 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":53,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:29:31.715668+0000","last_up_change":"2024-05-27T06:27:25.988592+0000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T06:27:26.590191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-27T06:29:29.402801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-27T06:29:30.674019+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6801","nonce":3674824716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6803","nonce":3674824716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6807","nonce":3674824716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6805","nonce":3674824716}]},"public_addr":"172.21.15.87:6801/3674824716","cluster_addr":"172.21.15.87:6803/3674824716","heartbeat_back_addr":"172.21.15.87:6807/3674824716","heartbeat_front_addr":"172.21.15.87:6805/3674824716","state":["exists","up"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6809","nonce":2443981288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6811","nonce":2443981288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6815","nonce":2443981288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6813","nonce":2443981288}]},"public_addr":"172.21.15.87:6809/2443981288","cluster_addr":"172.21.15.87:6811/2443981288","heartbeat_back_addr":"172.21.15.87:6815/2443981288","heartbeat_front_addr":"172.21.15.87:6813/2443981288","state":["exists","up"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6819","nonce":1441249238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6823","nonce":1441249238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6831","nonce":1441249238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6825","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6827","nonce":1441249238}]},"public_addr":"172.21.15.87:6819/1441249238","cluster_addr":"172.21.15.87:6823/1441249238","heartbeat_back_addr":"172.21.15.87:6831/1441249238","heartbeat_front_addr":"172.21.15.87:6827/1441249238","state":["exists","up"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6818","nonce":1173805234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6822","nonce":1173805234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6829","nonce":1173805234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6826","nonce":1173805234}]},"public_addr":"172.21.15.87:6818/1173805234","cluster_addr":"172.21.15.87:6822/1173805234","heartbeat_back_addr":"172.21.15.87:6829/1173805234","heartbeat_front_addr":"172.21.15.87:6826/1173805234","state":["exists","up"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6819","nonce":1551871079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6823","nonce":1551871079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6831","nonce":1551871079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6827","nonce":1551871079}]},"public_addr":"172.21.15.149:6819/1551871079","cluster_addr":"172.21.15.149:6823/1551871079","heartbeat_back_addr":"172.21.15.149:6831/1551871079","heartbeat_front_addr":"172.21.15.149:6827/1551871079","state":["exists","up"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6818","nonce":582864816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6822","nonce":582864816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6830","nonce":582864816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6826","nonce":582864816}]},"public_addr":"172.21.15.149:6818/582864816","cluster_addr":"172.21.15.149:6822/582864816","heartbeat_back_addr":"172.21.15.149:6830/582864816","heartbeat_front_addr":"172.21.15.149:6826/582864816","state":["exists","up"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6801","nonce":531351314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6803","nonce":531351314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6807","nonce":531351314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6805","nonce":531351314}]},"public_addr":"172.21.15.149:6801/531351314","cluster_addr":"172.21.15.149:6803/531351314","heartbeat_back_addr":"172.21.15.149:6807/531351314","heartbeat_front_addr":"172.21.15.149:6805/531351314","state":["exists","up"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6809","nonce":1171039913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6811","nonce":1171039913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6815","nonce":1171039913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6813","nonce":1171039913}]},"public_addr":"172.21.15.149:6809/1171039913","cluster_addr":"172.21.15.149:6811/1171039913","heartbeat_back_addr":"172.21.15.149:6815/1171039913","heartbeat_front_addr":"172.21.15.149:6813/1171039913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.589776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.819787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.767566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.683842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.038885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.120319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.687007+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.812832+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:29:33.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.032+0000 7f2c72400640 1 -- 172.21.15.87:0/3298744297 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2c4c06f400 msgr2=0x7f2c4c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:33.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.032+0000 7f2c72400640 1 --2- 172.21.15.87:0/3298744297 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2c4c06f400 0x7f2c4c071910 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2c580b2000 tx=0x7f2c58008040 comp rx=0 tx=0).stop 2024-05-27T06:29:33.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.032+0000 7f2c72400640 1 -- 172.21.15.87:0/3298744297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c6c0cbf90 msgr2=0x7f2c6c0cadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:33.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.032+0000 7f2c72400640 1 --2- 172.21.15.87:0/3298744297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c6c0cbf90 0x7f2c6c0cadc0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00c390 tx=0x7f2c5c00c850 comp rx=0 tx=0).stop 2024-05-27T06:29:33.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.032+0000 7f2c72400640 1 -- 172.21.15.87:0/3298744297 shutdown_connections 2024-05-27T06:29:33.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.032+0000 7f2c72400640 1 --2- 172.21.15.87:0/3298744297 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2c4c06f400 0x7f2c4c071910 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:33.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.032+0000 7f2c72400640 1 --2- 172.21.15.87:0/3298744297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c6c15cfe0 0x7f2c6c15a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:33.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.032+0000 7f2c72400640 1 --2- 172.21.15.87:0/3298744297 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c6c0d1740 0x7f2c6c09a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:33.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.032+0000 7f2c72400640 1 --2- 172.21.15.87:0/3298744297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c6c0cbf90 0x7f2c6c0cadc0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:33.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.032+0000 7f2c72400640 1 -- 172.21.15.87:0/3298744297 >> 172.21.15.87:0/3298744297 conn(0x7f2c6c0b46b0 msgr2=0x7f2c6c0cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:33.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.032+0000 7f2c72400640 1 -- 172.21.15.87:0/3298744297 shutdown_connections 2024-05-27T06:29:33.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.032+0000 7f2c72400640 1 -- 172.21.15.87:0/3298744297 wait complete. 2024-05-27T06:29:33.053 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-27T06:29:33.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.204+0000 7efe44400640 1 Processor -- start 2024-05-27T06:29:33.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.204+0000 7efe44400640 1 -- start start 2024-05-27T06:29:33.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.204+0000 7efe44400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efe3c157310 0x7efe3c15dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:33.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.204+0000 7efe44400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efe3c0d1700 0x7efe3c0d1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:33.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.204+0000 7efe44400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe3c06c940 0x7efe3c06cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:33.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.204+0000 7efe44400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7efe3c0d0140 con 0x7efe3c0d1700 2024-05-27T06:29:33.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.204+0000 7efe44400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7efe3c15e110 con 0x7efe3c157310 2024-05-27T06:29:33.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.204+0000 7efe44400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efe3c0d2050 con 0x7efe3c06c940 2024-05-27T06:29:33.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.204+0000 7efe41000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efe3c0d1700 0x7efe3c0d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:33.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.204+0000 7efe41000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efe3c0d1700 0x7efe3c0d1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41526/0 (socket says 172.21.15.87:41526) 2024-05-27T06:29:33.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.204+0000 7efe41000640 1 -- 172.21.15.87:0/4236701047 learned_addr learned my addr 172.21.15.87:0/4236701047 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:33.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.204+0000 7efe41a00640 1 --2- 172.21.15.87:0/4236701047 >> v2:172.21.15.149:3300/0 conn(0x7efe3c157310 0x7efe3c15dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:33.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.204+0000 7efe42400640 1 --2- 172.21.15.87:0/4236701047 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe3c06c940 0x7efe3c06cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:33.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.204+0000 7efe41000640 1 -- 172.21.15.87:0/4236701047 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe3c06c940 msgr2=0x7efe3c06cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:33.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.204+0000 7efe41000640 1 --2- 172.21.15.87:0/4236701047 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe3c06c940 0x7efe3c06cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:33.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.204+0000 7efe41000640 1 -- 172.21.15.87:0/4236701047 >> v2:172.21.15.149:3300/0 conn(0x7efe3c157310 msgr2=0x7efe3c15dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:33.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.204+0000 7efe41000640 1 --2- 172.21.15.87:0/4236701047 >> v2:172.21.15.149:3300/0 conn(0x7efe3c157310 0x7efe3c15dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:33.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.204+0000 7efe41000640 1 -- 172.21.15.87:0/4236701047 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3c0cf530 con 0x7efe3c0d1700 2024-05-27T06:29:33.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.208+0000 7efe41000640 1 --2- 172.21.15.87:0/4236701047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3c0d1700 0x7efe3c0d1b10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efe2800bb10 tx=0x7efe2801ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f0e36687ff853c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:33.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.208+0000 7efe3be00640 1 -- 172.21.15.87:0/4236701047 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe280b4070 con 0x7efe3c0d1700 2024-05-27T06:29:33.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.208+0000 7efe3be00640 1 -- 172.21.15.87:0/4236701047 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe280a7c50 con 0x7efe3c0d1700 2024-05-27T06:29:33.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.208+0000 7efe3be00640 1 -- 172.21.15.87:0/4236701047 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe280af440 con 0x7efe3c0d1700 2024-05-27T06:29:33.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.208+0000 7efe44400640 1 -- 172.21.15.87:0/4236701047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3c0d1700 msgr2=0x7efe3c0d1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:33.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.208+0000 7efe44400640 1 --2- 172.21.15.87:0/4236701047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3c0d1700 0x7efe3c0d1b10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efe2800bb10 tx=0x7efe2801ebc0 comp rx=0 tx=0).stop 2024-05-27T06:29:33.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.212+0000 7efe44400640 1 -- 172.21.15.87:0/4236701047 shutdown_connections 2024-05-27T06:29:33.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.212+0000 7efe44400640 1 --2- 172.21.15.87:0/4236701047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3c0d1700 0x7efe3c0d1b10 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:33.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.212+0000 7efe44400640 1 --2- 172.21.15.87:0/4236701047 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe3c06c940 0x7efe3c06cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:33.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.212+0000 7efe44400640 1 --2- 172.21.15.87:0/4236701047 >> v2:172.21.15.149:3300/0 conn(0x7efe3c157310 0x7efe3c15dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:33.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.212+0000 7efe44400640 1 -- 172.21.15.87:0/4236701047 >> 172.21.15.87:0/4236701047 conn(0x7efe3c0b46b0 msgr2=0x7efe3c0b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:33.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.212+0000 7efe44400640 1 -- 172.21.15.87:0/4236701047 shutdown_connections 2024-05-27T06:29:33.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.212+0000 7efe44400640 1 -- 172.21.15.87:0/4236701047 wait complete. 2024-05-27T06:29:33.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.212+0000 7efe44400640 1 Processor -- start 2024-05-27T06:29:33.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.212+0000 7efe44400640 1 -- start start 2024-05-27T06:29:33.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.212+0000 7efe44400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe3c06c940 0x7efe3c0afb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:33.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.212+0000 7efe44400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe3c0d1700 0x7efe3c14d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:33.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.212+0000 7efe44400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3c157310 0x7efe3c0ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:33.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.212+0000 7efe44400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efe3c06d6a0 con 0x7efe3c157310 2024-05-27T06:29:33.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.212+0000 7efe44400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efe3c0cf200 con 0x7efe3c06c940 2024-05-27T06:29:33.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.212+0000 7efe44400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efe3c070640 con 0x7efe3c0d1700 2024-05-27T06:29:33.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.216+0000 7efe42400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3c157310 0x7efe3c0ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:33.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.216+0000 7efe42400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3c157310 0x7efe3c0ae7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41542/0 (socket says 172.21.15.87:41542) 2024-05-27T06:29:33.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.216+0000 7efe42400640 1 -- 172.21.15.87:0/1374493314 learned_addr learned my addr 172.21.15.87:0/1374493314 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:33.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.216+0000 7efe41000640 1 --2- 172.21.15.87:0/1374493314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe3c0d1700 0x7efe3c14d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:33.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.216+0000 7efe41a00640 1 --2- 172.21.15.87:0/1374493314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe3c06c940 0x7efe3c0afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:33.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.216+0000 7efe42400640 1 -- 172.21.15.87:0/1374493314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe3c0d1700 msgr2=0x7efe3c14d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:33.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.216+0000 7efe42400640 1 --2- 172.21.15.87:0/1374493314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe3c0d1700 0x7efe3c14d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:33.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.216+0000 7efe42400640 1 -- 172.21.15.87:0/1374493314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe3c06c940 msgr2=0x7efe3c0afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:33.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.216+0000 7efe42400640 1 --2- 172.21.15.87:0/1374493314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe3c06c940 0x7efe3c0afb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:33.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.216+0000 7efe42400640 1 -- 172.21.15.87:0/1374493314 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3c1534c0 con 0x7efe3c157310 2024-05-27T06:29:33.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.216+0000 7efe42400640 1 --2- 172.21.15.87:0/1374493314 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3c157310 0x7efe3c0ae7a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efe3400eed0 tx=0x7efe3400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:33.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.216+0000 7efe39600640 1 -- 172.21.15.87:0/1374493314 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34018020 con 0x7efe3c157310 2024-05-27T06:29:33.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.216+0000 7efe39600640 1 -- 172.21.15.87:0/1374493314 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe3400bcd0 con 0x7efe3c157310 2024-05-27T06:29:33.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.216+0000 7efe44400640 1 -- 172.21.15.87:0/1374493314 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe3c0ae2c0 con 0x7efe3c157310 2024-05-27T06:29:33.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.216+0000 7efe39600640 1 -- 172.21.15.87:0/1374493314 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34014640 con 0x7efe3c157310 2024-05-27T06:29:33.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.216+0000 7efe44400640 1 -- 172.21.15.87:0/1374493314 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe3c152f00 con 0x7efe3c157310 2024-05-27T06:29:33.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.216+0000 7efe44400640 1 -- 172.21.15.87:0/1374493314 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe3c06aa30 con 0x7efe3c157310 2024-05-27T06:29:33.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.216+0000 7efe39600640 1 -- 172.21.15.87:0/1374493314 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7efe3401b020 con 0x7efe3c157310 2024-05-27T06:29:33.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.220+0000 7efe39600640 1 --2- 172.21.15.87:0/1374493314 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efe1c06f400 0x7efe1c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:33.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.220+0000 7efe39600640 1 -- 172.21.15.87:0/1374493314 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7efe3408fb10 con 0x7efe3c157310 2024-05-27T06:29:33.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.220+0000 7efe41a00640 1 --2- 172.21.15.87:0/1374493314 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efe1c06f400 0x7efe1c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:33.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.220+0000 7efe41a00640 1 --2- 172.21.15.87:0/1374493314 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efe1c06f400 0x7efe1c071910 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efe3c0d2290 tx=0x7efe30009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:33.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.224+0000 7efe39600640 1 -- 172.21.15.87:0/1374493314 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7efe34022030 con 0x7efe3c157310 2024-05-27T06:29:33.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:33.420+0000 7efe44400640 1 -- 172.21.15.87:0/1374493314 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7efe3c0d1e30 con 0x7efe3c157310 2024-05-27T06:29:34.290 INFO:tasks.ceph.mds.a.smithi087.stderr:2024-05-27T06:29:34.292+0000 7f3e3b600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-27T06:29:34.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.328+0000 7efe39600640 1 -- 172.21.15.87:0/1374493314 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v26) ==== 118+0+0 (secure 0 0 0) 0x7efe3405c2a0 con 0x7efe3c157310 2024-05-27T06:29:34.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.332+0000 7efe44400640 1 -- 172.21.15.87:0/1374493314 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efe1c06f400 msgr2=0x7efe1c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:34.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.332+0000 7efe44400640 1 --2- 172.21.15.87:0/1374493314 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efe1c06f400 0x7efe1c071910 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efe3c0d2290 tx=0x7efe30009190 comp rx=0 tx=0).stop 2024-05-27T06:29:34.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.332+0000 7efe44400640 1 -- 172.21.15.87:0/1374493314 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3c157310 msgr2=0x7efe3c0ae7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:34.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.332+0000 7efe44400640 1 --2- 172.21.15.87:0/1374493314 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3c157310 0x7efe3c0ae7a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efe3400eed0 tx=0x7efe3400b480 comp rx=0 tx=0).stop 2024-05-27T06:29:34.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.332+0000 7efe44400640 1 -- 172.21.15.87:0/1374493314 shutdown_connections 2024-05-27T06:29:34.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.332+0000 7efe44400640 1 --2- 172.21.15.87:0/1374493314 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efe1c06f400 0x7efe1c071910 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:34.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.332+0000 7efe44400640 1 --2- 172.21.15.87:0/1374493314 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe3c157310 0x7efe3c0ae7a0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:34.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.332+0000 7efe44400640 1 --2- 172.21.15.87:0/1374493314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe3c0d1700 0x7efe3c14d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:34.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.332+0000 7efe44400640 1 --2- 172.21.15.87:0/1374493314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe3c06c940 0x7efe3c0afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:34.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.332+0000 7efe44400640 1 -- 172.21.15.87:0/1374493314 >> 172.21.15.87:0/1374493314 conn(0x7efe3c0b46b0 msgr2=0x7efe3c0b35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:34.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.332+0000 7efe44400640 1 -- 172.21.15.87:0/1374493314 shutdown_connections 2024-05-27T06:29:34.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.332+0000 7efe44400640 1 -- 172.21.15.87:0/1374493314 wait complete. 2024-05-27T06:29:34.354 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-27T06:29:34.354 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-27T06:29:34.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.512+0000 7fc85ba00640 1 Processor -- start 2024-05-27T06:29:34.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.512+0000 7fc85ba00640 1 -- start start 2024-05-27T06:29:34.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.512+0000 7fc85ba00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc854157310 0x7fc85415dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:34.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.512+0000 7fc85ba00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc85415e110 con 0x7fc85406c940 2024-05-27T06:29:34.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.512+0000 7fc85ba00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8540cf530 con 0x7fc8540d1700 2024-05-27T06:29:34.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.512+0000 7fc85ba00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fc8540d0140 con 0x7fc854157310 2024-05-27T06:29:34.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.512+0000 7fc859a00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fc85406c940 0x7fc85406cd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:38120/0 (socket says 172.21.15.87:38120) 2024-05-27T06:29:34.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.512+0000 7fc859a00640 1 -- 172.21.15.87:0/2037916152 learned_addr learned my addr 172.21.15.87:0/2037916152 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:29:34.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.512+0000 7fc859000640 1 --2- 172.21.15.87:0/2037916152 >> v2:172.21.15.149:3300/0 conn(0x7fc854157310 0x7fc85415dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:34.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.512+0000 7fc853400640 1 -- 172.21.15.87:0/2037916152 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3118838783 0 0) 0x7fc84c0014a0 con 0x7fc85406c940 2024-05-27T06:29:34.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.512+0000 7fc853400640 1 -- 172.21.15.87:0/2037916152 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc838003530 con 0x7fc85406c940 2024-05-27T06:29:34.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.516+0000 7fc853400640 1 -- 172.21.15.87:0/2037916152 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3440362745 0 0) 0x7fc838003530 con 0x7fc85406c940 2024-05-27T06:29:34.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.516+0000 7fc853400640 1 -- 172.21.15.87:0/2037916152 >> v2:172.21.15.149:3300/0 conn(0x7fc854157310 msgr2=0x7fc85415dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:34.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.516+0000 7fc853400640 1 --2- 172.21.15.87:0/2037916152 >> v2:172.21.15.149:3300/0 conn(0x7fc854157310 0x7fc85415dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:34.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.516+0000 7fc853400640 1 -- 172.21.15.87:0/2037916152 >> v1:172.21.15.149:6789/0 conn(0x7fc8540d1700 legacy=0x7fc8540d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:34.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.516+0000 7fc853400640 1 -- 172.21.15.87:0/2037916152 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8540cf810 con 0x7fc85406c940 2024-05-27T06:29:34.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.516+0000 7fc853400640 1 -- 172.21.15.87:0/2037916152 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7fc84c001c50 con 0x7fc85406c940 2024-05-27T06:29:34.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.516+0000 7fc853400640 1 -- 172.21.15.87:0/2037916152 >> v1:172.21.15.87:6789/0 conn(0x7fc85406c940 legacy=0x7fc85406cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:34.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.516+0000 7fc853400640 1 --2- 172.21.15.87:0/2037916152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc838003a60 0x7fc838003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:34.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.516+0000 7fc853400640 1 --2- 172.21.15.87:0/2037916152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc838004810 0x7fc838004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:34.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.516+0000 7fc853400640 1 --2- 172.21.15.87:0/2037916152 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc838005360 0x7fc83800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:34.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.516+0000 7fc853400640 1 -- 172.21.15.87:0/2037916152 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc8540d0140 con 0x7fc838003a60 2024-05-27T06:29:34.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.516+0000 7fc853400640 1 -- 172.21.15.87:0/2037916152 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc83800c290 con 0x7fc838004810 2024-05-27T06:29:34.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.516+0000 7fc853400640 1 -- 172.21.15.87:0/2037916152 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc83800c490 con 0x7fc838005360 2024-05-27T06:29:34.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.516+0000 7fc859000640 1 --2- 172.21.15.87:0/2037916152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc838003a60 0x7fc838003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:34.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.516+0000 7fc853e00640 1 --2- 172.21.15.87:0/2037916152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc838004810 0x7fc838004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:34.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.516+0000 7fc859a00640 1 --2- 172.21.15.87:0/2037916152 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc838005360 0x7fc83800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:34.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.516+0000 7fc859000640 1 -- 172.21.15.87:0/2037916152 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc838005360 msgr2=0x7fc83800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:34.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.516+0000 7fc859000640 1 --2- 172.21.15.87:0/2037916152 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc838005360 0x7fc83800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:34.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.516+0000 7fc859000640 1 -- 172.21.15.87:0/2037916152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc838004810 msgr2=0x7fc838004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:34.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.516+0000 7fc859000640 1 --2- 172.21.15.87:0/2037916152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc838004810 0x7fc838004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:34.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.516+0000 7fc859000640 1 -- 172.21.15.87:0/2037916152 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc838003530 con 0x7fc838003a60 2024-05-27T06:29:34.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.516+0000 7fc859a00640 1 -- 172.21.15.87:0/2037916152 reap_dead start 2024-05-27T06:29:34.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.520+0000 7fc859000640 1 --2- 172.21.15.87:0/2037916152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc838003a60 0x7fc838003ed0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc854071fb0 tx=0x7fc84401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c12ab5f2b17c68e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:34.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.520+0000 7fc853400640 1 -- 172.21.15.87:0/2037916152 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8440096b0 con 0x7fc838003a60 2024-05-27T06:29:34.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.520+0000 7fc853400640 1 -- 172.21.15.87:0/2037916152 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8440a6410 con 0x7fc838003a60 2024-05-27T06:29:34.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.520+0000 7fc853400640 1 -- 172.21.15.87:0/2037916152 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8440a6800 con 0x7fc838003a60 2024-05-27T06:29:34.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.520+0000 7fc85ba00640 1 -- 172.21.15.87:0/2037916152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc838003a60 msgr2=0x7fc838003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:34.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.520+0000 7fc85ba00640 1 --2- 172.21.15.87:0/2037916152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc838003a60 0x7fc838003ed0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc854071fb0 tx=0x7fc84401ca30 comp rx=0 tx=0).stop 2024-05-27T06:29:34.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.520+0000 7fc85ba00640 1 -- 172.21.15.87:0/2037916152 shutdown_connections 2024-05-27T06:29:34.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.520+0000 7fc85ba00640 1 --2- 172.21.15.87:0/2037916152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc838003a60 0x7fc838003ed0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:34.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.520+0000 7fc85ba00640 1 -- 172.21.15.87:0/2037916152 >> 172.21.15.87:0/2037916152 conn(0x7fc8540b46b0 msgr2=0x7fc8540b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:34.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.520+0000 7fc85ba00640 1 -- 172.21.15.87:0/2037916152 shutdown_connections 2024-05-27T06:29:34.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.520+0000 7fc85ba00640 1 -- 172.21.15.87:0/2037916152 wait complete. 2024-05-27T06:29:34.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.520+0000 7fc85ba00640 1 Processor -- start 2024-05-27T06:29:34.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.520+0000 7fc85ba00640 1 -- start start 2024-05-27T06:29:34.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.524+0000 7fc85ba00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc838003a60 0x7fc854151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:34.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.524+0000 7fc85ba00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc85414ff60 0x7fc85414d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:34.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.524+0000 7fc85ba00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8541fae90 0x7fc8541fb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:34.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.524+0000 7fc85ba00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc8540d1f20 con 0x7fc85414ff60 2024-05-27T06:29:34.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.524+0000 7fc85ba00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc854070640 con 0x7fc8541fae90 2024-05-27T06:29:34.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.524+0000 7fc85ba00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc854152580 con 0x7fc838003a60 2024-05-27T06:29:34.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.524+0000 7fc853e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc85414ff60 0x7fc85414d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:34.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.524+0000 7fc853e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc85414ff60 0x7fc85414d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41562/0 (socket says 172.21.15.87:41562) 2024-05-27T06:29:34.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.524+0000 7fc853e00640 1 -- 172.21.15.87:0/2897352840 learned_addr learned my addr 172.21.15.87:0/2897352840 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:34.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.524+0000 7fc859000640 1 --2- 172.21.15.87:0/2897352840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc838003a60 0x7fc854151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:34.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.524+0000 7fc859a00640 1 --2- 172.21.15.87:0/2897352840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8541fae90 0x7fc8541fb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:34.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.524+0000 7fc853e00640 1 -- 172.21.15.87:0/2897352840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc838003a60 msgr2=0x7fc854151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:34.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.524+0000 7fc853e00640 1 --2- 172.21.15.87:0/2897352840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc838003a60 0x7fc854151e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:34.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.524+0000 7fc853e00640 1 -- 172.21.15.87:0/2897352840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8541fae90 msgr2=0x7fc8541fb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:34.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.524+0000 7fc853e00640 1 --2- 172.21.15.87:0/2897352840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8541fae90 0x7fc8541fb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:34.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.524+0000 7fc853e00640 1 -- 172.21.15.87:0/2897352840 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8541fb7e0 con 0x7fc85414ff60 2024-05-27T06:29:34.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.524+0000 7fc853e00640 1 --2- 172.21.15.87:0/2897352840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc85414ff60 0x7fc85414d730 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc84000f820 tx=0x7fc84000fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:34.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.524+0000 7fc850c00640 1 -- 172.21.15.87:0/2897352840 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84001a070 con 0x7fc85414ff60 2024-05-27T06:29:34.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.524+0000 7fc850c00640 1 -- 172.21.15.87:0/2897352840 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc840005110 con 0x7fc85414ff60 2024-05-27T06:29:34.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.524+0000 7fc85ba00640 1 -- 172.21.15.87:0/2897352840 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc854152370 con 0x7fc85414ff60 2024-05-27T06:29:34.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.524+0000 7fc850c00640 1 -- 172.21.15.87:0/2897352840 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8400067e0 con 0x7fc85414ff60 2024-05-27T06:29:34.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.524+0000 7fc85ba00640 1 -- 172.21.15.87:0/2897352840 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8541e8870 con 0x7fc85414ff60 2024-05-27T06:29:34.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.524+0000 7fc85ba00640 1 -- 172.21.15.87:0/2897352840 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc85406aa30 con 0x7fc85414ff60 2024-05-27T06:29:34.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.528+0000 7fc850c00640 1 -- 172.21.15.87:0/2897352840 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc84001d070 con 0x7fc85414ff60 2024-05-27T06:29:34.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.528+0000 7fc850c00640 1 --2- 172.21.15.87:0/2897352840 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc83406f430 0x7fc834071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:34.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.528+0000 7fc850c00640 1 -- 172.21.15.87:0/2897352840 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fc84008eba0 con 0x7fc85414ff60 2024-05-27T06:29:34.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.528+0000 7fc859000640 1 --2- 172.21.15.87:0/2897352840 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc83406f430 0x7fc834071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:34.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.528+0000 7fc859000640 1 --2- 172.21.15.87:0/2897352840 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc83406f430 0x7fc834071940 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc8440ad000 tx=0x7fc8440046d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:34.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.532+0000 7fc850c00640 1 -- 172.21.15.87:0/2897352840 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fc8541fb7e0 con 0x7fc85414ff60 2024-05-27T06:29:34.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:34.724+0000 7fc85ba00640 1 -- 172.21.15.87:0/2897352840 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc8540cdfd0 con 0x7fc85414ff60 2024-05-27T06:29:35.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.340+0000 7fc850c00640 1 -- 172.21.15.87:0/2897352840 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v27) ==== 122+0+0 (secure 0 0 0) 0x7fc84005b2b0 con 0x7fc85414ff60 2024-05-27T06:29:35.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.340+0000 7fc85ba00640 1 -- 172.21.15.87:0/2897352840 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc83406f430 msgr2=0x7fc834071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:35.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.340+0000 7fc85ba00640 1 --2- 172.21.15.87:0/2897352840 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc83406f430 0x7fc834071940 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc8440ad000 tx=0x7fc8440046d0 comp rx=0 tx=0).stop 2024-05-27T06:29:35.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.340+0000 7fc85ba00640 1 -- 172.21.15.87:0/2897352840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc85414ff60 msgr2=0x7fc85414d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:35.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.340+0000 7fc85ba00640 1 --2- 172.21.15.87:0/2897352840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc85414ff60 0x7fc85414d730 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc84000f820 tx=0x7fc84000fce0 comp rx=0 tx=0).stop 2024-05-27T06:29:35.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.340+0000 7fc85ba00640 1 -- 172.21.15.87:0/2897352840 shutdown_connections 2024-05-27T06:29:35.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.340+0000 7fc85ba00640 1 --2- 172.21.15.87:0/2897352840 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc83406f430 0x7fc834071940 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:35.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.340+0000 7fc85ba00640 1 --2- 172.21.15.87:0/2897352840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8541fae90 0x7fc8541fb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:35.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.340+0000 7fc85ba00640 1 --2- 172.21.15.87:0/2897352840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc85414ff60 0x7fc85414d730 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:35.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.340+0000 7fc85ba00640 1 --2- 172.21.15.87:0/2897352840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc838003a60 0x7fc854151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:35.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.340+0000 7fc85ba00640 1 -- 172.21.15.87:0/2897352840 >> 172.21.15.87:0/2897352840 conn(0x7fc8540b46b0 msgr2=0x7fc85415e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:35.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.340+0000 7fc85ba00640 1 -- 172.21.15.87:0/2897352840 shutdown_connections 2024-05-27T06:29:35.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.340+0000 7fc85ba00640 1 -- 172.21.15.87:0/2897352840 wait complete. 2024-05-27T06:29:35.363 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-27T06:29:35.363 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T06:29:35.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.512+0000 7f3138800640 1 Processor -- start 2024-05-27T06:29:35.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.512+0000 7f3138800640 1 -- start start 2024-05-27T06:29:35.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.516+0000 7f3138800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f313015cfe0 0x7f313015d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:35.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.516+0000 7f3138800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31300d1740 0x7f31300d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:35.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.516+0000 7f3138800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f313015d930 con 0x7f31300cbf90 2024-05-27T06:29:35.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.516+0000 7f3138800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f31300d2090 con 0x7f313015cfe0 2024-05-27T06:29:35.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.516+0000 7f3138800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f313015dbb0 con 0x7f31300d1740 2024-05-27T06:29:35.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.516+0000 7f3135400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f313015cfe0 0x7f313015d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:35.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.516+0000 7f3135e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f31300cbf90 0x7f313006cfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:32920/0 (socket says 172.21.15.87:32920) 2024-05-27T06:29:35.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.516+0000 7f3135e00640 1 -- 172.21.15.87:0/2301631592 learned_addr learned my addr 172.21.15.87:0/2301631592 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:29:35.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.516+0000 7f3136800640 1 --2- 172.21.15.87:0/2301631592 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31300d1740 0x7f31300d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:35.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.516+0000 7f3135400640 1 -- 172.21.15.87:0/2301631592 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31300d1740 msgr2=0x7f31300d1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:35.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.516+0000 7f3135400640 1 --2- 172.21.15.87:0/2301631592 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31300d1740 0x7f31300d1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:35.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.516+0000 7f3135400640 1 -- 172.21.15.87:0/2301631592 >> v1:172.21.15.87:6789/0 conn(0x7f31300cbf90 legacy=0x7f313006cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:35.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.516+0000 7f3135400640 1 -- 172.21.15.87:0/2301631592 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f313015de90 con 0x7f313015cfe0 2024-05-27T06:29:35.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.516+0000 7f3136800640 1 --2- 172.21.15.87:0/2301631592 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31300d1740 0x7f31300d1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:29:35.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.516+0000 7f3134a00640 1 -- 172.21.15.87:0/2301631592 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 668741856 0 0) 0x7f3124001120 con 0x7f31300cbf90 2024-05-27T06:29:35.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.520+0000 7f3135400640 1 --2- 172.21.15.87:0/2301631592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f313015cfe0 0x7f313015d3f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f31200097c0 tx=0x7f312001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62c2d3ac3ed0c1c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:35.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.520+0000 7f3134a00640 1 -- 172.21.15.87:0/2301631592 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31200b5070 con 0x7f313015cfe0 2024-05-27T06:29:35.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.520+0000 7f3134a00640 1 -- 172.21.15.87:0/2301631592 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31200a8990 con 0x7f313015cfe0 2024-05-27T06:29:35.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.520+0000 7f3134a00640 1 -- 172.21.15.87:0/2301631592 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31200a8d60 con 0x7f313015cfe0 2024-05-27T06:29:35.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.520+0000 7f3138800640 1 -- 172.21.15.87:0/2301631592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f313015cfe0 msgr2=0x7f313015d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:35.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.520+0000 7f3138800640 1 --2- 172.21.15.87:0/2301631592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f313015cfe0 0x7f313015d3f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f31200097c0 tx=0x7f312001ec90 comp rx=0 tx=0).stop 2024-05-27T06:29:35.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.520+0000 7f3138800640 1 -- 172.21.15.87:0/2301631592 shutdown_connections 2024-05-27T06:29:35.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.520+0000 7f3138800640 1 --2- 172.21.15.87:0/2301631592 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31300d1740 0x7f31300d1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:35.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.520+0000 7f3138800640 1 --2- 172.21.15.87:0/2301631592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f313015cfe0 0x7f313015d3f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:35.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.520+0000 7f3138800640 1 -- 172.21.15.87:0/2301631592 >> 172.21.15.87:0/2301631592 conn(0x7f31300b46b0 msgr2=0x7f31300b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:35.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.520+0000 7f3138800640 1 -- 172.21.15.87:0/2301631592 shutdown_connections 2024-05-27T06:29:35.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.520+0000 7f3138800640 1 -- 172.21.15.87:0/2301631592 wait complete. 2024-05-27T06:29:35.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.520+0000 7f3138800640 1 Processor -- start 2024-05-27T06:29:35.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.520+0000 7f3138800640 1 -- start start 2024-05-27T06:29:35.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.524+0000 7f3138800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31300cbf90 0x7f31301f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:35.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.524+0000 7f3138800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31300d1740 0x7f3130157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:35.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.524+0000 7f3138800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f313015cfe0 0x7f3130159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:35.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.524+0000 7f3138800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f313015e170 con 0x7f31300cbf90 2024-05-27T06:29:35.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.524+0000 7f3138800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f313006caa0 con 0x7f31300d1740 2024-05-27T06:29:35.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.524+0000 7f3138800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f31300cc3a0 con 0x7f313015cfe0 2024-05-27T06:29:35.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.524+0000 7f3135e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31300cbf90 0x7f31301f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:35.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.524+0000 7f3135e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31300cbf90 0x7f31301f57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57050/0 (socket says 172.21.15.87:57050) 2024-05-27T06:29:35.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.524+0000 7f3135e00640 1 -- 172.21.15.87:0/244373619 learned_addr learned my addr 172.21.15.87:0/244373619 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:35.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.524+0000 7f3136800640 1 --2- 172.21.15.87:0/244373619 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f313015cfe0 0x7f3130159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:35.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.524+0000 7f3135400640 1 --2- 172.21.15.87:0/244373619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31300d1740 0x7f3130157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:35.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.524+0000 7f3135e00640 1 -- 172.21.15.87:0/244373619 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f313015cfe0 msgr2=0x7f3130159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:35.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.524+0000 7f3135e00640 1 --2- 172.21.15.87:0/244373619 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f313015cfe0 0x7f3130159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:35.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.524+0000 7f3135e00640 1 -- 172.21.15.87:0/244373619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31300d1740 msgr2=0x7f3130157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:35.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.524+0000 7f3135e00640 1 --2- 172.21.15.87:0/244373619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31300d1740 0x7f3130157020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:35.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.524+0000 7f3135e00640 1 -- 172.21.15.87:0/244373619 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31300c79c0 con 0x7f31300cbf90 2024-05-27T06:29:35.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.524+0000 7f3135e00640 1 --2- 172.21.15.87:0/244373619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31300cbf90 0x7f31301f57d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f312400c430 tx=0x7f312400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:35.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.524+0000 7f312a000640 1 -- 172.21.15.87:0/244373619 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31240074e0 con 0x7f31300cbf90 2024-05-27T06:29:35.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.524+0000 7f312a000640 1 -- 172.21.15.87:0/244373619 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31240047f0 con 0x7f31300cbf90 2024-05-27T06:29:35.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.524+0000 7f312a000640 1 -- 172.21.15.87:0/244373619 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3124004be0 con 0x7f31300cbf90 2024-05-27T06:29:35.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.524+0000 7f3138800640 1 -- 172.21.15.87:0/244373619 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31300c53c0 con 0x7f31300cbf90 2024-05-27T06:29:35.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.524+0000 7f3138800640 1 -- 172.21.15.87:0/244373619 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31300c5980 con 0x7f31300cbf90 2024-05-27T06:29:35.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.524+0000 7f3138800640 1 -- 172.21.15.87:0/244373619 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f313006aa30 con 0x7f31300cbf90 2024-05-27T06:29:35.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.528+0000 7f312a000640 1 -- 172.21.15.87:0/244373619 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3124011070 con 0x7f31300cbf90 2024-05-27T06:29:35.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.528+0000 7f312a000640 1 --2- 172.21.15.87:0/244373619 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f311406f400 0x7f3114071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:35.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.528+0000 7f312a000640 1 -- 172.21.15.87:0/244373619 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f312408f0f0 con 0x7f31300cbf90 2024-05-27T06:29:35.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.528+0000 7f3135400640 1 --2- 172.21.15.87:0/244373619 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f311406f400 0x7f3114071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:35.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.528+0000 7f3135400640 1 --2- 172.21.15.87:0/244373619 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f311406f400 0x7f3114071910 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f31200b2000 tx=0x7f3120008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:35.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.532+0000 7f312a000640 1 -- 172.21.15.87:0/244373619 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f31300c79c0 con 0x7f31300cbf90 2024-05-27T06:29:35.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.720+0000 7f3138800640 1 -- 172.21.15.87:0/244373619 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3130069a90 con 0x7f31300cbf90 2024-05-27T06:29:35.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.720+0000 7f312a000640 1 -- 172.21.15.87:0/244373619 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5187 (secure 0 0 0) 0x7f313015d930 con 0x7f31300cbf90 2024-05-27T06:29:35.720 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:29:35.720 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5254,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/1883124200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1883124200},{"type":"v1","addr":"172.21.15.149:6834","nonce":1883124200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3525413342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":3525413342},{"type":"v1","addr":"172.21.15.149:6835","nonce":3525413342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5373,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1517601928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1517601928},{"type":"v1","addr":"172.21.15.87:6835","nonce":1517601928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T06:29:31.715627+0000","modified":"2024-05-27T06:29:34.730216+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5382":{"gid":5382,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/3958980223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":3958980223},{"type":"v1","addr":"172.21.15.87:6837","nonce":3958980223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5382,"qdb_cluster":[5382]},"id":3}]} 2024-05-27T06:29:35.720 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 27 2024-05-27T06:29:35.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.724+0000 7f3138800640 1 -- 172.21.15.87:0/244373619 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f311406f400 msgr2=0x7f3114071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:35.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.724+0000 7f3138800640 1 --2- 172.21.15.87:0/244373619 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f311406f400 0x7f3114071910 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f31200b2000 tx=0x7f3120008040 comp rx=0 tx=0).stop 2024-05-27T06:29:35.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.724+0000 7f3138800640 1 -- 172.21.15.87:0/244373619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31300cbf90 msgr2=0x7f31301f57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:35.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.724+0000 7f3138800640 1 --2- 172.21.15.87:0/244373619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31300cbf90 0x7f31301f57d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f312400c430 tx=0x7f312400c8f0 comp rx=0 tx=0).stop 2024-05-27T06:29:35.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.724+0000 7f3138800640 1 -- 172.21.15.87:0/244373619 shutdown_connections 2024-05-27T06:29:35.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.724+0000 7f3138800640 1 --2- 172.21.15.87:0/244373619 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f311406f400 0x7f3114071910 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:35.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.724+0000 7f3138800640 1 --2- 172.21.15.87:0/244373619 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f313015cfe0 0x7f3130159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:35.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.724+0000 7f3138800640 1 --2- 172.21.15.87:0/244373619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31300d1740 0x7f3130157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:35.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.724+0000 7f3138800640 1 --2- 172.21.15.87:0/244373619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31300cbf90 0x7f31301f57d0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:35.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.724+0000 7f3138800640 1 -- 172.21.15.87:0/244373619 >> 172.21.15.87:0/244373619 conn(0x7f31300b46b0 msgr2=0x7f31300b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:35.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.724+0000 7f3138800640 1 -- 172.21.15.87:0/244373619 shutdown_connections 2024-05-27T06:29:35.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.724+0000 7f3138800640 1 -- 172.21.15.87:0/244373619 wait complete. 2024-05-27T06:29:35.742 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T06:29:35.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.888+0000 7f2f9e400640 1 Processor -- start 2024-05-27T06:29:35.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.888+0000 7f2f9e400640 1 -- start start 2024-05-27T06:29:35.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.892+0000 7f2f9e400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2f9815fe80 0x7f2f98072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:35.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.892+0000 7f2f9e400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2f980d1e50 0x7f2f9806f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:35.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.892+0000 7f2f9e400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f9806ec40 con 0x7f2f9806d0b0 2024-05-27T06:29:35.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.892+0000 7f2f9e400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f2f98070960 con 0x7f2f980d1e50 2024-05-27T06:29:35.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.892+0000 7f2f9e400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f2f9806d4c0 con 0x7f2f9815fe80 2024-05-27T06:29:35.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.892+0000 7f2f97e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2f980d1e50 0x7f2f9806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:35.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.892+0000 7f2f97e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2f980d1e50 0x7f2f9806f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57058/0 (socket says 172.21.15.87:57058) 2024-05-27T06:29:35.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.892+0000 7f2f97e00640 1 -- 172.21.15.87:0/1332246707 learned_addr learned my addr 172.21.15.87:0/1332246707 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:35.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.892+0000 7f2f97e00640 1 -- 172.21.15.87:0/1332246707 >> v2:172.21.15.149:3300/0 conn(0x7f2f9815fe80 msgr2=0x7f2f98072aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:35.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.892+0000 7f2f97e00640 1 --2- 172.21.15.87:0/1332246707 >> v2:172.21.15.149:3300/0 conn(0x7f2f9815fe80 0x7f2f98072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:35.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.892+0000 7f2f97e00640 1 -- 172.21.15.87:0/1332246707 >> v1:172.21.15.149:6789/0 conn(0x7f2f9806d0b0 legacy=0x7f2f980d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:35.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.892+0000 7f2f97e00640 1 -- 172.21.15.87:0/1332246707 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f980703a0 con 0x7f2f980d1e50 2024-05-27T06:29:35.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.896+0000 7f2f97e00640 1 --2- 172.21.15.87:0/1332246707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f980d1e50 0x7f2f9806f120 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2f980d2330 tx=0x7f2f9001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b04ce6605029b52 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:35.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.896+0000 7f2f96a00640 1 -- 172.21.15.87:0/1332246707 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f900a55e0 con 0x7f2f980d1e50 2024-05-27T06:29:35.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.896+0000 7f2f96a00640 1 -- 172.21.15.87:0/1332246707 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f900a5780 con 0x7f2f980d1e50 2024-05-27T06:29:35.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.896+0000 7f2f96a00640 1 -- 172.21.15.87:0/1332246707 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f900a5b50 con 0x7f2f980d1e50 2024-05-27T06:29:35.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.896+0000 7f2f9e400640 1 -- 172.21.15.87:0/1332246707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f980d1e50 msgr2=0x7f2f9806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:35.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.896+0000 7f2f9e400640 1 --2- 172.21.15.87:0/1332246707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f980d1e50 0x7f2f9806f120 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2f980d2330 tx=0x7f2f9001c9f0 comp rx=0 tx=0).stop 2024-05-27T06:29:35.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.896+0000 7f2f9e400640 1 -- 172.21.15.87:0/1332246707 shutdown_connections 2024-05-27T06:29:35.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.896+0000 7f2f9e400640 1 --2- 172.21.15.87:0/1332246707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f980d1e50 0x7f2f9806f120 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:35.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.896+0000 7f2f9e400640 1 --2- 172.21.15.87:0/1332246707 >> v2:172.21.15.149:3300/0 conn(0x7f2f9815fe80 0x7f2f98072aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:35.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.896+0000 7f2f9e400640 1 -- 172.21.15.87:0/1332246707 >> 172.21.15.87:0/1332246707 conn(0x7f2f980b46b0 msgr2=0x7f2f980b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:35.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.896+0000 7f2f9e400640 1 -- 172.21.15.87:0/1332246707 shutdown_connections 2024-05-27T06:29:35.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.896+0000 7f2f9e400640 1 -- 172.21.15.87:0/1332246707 wait complete. 2024-05-27T06:29:35.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.896+0000 7f2f9e400640 1 Processor -- start 2024-05-27T06:29:35.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.896+0000 7f2f9e400640 1 -- start start 2024-05-27T06:29:35.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.900+0000 7f2f9e400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f9806d0b0 0x7f2f980cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:35.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.900+0000 7f2f9e400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f9815fe80 0x7f2f980ae190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:35.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.900+0000 7f2f9e400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f9814b260 0x7f2f980ae6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:35.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.900+0000 7f2f9e400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9816ccd0 con 0x7f2f9815fe80 2024-05-27T06:29:35.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.900+0000 7f2f9e400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9816cb50 con 0x7f2f9806d0b0 2024-05-27T06:29:35.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.900+0000 7f2f9e400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2f9816ce50 con 0x7f2f9814b260 2024-05-27T06:29:35.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.900+0000 7f2f8ea00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f9815fe80 0x7f2f980ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:35.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.900+0000 7f2f8ea00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f9815fe80 0x7f2f980ae190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57072/0 (socket says 172.21.15.87:57072) 2024-05-27T06:29:35.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.900+0000 7f2f8ea00640 1 -- 172.21.15.87:0/3715047514 learned_addr learned my addr 172.21.15.87:0/3715047514 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:35.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.900+0000 7f2f97e00640 1 --2- 172.21.15.87:0/3715047514 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f9814b260 0x7f2f980ae6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:35.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.900+0000 7f2f97400640 1 --2- 172.21.15.87:0/3715047514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f9806d0b0 0x7f2f980cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:35.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.900+0000 7f2f8ea00640 1 -- 172.21.15.87:0/3715047514 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f9814b260 msgr2=0x7f2f980ae6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:35.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.900+0000 7f2f8ea00640 1 --2- 172.21.15.87:0/3715047514 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f9814b260 0x7f2f980ae6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:35.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.900+0000 7f2f8ea00640 1 -- 172.21.15.87:0/3715047514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f9806d0b0 msgr2=0x7f2f980cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:35.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.900+0000 7f2f8ea00640 1 --2- 172.21.15.87:0/3715047514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f9806d0b0 0x7f2f980cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:35.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.900+0000 7f2f8ea00640 1 -- 172.21.15.87:0/3715047514 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f98159230 con 0x7f2f9815fe80 2024-05-27T06:29:35.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.900+0000 7f2f97e00640 1 --2- 172.21.15.87:0/3715047514 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f9814b260 0x7f2f980ae6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:29:35.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.900+0000 7f2f8ea00640 1 --2- 172.21.15.87:0/3715047514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f9815fe80 0x7f2f980ae190 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000b440 tx=0x7f2f8000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:35.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.900+0000 7f2f8fe00640 1 -- 172.21.15.87:0/3715047514 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f80015020 con 0x7f2f9815fe80 2024-05-27T06:29:35.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.900+0000 7f2f8fe00640 1 -- 172.21.15.87:0/3715047514 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f800118b0 con 0x7f2f9815fe80 2024-05-27T06:29:35.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.900+0000 7f2f9e400640 1 -- 172.21.15.87:0/3715047514 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f98159510 con 0x7f2f9815fe80 2024-05-27T06:29:35.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.900+0000 7f2f8fe00640 1 -- 172.21.15.87:0/3715047514 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f80011ca0 con 0x7f2f9815fe80 2024-05-27T06:29:35.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.900+0000 7f2f9e400640 1 -- 172.21.15.87:0/3715047514 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f98159ad0 con 0x7f2f9815fe80 2024-05-27T06:29:35.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.900+0000 7f2f9e400640 1 -- 172.21.15.87:0/3715047514 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f98158fa0 con 0x7f2f9815fe80 2024-05-27T06:29:35.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.904+0000 7f2f8fe00640 1 -- 172.21.15.87:0/3715047514 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2f80018020 con 0x7f2f9815fe80 2024-05-27T06:29:35.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.904+0000 7f2f8fe00640 1 --2- 172.21.15.87:0/3715047514 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2f7406f430 0x7f2f74071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:35.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.904+0000 7f2f8fe00640 1 -- 172.21.15.87:0/3715047514 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f2f8008f630 con 0x7f2f9815fe80 2024-05-27T06:29:35.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.904+0000 7f2f97400640 1 --2- 172.21.15.87:0/3715047514 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2f7406f430 0x7f2f74071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:35.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.904+0000 7f2f97400640 1 --2- 172.21.15.87:0/3715047514 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2f7406f430 0x7f2f74071940 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2f88006fd0 tx=0x7f2f88008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:35.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:35.908+0000 7f2f8fe00640 1 -- 172.21.15.87:0/3715047514 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f2f8001f020 con 0x7f2f9815fe80 2024-05-27T06:29:36.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.068+0000 7f2f9e400640 1 -- 172.21.15.87:0/3715047514 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2f9806aa30 con 0x7f2f9815fe80 2024-05-27T06:29:36.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.068+0000 7f2f8fe00640 1 -- 172.21.15.87:0/3715047514 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+16926 (secure 0 0 0) 0x7f2f8000d040 con 0x7f2f9815fe80 2024-05-27T06:29:36.067 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:29:36.067 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":54,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:29:33.325293+0000","last_up_change":"2024-05-27T06:27:25.988592+0000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T06:27:26.590191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-27T06:29:29.402801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-27T06:29:30.674019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6801","nonce":3674824716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6803","nonce":3674824716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6807","nonce":3674824716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6805","nonce":3674824716}]},"public_addr":"172.21.15.87:6801/3674824716","cluster_addr":"172.21.15.87:6803/3674824716","heartbeat_back_addr":"172.21.15.87:6807/3674824716","heartbeat_front_addr":"172.21.15.87:6805/3674824716","state":["exists","up"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6809","nonce":2443981288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6811","nonce":2443981288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6815","nonce":2443981288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6813","nonce":2443981288}]},"public_addr":"172.21.15.87:6809/2443981288","cluster_addr":"172.21.15.87:6811/2443981288","heartbeat_back_addr":"172.21.15.87:6815/2443981288","heartbeat_front_addr":"172.21.15.87:6813/2443981288","state":["exists","up"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6819","nonce":1441249238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6823","nonce":1441249238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6831","nonce":1441249238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6825","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6827","nonce":1441249238}]},"public_addr":"172.21.15.87:6819/1441249238","cluster_addr":"172.21.15.87:6823/1441249238","heartbeat_back_addr":"172.21.15.87:6831/1441249238","heartbeat_front_addr":"172.21.15.87:6827/1441249238","state":["exists","up"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6818","nonce":1173805234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6822","nonce":1173805234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6829","nonce":1173805234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6826","nonce":1173805234}]},"public_addr":"172.21.15.87:6818/1173805234","cluster_addr":"172.21.15.87:6822/1173805234","heartbeat_back_addr":"172.21.15.87:6829/1173805234","heartbeat_front_addr":"172.21.15.87:6826/1173805234","state":["exists","up"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6819","nonce":1551871079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6823","nonce":1551871079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6831","nonce":1551871079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6827","nonce":1551871079}]},"public_addr":"172.21.15.149:6819/1551871079","cluster_addr":"172.21.15.149:6823/1551871079","heartbeat_back_addr":"172.21.15.149:6831/1551871079","heartbeat_front_addr":"172.21.15.149:6827/1551871079","state":["exists","up"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6818","nonce":582864816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6822","nonce":582864816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6830","nonce":582864816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6826","nonce":582864816}]},"public_addr":"172.21.15.149:6818/582864816","cluster_addr":"172.21.15.149:6822/582864816","heartbeat_back_addr":"172.21.15.149:6830/582864816","heartbeat_front_addr":"172.21.15.149:6826/582864816","state":["exists","up"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6801","nonce":531351314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6803","nonce":531351314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6807","nonce":531351314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6805","nonce":531351314}]},"public_addr":"172.21.15.149:6801/531351314","cluster_addr":"172.21.15.149:6803/531351314","heartbeat_back_addr":"172.21.15.149:6807/531351314","heartbeat_front_addr":"172.21.15.149:6805/531351314","state":["exists","up"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6809","nonce":1171039913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6811","nonce":1171039913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6815","nonce":1171039913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6813","nonce":1171039913}]},"public_addr":"172.21.15.149:6809/1171039913","cluster_addr":"172.21.15.149:6811/1171039913","heartbeat_back_addr":"172.21.15.149:6815/1171039913","heartbeat_front_addr":"172.21.15.149:6813/1171039913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.589776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.819787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.767566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.683842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.038885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.120319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.687007+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.812832+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:29:36.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.068+0000 7f2f9e400640 1 -- 172.21.15.87:0/3715047514 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2f7406f430 msgr2=0x7f2f74071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:36.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.068+0000 7f2f9e400640 1 --2- 172.21.15.87:0/3715047514 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2f7406f430 0x7f2f74071940 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2f88006fd0 tx=0x7f2f88008040 comp rx=0 tx=0).stop 2024-05-27T06:29:36.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.068+0000 7f2f9e400640 1 -- 172.21.15.87:0/3715047514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f9815fe80 msgr2=0x7f2f980ae190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:36.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.068+0000 7f2f9e400640 1 --2- 172.21.15.87:0/3715047514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f9815fe80 0x7f2f980ae190 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000b440 tx=0x7f2f8000b900 comp rx=0 tx=0).stop 2024-05-27T06:29:36.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.068+0000 7f2f9e400640 1 -- 172.21.15.87:0/3715047514 shutdown_connections 2024-05-27T06:29:36.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.068+0000 7f2f9e400640 1 --2- 172.21.15.87:0/3715047514 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f2f7406f430 0x7f2f74071940 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:36.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.068+0000 7f2f9e400640 1 --2- 172.21.15.87:0/3715047514 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f9814b260 0x7f2f980ae6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:36.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.068+0000 7f2f9e400640 1 --2- 172.21.15.87:0/3715047514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f9815fe80 0x7f2f980ae190 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:36.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.068+0000 7f2f9e400640 1 --2- 172.21.15.87:0/3715047514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f9806d0b0 0x7f2f980cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:36.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.068+0000 7f2f9e400640 1 -- 172.21.15.87:0/3715047514 >> 172.21.15.87:0/3715047514 conn(0x7f2f980b46b0 msgr2=0x7f2f980b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:36.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.068+0000 7f2f9e400640 1 -- 172.21.15.87:0/3715047514 shutdown_connections 2024-05-27T06:29:36.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.068+0000 7f2f9e400640 1 -- 172.21.15.87:0/3715047514 wait complete. 2024-05-27T06:29:36.089 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-27T06:29:36.089 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T06:29:36.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.236+0000 7fb0e2200640 1 Processor -- start 2024-05-27T06:29:36.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.236+0000 7fb0e2200640 1 -- start start 2024-05-27T06:29:36.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.236+0000 7fb0e2200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb0dc0d26d0 0x7fb0dc0d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:36.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.236+0000 7fb0e2200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0dc0cde10 0x7fb0dc0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:36.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.236+0000 7fb0e2200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0dc0ce760 con 0x7fb0dc161630 2024-05-27T06:29:36.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.236+0000 7fb0e2200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fb0dc0b4a00 con 0x7fb0dc0d26d0 2024-05-27T06:29:36.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.236+0000 7fb0e2200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb0dc0d30e0 con 0x7fb0dc0cde10 2024-05-27T06:29:36.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.240+0000 7fb0e0e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb0dc0d26d0 0x7fb0dc0d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:36.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.240+0000 7fb0e1800640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb0dc161630 0x7fb0dc161a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:32932/0 (socket says 172.21.15.87:32932) 2024-05-27T06:29:36.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.240+0000 7fb0e1800640 1 -- 172.21.15.87:0/3595995868 learned_addr learned my addr 172.21.15.87:0/3595995868 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:29:36.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.240+0000 7fb0dbe00640 1 --2- 172.21.15.87:0/3595995868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0dc0cde10 0x7fb0dc0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:36.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.240+0000 7fb0e0e00640 1 -- 172.21.15.87:0/3595995868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0dc0cde10 msgr2=0x7fb0dc0ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:36.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.240+0000 7fb0e0e00640 1 --2- 172.21.15.87:0/3595995868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0dc0cde10 0x7fb0dc0ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:36.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.240+0000 7fb0e0e00640 1 -- 172.21.15.87:0/3595995868 >> v1:172.21.15.87:6789/0 conn(0x7fb0dc161630 legacy=0x7fb0dc161a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:36.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.240+0000 7fb0e0e00640 1 -- 172.21.15.87:0/3595995868 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0dc0b2f10 con 0x7fb0dc0d26d0 2024-05-27T06:29:36.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.240+0000 7fb0db400640 1 -- 172.21.15.87:0/3595995868 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1237839958 0 0) 0x7fb0d4001120 con 0x7fb0dc161630 2024-05-27T06:29:36.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.240+0000 7fb0e0e00640 1 --2- 172.21.15.87:0/3595995868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0dc0d26d0 0x7fb0dc0d2ae0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc009d90 tx=0x7fb0cc01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d620f428c27afafc server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:36.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.240+0000 7fb0db400640 1 -- 172.21.15.87:0/3595995868 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc0b2070 con 0x7fb0dc0d26d0 2024-05-27T06:29:36.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.240+0000 7fb0db400640 1 -- 172.21.15.87:0/3595995868 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0cc0a5920 con 0x7fb0dc0d26d0 2024-05-27T06:29:36.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.240+0000 7fb0db400640 1 -- 172.21.15.87:0/3595995868 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc0a5cf0 con 0x7fb0dc0d26d0 2024-05-27T06:29:36.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.244+0000 7fb0e2200640 1 -- 172.21.15.87:0/3595995868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0dc0d26d0 msgr2=0x7fb0dc0d2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:36.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.244+0000 7fb0e2200640 1 --2- 172.21.15.87:0/3595995868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0dc0d26d0 0x7fb0dc0d2ae0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc009d90 tx=0x7fb0cc01c970 comp rx=0 tx=0).stop 2024-05-27T06:29:36.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.244+0000 7fb0e2200640 1 -- 172.21.15.87:0/3595995868 shutdown_connections 2024-05-27T06:29:36.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.244+0000 7fb0e2200640 1 --2- 172.21.15.87:0/3595995868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0dc0cde10 0x7fb0dc0ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:36.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.244+0000 7fb0e2200640 1 --2- 172.21.15.87:0/3595995868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0dc0d26d0 0x7fb0dc0d2ae0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:36.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.244+0000 7fb0e2200640 1 -- 172.21.15.87:0/3595995868 >> 172.21.15.87:0/3595995868 conn(0x7fb0dc0d3490 msgr2=0x7fb0dc0d38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:36.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.244+0000 7fb0e2200640 1 -- 172.21.15.87:0/3595995868 shutdown_connections 2024-05-27T06:29:36.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.244+0000 7fb0e2200640 1 -- 172.21.15.87:0/3595995868 wait complete. 2024-05-27T06:29:36.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.244+0000 7fb0e2200640 1 Processor -- start 2024-05-27T06:29:36.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.244+0000 7fb0e2200640 1 -- start start 2024-05-27T06:29:36.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.248+0000 7fb0e2200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0dc0cde10 0x7fb0dc148090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:36.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.248+0000 7fb0e2200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0dc0d26d0 0x7fb0dc160990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:36.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.248+0000 7fb0e2200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0dc161630 0x7fb0dc0c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:36.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.248+0000 7fb0e2200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc15df40 con 0x7fb0dc0cde10 2024-05-27T06:29:36.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.248+0000 7fb0e2200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc15ddc0 con 0x7fb0dc161630 2024-05-27T06:29:36.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.248+0000 7fb0e2200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb0dc0d1930 con 0x7fb0dc0d26d0 2024-05-27T06:29:36.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.248+0000 7fb0e0e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0dc0cde10 0x7fb0dc148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:36.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.248+0000 7fb0e0e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0dc0cde10 0x7fb0dc148090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57088/0 (socket says 172.21.15.87:57088) 2024-05-27T06:29:36.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.248+0000 7fb0e0e00640 1 -- 172.21.15.87:0/778383413 learned_addr learned my addr 172.21.15.87:0/778383413 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:36.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.248+0000 7fb0dbe00640 1 --2- 172.21.15.87:0/778383413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0dc0d26d0 0x7fb0dc160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:36.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.248+0000 7fb0e1800640 1 --2- 172.21.15.87:0/778383413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0dc161630 0x7fb0dc0c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:36.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.248+0000 7fb0e0e00640 1 -- 172.21.15.87:0/778383413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0dc0d26d0 msgr2=0x7fb0dc160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:36.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.248+0000 7fb0e0e00640 1 --2- 172.21.15.87:0/778383413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0dc0d26d0 0x7fb0dc160990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:36.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.248+0000 7fb0e0e00640 1 -- 172.21.15.87:0/778383413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0dc161630 msgr2=0x7fb0dc0c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:36.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.248+0000 7fb0e0e00640 1 --2- 172.21.15.87:0/778383413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0dc161630 0x7fb0dc0c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:36.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.248+0000 7fb0e0e00640 1 -- 172.21.15.87:0/778383413 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0dc0c70b0 con 0x7fb0dc0cde10 2024-05-27T06:29:36.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.248+0000 7fb0e0e00640 1 --2- 172.21.15.87:0/778383413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0dc0cde10 0x7fb0dc148090 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0b0040 tx=0x7fb0cc019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:36.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.248+0000 7fb0d8c00640 1 -- 172.21.15.87:0/778383413 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc0b2040 con 0x7fb0dc0cde10 2024-05-27T06:29:36.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.248+0000 7fb0d8c00640 1 -- 172.21.15.87:0/778383413 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0cc0bf070 con 0x7fb0dc0cde10 2024-05-27T06:29:36.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.248+0000 7fb0e2200640 1 -- 172.21.15.87:0/778383413 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0dc0c7390 con 0x7fb0dc0cde10 2024-05-27T06:29:36.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.248+0000 7fb0d8c00640 1 -- 172.21.15.87:0/778383413 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc0b8870 con 0x7fb0dc0cde10 2024-05-27T06:29:36.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.248+0000 7fb0e2200640 1 -- 172.21.15.87:0/778383413 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0dc0c7950 con 0x7fb0dc0cde10 2024-05-27T06:29:36.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.248+0000 7fb0e2200640 1 -- 172.21.15.87:0/778383413 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0dc06aa30 con 0x7fb0dc0cde10 2024-05-27T06:29:36.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.248+0000 7fb0d8c00640 1 -- 172.21.15.87:0/778383413 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb0cc0b8a10 con 0x7fb0dc0cde10 2024-05-27T06:29:36.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.252+0000 7fb0d8c00640 1 --2- 172.21.15.87:0/778383413 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb0bc06f430 0x7fb0bc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:36.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.252+0000 7fb0d8c00640 1 -- 172.21.15.87:0/778383413 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fb0cc12a050 con 0x7fb0dc0cde10 2024-05-27T06:29:36.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.252+0000 7fb0dbe00640 1 --2- 172.21.15.87:0/778383413 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb0bc06f430 0x7fb0bc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:36.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.252+0000 7fb0dbe00640 1 --2- 172.21.15.87:0/778383413 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb0bc06f430 0x7fb0bc071940 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc157be0 tx=0x7fb0c8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:36.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.256+0000 7fb0d8c00640 1 -- 172.21.15.87:0/778383413 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb0cc016560 con 0x7fb0dc0cde10 2024-05-27T06:29:36.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.408+0000 7fb0e2200640 1 -- 172.21.15.87:0/778383413 --> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb0dc0c6e60 con 0x7fb0bc06f430 2024-05-27T06:29:36.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.416+0000 7fb0d8c00640 1 -- 172.21.15.87:0/778383413 <== mgr.4111 v2:172.21.15.87:6832/2724754260 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246624 (secure 0 0 0) 0x7fb0dc0c6e60 con 0x7fb0bc06f430 2024-05-27T06:29:36.418 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:29:36.419 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-27T06:29:36.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.420+0000 7fb0e2200640 1 -- 172.21.15.87:0/778383413 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb0bc06f430 msgr2=0x7fb0bc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:36.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.420+0000 7fb0e2200640 1 --2- 172.21.15.87:0/778383413 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb0bc06f430 0x7fb0bc071940 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc157be0 tx=0x7fb0c8008040 comp rx=0 tx=0).stop 2024-05-27T06:29:36.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.420+0000 7fb0e2200640 1 -- 172.21.15.87:0/778383413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0dc0cde10 msgr2=0x7fb0dc148090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:36.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.420+0000 7fb0e2200640 1 --2- 172.21.15.87:0/778383413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0dc0cde10 0x7fb0dc148090 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0b0040 tx=0x7fb0cc019710 comp rx=0 tx=0).stop 2024-05-27T06:29:36.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.420+0000 7fb0e2200640 1 -- 172.21.15.87:0/778383413 shutdown_connections 2024-05-27T06:29:36.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.420+0000 7fb0e2200640 1 --2- 172.21.15.87:0/778383413 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb0bc06f430 0x7fb0bc071940 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:36.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.420+0000 7fb0e2200640 1 --2- 172.21.15.87:0/778383413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0dc161630 0x7fb0dc0c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:36.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.420+0000 7fb0e2200640 1 --2- 172.21.15.87:0/778383413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0dc0d26d0 0x7fb0dc160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:36.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.420+0000 7fb0e2200640 1 --2- 172.21.15.87:0/778383413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0dc0cde10 0x7fb0dc148090 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:36.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.420+0000 7fb0e2200640 1 -- 172.21.15.87:0/778383413 >> 172.21.15.87:0/778383413 conn(0x7fb0dc0d3490 msgr2=0x7fb0dc0d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:36.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.420+0000 7fb0e2200640 1 -- 172.21.15.87:0/778383413 shutdown_connections 2024-05-27T06:29:36.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.420+0000 7fb0e2200640 1 -- 172.21.15.87:0/778383413 wait complete. 2024-05-27T06:29:36.439 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2024-05-27T06:29:34.592546+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226296,"kb_used_data":5964,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748424,"statfs":{"total":773094113280,"available":772862386176,"internally_reserved":0,"allocated":6107136,"data_stored":3380513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.292793"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.325351+0000","last_change":"2024-05-27T06:29:31.325351+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.325351+0000","last_undegraded":"2024-05-27T06:29:31.325351+0000","last_fullsized":"2024-05-27T06:29:31.325351+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.331688+0000","last_change":"2024-05-27T06:29:31.331688+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.331688+0000","last_undegraded":"2024-05-27T06:29:31.331688+0000","last_fullsized":"2024-05-27T06:29:31.331688+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.321588+0000","last_change":"2024-05-27T06:29:31.321588+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.321588+0000","last_undegraded":"2024-05-27T06:29:31.321588+0000","last_fullsized":"2024-05-27T06:29:31.321588+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316361+0000","last_change":"2024-05-27T06:29:31.316361+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316361+0000","last_undegraded":"2024-05-27T06:29:31.316361+0000","last_fullsized":"2024-05-27T06:29:31.316361+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.322694+0000","last_change":"2024-05-27T06:29:31.322694+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.322694+0000","last_undegraded":"2024-05-27T06:29:31.322694+0000","last_fullsized":"2024-05-27T06:29:31.322694+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316328+0000","last_change":"2024-05-27T06:29:31.316328+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316328+0000","last_undegraded":"2024-05-27T06:29:31.316328+0000","last_fullsized":"2024-05-27T06:29:31.316328+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.328222+0000","last_change":"2024-05-27T06:29:31.328222+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.328222+0000","last_undegraded":"2024-05-27T06:29:31.328222+0000","last_fullsized":"2024-05-27T06:29:31.328222+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.329940+0000","last_change":"2024-05-27T06:29:31.329940+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.329940+0000","last_undegraded":"2024-05-27T06:29:31.329940+0000","last_fullsized":"2024-05-27T06:29:31.329940+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.324127+0000","last_change":"2024-05-27T06:29:31.324127+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.324127+0000","last_undegraded":"2024-05-27T06:29:31.324127+0000","last_fullsized":"2024-05-27T06:29:31.324127+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.314719+0000","last_change":"2024-05-27T06:29:31.314719+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.314719+0000","last_undegraded":"2024-05-27T06:29:31.314719+0000","last_fullsized":"2024-05-27T06:29:31.314719+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.314718+0000","last_change":"2024-05-27T06:29:31.314718+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.314718+0000","last_undegraded":"2024-05-27T06:29:31.314718+0000","last_fullsized":"2024-05-27T06:29:31.314718+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.315776+0000","last_change":"2024-05-27T06:29:31.315776+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.315776+0000","last_undegraded":"2024-05-27T06:29:31.315776+0000","last_fullsized":"2024-05-27T06:29:31.315776+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.326291+0000","last_change":"2024-05-27T06:29:31.326291+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.326291+0000","last_undegraded":"2024-05-27T06:29:31.326291+0000","last_fullsized":"2024-05-27T06:29:31.326291+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.324937+0000","last_change":"2024-05-27T06:29:31.324937+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.324937+0000","last_undegraded":"2024-05-27T06:29:31.324937+0000","last_fullsized":"2024-05-27T06:29:31.324937+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.323137+0000","last_change":"2024-05-27T06:29:31.323137+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.323137+0000","last_undegraded":"2024-05-27T06:29:31.323137+0000","last_fullsized":"2024-05-27T06:29:31.323137+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.315935+0000","last_change":"2024-05-27T06:29:31.315935+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.315935+0000","last_undegraded":"2024-05-27T06:29:31.315935+0000","last_fullsized":"2024-05-27T06:29:31.315935+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.331611+0000","last_change":"2024-05-27T06:29:31.331611+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.331611+0000","last_undegraded":"2024-05-27T06:29:31.331611+0000","last_fullsized":"2024-05-27T06:29:31.331611+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.323762+0000","last_change":"2024-05-27T06:29:31.323762+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.323762+0000","last_undegraded":"2024-05-27T06:29:31.323762+0000","last_fullsized":"2024-05-27T06:29:31.323762+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.324275+0000","last_change":"2024-05-27T06:29:31.324275+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.324275+0000","last_undegraded":"2024-05-27T06:29:31.324275+0000","last_fullsized":"2024-05-27T06:29:31.324275+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.330730+0000","last_change":"2024-05-27T06:29:31.330730+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.330730+0000","last_undegraded":"2024-05-27T06:29:31.330730+0000","last_fullsized":"2024-05-27T06:29:31.330730+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.321230+0000","last_change":"2024-05-27T06:29:31.321230+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.321230+0000","last_undegraded":"2024-05-27T06:29:31.321230+0000","last_fullsized":"2024-05-27T06:29:31.321230+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.331015+0000","last_change":"2024-05-27T06:29:31.331015+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.331015+0000","last_undegraded":"2024-05-27T06:29:31.331015+0000","last_fullsized":"2024-05-27T06:29:31.331015+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.319934+0000","last_change":"2024-05-27T06:29:31.319934+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.319934+0000","last_undegraded":"2024-05-27T06:29:31.319934+0000","last_fullsized":"2024-05-27T06:29:31.319934+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.325828+0000","last_change":"2024-05-27T06:29:31.325828+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.325828+0000","last_undegraded":"2024-05-27T06:29:31.325828+0000","last_fullsized":"2024-05-27T06:29:31.325828+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.323843+0000","last_change":"2024-05-27T06:29:31.323843+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.323843+0000","last_undegraded":"2024-05-27T06:29:31.323843+0000","last_fullsized":"2024-05-27T06:29:31.323843+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316929+0000","last_change":"2024-05-27T06:29:31.316929+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316929+0000","last_undegraded":"2024-05-27T06:29:31.316929+0000","last_fullsized":"2024-05-27T06:29:31.316929+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.319583+0000","last_change":"2024-05-27T06:29:31.319583+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.319583+0000","last_undegraded":"2024-05-27T06:29:31.319583+0000","last_fullsized":"2024-05-27T06:29:31.319583+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.322732+0000","last_change":"2024-05-27T06:29:31.322732+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.322732+0000","last_undegraded":"2024-05-27T06:29:31.322732+0000","last_fullsized":"2024-05-27T06:29:31.322732+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.326867+0000","last_change":"2024-05-27T06:29:31.326867+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.326867+0000","last_undegraded":"2024-05-27T06:29:31.326867+0000","last_fullsized":"2024-05-27T06:29:31.326867+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.318606+0000","last_change":"2024-05-27T06:29:31.318606+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.318606+0000","last_undegraded":"2024-05-27T06:29:31.318606+0000","last_fullsized":"2024-05-27T06:29:31.318606+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.322669+0000","last_change":"2024-05-27T06:29:31.322669+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.322669+0000","last_undegraded":"2024-05-27T06:29:31.322669+0000","last_fullsized":"2024-05-27T06:29:31.322669+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.315121+0000","last_change":"2024-05-27T06:29:31.315121+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.315121+0000","last_undegraded":"2024-05-27T06:29:31.315121+0000","last_fullsized":"2024-05-27T06:29:31.315121+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.318800+0000","last_change":"2024-05-27T06:29:31.318800+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.318800+0000","last_undegraded":"2024-05-27T06:29:31.318800+0000","last_fullsized":"2024-05-27T06:29:31.318800+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.342721+0000","last_change":"2024-05-27T06:29:31.337912+0000","last_active":"2024-05-27T06:29:31.342721+0000","last_peered":"2024-05-27T06:29:31.342721+0000","last_clean":"2024-05-27T06:29:31.342721+0000","last_became_active":"2024-05-27T06:29:31.337076+0000","last_became_peered":"2024-05-27T06:29:31.337076+0000","last_unstale":"2024-05-27T06:29:31.342721+0000","last_undegraded":"2024-05-27T06:29:31.342721+0000","last_fullsized":"2024-05-27T06:29:31.342721+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:49:26.326325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.314740+0000","last_change":"2024-05-27T06:29:31.314740+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.314740+0000","last_undegraded":"2024-05-27T06:29:31.314740+0000","last_fullsized":"2024-05-27T06:29:31.314740+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.345646+0000","last_change":"2024-05-27T06:29:31.340901+0000","last_active":"2024-05-27T06:29:31.345646+0000","last_peered":"2024-05-27T06:29:31.345646+0000","last_clean":"2024-05-27T06:29:31.345646+0000","last_became_active":"2024-05-27T06:29:31.340584+0000","last_became_peered":"2024-05-27T06:29:31.340584+0000","last_unstale":"2024-05-27T06:29:31.345646+0000","last_undegraded":"2024-05-27T06:29:31.345646+0000","last_fullsized":"2024-05-27T06:29:31.345646+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:16:07.331463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.317761+0000","last_change":"2024-05-27T06:29:31.317761+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.317761+0000","last_undegraded":"2024-05-27T06:29:31.317761+0000","last_fullsized":"2024-05-27T06:29:31.317761+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.325224+0000","last_change":"2024-05-27T06:29:31.321412+0000","last_active":"2024-05-27T06:29:31.325224+0000","last_peered":"2024-05-27T06:29:31.325224+0000","last_clean":"2024-05-27T06:29:31.325224+0000","last_became_active":"2024-05-27T06:29:31.321110+0000","last_became_peered":"2024-05-27T06:29:31.321110+0000","last_unstale":"2024-05-27T06:29:31.325224+0000","last_undegraded":"2024-05-27T06:29:31.325224+0000","last_fullsized":"2024-05-27T06:29:31.325224+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:18:17.279684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.319138+0000","last_change":"2024-05-27T06:29:31.319138+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.319138+0000","last_undegraded":"2024-05-27T06:29:31.319138+0000","last_fullsized":"2024-05-27T06:29:31.319138+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.336819+0000","last_change":"2024-05-27T06:29:31.324922+0000","last_active":"2024-05-27T06:29:31.336819+0000","last_peered":"2024-05-27T06:29:31.336819+0000","last_clean":"2024-05-27T06:29:31.336819+0000","last_became_active":"2024-05-27T06:29:31.324534+0000","last_became_peered":"2024-05-27T06:29:31.324534+0000","last_unstale":"2024-05-27T06:29:31.336819+0000","last_undegraded":"2024-05-27T06:29:31.336819+0000","last_fullsized":"2024-05-27T06:29:31.336819+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:07:45.468162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.328009+0000","last_change":"2024-05-27T06:29:31.328009+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.328009+0000","last_undegraded":"2024-05-27T06:29:31.328009+0000","last_fullsized":"2024-05-27T06:29:31.328009+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.335743+0000","last_change":"2024-05-27T06:29:31.328972+0000","last_active":"2024-05-27T06:29:31.335743+0000","last_peered":"2024-05-27T06:29:31.335743+0000","last_clean":"2024-05-27T06:29:31.335743+0000","last_became_active":"2024-05-27T06:29:31.328662+0000","last_became_peered":"2024-05-27T06:29:31.328662+0000","last_unstale":"2024-05-27T06:29:31.335743+0000","last_undegraded":"2024-05-27T06:29:31.335743+0000","last_fullsized":"2024-05-27T06:29:31.335743+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:21:50.798081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.326491+0000","last_change":"2024-05-27T06:29:31.326491+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.326491+0000","last_undegraded":"2024-05-27T06:29:31.326491+0000","last_fullsized":"2024-05-27T06:29:31.326491+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.340527+0000","last_change":"2024-05-27T06:29:31.333973+0000","last_active":"2024-05-27T06:29:31.340527+0000","last_peered":"2024-05-27T06:29:31.340527+0000","last_clean":"2024-05-27T06:29:31.340527+0000","last_became_active":"2024-05-27T06:29:31.333665+0000","last_became_peered":"2024-05-27T06:29:31.333665+0000","last_unstale":"2024-05-27T06:29:31.340527+0000","last_undegraded":"2024-05-27T06:29:31.340527+0000","last_fullsized":"2024-05-27T06:29:31.340527+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:55:11.170951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.325035+0000","last_change":"2024-05-27T06:29:31.325035+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.325035+0000","last_undegraded":"2024-05-27T06:29:31.325035+0000","last_fullsized":"2024-05-27T06:29:31.325035+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.337686+0000","last_change":"2024-05-27T06:29:31.332145+0000","last_active":"2024-05-27T06:29:31.337686+0000","last_peered":"2024-05-27T06:29:31.337686+0000","last_clean":"2024-05-27T06:29:31.337686+0000","last_became_active":"2024-05-27T06:29:31.331328+0000","last_became_peered":"2024-05-27T06:29:31.331328+0000","last_unstale":"2024-05-27T06:29:31.337686+0000","last_undegraded":"2024-05-27T06:29:31.337686+0000","last_fullsized":"2024-05-27T06:29:31.337686+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:50:20.583108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.321350+0000","last_change":"2024-05-27T06:29:31.321350+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.321350+0000","last_undegraded":"2024-05-27T06:29:31.321350+0000","last_fullsized":"2024-05-27T06:29:31.321350+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.341435+0000","last_change":"2024-05-27T06:29:31.339195+0000","last_active":"2024-05-27T06:29:31.341435+0000","last_peered":"2024-05-27T06:29:31.341435+0000","last_clean":"2024-05-27T06:29:31.341435+0000","last_became_active":"2024-05-27T06:29:31.338863+0000","last_became_peered":"2024-05-27T06:29:31.338863+0000","last_unstale":"2024-05-27T06:29:31.341435+0000","last_undegraded":"2024-05-27T06:29:31.341435+0000","last_fullsized":"2024-05-27T06:29:31.341435+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:05:26.579241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.322484+0000","last_change":"2024-05-27T06:29:31.322484+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.322484+0000","last_undegraded":"2024-05-27T06:29:31.322484+0000","last_fullsized":"2024-05-27T06:29:31.322484+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.342900+0000","last_change":"2024-05-27T06:29:31.340841+0000","last_active":"2024-05-27T06:29:31.342900+0000","last_peered":"2024-05-27T06:29:31.342900+0000","last_clean":"2024-05-27T06:29:31.342900+0000","last_became_active":"2024-05-27T06:29:31.340483+0000","last_became_peered":"2024-05-27T06:29:31.340483+0000","last_unstale":"2024-05-27T06:29:31.342900+0000","last_undegraded":"2024-05-27T06:29:31.342900+0000","last_fullsized":"2024-05-27T06:29:31.342900+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:07:45.468162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.319216+0000","last_change":"2024-05-27T06:29:31.319216+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.319216+0000","last_undegraded":"2024-05-27T06:29:31.319216+0000","last_fullsized":"2024-05-27T06:29:31.319216+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.343028+0000","last_change":"2024-05-27T06:29:31.336123+0000","last_active":"2024-05-27T06:29:31.343028+0000","last_peered":"2024-05-27T06:29:31.343028+0000","last_clean":"2024-05-27T06:29:31.343028+0000","last_became_active":"2024-05-27T06:29:31.335682+0000","last_became_peered":"2024-05-27T06:29:31.335682+0000","last_unstale":"2024-05-27T06:29:31.343028+0000","last_undegraded":"2024-05-27T06:29:31.343028+0000","last_fullsized":"2024-05-27T06:29:31.343028+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:49:26.326325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.315321+0000","last_change":"2024-05-27T06:29:31.315321+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.315321+0000","last_undegraded":"2024-05-27T06:29:31.315321+0000","last_fullsized":"2024-05-27T06:29:31.315321+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.342881+0000","last_change":"2024-05-27T06:29:31.340823+0000","last_active":"2024-05-27T06:29:31.342881+0000","last_peered":"2024-05-27T06:29:31.342881+0000","last_clean":"2024-05-27T06:29:31.342881+0000","last_became_active":"2024-05-27T06:29:31.340446+0000","last_became_peered":"2024-05-27T06:29:31.340446+0000","last_unstale":"2024-05-27T06:29:31.342881+0000","last_undegraded":"2024-05-27T06:29:31.342881+0000","last_fullsized":"2024-05-27T06:29:31.342881+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:18:17.279684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.321073+0000","last_change":"2024-05-27T06:29:31.321073+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.321073+0000","last_undegraded":"2024-05-27T06:29:31.321073+0000","last_fullsized":"2024-05-27T06:29:31.321073+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.336747+0000","last_change":"2024-05-27T06:29:31.331195+0000","last_active":"2024-05-27T06:29:31.336747+0000","last_peered":"2024-05-27T06:29:31.336747+0000","last_clean":"2024-05-27T06:29:31.336747+0000","last_became_active":"2024-05-27T06:29:31.330881+0000","last_became_peered":"2024-05-27T06:29:31.330881+0000","last_unstale":"2024-05-27T06:29:31.336747+0000","last_undegraded":"2024-05-27T06:29:31.336747+0000","last_fullsized":"2024-05-27T06:29:31.336747+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:24:48.091681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.318280+0000","last_change":"2024-05-27T06:29:31.318280+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.318280+0000","last_undegraded":"2024-05-27T06:29:31.318280+0000","last_fullsized":"2024-05-27T06:29:31.318280+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.343187+0000","last_change":"2024-05-27T06:29:31.336599+0000","last_active":"2024-05-27T06:29:31.343187+0000","last_peered":"2024-05-27T06:29:31.343187+0000","last_clean":"2024-05-27T06:29:31.343187+0000","last_became_active":"2024-05-27T06:29:31.336273+0000","last_became_peered":"2024-05-27T06:29:31.336273+0000","last_unstale":"2024-05-27T06:29:31.343187+0000","last_undegraded":"2024-05-27T06:29:31.343187+0000","last_fullsized":"2024-05-27T06:29:31.343187+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:10:34.186274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.320720+0000","last_change":"2024-05-27T06:29:31.320720+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.320720+0000","last_undegraded":"2024-05-27T06:29:31.320720+0000","last_fullsized":"2024-05-27T06:29:31.320720+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.341063+0000","last_change":"2024-05-27T06:29:31.335657+0000","last_active":"2024-05-27T06:29:31.341063+0000","last_peered":"2024-05-27T06:29:31.341063+0000","last_clean":"2024-05-27T06:29:31.341063+0000","last_became_active":"2024-05-27T06:29:31.335285+0000","last_became_peered":"2024-05-27T06:29:31.335285+0000","last_unstale":"2024-05-27T06:29:31.341063+0000","last_undegraded":"2024-05-27T06:29:31.341063+0000","last_fullsized":"2024-05-27T06:29:31.341063+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:48:45.545585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.322872+0000","last_change":"2024-05-27T06:29:31.322872+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.322872+0000","last_undegraded":"2024-05-27T06:29:31.322872+0000","last_fullsized":"2024-05-27T06:29:31.322872+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.331881+0000","last_change":"2024-05-27T06:29:31.323676+0000","last_active":"2024-05-27T06:29:31.331881+0000","last_peered":"2024-05-27T06:29:31.331881+0000","last_clean":"2024-05-27T06:29:31.331881+0000","last_became_active":"2024-05-27T06:29:31.323378+0000","last_became_peered":"2024-05-27T06:29:31.323378+0000","last_unstale":"2024-05-27T06:29:31.331881+0000","last_undegraded":"2024-05-27T06:29:31.331881+0000","last_fullsized":"2024-05-27T06:29:31.331881+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:18:17.279684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.318732+0000","last_change":"2024-05-27T06:29:31.318732+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.318732+0000","last_undegraded":"2024-05-27T06:29:31.318732+0000","last_fullsized":"2024-05-27T06:29:31.318732+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.342845+0000","last_change":"2024-05-27T06:29:31.340500+0000","last_active":"2024-05-27T06:29:31.342845+0000","last_peered":"2024-05-27T06:29:31.342845+0000","last_clean":"2024-05-27T06:29:31.342845+0000","last_became_active":"2024-05-27T06:29:31.340151+0000","last_became_peered":"2024-05-27T06:29:31.340151+0000","last_unstale":"2024-05-27T06:29:31.342845+0000","last_undegraded":"2024-05-27T06:29:31.342845+0000","last_fullsized":"2024-05-27T06:29:31.342845+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:25:39.940766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.320036+0000","last_change":"2024-05-27T06:29:31.320036+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.320036+0000","last_undegraded":"2024-05-27T06:29:31.320036+0000","last_fullsized":"2024-05-27T06:29:31.320036+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.343239+0000","last_change":"2024-05-27T06:29:31.336677+0000","last_active":"2024-05-27T06:29:31.343239+0000","last_peered":"2024-05-27T06:29:31.343239+0000","last_clean":"2024-05-27T06:29:31.343239+0000","last_became_active":"2024-05-27T06:29:31.336379+0000","last_became_peered":"2024-05-27T06:29:31.336379+0000","last_unstale":"2024-05-27T06:29:31.343239+0000","last_undegraded":"2024-05-27T06:29:31.343239+0000","last_fullsized":"2024-05-27T06:29:31.343239+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:24:21.069227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316739+0000","last_change":"2024-05-27T06:29:31.316739+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316739+0000","last_undegraded":"2024-05-27T06:29:31.316739+0000","last_fullsized":"2024-05-27T06:29:31.316739+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.335883+0000","last_change":"2024-05-27T06:29:31.329550+0000","last_active":"2024-05-27T06:29:31.335883+0000","last_peered":"2024-05-27T06:29:31.335883+0000","last_clean":"2024-05-27T06:29:31.335883+0000","last_became_active":"2024-05-27T06:29:31.329294+0000","last_became_peered":"2024-05-27T06:29:31.329294+0000","last_unstale":"2024-05-27T06:29:31.335883+0000","last_undegraded":"2024-05-27T06:29:31.335883+0000","last_fullsized":"2024-05-27T06:29:31.335883+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:07:45.468162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.325710+0000","last_change":"2024-05-27T06:29:31.325710+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.325710+0000","last_undegraded":"2024-05-27T06:29:31.325710+0000","last_fullsized":"2024-05-27T06:29:31.325710+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.336602+0000","last_change":"2024-05-27T06:29:31.330141+0000","last_active":"2024-05-27T06:29:31.336602+0000","last_peered":"2024-05-27T06:29:31.336602+0000","last_clean":"2024-05-27T06:29:31.336602+0000","last_became_active":"2024-05-27T06:29:31.329830+0000","last_became_peered":"2024-05-27T06:29:31.329830+0000","last_unstale":"2024-05-27T06:29:31.336602+0000","last_undegraded":"2024-05-27T06:29:31.336602+0000","last_fullsized":"2024-05-27T06:29:31.336602+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:51:42.711265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.320595+0000","last_change":"2024-05-27T06:29:31.320595+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.320595+0000","last_undegraded":"2024-05-27T06:29:31.320595+0000","last_fullsized":"2024-05-27T06:29:31.320595+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.336058+0000","last_change":"2024-05-27T06:29:31.332562+0000","last_active":"2024-05-27T06:29:31.336058+0000","last_peered":"2024-05-27T06:29:31.336058+0000","last_clean":"2024-05-27T06:29:31.336058+0000","last_became_active":"2024-05-27T06:29:31.332221+0000","last_became_peered":"2024-05-27T06:29:31.332221+0000","last_unstale":"2024-05-27T06:29:31.336058+0000","last_undegraded":"2024-05-27T06:29:31.336058+0000","last_fullsized":"2024-05-27T06:29:31.336058+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:51:42.711265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316837+0000","last_change":"2024-05-27T06:29:31.316837+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316837+0000","last_undegraded":"2024-05-27T06:29:31.316837+0000","last_fullsized":"2024-05-27T06:29:31.316837+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.343207+0000","last_change":"2024-05-27T06:29:31.336613+0000","last_active":"2024-05-27T06:29:31.343207+0000","last_peered":"2024-05-27T06:29:31.343207+0000","last_clean":"2024-05-27T06:29:31.343207+0000","last_became_active":"2024-05-27T06:29:31.336319+0000","last_became_peered":"2024-05-27T06:29:31.336319+0000","last_unstale":"2024-05-27T06:29:31.343207+0000","last_undegraded":"2024-05-27T06:29:31.343207+0000","last_fullsized":"2024-05-27T06:29:31.343207+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:16:41.521107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316374+0000","last_change":"2024-05-27T06:29:31.316374+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316374+0000","last_undegraded":"2024-05-27T06:29:31.316374+0000","last_fullsized":"2024-05-27T06:29:31.316374+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.331552+0000","last_change":"2024-05-27T06:29:31.326223+0000","last_active":"2024-05-27T06:29:31.331552+0000","last_peered":"2024-05-27T06:29:31.331552+0000","last_clean":"2024-05-27T06:29:31.331552+0000","last_became_active":"2024-05-27T06:29:31.325962+0000","last_became_peered":"2024-05-27T06:29:31.325962+0000","last_unstale":"2024-05-27T06:29:31.331552+0000","last_undegraded":"2024-05-27T06:29:31.331552+0000","last_fullsized":"2024-05-27T06:29:31.331552+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:21:17.064386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.315692+0000","last_change":"2024-05-27T06:29:31.315692+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.315692+0000","last_undegraded":"2024-05-27T06:29:31.315692+0000","last_fullsized":"2024-05-27T06:29:31.315692+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.337644+0000","last_change":"2024-05-27T06:29:31.332841+0000","last_active":"2024-05-27T06:29:31.337644+0000","last_peered":"2024-05-27T06:29:31.337644+0000","last_clean":"2024-05-27T06:29:31.337644+0000","last_became_active":"2024-05-27T06:29:31.332404+0000","last_became_peered":"2024-05-27T06:29:31.332404+0000","last_unstale":"2024-05-27T06:29:31.337644+0000","last_undegraded":"2024-05-27T06:29:31.337644+0000","last_fullsized":"2024-05-27T06:29:31.337644+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:55:11.170951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316490+0000","last_change":"2024-05-27T06:29:31.316490+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316490+0000","last_undegraded":"2024-05-27T06:29:31.316490+0000","last_fullsized":"2024-05-27T06:29:31.316490+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.342953+0000","last_change":"2024-05-27T06:29:31.338844+0000","last_active":"2024-05-27T06:29:31.342953+0000","last_peered":"2024-05-27T06:29:31.342953+0000","last_clean":"2024-05-27T06:29:31.342953+0000","last_became_active":"2024-05-27T06:29:31.338521+0000","last_became_peered":"2024-05-27T06:29:31.338521+0000","last_unstale":"2024-05-27T06:29:31.342953+0000","last_undegraded":"2024-05-27T06:29:31.342953+0000","last_fullsized":"2024-05-27T06:29:31.342953+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:31:46.375058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316199+0000","last_change":"2024-05-27T06:29:31.316199+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316199+0000","last_undegraded":"2024-05-27T06:29:31.316199+0000","last_fullsized":"2024-05-27T06:29:31.316199+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.336114+0000","last_change":"2024-05-27T06:29:31.333344+0000","last_active":"2024-05-27T06:29:31.336114+0000","last_peered":"2024-05-27T06:29:31.336114+0000","last_clean":"2024-05-27T06:29:31.336114+0000","last_became_active":"2024-05-27T06:29:31.333044+0000","last_became_peered":"2024-05-27T06:29:31.333044+0000","last_unstale":"2024-05-27T06:29:31.336114+0000","last_undegraded":"2024-05-27T06:29:31.336114+0000","last_fullsized":"2024-05-27T06:29:31.336114+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:50:20.583108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.314819+0000","last_change":"2024-05-27T06:29:31.314819+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.314819+0000","last_undegraded":"2024-05-27T06:29:31.314819+0000","last_fullsized":"2024-05-27T06:29:31.314819+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.337606+0000","last_change":"2024-05-27T06:29:31.335481+0000","last_active":"2024-05-27T06:29:31.337606+0000","last_peered":"2024-05-27T06:29:31.337606+0000","last_clean":"2024-05-27T06:29:31.337606+0000","last_became_active":"2024-05-27T06:29:31.334999+0000","last_became_peered":"2024-05-27T06:29:31.334999+0000","last_unstale":"2024-05-27T06:29:31.337606+0000","last_undegraded":"2024-05-27T06:29:31.337606+0000","last_fullsized":"2024-05-27T06:29:31.337606+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:05:26.579241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.317184+0000","last_change":"2024-05-27T06:29:31.317184+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.317184+0000","last_undegraded":"2024-05-27T06:29:31.317184+0000","last_fullsized":"2024-05-27T06:29:31.317184+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.339998+0000","last_change":"2024-05-27T06:29:31.336050+0000","last_active":"2024-05-27T06:29:31.339998+0000","last_peered":"2024-05-27T06:29:31.339998+0000","last_clean":"2024-05-27T06:29:31.339998+0000","last_became_active":"2024-05-27T06:29:31.335730+0000","last_became_peered":"2024-05-27T06:29:31.335730+0000","last_unstale":"2024-05-27T06:29:31.339998+0000","last_undegraded":"2024-05-27T06:29:31.339998+0000","last_fullsized":"2024-05-27T06:29:31.339998+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:49:26.326325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.321809+0000","last_change":"2024-05-27T06:29:31.321809+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.321809+0000","last_undegraded":"2024-05-27T06:29:31.321809+0000","last_fullsized":"2024-05-27T06:29:31.321809+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.330550+0000","last_change":"2024-05-27T06:29:31.322798+0000","last_active":"2024-05-27T06:29:31.330550+0000","last_peered":"2024-05-27T06:29:31.330550+0000","last_clean":"2024-05-27T06:29:31.330550+0000","last_became_active":"2024-05-27T06:29:31.322512+0000","last_became_peered":"2024-05-27T06:29:31.322512+0000","last_unstale":"2024-05-27T06:29:31.330550+0000","last_undegraded":"2024-05-27T06:29:31.330550+0000","last_fullsized":"2024-05-27T06:29:31.330550+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:48:45.545585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.320106+0000","last_change":"2024-05-27T06:29:31.320106+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.320106+0000","last_undegraded":"2024-05-27T06:29:31.320106+0000","last_fullsized":"2024-05-27T06:29:31.320106+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.335841+0000","last_change":"2024-05-27T06:29:31.333682+0000","last_active":"2024-05-27T06:29:31.335841+0000","last_peered":"2024-05-27T06:29:31.335841+0000","last_clean":"2024-05-27T06:29:31.335841+0000","last_became_active":"2024-05-27T06:29:31.333356+0000","last_became_peered":"2024-05-27T06:29:31.333356+0000","last_unstale":"2024-05-27T06:29:31.335841+0000","last_undegraded":"2024-05-27T06:29:31.335841+0000","last_fullsized":"2024-05-27T06:29:31.335841+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:50:50.388948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.314897+0000","last_change":"2024-05-27T06:29:31.314897+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.314897+0000","last_undegraded":"2024-05-27T06:29:31.314897+0000","last_fullsized":"2024-05-27T06:29:31.314897+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.321473+0000","last_change":"2024-05-27T06:29:31.319544+0000","last_active":"2024-05-27T06:29:31.321473+0000","last_peered":"2024-05-27T06:29:31.321473+0000","last_clean":"2024-05-27T06:29:31.321473+0000","last_became_active":"2024-05-27T06:29:31.319187+0000","last_became_peered":"2024-05-27T06:29:31.319187+0000","last_unstale":"2024-05-27T06:29:31.321473+0000","last_undegraded":"2024-05-27T06:29:31.321473+0000","last_fullsized":"2024-05-27T06:29:31.321473+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:05:26.579241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.320910+0000","last_change":"2024-05-27T06:29:31.320910+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.320910+0000","last_undegraded":"2024-05-27T06:29:31.320910+0000","last_fullsized":"2024-05-27T06:29:31.320910+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.337788+0000","last_change":"2024-05-27T06:29:31.330242+0000","last_active":"2024-05-27T06:29:31.337788+0000","last_peered":"2024-05-27T06:29:31.337788+0000","last_clean":"2024-05-27T06:29:31.337788+0000","last_became_active":"2024-05-27T06:29:31.329531+0000","last_became_peered":"2024-05-27T06:29:31.329531+0000","last_unstale":"2024-05-27T06:29:31.337788+0000","last_undegraded":"2024-05-27T06:29:31.337788+0000","last_fullsized":"2024-05-27T06:29:31.337788+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:55:11.170951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.319519+0000","last_change":"2024-05-27T06:29:31.319519+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.319519+0000","last_undegraded":"2024-05-27T06:29:31.319519+0000","last_fullsized":"2024-05-27T06:29:31.319519+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.342691+0000","last_change":"2024-05-27T06:29:31.338455+0000","last_active":"2024-05-27T06:29:31.342691+0000","last_peered":"2024-05-27T06:29:31.342691+0000","last_clean":"2024-05-27T06:29:31.342691+0000","last_became_active":"2024-05-27T06:29:31.338096+0000","last_became_peered":"2024-05-27T06:29:31.338096+0000","last_unstale":"2024-05-27T06:29:31.342691+0000","last_undegraded":"2024-05-27T06:29:31.342691+0000","last_fullsized":"2024-05-27T06:29:31.342691+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:21:17.064386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":169,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.328335+0000","last_change":"2024-05-27T06:27:28.692457+0000","last_active":"2024-05-27T06:29:31.328335+0000","last_peered":"2024-05-27T06:29:31.328335+0000","last_clean":"2024-05-27T06:29:31.328335+0000","last_became_active":"2024-05-27T06:27:28.691290+0000","last_became_peered":"2024-05-27T06:27:28.691290+0000","last_unstale":"2024-05-27T06:29:31.328335+0000","last_undegraded":"2024-05-27T06:29:31.328335+0000","last_fullsized":"2024-05-27T06:29:31.328335+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_clean_scrub_stamp":"2024-05-27T06:27:26.991915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:45.563728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28212,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343628,"statfs":{"total":96636764160,"available":96607875072,"internally_reserved":0,"allocated":1216512,"data_stored":869502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":272475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":272475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":272475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":272475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":279134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":272475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32372,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":1216512,"data_stored":869502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T06:29:36.443 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T06:29:36.495 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T06:29:36.549 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T06:29:36.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.644+0000 7fc98f200640 1 Processor -- start 2024-05-27T06:29:36.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.644+0000 7fc98f200640 1 -- start start 2024-05-27T06:29:36.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.644+0000 7fc98f200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc9880cea40 0x7fc988158360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:36.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.644+0000 7fc98f200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc9880b2fb0 0x7fc9880b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:36.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.644+0000 7fc98f200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9880b2cd0 con 0x7fc9880d2010 2024-05-27T06:29:36.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.644+0000 7fc98f200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fc9880ce5b0 con 0x7fc9880cea40 2024-05-27T06:29:36.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.644+0000 7fc98f200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fc9880cdc80 con 0x7fc9880b2fb0 2024-05-27T06:29:36.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.644+0000 7fc987e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc9880cea40 0x7fc988158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:36.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.644+0000 7fc987e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc9880cea40 0x7fc988158360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57102/0 (socket says 172.21.15.87:57102) 2024-05-27T06:29:36.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.644+0000 7fc987e00640 1 -- 172.21.15.87:0/336150987 learned_addr learned my addr 172.21.15.87:0/336150987 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:36.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.644+0000 7fc98d200640 1 --2- 172.21.15.87:0/336150987 >> v2:172.21.15.149:3300/0 conn(0x7fc9880b2fb0 0x7fc9880b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:36.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.644+0000 7fc987e00640 1 -- 172.21.15.87:0/336150987 >> v2:172.21.15.149:3300/0 conn(0x7fc9880b2fb0 msgr2=0x7fc9880b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:36.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.644+0000 7fc987e00640 1 --2- 172.21.15.87:0/336150987 >> v2:172.21.15.149:3300/0 conn(0x7fc9880b2fb0 0x7fc9880b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:36.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.644+0000 7fc987e00640 1 -- 172.21.15.87:0/336150987 >> v1:172.21.15.149:6789/0 conn(0x7fc9880d2010 legacy=0x7fc9880d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:36.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.644+0000 7fc987e00640 1 -- 172.21.15.87:0/336150987 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9880cdf60 con 0x7fc9880cea40 2024-05-27T06:29:36.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.644+0000 7fc98d200640 1 --2- 172.21.15.87:0/336150987 >> v2:172.21.15.149:3300/0 conn(0x7fc9880b2fb0 0x7fc9880b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:29:36.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.648+0000 7fc987e00640 1 --2- 172.21.15.87:0/336150987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9880cea40 0x7fc988158360 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc988074ab0 tx=0x7fc97801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562af286e2868f02 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:36.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.648+0000 7fc987400640 1 -- 172.21.15.87:0/336150987 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9780aa610 con 0x7fc9880cea40 2024-05-27T06:29:36.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.648+0000 7fc987400640 1 -- 172.21.15.87:0/336150987 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9780af070 con 0x7fc9880cea40 2024-05-27T06:29:36.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.648+0000 7fc987400640 1 -- 172.21.15.87:0/336150987 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9780aa9d0 con 0x7fc9880cea40 2024-05-27T06:29:36.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.648+0000 7fc98f200640 1 -- 172.21.15.87:0/336150987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9880cea40 msgr2=0x7fc988158360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:36.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.648+0000 7fc98f200640 1 --2- 172.21.15.87:0/336150987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9880cea40 0x7fc988158360 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc988074ab0 tx=0x7fc97801c4f0 comp rx=0 tx=0).stop 2024-05-27T06:29:36.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.648+0000 7fc98f200640 1 -- 172.21.15.87:0/336150987 shutdown_connections 2024-05-27T06:29:36.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.648+0000 7fc98f200640 1 --2- 172.21.15.87:0/336150987 >> v2:172.21.15.149:3300/0 conn(0x7fc9880b2fb0 0x7fc9880b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:36.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.648+0000 7fc98f200640 1 --2- 172.21.15.87:0/336150987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9880cea40 0x7fc988158360 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:36.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.648+0000 7fc98f200640 1 -- 172.21.15.87:0/336150987 >> 172.21.15.87:0/336150987 conn(0x7fc9880d3590 msgr2=0x7fc9880d39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:36.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.648+0000 7fc98f200640 1 -- 172.21.15.87:0/336150987 shutdown_connections 2024-05-27T06:29:36.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.648+0000 7fc98f200640 1 -- 172.21.15.87:0/336150987 wait complete. 2024-05-27T06:29:36.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.652+0000 7fc98f200640 1 Processor -- start 2024-05-27T06:29:36.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.652+0000 7fc98f200640 1 -- start start 2024-05-27T06:29:36.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.652+0000 7fc98f200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9880b2fb0 0x7fc98814bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:36.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.652+0000 7fc98f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9880cea40 0x7fc988158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:36.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.652+0000 7fc98f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9880d2010 0x7fc9880cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:36.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.652+0000 7fc98f200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc9880d2ee0 con 0x7fc9880b2fb0 2024-05-27T06:29:36.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.652+0000 7fc98f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc9880d2d60 con 0x7fc9880d2010 2024-05-27T06:29:36.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.652+0000 7fc98f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc9880cee50 con 0x7fc9880cea40 2024-05-27T06:29:36.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.652+0000 7fc987e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9880b2fb0 0x7fc98814bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:36.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.652+0000 7fc987e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9880b2fb0 0x7fc98814bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57116/0 (socket says 172.21.15.87:57116) 2024-05-27T06:29:36.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.652+0000 7fc987e00640 1 -- 172.21.15.87:0/4226233534 learned_addr learned my addr 172.21.15.87:0/4226233534 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:36.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.652+0000 7fc987e00640 1 -- 172.21.15.87:0/4226233534 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9880cea40 msgr2=0x7fc988158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:36.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.652+0000 7fc987e00640 1 --2- 172.21.15.87:0/4226233534 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9880cea40 0x7fc988158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:36.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.652+0000 7fc987e00640 1 -- 172.21.15.87:0/4226233534 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9880d2010 msgr2=0x7fc9880cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:36.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.652+0000 7fc987e00640 1 --2- 172.21.15.87:0/4226233534 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9880d2010 0x7fc9880cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:36.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.652+0000 7fc987e00640 1 -- 172.21.15.87:0/4226233534 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9880cb9b0 con 0x7fc9880b2fb0 2024-05-27T06:29:36.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.656+0000 7fc987e00640 1 --2- 172.21.15.87:0/4226233534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9880b2fb0 0x7fc98814bed0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc97801aba0 tx=0x7fc97801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:36.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.656+0000 7fc984c00640 1 -- 172.21.15.87:0/4226233534 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9780b3800 con 0x7fc9880b2fb0 2024-05-27T06:29:36.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.656+0000 7fc984c00640 1 -- 172.21.15.87:0/4226233534 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9780b39c0 con 0x7fc9880b2fb0 2024-05-27T06:29:36.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.656+0000 7fc984c00640 1 -- 172.21.15.87:0/4226233534 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9780b3db0 con 0x7fc9880b2fb0 2024-05-27T06:29:36.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.656+0000 7fc98f200640 1 -- 172.21.15.87:0/4226233534 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9880cbc90 con 0x7fc9880b2fb0 2024-05-27T06:29:36.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.656+0000 7fc98f200640 1 -- 172.21.15.87:0/4226233534 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9880cc250 con 0x7fc9880b2fb0 2024-05-27T06:29:36.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.656+0000 7fc98f200640 1 -- 172.21.15.87:0/4226233534 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc98806aa30 con 0x7fc9880b2fb0 2024-05-27T06:29:36.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.656+0000 7fc984c00640 1 -- 172.21.15.87:0/4226233534 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc9780b2380 con 0x7fc9880b2fb0 2024-05-27T06:29:36.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.660+0000 7fc984c00640 1 --2- 172.21.15.87:0/4226233534 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc96406f430 0x7fc964071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:36.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.660+0000 7fc984c00640 1 -- 172.21.15.87:0/4226233534 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fc978129420 con 0x7fc9880b2fb0 2024-05-27T06:29:36.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.660+0000 7fc97f400640 1 --2- 172.21.15.87:0/4226233534 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc96406f430 0x7fc964071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:36.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.660+0000 7fc97f400640 1 --2- 172.21.15.87:0/4226233534 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc96406f430 0x7fc964071940 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc9880b29f0 tx=0x7fc970006bd0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:36.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.664+0000 7fc984c00640 1 -- 172.21.15.87:0/4226233534 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fc9780a7070 con 0x7fc9880b2fb0 2024-05-27T06:29:36.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.820+0000 7fc98f200640 1 -- 172.21.15.87:0/4226233534 --> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc988169c20 con 0x7fc96406f430 2024-05-27T06:29:36.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.824+0000 7fc984c00640 1 -- 172.21.15.87:0/4226233534 <== mgr.4111 v2:172.21.15.87:6832/2724754260 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246624 (secure 0 0 0) 0x7fc988169c20 con 0x7fc96406f430 2024-05-27T06:29:36.827 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:29:36.828 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-27T06:29:36.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.828+0000 7fc98f200640 1 -- 172.21.15.87:0/4226233534 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc96406f430 msgr2=0x7fc964071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:36.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.828+0000 7fc98f200640 1 --2- 172.21.15.87:0/4226233534 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc96406f430 0x7fc964071940 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc9880b29f0 tx=0x7fc970006bd0 comp rx=0 tx=0).stop 2024-05-27T06:29:36.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.828+0000 7fc98f200640 1 -- 172.21.15.87:0/4226233534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9880b2fb0 msgr2=0x7fc98814bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:36.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.828+0000 7fc98f200640 1 --2- 172.21.15.87:0/4226233534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9880b2fb0 0x7fc98814bed0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc97801aba0 tx=0x7fc97801ad30 comp rx=0 tx=0).stop 2024-05-27T06:29:36.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.828+0000 7fc98f200640 1 -- 172.21.15.87:0/4226233534 shutdown_connections 2024-05-27T06:29:36.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.828+0000 7fc98f200640 1 --2- 172.21.15.87:0/4226233534 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc96406f430 0x7fc964071940 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:36.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.828+0000 7fc98f200640 1 --2- 172.21.15.87:0/4226233534 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9880d2010 0x7fc9880cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:36.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.828+0000 7fc98f200640 1 --2- 172.21.15.87:0/4226233534 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9880cea40 0x7fc988158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:36.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.828+0000 7fc98f200640 1 --2- 172.21.15.87:0/4226233534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9880b2fb0 0x7fc98814bed0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:36.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.828+0000 7fc98f200640 1 -- 172.21.15.87:0/4226233534 >> 172.21.15.87:0/4226233534 conn(0x7fc9880d3590 msgr2=0x7fc9880b6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:36.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.828+0000 7fc98f200640 1 -- 172.21.15.87:0/4226233534 shutdown_connections 2024-05-27T06:29:36.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:36.828+0000 7fc98f200640 1 -- 172.21.15.87:0/4226233534 wait complete. 2024-05-27T06:29:36.847 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2024-05-27T06:29:36.592865+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226296,"kb_used_data":5964,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748424,"statfs":{"total":773094113280,"available":772862386176,"internally_reserved":0,"allocated":6107136,"data_stored":3380513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000957"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.325351+0000","last_change":"2024-05-27T06:29:31.325351+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.325351+0000","last_undegraded":"2024-05-27T06:29:31.325351+0000","last_fullsized":"2024-05-27T06:29:31.325351+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.331688+0000","last_change":"2024-05-27T06:29:31.331688+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.331688+0000","last_undegraded":"2024-05-27T06:29:31.331688+0000","last_fullsized":"2024-05-27T06:29:31.331688+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.321588+0000","last_change":"2024-05-27T06:29:31.321588+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.321588+0000","last_undegraded":"2024-05-27T06:29:31.321588+0000","last_fullsized":"2024-05-27T06:29:31.321588+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316361+0000","last_change":"2024-05-27T06:29:31.316361+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316361+0000","last_undegraded":"2024-05-27T06:29:31.316361+0000","last_fullsized":"2024-05-27T06:29:31.316361+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.322694+0000","last_change":"2024-05-27T06:29:31.322694+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.322694+0000","last_undegraded":"2024-05-27T06:29:31.322694+0000","last_fullsized":"2024-05-27T06:29:31.322694+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316328+0000","last_change":"2024-05-27T06:29:31.316328+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316328+0000","last_undegraded":"2024-05-27T06:29:31.316328+0000","last_fullsized":"2024-05-27T06:29:31.316328+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.328222+0000","last_change":"2024-05-27T06:29:31.328222+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.328222+0000","last_undegraded":"2024-05-27T06:29:31.328222+0000","last_fullsized":"2024-05-27T06:29:31.328222+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.329940+0000","last_change":"2024-05-27T06:29:31.329940+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.329940+0000","last_undegraded":"2024-05-27T06:29:31.329940+0000","last_fullsized":"2024-05-27T06:29:31.329940+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.324127+0000","last_change":"2024-05-27T06:29:31.324127+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.324127+0000","last_undegraded":"2024-05-27T06:29:31.324127+0000","last_fullsized":"2024-05-27T06:29:31.324127+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.314719+0000","last_change":"2024-05-27T06:29:31.314719+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.314719+0000","last_undegraded":"2024-05-27T06:29:31.314719+0000","last_fullsized":"2024-05-27T06:29:31.314719+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.314718+0000","last_change":"2024-05-27T06:29:31.314718+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.314718+0000","last_undegraded":"2024-05-27T06:29:31.314718+0000","last_fullsized":"2024-05-27T06:29:31.314718+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.315776+0000","last_change":"2024-05-27T06:29:31.315776+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.315776+0000","last_undegraded":"2024-05-27T06:29:31.315776+0000","last_fullsized":"2024-05-27T06:29:31.315776+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.326291+0000","last_change":"2024-05-27T06:29:31.326291+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.326291+0000","last_undegraded":"2024-05-27T06:29:31.326291+0000","last_fullsized":"2024-05-27T06:29:31.326291+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.324937+0000","last_change":"2024-05-27T06:29:31.324937+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.324937+0000","last_undegraded":"2024-05-27T06:29:31.324937+0000","last_fullsized":"2024-05-27T06:29:31.324937+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.323137+0000","last_change":"2024-05-27T06:29:31.323137+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.323137+0000","last_undegraded":"2024-05-27T06:29:31.323137+0000","last_fullsized":"2024-05-27T06:29:31.323137+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.315935+0000","last_change":"2024-05-27T06:29:31.315935+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.315935+0000","last_undegraded":"2024-05-27T06:29:31.315935+0000","last_fullsized":"2024-05-27T06:29:31.315935+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.331611+0000","last_change":"2024-05-27T06:29:31.331611+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.331611+0000","last_undegraded":"2024-05-27T06:29:31.331611+0000","last_fullsized":"2024-05-27T06:29:31.331611+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.323762+0000","last_change":"2024-05-27T06:29:31.323762+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.323762+0000","last_undegraded":"2024-05-27T06:29:31.323762+0000","last_fullsized":"2024-05-27T06:29:31.323762+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.324275+0000","last_change":"2024-05-27T06:29:31.324275+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.324275+0000","last_undegraded":"2024-05-27T06:29:31.324275+0000","last_fullsized":"2024-05-27T06:29:31.324275+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.330730+0000","last_change":"2024-05-27T06:29:31.330730+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.330730+0000","last_undegraded":"2024-05-27T06:29:31.330730+0000","last_fullsized":"2024-05-27T06:29:31.330730+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.321230+0000","last_change":"2024-05-27T06:29:31.321230+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.321230+0000","last_undegraded":"2024-05-27T06:29:31.321230+0000","last_fullsized":"2024-05-27T06:29:31.321230+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.331015+0000","last_change":"2024-05-27T06:29:31.331015+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.331015+0000","last_undegraded":"2024-05-27T06:29:31.331015+0000","last_fullsized":"2024-05-27T06:29:31.331015+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.319934+0000","last_change":"2024-05-27T06:29:31.319934+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.319934+0000","last_undegraded":"2024-05-27T06:29:31.319934+0000","last_fullsized":"2024-05-27T06:29:31.319934+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.325828+0000","last_change":"2024-05-27T06:29:31.325828+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.325828+0000","last_undegraded":"2024-05-27T06:29:31.325828+0000","last_fullsized":"2024-05-27T06:29:31.325828+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.323843+0000","last_change":"2024-05-27T06:29:31.323843+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.323843+0000","last_undegraded":"2024-05-27T06:29:31.323843+0000","last_fullsized":"2024-05-27T06:29:31.323843+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316929+0000","last_change":"2024-05-27T06:29:31.316929+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316929+0000","last_undegraded":"2024-05-27T06:29:31.316929+0000","last_fullsized":"2024-05-27T06:29:31.316929+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.319583+0000","last_change":"2024-05-27T06:29:31.319583+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.319583+0000","last_undegraded":"2024-05-27T06:29:31.319583+0000","last_fullsized":"2024-05-27T06:29:31.319583+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.322732+0000","last_change":"2024-05-27T06:29:31.322732+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.322732+0000","last_undegraded":"2024-05-27T06:29:31.322732+0000","last_fullsized":"2024-05-27T06:29:31.322732+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.326867+0000","last_change":"2024-05-27T06:29:31.326867+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.326867+0000","last_undegraded":"2024-05-27T06:29:31.326867+0000","last_fullsized":"2024-05-27T06:29:31.326867+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.318606+0000","last_change":"2024-05-27T06:29:31.318606+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.318606+0000","last_undegraded":"2024-05-27T06:29:31.318606+0000","last_fullsized":"2024-05-27T06:29:31.318606+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.322669+0000","last_change":"2024-05-27T06:29:31.322669+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.322669+0000","last_undegraded":"2024-05-27T06:29:31.322669+0000","last_fullsized":"2024-05-27T06:29:31.322669+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.315121+0000","last_change":"2024-05-27T06:29:31.315121+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.315121+0000","last_undegraded":"2024-05-27T06:29:31.315121+0000","last_fullsized":"2024-05-27T06:29:31.315121+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.318800+0000","last_change":"2024-05-27T06:29:31.318800+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.318800+0000","last_undegraded":"2024-05-27T06:29:31.318800+0000","last_fullsized":"2024-05-27T06:29:31.318800+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.342721+0000","last_change":"2024-05-27T06:29:31.337912+0000","last_active":"2024-05-27T06:29:31.342721+0000","last_peered":"2024-05-27T06:29:31.342721+0000","last_clean":"2024-05-27T06:29:31.342721+0000","last_became_active":"2024-05-27T06:29:31.337076+0000","last_became_peered":"2024-05-27T06:29:31.337076+0000","last_unstale":"2024-05-27T06:29:31.342721+0000","last_undegraded":"2024-05-27T06:29:31.342721+0000","last_fullsized":"2024-05-27T06:29:31.342721+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:49:26.326325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.314740+0000","last_change":"2024-05-27T06:29:31.314740+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.314740+0000","last_undegraded":"2024-05-27T06:29:31.314740+0000","last_fullsized":"2024-05-27T06:29:31.314740+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.345646+0000","last_change":"2024-05-27T06:29:31.340901+0000","last_active":"2024-05-27T06:29:31.345646+0000","last_peered":"2024-05-27T06:29:31.345646+0000","last_clean":"2024-05-27T06:29:31.345646+0000","last_became_active":"2024-05-27T06:29:31.340584+0000","last_became_peered":"2024-05-27T06:29:31.340584+0000","last_unstale":"2024-05-27T06:29:31.345646+0000","last_undegraded":"2024-05-27T06:29:31.345646+0000","last_fullsized":"2024-05-27T06:29:31.345646+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:16:07.331463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.317761+0000","last_change":"2024-05-27T06:29:31.317761+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.317761+0000","last_undegraded":"2024-05-27T06:29:31.317761+0000","last_fullsized":"2024-05-27T06:29:31.317761+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.325224+0000","last_change":"2024-05-27T06:29:31.321412+0000","last_active":"2024-05-27T06:29:31.325224+0000","last_peered":"2024-05-27T06:29:31.325224+0000","last_clean":"2024-05-27T06:29:31.325224+0000","last_became_active":"2024-05-27T06:29:31.321110+0000","last_became_peered":"2024-05-27T06:29:31.321110+0000","last_unstale":"2024-05-27T06:29:31.325224+0000","last_undegraded":"2024-05-27T06:29:31.325224+0000","last_fullsized":"2024-05-27T06:29:31.325224+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:18:17.279684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.319138+0000","last_change":"2024-05-27T06:29:31.319138+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.319138+0000","last_undegraded":"2024-05-27T06:29:31.319138+0000","last_fullsized":"2024-05-27T06:29:31.319138+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.336819+0000","last_change":"2024-05-27T06:29:31.324922+0000","last_active":"2024-05-27T06:29:31.336819+0000","last_peered":"2024-05-27T06:29:31.336819+0000","last_clean":"2024-05-27T06:29:31.336819+0000","last_became_active":"2024-05-27T06:29:31.324534+0000","last_became_peered":"2024-05-27T06:29:31.324534+0000","last_unstale":"2024-05-27T06:29:31.336819+0000","last_undegraded":"2024-05-27T06:29:31.336819+0000","last_fullsized":"2024-05-27T06:29:31.336819+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:07:45.468162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.328009+0000","last_change":"2024-05-27T06:29:31.328009+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.328009+0000","last_undegraded":"2024-05-27T06:29:31.328009+0000","last_fullsized":"2024-05-27T06:29:31.328009+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.335743+0000","last_change":"2024-05-27T06:29:31.328972+0000","last_active":"2024-05-27T06:29:31.335743+0000","last_peered":"2024-05-27T06:29:31.335743+0000","last_clean":"2024-05-27T06:29:31.335743+0000","last_became_active":"2024-05-27T06:29:31.328662+0000","last_became_peered":"2024-05-27T06:29:31.328662+0000","last_unstale":"2024-05-27T06:29:31.335743+0000","last_undegraded":"2024-05-27T06:29:31.335743+0000","last_fullsized":"2024-05-27T06:29:31.335743+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:21:50.798081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.326491+0000","last_change":"2024-05-27T06:29:31.326491+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.326491+0000","last_undegraded":"2024-05-27T06:29:31.326491+0000","last_fullsized":"2024-05-27T06:29:31.326491+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.340527+0000","last_change":"2024-05-27T06:29:31.333973+0000","last_active":"2024-05-27T06:29:31.340527+0000","last_peered":"2024-05-27T06:29:31.340527+0000","last_clean":"2024-05-27T06:29:31.340527+0000","last_became_active":"2024-05-27T06:29:31.333665+0000","last_became_peered":"2024-05-27T06:29:31.333665+0000","last_unstale":"2024-05-27T06:29:31.340527+0000","last_undegraded":"2024-05-27T06:29:31.340527+0000","last_fullsized":"2024-05-27T06:29:31.340527+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:55:11.170951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.325035+0000","last_change":"2024-05-27T06:29:31.325035+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.325035+0000","last_undegraded":"2024-05-27T06:29:31.325035+0000","last_fullsized":"2024-05-27T06:29:31.325035+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.337686+0000","last_change":"2024-05-27T06:29:31.332145+0000","last_active":"2024-05-27T06:29:31.337686+0000","last_peered":"2024-05-27T06:29:31.337686+0000","last_clean":"2024-05-27T06:29:31.337686+0000","last_became_active":"2024-05-27T06:29:31.331328+0000","last_became_peered":"2024-05-27T06:29:31.331328+0000","last_unstale":"2024-05-27T06:29:31.337686+0000","last_undegraded":"2024-05-27T06:29:31.337686+0000","last_fullsized":"2024-05-27T06:29:31.337686+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:50:20.583108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.321350+0000","last_change":"2024-05-27T06:29:31.321350+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.321350+0000","last_undegraded":"2024-05-27T06:29:31.321350+0000","last_fullsized":"2024-05-27T06:29:31.321350+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.341435+0000","last_change":"2024-05-27T06:29:31.339195+0000","last_active":"2024-05-27T06:29:31.341435+0000","last_peered":"2024-05-27T06:29:31.341435+0000","last_clean":"2024-05-27T06:29:31.341435+0000","last_became_active":"2024-05-27T06:29:31.338863+0000","last_became_peered":"2024-05-27T06:29:31.338863+0000","last_unstale":"2024-05-27T06:29:31.341435+0000","last_undegraded":"2024-05-27T06:29:31.341435+0000","last_fullsized":"2024-05-27T06:29:31.341435+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:05:26.579241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.322484+0000","last_change":"2024-05-27T06:29:31.322484+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.322484+0000","last_undegraded":"2024-05-27T06:29:31.322484+0000","last_fullsized":"2024-05-27T06:29:31.322484+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.342900+0000","last_change":"2024-05-27T06:29:31.340841+0000","last_active":"2024-05-27T06:29:31.342900+0000","last_peered":"2024-05-27T06:29:31.342900+0000","last_clean":"2024-05-27T06:29:31.342900+0000","last_became_active":"2024-05-27T06:29:31.340483+0000","last_became_peered":"2024-05-27T06:29:31.340483+0000","last_unstale":"2024-05-27T06:29:31.342900+0000","last_undegraded":"2024-05-27T06:29:31.342900+0000","last_fullsized":"2024-05-27T06:29:31.342900+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:07:45.468162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.319216+0000","last_change":"2024-05-27T06:29:31.319216+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.319216+0000","last_undegraded":"2024-05-27T06:29:31.319216+0000","last_fullsized":"2024-05-27T06:29:31.319216+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.343028+0000","last_change":"2024-05-27T06:29:31.336123+0000","last_active":"2024-05-27T06:29:31.343028+0000","last_peered":"2024-05-27T06:29:31.343028+0000","last_clean":"2024-05-27T06:29:31.343028+0000","last_became_active":"2024-05-27T06:29:31.335682+0000","last_became_peered":"2024-05-27T06:29:31.335682+0000","last_unstale":"2024-05-27T06:29:31.343028+0000","last_undegraded":"2024-05-27T06:29:31.343028+0000","last_fullsized":"2024-05-27T06:29:31.343028+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:49:26.326325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.315321+0000","last_change":"2024-05-27T06:29:31.315321+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.315321+0000","last_undegraded":"2024-05-27T06:29:31.315321+0000","last_fullsized":"2024-05-27T06:29:31.315321+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.342881+0000","last_change":"2024-05-27T06:29:31.340823+0000","last_active":"2024-05-27T06:29:31.342881+0000","last_peered":"2024-05-27T06:29:31.342881+0000","last_clean":"2024-05-27T06:29:31.342881+0000","last_became_active":"2024-05-27T06:29:31.340446+0000","last_became_peered":"2024-05-27T06:29:31.340446+0000","last_unstale":"2024-05-27T06:29:31.342881+0000","last_undegraded":"2024-05-27T06:29:31.342881+0000","last_fullsized":"2024-05-27T06:29:31.342881+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:18:17.279684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.321073+0000","last_change":"2024-05-27T06:29:31.321073+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.321073+0000","last_undegraded":"2024-05-27T06:29:31.321073+0000","last_fullsized":"2024-05-27T06:29:31.321073+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.336747+0000","last_change":"2024-05-27T06:29:31.331195+0000","last_active":"2024-05-27T06:29:31.336747+0000","last_peered":"2024-05-27T06:29:31.336747+0000","last_clean":"2024-05-27T06:29:31.336747+0000","last_became_active":"2024-05-27T06:29:31.330881+0000","last_became_peered":"2024-05-27T06:29:31.330881+0000","last_unstale":"2024-05-27T06:29:31.336747+0000","last_undegraded":"2024-05-27T06:29:31.336747+0000","last_fullsized":"2024-05-27T06:29:31.336747+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:24:48.091681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.318280+0000","last_change":"2024-05-27T06:29:31.318280+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.318280+0000","last_undegraded":"2024-05-27T06:29:31.318280+0000","last_fullsized":"2024-05-27T06:29:31.318280+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.343187+0000","last_change":"2024-05-27T06:29:31.336599+0000","last_active":"2024-05-27T06:29:31.343187+0000","last_peered":"2024-05-27T06:29:31.343187+0000","last_clean":"2024-05-27T06:29:31.343187+0000","last_became_active":"2024-05-27T06:29:31.336273+0000","last_became_peered":"2024-05-27T06:29:31.336273+0000","last_unstale":"2024-05-27T06:29:31.343187+0000","last_undegraded":"2024-05-27T06:29:31.343187+0000","last_fullsized":"2024-05-27T06:29:31.343187+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:10:34.186274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.320720+0000","last_change":"2024-05-27T06:29:31.320720+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.320720+0000","last_undegraded":"2024-05-27T06:29:31.320720+0000","last_fullsized":"2024-05-27T06:29:31.320720+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.341063+0000","last_change":"2024-05-27T06:29:31.335657+0000","last_active":"2024-05-27T06:29:31.341063+0000","last_peered":"2024-05-27T06:29:31.341063+0000","last_clean":"2024-05-27T06:29:31.341063+0000","last_became_active":"2024-05-27T06:29:31.335285+0000","last_became_peered":"2024-05-27T06:29:31.335285+0000","last_unstale":"2024-05-27T06:29:31.341063+0000","last_undegraded":"2024-05-27T06:29:31.341063+0000","last_fullsized":"2024-05-27T06:29:31.341063+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:48:45.545585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.322872+0000","last_change":"2024-05-27T06:29:31.322872+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.322872+0000","last_undegraded":"2024-05-27T06:29:31.322872+0000","last_fullsized":"2024-05-27T06:29:31.322872+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.331881+0000","last_change":"2024-05-27T06:29:31.323676+0000","last_active":"2024-05-27T06:29:31.331881+0000","last_peered":"2024-05-27T06:29:31.331881+0000","last_clean":"2024-05-27T06:29:31.331881+0000","last_became_active":"2024-05-27T06:29:31.323378+0000","last_became_peered":"2024-05-27T06:29:31.323378+0000","last_unstale":"2024-05-27T06:29:31.331881+0000","last_undegraded":"2024-05-27T06:29:31.331881+0000","last_fullsized":"2024-05-27T06:29:31.331881+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:18:17.279684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.318732+0000","last_change":"2024-05-27T06:29:31.318732+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.318732+0000","last_undegraded":"2024-05-27T06:29:31.318732+0000","last_fullsized":"2024-05-27T06:29:31.318732+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.342845+0000","last_change":"2024-05-27T06:29:31.340500+0000","last_active":"2024-05-27T06:29:31.342845+0000","last_peered":"2024-05-27T06:29:31.342845+0000","last_clean":"2024-05-27T06:29:31.342845+0000","last_became_active":"2024-05-27T06:29:31.340151+0000","last_became_peered":"2024-05-27T06:29:31.340151+0000","last_unstale":"2024-05-27T06:29:31.342845+0000","last_undegraded":"2024-05-27T06:29:31.342845+0000","last_fullsized":"2024-05-27T06:29:31.342845+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:25:39.940766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.320036+0000","last_change":"2024-05-27T06:29:31.320036+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.320036+0000","last_undegraded":"2024-05-27T06:29:31.320036+0000","last_fullsized":"2024-05-27T06:29:31.320036+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.343239+0000","last_change":"2024-05-27T06:29:31.336677+0000","last_active":"2024-05-27T06:29:31.343239+0000","last_peered":"2024-05-27T06:29:31.343239+0000","last_clean":"2024-05-27T06:29:31.343239+0000","last_became_active":"2024-05-27T06:29:31.336379+0000","last_became_peered":"2024-05-27T06:29:31.336379+0000","last_unstale":"2024-05-27T06:29:31.343239+0000","last_undegraded":"2024-05-27T06:29:31.343239+0000","last_fullsized":"2024-05-27T06:29:31.343239+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:24:21.069227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316739+0000","last_change":"2024-05-27T06:29:31.316739+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316739+0000","last_undegraded":"2024-05-27T06:29:31.316739+0000","last_fullsized":"2024-05-27T06:29:31.316739+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.335883+0000","last_change":"2024-05-27T06:29:31.329550+0000","last_active":"2024-05-27T06:29:31.335883+0000","last_peered":"2024-05-27T06:29:31.335883+0000","last_clean":"2024-05-27T06:29:31.335883+0000","last_became_active":"2024-05-27T06:29:31.329294+0000","last_became_peered":"2024-05-27T06:29:31.329294+0000","last_unstale":"2024-05-27T06:29:31.335883+0000","last_undegraded":"2024-05-27T06:29:31.335883+0000","last_fullsized":"2024-05-27T06:29:31.335883+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:07:45.468162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.325710+0000","last_change":"2024-05-27T06:29:31.325710+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.325710+0000","last_undegraded":"2024-05-27T06:29:31.325710+0000","last_fullsized":"2024-05-27T06:29:31.325710+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.336602+0000","last_change":"2024-05-27T06:29:31.330141+0000","last_active":"2024-05-27T06:29:31.336602+0000","last_peered":"2024-05-27T06:29:31.336602+0000","last_clean":"2024-05-27T06:29:31.336602+0000","last_became_active":"2024-05-27T06:29:31.329830+0000","last_became_peered":"2024-05-27T06:29:31.329830+0000","last_unstale":"2024-05-27T06:29:31.336602+0000","last_undegraded":"2024-05-27T06:29:31.336602+0000","last_fullsized":"2024-05-27T06:29:31.336602+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:51:42.711265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.320595+0000","last_change":"2024-05-27T06:29:31.320595+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.320595+0000","last_undegraded":"2024-05-27T06:29:31.320595+0000","last_fullsized":"2024-05-27T06:29:31.320595+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.336058+0000","last_change":"2024-05-27T06:29:31.332562+0000","last_active":"2024-05-27T06:29:31.336058+0000","last_peered":"2024-05-27T06:29:31.336058+0000","last_clean":"2024-05-27T06:29:31.336058+0000","last_became_active":"2024-05-27T06:29:31.332221+0000","last_became_peered":"2024-05-27T06:29:31.332221+0000","last_unstale":"2024-05-27T06:29:31.336058+0000","last_undegraded":"2024-05-27T06:29:31.336058+0000","last_fullsized":"2024-05-27T06:29:31.336058+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:51:42.711265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316837+0000","last_change":"2024-05-27T06:29:31.316837+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316837+0000","last_undegraded":"2024-05-27T06:29:31.316837+0000","last_fullsized":"2024-05-27T06:29:31.316837+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.343207+0000","last_change":"2024-05-27T06:29:31.336613+0000","last_active":"2024-05-27T06:29:31.343207+0000","last_peered":"2024-05-27T06:29:31.343207+0000","last_clean":"2024-05-27T06:29:31.343207+0000","last_became_active":"2024-05-27T06:29:31.336319+0000","last_became_peered":"2024-05-27T06:29:31.336319+0000","last_unstale":"2024-05-27T06:29:31.343207+0000","last_undegraded":"2024-05-27T06:29:31.343207+0000","last_fullsized":"2024-05-27T06:29:31.343207+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:16:41.521107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316374+0000","last_change":"2024-05-27T06:29:31.316374+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316374+0000","last_undegraded":"2024-05-27T06:29:31.316374+0000","last_fullsized":"2024-05-27T06:29:31.316374+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.331552+0000","last_change":"2024-05-27T06:29:31.326223+0000","last_active":"2024-05-27T06:29:31.331552+0000","last_peered":"2024-05-27T06:29:31.331552+0000","last_clean":"2024-05-27T06:29:31.331552+0000","last_became_active":"2024-05-27T06:29:31.325962+0000","last_became_peered":"2024-05-27T06:29:31.325962+0000","last_unstale":"2024-05-27T06:29:31.331552+0000","last_undegraded":"2024-05-27T06:29:31.331552+0000","last_fullsized":"2024-05-27T06:29:31.331552+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:21:17.064386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.315692+0000","last_change":"2024-05-27T06:29:31.315692+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.315692+0000","last_undegraded":"2024-05-27T06:29:31.315692+0000","last_fullsized":"2024-05-27T06:29:31.315692+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.337644+0000","last_change":"2024-05-27T06:29:31.332841+0000","last_active":"2024-05-27T06:29:31.337644+0000","last_peered":"2024-05-27T06:29:31.337644+0000","last_clean":"2024-05-27T06:29:31.337644+0000","last_became_active":"2024-05-27T06:29:31.332404+0000","last_became_peered":"2024-05-27T06:29:31.332404+0000","last_unstale":"2024-05-27T06:29:31.337644+0000","last_undegraded":"2024-05-27T06:29:31.337644+0000","last_fullsized":"2024-05-27T06:29:31.337644+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:55:11.170951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316490+0000","last_change":"2024-05-27T06:29:31.316490+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316490+0000","last_undegraded":"2024-05-27T06:29:31.316490+0000","last_fullsized":"2024-05-27T06:29:31.316490+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.342953+0000","last_change":"2024-05-27T06:29:31.338844+0000","last_active":"2024-05-27T06:29:31.342953+0000","last_peered":"2024-05-27T06:29:31.342953+0000","last_clean":"2024-05-27T06:29:31.342953+0000","last_became_active":"2024-05-27T06:29:31.338521+0000","last_became_peered":"2024-05-27T06:29:31.338521+0000","last_unstale":"2024-05-27T06:29:31.342953+0000","last_undegraded":"2024-05-27T06:29:31.342953+0000","last_fullsized":"2024-05-27T06:29:31.342953+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:31:46.375058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316199+0000","last_change":"2024-05-27T06:29:31.316199+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316199+0000","last_undegraded":"2024-05-27T06:29:31.316199+0000","last_fullsized":"2024-05-27T06:29:31.316199+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.336114+0000","last_change":"2024-05-27T06:29:31.333344+0000","last_active":"2024-05-27T06:29:31.336114+0000","last_peered":"2024-05-27T06:29:31.336114+0000","last_clean":"2024-05-27T06:29:31.336114+0000","last_became_active":"2024-05-27T06:29:31.333044+0000","last_became_peered":"2024-05-27T06:29:31.333044+0000","last_unstale":"2024-05-27T06:29:31.336114+0000","last_undegraded":"2024-05-27T06:29:31.336114+0000","last_fullsized":"2024-05-27T06:29:31.336114+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:50:20.583108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.314819+0000","last_change":"2024-05-27T06:29:31.314819+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.314819+0000","last_undegraded":"2024-05-27T06:29:31.314819+0000","last_fullsized":"2024-05-27T06:29:31.314819+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.337606+0000","last_change":"2024-05-27T06:29:31.335481+0000","last_active":"2024-05-27T06:29:31.337606+0000","last_peered":"2024-05-27T06:29:31.337606+0000","last_clean":"2024-05-27T06:29:31.337606+0000","last_became_active":"2024-05-27T06:29:31.334999+0000","last_became_peered":"2024-05-27T06:29:31.334999+0000","last_unstale":"2024-05-27T06:29:31.337606+0000","last_undegraded":"2024-05-27T06:29:31.337606+0000","last_fullsized":"2024-05-27T06:29:31.337606+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:05:26.579241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.317184+0000","last_change":"2024-05-27T06:29:31.317184+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.317184+0000","last_undegraded":"2024-05-27T06:29:31.317184+0000","last_fullsized":"2024-05-27T06:29:31.317184+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.339998+0000","last_change":"2024-05-27T06:29:31.336050+0000","last_active":"2024-05-27T06:29:31.339998+0000","last_peered":"2024-05-27T06:29:31.339998+0000","last_clean":"2024-05-27T06:29:31.339998+0000","last_became_active":"2024-05-27T06:29:31.335730+0000","last_became_peered":"2024-05-27T06:29:31.335730+0000","last_unstale":"2024-05-27T06:29:31.339998+0000","last_undegraded":"2024-05-27T06:29:31.339998+0000","last_fullsized":"2024-05-27T06:29:31.339998+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:49:26.326325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.321809+0000","last_change":"2024-05-27T06:29:31.321809+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.321809+0000","last_undegraded":"2024-05-27T06:29:31.321809+0000","last_fullsized":"2024-05-27T06:29:31.321809+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.330550+0000","last_change":"2024-05-27T06:29:31.322798+0000","last_active":"2024-05-27T06:29:31.330550+0000","last_peered":"2024-05-27T06:29:31.330550+0000","last_clean":"2024-05-27T06:29:31.330550+0000","last_became_active":"2024-05-27T06:29:31.322512+0000","last_became_peered":"2024-05-27T06:29:31.322512+0000","last_unstale":"2024-05-27T06:29:31.330550+0000","last_undegraded":"2024-05-27T06:29:31.330550+0000","last_fullsized":"2024-05-27T06:29:31.330550+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:48:45.545585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.320106+0000","last_change":"2024-05-27T06:29:31.320106+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.320106+0000","last_undegraded":"2024-05-27T06:29:31.320106+0000","last_fullsized":"2024-05-27T06:29:31.320106+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.335841+0000","last_change":"2024-05-27T06:29:31.333682+0000","last_active":"2024-05-27T06:29:31.335841+0000","last_peered":"2024-05-27T06:29:31.335841+0000","last_clean":"2024-05-27T06:29:31.335841+0000","last_became_active":"2024-05-27T06:29:31.333356+0000","last_became_peered":"2024-05-27T06:29:31.333356+0000","last_unstale":"2024-05-27T06:29:31.335841+0000","last_undegraded":"2024-05-27T06:29:31.335841+0000","last_fullsized":"2024-05-27T06:29:31.335841+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:50:50.388948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.314897+0000","last_change":"2024-05-27T06:29:31.314897+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.314897+0000","last_undegraded":"2024-05-27T06:29:31.314897+0000","last_fullsized":"2024-05-27T06:29:31.314897+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.321473+0000","last_change":"2024-05-27T06:29:31.319544+0000","last_active":"2024-05-27T06:29:31.321473+0000","last_peered":"2024-05-27T06:29:31.321473+0000","last_clean":"2024-05-27T06:29:31.321473+0000","last_became_active":"2024-05-27T06:29:31.319187+0000","last_became_peered":"2024-05-27T06:29:31.319187+0000","last_unstale":"2024-05-27T06:29:31.321473+0000","last_undegraded":"2024-05-27T06:29:31.321473+0000","last_fullsized":"2024-05-27T06:29:31.321473+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:05:26.579241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.320910+0000","last_change":"2024-05-27T06:29:31.320910+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.320910+0000","last_undegraded":"2024-05-27T06:29:31.320910+0000","last_fullsized":"2024-05-27T06:29:31.320910+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.337788+0000","last_change":"2024-05-27T06:29:31.330242+0000","last_active":"2024-05-27T06:29:31.337788+0000","last_peered":"2024-05-27T06:29:31.337788+0000","last_clean":"2024-05-27T06:29:31.337788+0000","last_became_active":"2024-05-27T06:29:31.329531+0000","last_became_peered":"2024-05-27T06:29:31.329531+0000","last_unstale":"2024-05-27T06:29:31.337788+0000","last_undegraded":"2024-05-27T06:29:31.337788+0000","last_fullsized":"2024-05-27T06:29:31.337788+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:55:11.170951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.319519+0000","last_change":"2024-05-27T06:29:31.319519+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.319519+0000","last_undegraded":"2024-05-27T06:29:31.319519+0000","last_fullsized":"2024-05-27T06:29:31.319519+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.342691+0000","last_change":"2024-05-27T06:29:31.338455+0000","last_active":"2024-05-27T06:29:31.342691+0000","last_peered":"2024-05-27T06:29:31.342691+0000","last_clean":"2024-05-27T06:29:31.342691+0000","last_became_active":"2024-05-27T06:29:31.338096+0000","last_became_peered":"2024-05-27T06:29:31.338096+0000","last_unstale":"2024-05-27T06:29:31.342691+0000","last_undegraded":"2024-05-27T06:29:31.342691+0000","last_fullsized":"2024-05-27T06:29:31.342691+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:21:17.064386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":169,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.328335+0000","last_change":"2024-05-27T06:27:28.692457+0000","last_active":"2024-05-27T06:29:31.328335+0000","last_peered":"2024-05-27T06:29:31.328335+0000","last_clean":"2024-05-27T06:29:31.328335+0000","last_became_active":"2024-05-27T06:27:28.691290+0000","last_became_peered":"2024-05-27T06:27:28.691290+0000","last_unstale":"2024-05-27T06:29:31.328335+0000","last_undegraded":"2024-05-27T06:29:31.328335+0000","last_fullsized":"2024-05-27T06:29:31.328335+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_clean_scrub_stamp":"2024-05-27T06:27:26.991915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:45.563728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28212,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343628,"statfs":{"total":96636764160,"available":96607875072,"internally_reserved":0,"allocated":1216512,"data_stored":869502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":272475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":272475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":272475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":272475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":279134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":272475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32372,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":1216512,"data_stored":869502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T06:29:36.852 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T06:29:37.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.036+0000 7f82dee00640 1 Processor -- start 2024-05-27T06:29:37.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.036+0000 7f82dee00640 1 -- start start 2024-05-27T06:29:37.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.036+0000 7f82dee00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f82d80cea40 0x7f82d8158360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:37.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.036+0000 7f82dee00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82d80b2fb0 0x7f82d80b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:37.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.036+0000 7f82dee00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82d80b2cd0 con 0x7f82d80d2010 2024-05-27T06:29:37.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.036+0000 7f82dee00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f82d80ce5b0 con 0x7f82d80cea40 2024-05-27T06:29:37.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.036+0000 7f82dee00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f82d80cdc80 con 0x7f82d80b2fb0 2024-05-27T06:29:37.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.036+0000 7f82cf400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f82d80d2010 0x7f82d80d2420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:32938/0 (socket says 172.21.15.87:32938) 2024-05-27T06:29:37.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.036+0000 7f82cf400640 1 -- 172.21.15.87:0/1782241120 learned_addr learned my addr 172.21.15.87:0/1782241120 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:29:37.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.036+0000 7f82d7e00640 1 --2- 172.21.15.87:0/1782241120 >> v2:172.21.15.87:3300/0 conn(0x7f82d80cea40 0x7f82d8158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:37.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.040+0000 7f82dce00640 1 --2- 172.21.15.87:0/1782241120 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82d80b2fb0 0x7f82d80b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:37.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.040+0000 7f82d7e00640 1 -- 172.21.15.87:0/1782241120 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82d80b2fb0 msgr2=0x7f82d80b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:37.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.040+0000 7f82d7e00640 1 --2- 172.21.15.87:0/1782241120 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82d80b2fb0 0x7f82d80b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:37.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.040+0000 7f82d7e00640 1 -- 172.21.15.87:0/1782241120 >> v1:172.21.15.87:6789/0 conn(0x7f82d80d2010 legacy=0x7f82d80d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:37.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.040+0000 7f82d7400640 1 -- 172.21.15.87:0/1782241120 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 276054459 0 0) 0x7f82d80b2cd0 con 0x7f82d80d2010 2024-05-27T06:29:37.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.040+0000 7f82d7e00640 1 -- 172.21.15.87:0/1782241120 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d80cdf60 con 0x7f82d80cea40 2024-05-27T06:29:37.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.040+0000 7f82d7e00640 1 --2- 172.21.15.87:0/1782241120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82d80cea40 0x7f82d8158360 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009d90 tx=0x7f82c801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6b0faa4c22ee server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:37.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.040+0000 7f82d7400640 1 -- 172.21.15.87:0/1782241120 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c80b2070 con 0x7f82d80cea40 2024-05-27T06:29:37.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.040+0000 7f82d7400640 1 -- 172.21.15.87:0/1782241120 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82c80a5a00 con 0x7f82d80cea40 2024-05-27T06:29:37.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.040+0000 7f82d7400640 1 -- 172.21.15.87:0/1782241120 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c80a5dd0 con 0x7f82d80cea40 2024-05-27T06:29:37.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.044+0000 7f82dee00640 1 -- 172.21.15.87:0/1782241120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82d80cea40 msgr2=0x7f82d8158360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:37.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.044+0000 7f82dee00640 1 --2- 172.21.15.87:0/1782241120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82d80cea40 0x7f82d8158360 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009d90 tx=0x7f82c801c940 comp rx=0 tx=0).stop 2024-05-27T06:29:37.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.044+0000 7f82dee00640 1 -- 172.21.15.87:0/1782241120 shutdown_connections 2024-05-27T06:29:37.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.044+0000 7f82dee00640 1 --2- 172.21.15.87:0/1782241120 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82d80b2fb0 0x7f82d80b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:37.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.044+0000 7f82dee00640 1 --2- 172.21.15.87:0/1782241120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82d80cea40 0x7f82d8158360 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:37.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.044+0000 7f82dee00640 1 -- 172.21.15.87:0/1782241120 >> 172.21.15.87:0/1782241120 conn(0x7f82d80d3590 msgr2=0x7f82d80d39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:37.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.044+0000 7f82dee00640 1 -- 172.21.15.87:0/1782241120 shutdown_connections 2024-05-27T06:29:37.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.044+0000 7f82dee00640 1 -- 172.21.15.87:0/1782241120 wait complete. 2024-05-27T06:29:37.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.044+0000 7f82dee00640 1 Processor -- start 2024-05-27T06:29:37.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.044+0000 7f82dee00640 1 -- start start 2024-05-27T06:29:37.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.044+0000 7f82dee00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82d80b2fb0 0x7f82d80702d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:37.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.044+0000 7f82dee00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82d80cea40 0x7f82d8153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:37.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.044+0000 7f82dee00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d80d2010 0x7f82d8161a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:37.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.044+0000 7f82dee00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f82d80d2ee0 con 0x7f82d80cea40 2024-05-27T06:29:37.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.044+0000 7f82dee00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f82d80d2d60 con 0x7f82d80d2010 2024-05-27T06:29:37.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.044+0000 7f82dee00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f82d80cee50 con 0x7f82d80b2fb0 2024-05-27T06:29:37.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.048+0000 7f82cf400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82d80cea40 0x7f82d8153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:37.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.048+0000 7f82cf400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82d80cea40 0x7f82d8153870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57134/0 (socket says 172.21.15.87:57134) 2024-05-27T06:29:37.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.048+0000 7f82cf400640 1 -- 172.21.15.87:0/2519438447 learned_addr learned my addr 172.21.15.87:0/2519438447 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:37.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.048+0000 7f82d7e00640 1 --2- 172.21.15.87:0/2519438447 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82d80b2fb0 0x7f82d80702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:37.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.048+0000 7f82dce00640 1 --2- 172.21.15.87:0/2519438447 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d80d2010 0x7f82d8161a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:37.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.048+0000 7f82cf400640 1 -- 172.21.15.87:0/2519438447 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82d80b2fb0 msgr2=0x7f82d80702d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:37.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.048+0000 7f82cf400640 1 --2- 172.21.15.87:0/2519438447 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82d80b2fb0 0x7f82d80702d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:37.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.048+0000 7f82cf400640 1 -- 172.21.15.87:0/2519438447 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d80d2010 msgr2=0x7f82d8161a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:37.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.048+0000 7f82cf400640 1 --2- 172.21.15.87:0/2519438447 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d80d2010 0x7f82d8161a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:37.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.048+0000 7f82cf400640 1 -- 172.21.15.87:0/2519438447 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d8070d50 con 0x7f82d80cea40 2024-05-27T06:29:37.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.048+0000 7f82dce00640 1 --2- 172.21.15.87:0/2519438447 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d80d2010 0x7f82d8161a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:29:37.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.048+0000 7f82cf400640 1 --2- 172.21.15.87:0/2519438447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82d80cea40 0x7f82d8153870 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f82c000c460 tx=0x7f82c000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:37.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.048+0000 7f82d4c00640 1 -- 172.21.15.87:0/2519438447 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c0018070 con 0x7f82d80cea40 2024-05-27T06:29:37.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.048+0000 7f82d4c00640 1 -- 172.21.15.87:0/2519438447 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82c0007500 con 0x7f82d80cea40 2024-05-27T06:29:37.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.048+0000 7f82dee00640 1 -- 172.21.15.87:0/2519438447 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d8071030 con 0x7f82d80cea40 2024-05-27T06:29:37.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.048+0000 7f82d4c00640 1 -- 172.21.15.87:0/2519438447 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c0004a30 con 0x7f82d80cea40 2024-05-27T06:29:37.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.048+0000 7f82dee00640 1 -- 172.21.15.87:0/2519438447 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d8070810 con 0x7f82d80cea40 2024-05-27T06:29:37.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.048+0000 7f82dee00640 1 -- 172.21.15.87:0/2519438447 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82d806aa30 con 0x7f82d80cea40 2024-05-27T06:29:37.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.048+0000 7f82d4c00640 1 -- 172.21.15.87:0/2519438447 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f82c001b070 con 0x7f82d80cea40 2024-05-27T06:29:37.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.052+0000 7f82d4c00640 1 --2- 172.21.15.87:0/2519438447 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f82b406f430 0x7f82b4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:37.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.052+0000 7f82d4c00640 1 -- 172.21.15.87:0/2519438447 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f82c008e750 con 0x7f82d80cea40 2024-05-27T06:29:37.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.052+0000 7f82d7e00640 1 --2- 172.21.15.87:0/2519438447 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f82b406f430 0x7f82b4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:37.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.052+0000 7f82d7e00640 1 --2- 172.21.15.87:0/2519438447 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f82b406f430 0x7f82b4071940 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f82c80af000 tx=0x7f82c80a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:37.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.056+0000 7f82d4c00640 1 -- 172.21.15.87:0/2519438447 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f82c005b410 con 0x7f82d80cea40 2024-05-27T06:29:37.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.208+0000 7f82dee00640 1 -- 172.21.15.87:0/2519438447 --> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f82d8070ae0 con 0x7f82b406f430 2024-05-27T06:29:37.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.216+0000 7f82d4c00640 1 -- 172.21.15.87:0/2519438447 <== mgr.4111 v2:172.21.15.87:6832/2724754260 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246624 (secure 0 0 0) 0x7f82d8070ae0 con 0x7f82b406f430 2024-05-27T06:29:37.217 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:29:37.219 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-27T06:29:37.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.220+0000 7f82dee00640 1 -- 172.21.15.87:0/2519438447 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f82b406f430 msgr2=0x7f82b4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:37.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.220+0000 7f82dee00640 1 --2- 172.21.15.87:0/2519438447 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f82b406f430 0x7f82b4071940 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f82c80af000 tx=0x7f82c80a7070 comp rx=0 tx=0).stop 2024-05-27T06:29:37.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.220+0000 7f82dee00640 1 -- 172.21.15.87:0/2519438447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82d80cea40 msgr2=0x7f82d8153870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:37.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.220+0000 7f82dee00640 1 --2- 172.21.15.87:0/2519438447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82d80cea40 0x7f82d8153870 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f82c000c460 tx=0x7f82c000c920 comp rx=0 tx=0).stop 2024-05-27T06:29:37.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.220+0000 7f82dee00640 1 -- 172.21.15.87:0/2519438447 shutdown_connections 2024-05-27T06:29:37.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.220+0000 7f82dee00640 1 --2- 172.21.15.87:0/2519438447 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f82b406f430 0x7f82b4071940 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:37.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.220+0000 7f82dee00640 1 --2- 172.21.15.87:0/2519438447 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82d80d2010 0x7f82d8161a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:37.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.220+0000 7f82dee00640 1 --2- 172.21.15.87:0/2519438447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82d80cea40 0x7f82d8153870 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:37.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.220+0000 7f82dee00640 1 --2- 172.21.15.87:0/2519438447 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82d80b2fb0 0x7f82d80702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:37.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.220+0000 7f82dee00640 1 -- 172.21.15.87:0/2519438447 >> 172.21.15.87:0/2519438447 conn(0x7f82d80d3590 msgr2=0x7f82d815cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:37.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.220+0000 7f82dee00640 1 -- 172.21.15.87:0/2519438447 shutdown_connections 2024-05-27T06:29:37.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.220+0000 7f82dee00640 1 -- 172.21.15.87:0/2519438447 wait complete. 2024-05-27T06:29:37.238 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2024-05-27T06:29:36.592865+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226296,"kb_used_data":5964,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748424,"statfs":{"total":773094113280,"available":772862386176,"internally_reserved":0,"allocated":6107136,"data_stored":3380513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000957"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.325351+0000","last_change":"2024-05-27T06:29:31.325351+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.325351+0000","last_undegraded":"2024-05-27T06:29:31.325351+0000","last_fullsized":"2024-05-27T06:29:31.325351+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.331688+0000","last_change":"2024-05-27T06:29:31.331688+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.331688+0000","last_undegraded":"2024-05-27T06:29:31.331688+0000","last_fullsized":"2024-05-27T06:29:31.331688+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.321588+0000","last_change":"2024-05-27T06:29:31.321588+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.321588+0000","last_undegraded":"2024-05-27T06:29:31.321588+0000","last_fullsized":"2024-05-27T06:29:31.321588+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316361+0000","last_change":"2024-05-27T06:29:31.316361+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316361+0000","last_undegraded":"2024-05-27T06:29:31.316361+0000","last_fullsized":"2024-05-27T06:29:31.316361+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.322694+0000","last_change":"2024-05-27T06:29:31.322694+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.322694+0000","last_undegraded":"2024-05-27T06:29:31.322694+0000","last_fullsized":"2024-05-27T06:29:31.322694+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316328+0000","last_change":"2024-05-27T06:29:31.316328+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316328+0000","last_undegraded":"2024-05-27T06:29:31.316328+0000","last_fullsized":"2024-05-27T06:29:31.316328+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.328222+0000","last_change":"2024-05-27T06:29:31.328222+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.328222+0000","last_undegraded":"2024-05-27T06:29:31.328222+0000","last_fullsized":"2024-05-27T06:29:31.328222+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.329940+0000","last_change":"2024-05-27T06:29:31.329940+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.329940+0000","last_undegraded":"2024-05-27T06:29:31.329940+0000","last_fullsized":"2024-05-27T06:29:31.329940+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.324127+0000","last_change":"2024-05-27T06:29:31.324127+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.324127+0000","last_undegraded":"2024-05-27T06:29:31.324127+0000","last_fullsized":"2024-05-27T06:29:31.324127+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.314719+0000","last_change":"2024-05-27T06:29:31.314719+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.314719+0000","last_undegraded":"2024-05-27T06:29:31.314719+0000","last_fullsized":"2024-05-27T06:29:31.314719+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.314718+0000","last_change":"2024-05-27T06:29:31.314718+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.314718+0000","last_undegraded":"2024-05-27T06:29:31.314718+0000","last_fullsized":"2024-05-27T06:29:31.314718+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.315776+0000","last_change":"2024-05-27T06:29:31.315776+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.315776+0000","last_undegraded":"2024-05-27T06:29:31.315776+0000","last_fullsized":"2024-05-27T06:29:31.315776+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.326291+0000","last_change":"2024-05-27T06:29:31.326291+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.326291+0000","last_undegraded":"2024-05-27T06:29:31.326291+0000","last_fullsized":"2024-05-27T06:29:31.326291+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.324937+0000","last_change":"2024-05-27T06:29:31.324937+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.324937+0000","last_undegraded":"2024-05-27T06:29:31.324937+0000","last_fullsized":"2024-05-27T06:29:31.324937+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.323137+0000","last_change":"2024-05-27T06:29:31.323137+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.323137+0000","last_undegraded":"2024-05-27T06:29:31.323137+0000","last_fullsized":"2024-05-27T06:29:31.323137+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.315935+0000","last_change":"2024-05-27T06:29:31.315935+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.315935+0000","last_undegraded":"2024-05-27T06:29:31.315935+0000","last_fullsized":"2024-05-27T06:29:31.315935+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.331611+0000","last_change":"2024-05-27T06:29:31.331611+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.331611+0000","last_undegraded":"2024-05-27T06:29:31.331611+0000","last_fullsized":"2024-05-27T06:29:31.331611+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.323762+0000","last_change":"2024-05-27T06:29:31.323762+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.323762+0000","last_undegraded":"2024-05-27T06:29:31.323762+0000","last_fullsized":"2024-05-27T06:29:31.323762+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.324275+0000","last_change":"2024-05-27T06:29:31.324275+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.324275+0000","last_undegraded":"2024-05-27T06:29:31.324275+0000","last_fullsized":"2024-05-27T06:29:31.324275+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.330730+0000","last_change":"2024-05-27T06:29:31.330730+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.330730+0000","last_undegraded":"2024-05-27T06:29:31.330730+0000","last_fullsized":"2024-05-27T06:29:31.330730+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.321230+0000","last_change":"2024-05-27T06:29:31.321230+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.321230+0000","last_undegraded":"2024-05-27T06:29:31.321230+0000","last_fullsized":"2024-05-27T06:29:31.321230+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.331015+0000","last_change":"2024-05-27T06:29:31.331015+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.331015+0000","last_undegraded":"2024-05-27T06:29:31.331015+0000","last_fullsized":"2024-05-27T06:29:31.331015+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.319934+0000","last_change":"2024-05-27T06:29:31.319934+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.319934+0000","last_undegraded":"2024-05-27T06:29:31.319934+0000","last_fullsized":"2024-05-27T06:29:31.319934+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.325828+0000","last_change":"2024-05-27T06:29:31.325828+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.325828+0000","last_undegraded":"2024-05-27T06:29:31.325828+0000","last_fullsized":"2024-05-27T06:29:31.325828+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.323843+0000","last_change":"2024-05-27T06:29:31.323843+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.323843+0000","last_undegraded":"2024-05-27T06:29:31.323843+0000","last_fullsized":"2024-05-27T06:29:31.323843+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316929+0000","last_change":"2024-05-27T06:29:31.316929+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316929+0000","last_undegraded":"2024-05-27T06:29:31.316929+0000","last_fullsized":"2024-05-27T06:29:31.316929+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.319583+0000","last_change":"2024-05-27T06:29:31.319583+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.319583+0000","last_undegraded":"2024-05-27T06:29:31.319583+0000","last_fullsized":"2024-05-27T06:29:31.319583+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.322732+0000","last_change":"2024-05-27T06:29:31.322732+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.322732+0000","last_undegraded":"2024-05-27T06:29:31.322732+0000","last_fullsized":"2024-05-27T06:29:31.322732+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.326867+0000","last_change":"2024-05-27T06:29:31.326867+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.326867+0000","last_undegraded":"2024-05-27T06:29:31.326867+0000","last_fullsized":"2024-05-27T06:29:31.326867+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.318606+0000","last_change":"2024-05-27T06:29:31.318606+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.318606+0000","last_undegraded":"2024-05-27T06:29:31.318606+0000","last_fullsized":"2024-05-27T06:29:31.318606+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.322669+0000","last_change":"2024-05-27T06:29:31.322669+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.322669+0000","last_undegraded":"2024-05-27T06:29:31.322669+0000","last_fullsized":"2024-05-27T06:29:31.322669+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.315121+0000","last_change":"2024-05-27T06:29:31.315121+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.315121+0000","last_undegraded":"2024-05-27T06:29:31.315121+0000","last_fullsized":"2024-05-27T06:29:31.315121+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.318800+0000","last_change":"2024-05-27T06:29:31.318800+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.318800+0000","last_undegraded":"2024-05-27T06:29:31.318800+0000","last_fullsized":"2024-05-27T06:29:31.318800+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.342721+0000","last_change":"2024-05-27T06:29:31.337912+0000","last_active":"2024-05-27T06:29:31.342721+0000","last_peered":"2024-05-27T06:29:31.342721+0000","last_clean":"2024-05-27T06:29:31.342721+0000","last_became_active":"2024-05-27T06:29:31.337076+0000","last_became_peered":"2024-05-27T06:29:31.337076+0000","last_unstale":"2024-05-27T06:29:31.342721+0000","last_undegraded":"2024-05-27T06:29:31.342721+0000","last_fullsized":"2024-05-27T06:29:31.342721+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:49:26.326325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.314740+0000","last_change":"2024-05-27T06:29:31.314740+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.314740+0000","last_undegraded":"2024-05-27T06:29:31.314740+0000","last_fullsized":"2024-05-27T06:29:31.314740+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.345646+0000","last_change":"2024-05-27T06:29:31.340901+0000","last_active":"2024-05-27T06:29:31.345646+0000","last_peered":"2024-05-27T06:29:31.345646+0000","last_clean":"2024-05-27T06:29:31.345646+0000","last_became_active":"2024-05-27T06:29:31.340584+0000","last_became_peered":"2024-05-27T06:29:31.340584+0000","last_unstale":"2024-05-27T06:29:31.345646+0000","last_undegraded":"2024-05-27T06:29:31.345646+0000","last_fullsized":"2024-05-27T06:29:31.345646+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:16:07.331463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.317761+0000","last_change":"2024-05-27T06:29:31.317761+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.317761+0000","last_undegraded":"2024-05-27T06:29:31.317761+0000","last_fullsized":"2024-05-27T06:29:31.317761+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.325224+0000","last_change":"2024-05-27T06:29:31.321412+0000","last_active":"2024-05-27T06:29:31.325224+0000","last_peered":"2024-05-27T06:29:31.325224+0000","last_clean":"2024-05-27T06:29:31.325224+0000","last_became_active":"2024-05-27T06:29:31.321110+0000","last_became_peered":"2024-05-27T06:29:31.321110+0000","last_unstale":"2024-05-27T06:29:31.325224+0000","last_undegraded":"2024-05-27T06:29:31.325224+0000","last_fullsized":"2024-05-27T06:29:31.325224+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:18:17.279684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.319138+0000","last_change":"2024-05-27T06:29:31.319138+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.319138+0000","last_undegraded":"2024-05-27T06:29:31.319138+0000","last_fullsized":"2024-05-27T06:29:31.319138+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.336819+0000","last_change":"2024-05-27T06:29:31.324922+0000","last_active":"2024-05-27T06:29:31.336819+0000","last_peered":"2024-05-27T06:29:31.336819+0000","last_clean":"2024-05-27T06:29:31.336819+0000","last_became_active":"2024-05-27T06:29:31.324534+0000","last_became_peered":"2024-05-27T06:29:31.324534+0000","last_unstale":"2024-05-27T06:29:31.336819+0000","last_undegraded":"2024-05-27T06:29:31.336819+0000","last_fullsized":"2024-05-27T06:29:31.336819+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:07:45.468162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.328009+0000","last_change":"2024-05-27T06:29:31.328009+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.328009+0000","last_undegraded":"2024-05-27T06:29:31.328009+0000","last_fullsized":"2024-05-27T06:29:31.328009+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.335743+0000","last_change":"2024-05-27T06:29:31.328972+0000","last_active":"2024-05-27T06:29:31.335743+0000","last_peered":"2024-05-27T06:29:31.335743+0000","last_clean":"2024-05-27T06:29:31.335743+0000","last_became_active":"2024-05-27T06:29:31.328662+0000","last_became_peered":"2024-05-27T06:29:31.328662+0000","last_unstale":"2024-05-27T06:29:31.335743+0000","last_undegraded":"2024-05-27T06:29:31.335743+0000","last_fullsized":"2024-05-27T06:29:31.335743+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:21:50.798081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.326491+0000","last_change":"2024-05-27T06:29:31.326491+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.326491+0000","last_undegraded":"2024-05-27T06:29:31.326491+0000","last_fullsized":"2024-05-27T06:29:31.326491+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.340527+0000","last_change":"2024-05-27T06:29:31.333973+0000","last_active":"2024-05-27T06:29:31.340527+0000","last_peered":"2024-05-27T06:29:31.340527+0000","last_clean":"2024-05-27T06:29:31.340527+0000","last_became_active":"2024-05-27T06:29:31.333665+0000","last_became_peered":"2024-05-27T06:29:31.333665+0000","last_unstale":"2024-05-27T06:29:31.340527+0000","last_undegraded":"2024-05-27T06:29:31.340527+0000","last_fullsized":"2024-05-27T06:29:31.340527+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:55:11.170951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.325035+0000","last_change":"2024-05-27T06:29:31.325035+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.325035+0000","last_undegraded":"2024-05-27T06:29:31.325035+0000","last_fullsized":"2024-05-27T06:29:31.325035+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.337686+0000","last_change":"2024-05-27T06:29:31.332145+0000","last_active":"2024-05-27T06:29:31.337686+0000","last_peered":"2024-05-27T06:29:31.337686+0000","last_clean":"2024-05-27T06:29:31.337686+0000","last_became_active":"2024-05-27T06:29:31.331328+0000","last_became_peered":"2024-05-27T06:29:31.331328+0000","last_unstale":"2024-05-27T06:29:31.337686+0000","last_undegraded":"2024-05-27T06:29:31.337686+0000","last_fullsized":"2024-05-27T06:29:31.337686+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:50:20.583108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.321350+0000","last_change":"2024-05-27T06:29:31.321350+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.321350+0000","last_undegraded":"2024-05-27T06:29:31.321350+0000","last_fullsized":"2024-05-27T06:29:31.321350+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.341435+0000","last_change":"2024-05-27T06:29:31.339195+0000","last_active":"2024-05-27T06:29:31.341435+0000","last_peered":"2024-05-27T06:29:31.341435+0000","last_clean":"2024-05-27T06:29:31.341435+0000","last_became_active":"2024-05-27T06:29:31.338863+0000","last_became_peered":"2024-05-27T06:29:31.338863+0000","last_unstale":"2024-05-27T06:29:31.341435+0000","last_undegraded":"2024-05-27T06:29:31.341435+0000","last_fullsized":"2024-05-27T06:29:31.341435+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:05:26.579241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.322484+0000","last_change":"2024-05-27T06:29:31.322484+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.322484+0000","last_undegraded":"2024-05-27T06:29:31.322484+0000","last_fullsized":"2024-05-27T06:29:31.322484+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.342900+0000","last_change":"2024-05-27T06:29:31.340841+0000","last_active":"2024-05-27T06:29:31.342900+0000","last_peered":"2024-05-27T06:29:31.342900+0000","last_clean":"2024-05-27T06:29:31.342900+0000","last_became_active":"2024-05-27T06:29:31.340483+0000","last_became_peered":"2024-05-27T06:29:31.340483+0000","last_unstale":"2024-05-27T06:29:31.342900+0000","last_undegraded":"2024-05-27T06:29:31.342900+0000","last_fullsized":"2024-05-27T06:29:31.342900+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:07:45.468162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.319216+0000","last_change":"2024-05-27T06:29:31.319216+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.319216+0000","last_undegraded":"2024-05-27T06:29:31.319216+0000","last_fullsized":"2024-05-27T06:29:31.319216+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.343028+0000","last_change":"2024-05-27T06:29:31.336123+0000","last_active":"2024-05-27T06:29:31.343028+0000","last_peered":"2024-05-27T06:29:31.343028+0000","last_clean":"2024-05-27T06:29:31.343028+0000","last_became_active":"2024-05-27T06:29:31.335682+0000","last_became_peered":"2024-05-27T06:29:31.335682+0000","last_unstale":"2024-05-27T06:29:31.343028+0000","last_undegraded":"2024-05-27T06:29:31.343028+0000","last_fullsized":"2024-05-27T06:29:31.343028+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:49:26.326325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.315321+0000","last_change":"2024-05-27T06:29:31.315321+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.315321+0000","last_undegraded":"2024-05-27T06:29:31.315321+0000","last_fullsized":"2024-05-27T06:29:31.315321+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.342881+0000","last_change":"2024-05-27T06:29:31.340823+0000","last_active":"2024-05-27T06:29:31.342881+0000","last_peered":"2024-05-27T06:29:31.342881+0000","last_clean":"2024-05-27T06:29:31.342881+0000","last_became_active":"2024-05-27T06:29:31.340446+0000","last_became_peered":"2024-05-27T06:29:31.340446+0000","last_unstale":"2024-05-27T06:29:31.342881+0000","last_undegraded":"2024-05-27T06:29:31.342881+0000","last_fullsized":"2024-05-27T06:29:31.342881+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:18:17.279684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.321073+0000","last_change":"2024-05-27T06:29:31.321073+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.321073+0000","last_undegraded":"2024-05-27T06:29:31.321073+0000","last_fullsized":"2024-05-27T06:29:31.321073+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.336747+0000","last_change":"2024-05-27T06:29:31.331195+0000","last_active":"2024-05-27T06:29:31.336747+0000","last_peered":"2024-05-27T06:29:31.336747+0000","last_clean":"2024-05-27T06:29:31.336747+0000","last_became_active":"2024-05-27T06:29:31.330881+0000","last_became_peered":"2024-05-27T06:29:31.330881+0000","last_unstale":"2024-05-27T06:29:31.336747+0000","last_undegraded":"2024-05-27T06:29:31.336747+0000","last_fullsized":"2024-05-27T06:29:31.336747+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:24:48.091681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.318280+0000","last_change":"2024-05-27T06:29:31.318280+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.318280+0000","last_undegraded":"2024-05-27T06:29:31.318280+0000","last_fullsized":"2024-05-27T06:29:31.318280+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.343187+0000","last_change":"2024-05-27T06:29:31.336599+0000","last_active":"2024-05-27T06:29:31.343187+0000","last_peered":"2024-05-27T06:29:31.343187+0000","last_clean":"2024-05-27T06:29:31.343187+0000","last_became_active":"2024-05-27T06:29:31.336273+0000","last_became_peered":"2024-05-27T06:29:31.336273+0000","last_unstale":"2024-05-27T06:29:31.343187+0000","last_undegraded":"2024-05-27T06:29:31.343187+0000","last_fullsized":"2024-05-27T06:29:31.343187+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:10:34.186274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.320720+0000","last_change":"2024-05-27T06:29:31.320720+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.320720+0000","last_undegraded":"2024-05-27T06:29:31.320720+0000","last_fullsized":"2024-05-27T06:29:31.320720+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.341063+0000","last_change":"2024-05-27T06:29:31.335657+0000","last_active":"2024-05-27T06:29:31.341063+0000","last_peered":"2024-05-27T06:29:31.341063+0000","last_clean":"2024-05-27T06:29:31.341063+0000","last_became_active":"2024-05-27T06:29:31.335285+0000","last_became_peered":"2024-05-27T06:29:31.335285+0000","last_unstale":"2024-05-27T06:29:31.341063+0000","last_undegraded":"2024-05-27T06:29:31.341063+0000","last_fullsized":"2024-05-27T06:29:31.341063+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:48:45.545585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.322872+0000","last_change":"2024-05-27T06:29:31.322872+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.322872+0000","last_undegraded":"2024-05-27T06:29:31.322872+0000","last_fullsized":"2024-05-27T06:29:31.322872+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.331881+0000","last_change":"2024-05-27T06:29:31.323676+0000","last_active":"2024-05-27T06:29:31.331881+0000","last_peered":"2024-05-27T06:29:31.331881+0000","last_clean":"2024-05-27T06:29:31.331881+0000","last_became_active":"2024-05-27T06:29:31.323378+0000","last_became_peered":"2024-05-27T06:29:31.323378+0000","last_unstale":"2024-05-27T06:29:31.331881+0000","last_undegraded":"2024-05-27T06:29:31.331881+0000","last_fullsized":"2024-05-27T06:29:31.331881+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:18:17.279684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.318732+0000","last_change":"2024-05-27T06:29:31.318732+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.318732+0000","last_undegraded":"2024-05-27T06:29:31.318732+0000","last_fullsized":"2024-05-27T06:29:31.318732+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.342845+0000","last_change":"2024-05-27T06:29:31.340500+0000","last_active":"2024-05-27T06:29:31.342845+0000","last_peered":"2024-05-27T06:29:31.342845+0000","last_clean":"2024-05-27T06:29:31.342845+0000","last_became_active":"2024-05-27T06:29:31.340151+0000","last_became_peered":"2024-05-27T06:29:31.340151+0000","last_unstale":"2024-05-27T06:29:31.342845+0000","last_undegraded":"2024-05-27T06:29:31.342845+0000","last_fullsized":"2024-05-27T06:29:31.342845+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:25:39.940766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.320036+0000","last_change":"2024-05-27T06:29:31.320036+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.320036+0000","last_undegraded":"2024-05-27T06:29:31.320036+0000","last_fullsized":"2024-05-27T06:29:31.320036+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.343239+0000","last_change":"2024-05-27T06:29:31.336677+0000","last_active":"2024-05-27T06:29:31.343239+0000","last_peered":"2024-05-27T06:29:31.343239+0000","last_clean":"2024-05-27T06:29:31.343239+0000","last_became_active":"2024-05-27T06:29:31.336379+0000","last_became_peered":"2024-05-27T06:29:31.336379+0000","last_unstale":"2024-05-27T06:29:31.343239+0000","last_undegraded":"2024-05-27T06:29:31.343239+0000","last_fullsized":"2024-05-27T06:29:31.343239+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:24:21.069227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316739+0000","last_change":"2024-05-27T06:29:31.316739+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316739+0000","last_undegraded":"2024-05-27T06:29:31.316739+0000","last_fullsized":"2024-05-27T06:29:31.316739+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.335883+0000","last_change":"2024-05-27T06:29:31.329550+0000","last_active":"2024-05-27T06:29:31.335883+0000","last_peered":"2024-05-27T06:29:31.335883+0000","last_clean":"2024-05-27T06:29:31.335883+0000","last_became_active":"2024-05-27T06:29:31.329294+0000","last_became_peered":"2024-05-27T06:29:31.329294+0000","last_unstale":"2024-05-27T06:29:31.335883+0000","last_undegraded":"2024-05-27T06:29:31.335883+0000","last_fullsized":"2024-05-27T06:29:31.335883+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:07:45.468162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.325710+0000","last_change":"2024-05-27T06:29:31.325710+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.325710+0000","last_undegraded":"2024-05-27T06:29:31.325710+0000","last_fullsized":"2024-05-27T06:29:31.325710+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.336602+0000","last_change":"2024-05-27T06:29:31.330141+0000","last_active":"2024-05-27T06:29:31.336602+0000","last_peered":"2024-05-27T06:29:31.336602+0000","last_clean":"2024-05-27T06:29:31.336602+0000","last_became_active":"2024-05-27T06:29:31.329830+0000","last_became_peered":"2024-05-27T06:29:31.329830+0000","last_unstale":"2024-05-27T06:29:31.336602+0000","last_undegraded":"2024-05-27T06:29:31.336602+0000","last_fullsized":"2024-05-27T06:29:31.336602+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:51:42.711265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.320595+0000","last_change":"2024-05-27T06:29:31.320595+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.320595+0000","last_undegraded":"2024-05-27T06:29:31.320595+0000","last_fullsized":"2024-05-27T06:29:31.320595+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.336058+0000","last_change":"2024-05-27T06:29:31.332562+0000","last_active":"2024-05-27T06:29:31.336058+0000","last_peered":"2024-05-27T06:29:31.336058+0000","last_clean":"2024-05-27T06:29:31.336058+0000","last_became_active":"2024-05-27T06:29:31.332221+0000","last_became_peered":"2024-05-27T06:29:31.332221+0000","last_unstale":"2024-05-27T06:29:31.336058+0000","last_undegraded":"2024-05-27T06:29:31.336058+0000","last_fullsized":"2024-05-27T06:29:31.336058+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:51:42.711265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316837+0000","last_change":"2024-05-27T06:29:31.316837+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316837+0000","last_undegraded":"2024-05-27T06:29:31.316837+0000","last_fullsized":"2024-05-27T06:29:31.316837+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.343207+0000","last_change":"2024-05-27T06:29:31.336613+0000","last_active":"2024-05-27T06:29:31.343207+0000","last_peered":"2024-05-27T06:29:31.343207+0000","last_clean":"2024-05-27T06:29:31.343207+0000","last_became_active":"2024-05-27T06:29:31.336319+0000","last_became_peered":"2024-05-27T06:29:31.336319+0000","last_unstale":"2024-05-27T06:29:31.343207+0000","last_undegraded":"2024-05-27T06:29:31.343207+0000","last_fullsized":"2024-05-27T06:29:31.343207+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:16:41.521107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316374+0000","last_change":"2024-05-27T06:29:31.316374+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316374+0000","last_undegraded":"2024-05-27T06:29:31.316374+0000","last_fullsized":"2024-05-27T06:29:31.316374+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.331552+0000","last_change":"2024-05-27T06:29:31.326223+0000","last_active":"2024-05-27T06:29:31.331552+0000","last_peered":"2024-05-27T06:29:31.331552+0000","last_clean":"2024-05-27T06:29:31.331552+0000","last_became_active":"2024-05-27T06:29:31.325962+0000","last_became_peered":"2024-05-27T06:29:31.325962+0000","last_unstale":"2024-05-27T06:29:31.331552+0000","last_undegraded":"2024-05-27T06:29:31.331552+0000","last_fullsized":"2024-05-27T06:29:31.331552+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:21:17.064386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.315692+0000","last_change":"2024-05-27T06:29:31.315692+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.315692+0000","last_undegraded":"2024-05-27T06:29:31.315692+0000","last_fullsized":"2024-05-27T06:29:31.315692+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.337644+0000","last_change":"2024-05-27T06:29:31.332841+0000","last_active":"2024-05-27T06:29:31.337644+0000","last_peered":"2024-05-27T06:29:31.337644+0000","last_clean":"2024-05-27T06:29:31.337644+0000","last_became_active":"2024-05-27T06:29:31.332404+0000","last_became_peered":"2024-05-27T06:29:31.332404+0000","last_unstale":"2024-05-27T06:29:31.337644+0000","last_undegraded":"2024-05-27T06:29:31.337644+0000","last_fullsized":"2024-05-27T06:29:31.337644+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:55:11.170951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316490+0000","last_change":"2024-05-27T06:29:31.316490+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316490+0000","last_undegraded":"2024-05-27T06:29:31.316490+0000","last_fullsized":"2024-05-27T06:29:31.316490+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.342953+0000","last_change":"2024-05-27T06:29:31.338844+0000","last_active":"2024-05-27T06:29:31.342953+0000","last_peered":"2024-05-27T06:29:31.342953+0000","last_clean":"2024-05-27T06:29:31.342953+0000","last_became_active":"2024-05-27T06:29:31.338521+0000","last_became_peered":"2024-05-27T06:29:31.338521+0000","last_unstale":"2024-05-27T06:29:31.342953+0000","last_undegraded":"2024-05-27T06:29:31.342953+0000","last_fullsized":"2024-05-27T06:29:31.342953+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:31:46.375058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316199+0000","last_change":"2024-05-27T06:29:31.316199+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316199+0000","last_undegraded":"2024-05-27T06:29:31.316199+0000","last_fullsized":"2024-05-27T06:29:31.316199+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.336114+0000","last_change":"2024-05-27T06:29:31.333344+0000","last_active":"2024-05-27T06:29:31.336114+0000","last_peered":"2024-05-27T06:29:31.336114+0000","last_clean":"2024-05-27T06:29:31.336114+0000","last_became_active":"2024-05-27T06:29:31.333044+0000","last_became_peered":"2024-05-27T06:29:31.333044+0000","last_unstale":"2024-05-27T06:29:31.336114+0000","last_undegraded":"2024-05-27T06:29:31.336114+0000","last_fullsized":"2024-05-27T06:29:31.336114+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:50:20.583108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.314819+0000","last_change":"2024-05-27T06:29:31.314819+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.314819+0000","last_undegraded":"2024-05-27T06:29:31.314819+0000","last_fullsized":"2024-05-27T06:29:31.314819+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.337606+0000","last_change":"2024-05-27T06:29:31.335481+0000","last_active":"2024-05-27T06:29:31.337606+0000","last_peered":"2024-05-27T06:29:31.337606+0000","last_clean":"2024-05-27T06:29:31.337606+0000","last_became_active":"2024-05-27T06:29:31.334999+0000","last_became_peered":"2024-05-27T06:29:31.334999+0000","last_unstale":"2024-05-27T06:29:31.337606+0000","last_undegraded":"2024-05-27T06:29:31.337606+0000","last_fullsized":"2024-05-27T06:29:31.337606+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:05:26.579241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.317184+0000","last_change":"2024-05-27T06:29:31.317184+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.317184+0000","last_undegraded":"2024-05-27T06:29:31.317184+0000","last_fullsized":"2024-05-27T06:29:31.317184+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.339998+0000","last_change":"2024-05-27T06:29:31.336050+0000","last_active":"2024-05-27T06:29:31.339998+0000","last_peered":"2024-05-27T06:29:31.339998+0000","last_clean":"2024-05-27T06:29:31.339998+0000","last_became_active":"2024-05-27T06:29:31.335730+0000","last_became_peered":"2024-05-27T06:29:31.335730+0000","last_unstale":"2024-05-27T06:29:31.339998+0000","last_undegraded":"2024-05-27T06:29:31.339998+0000","last_fullsized":"2024-05-27T06:29:31.339998+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:49:26.326325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.321809+0000","last_change":"2024-05-27T06:29:31.321809+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.321809+0000","last_undegraded":"2024-05-27T06:29:31.321809+0000","last_fullsized":"2024-05-27T06:29:31.321809+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.330550+0000","last_change":"2024-05-27T06:29:31.322798+0000","last_active":"2024-05-27T06:29:31.330550+0000","last_peered":"2024-05-27T06:29:31.330550+0000","last_clean":"2024-05-27T06:29:31.330550+0000","last_became_active":"2024-05-27T06:29:31.322512+0000","last_became_peered":"2024-05-27T06:29:31.322512+0000","last_unstale":"2024-05-27T06:29:31.330550+0000","last_undegraded":"2024-05-27T06:29:31.330550+0000","last_fullsized":"2024-05-27T06:29:31.330550+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:48:45.545585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.320106+0000","last_change":"2024-05-27T06:29:31.320106+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.320106+0000","last_undegraded":"2024-05-27T06:29:31.320106+0000","last_fullsized":"2024-05-27T06:29:31.320106+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.335841+0000","last_change":"2024-05-27T06:29:31.333682+0000","last_active":"2024-05-27T06:29:31.335841+0000","last_peered":"2024-05-27T06:29:31.335841+0000","last_clean":"2024-05-27T06:29:31.335841+0000","last_became_active":"2024-05-27T06:29:31.333356+0000","last_became_peered":"2024-05-27T06:29:31.333356+0000","last_unstale":"2024-05-27T06:29:31.335841+0000","last_undegraded":"2024-05-27T06:29:31.335841+0000","last_fullsized":"2024-05-27T06:29:31.335841+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:50:50.388948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.314897+0000","last_change":"2024-05-27T06:29:31.314897+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.314897+0000","last_undegraded":"2024-05-27T06:29:31.314897+0000","last_fullsized":"2024-05-27T06:29:31.314897+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.321473+0000","last_change":"2024-05-27T06:29:31.319544+0000","last_active":"2024-05-27T06:29:31.321473+0000","last_peered":"2024-05-27T06:29:31.321473+0000","last_clean":"2024-05-27T06:29:31.321473+0000","last_became_active":"2024-05-27T06:29:31.319187+0000","last_became_peered":"2024-05-27T06:29:31.319187+0000","last_unstale":"2024-05-27T06:29:31.321473+0000","last_undegraded":"2024-05-27T06:29:31.321473+0000","last_fullsized":"2024-05-27T06:29:31.321473+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:05:26.579241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.320910+0000","last_change":"2024-05-27T06:29:31.320910+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.320910+0000","last_undegraded":"2024-05-27T06:29:31.320910+0000","last_fullsized":"2024-05-27T06:29:31.320910+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.337788+0000","last_change":"2024-05-27T06:29:31.330242+0000","last_active":"2024-05-27T06:29:31.337788+0000","last_peered":"2024-05-27T06:29:31.337788+0000","last_clean":"2024-05-27T06:29:31.337788+0000","last_became_active":"2024-05-27T06:29:31.329531+0000","last_became_peered":"2024-05-27T06:29:31.329531+0000","last_unstale":"2024-05-27T06:29:31.337788+0000","last_undegraded":"2024-05-27T06:29:31.337788+0000","last_fullsized":"2024-05-27T06:29:31.337788+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:55:11.170951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.319519+0000","last_change":"2024-05-27T06:29:31.319519+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.319519+0000","last_undegraded":"2024-05-27T06:29:31.319519+0000","last_fullsized":"2024-05-27T06:29:31.319519+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.342691+0000","last_change":"2024-05-27T06:29:31.338455+0000","last_active":"2024-05-27T06:29:31.342691+0000","last_peered":"2024-05-27T06:29:31.342691+0000","last_clean":"2024-05-27T06:29:31.342691+0000","last_became_active":"2024-05-27T06:29:31.338096+0000","last_became_peered":"2024-05-27T06:29:31.338096+0000","last_unstale":"2024-05-27T06:29:31.342691+0000","last_undegraded":"2024-05-27T06:29:31.342691+0000","last_fullsized":"2024-05-27T06:29:31.342691+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:21:17.064386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":169,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.328335+0000","last_change":"2024-05-27T06:27:28.692457+0000","last_active":"2024-05-27T06:29:31.328335+0000","last_peered":"2024-05-27T06:29:31.328335+0000","last_clean":"2024-05-27T06:29:31.328335+0000","last_became_active":"2024-05-27T06:27:28.691290+0000","last_became_peered":"2024-05-27T06:27:28.691290+0000","last_unstale":"2024-05-27T06:29:31.328335+0000","last_undegraded":"2024-05-27T06:29:31.328335+0000","last_fullsized":"2024-05-27T06:29:31.328335+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_clean_scrub_stamp":"2024-05-27T06:27:26.991915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:45.563728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28212,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343628,"statfs":{"total":96636764160,"available":96607875072,"internally_reserved":0,"allocated":1216512,"data_stored":869502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":272475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":272475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":272475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":272475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":279134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":272475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32372,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":1216512,"data_stored":869502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T06:29:37.242 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3f is not active+clean 2024-05-27T06:29:37.242 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.325351+0000', 'last_change': '2024-05-27T06:29:31.325351+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.325351+0000', 'last_undegraded': '2024-05-27T06:29:31.325351+0000', 'last_fullsized': '2024-05-27T06:29:31.325351+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-27T06:29:37.242 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3e is not active+clean 2024-05-27T06:29:37.242 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.331688+0000', 'last_change': '2024-05-27T06:29:31.331688+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.331688+0000', 'last_undegraded': '2024-05-27T06:29:31.331688+0000', 'last_fullsized': '2024-05-27T06:29:31.331688+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-27T06:29:37.242 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3d is not active+clean 2024-05-27T06:29:37.242 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.321588+0000', 'last_change': '2024-05-27T06:29:31.321588+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.321588+0000', 'last_undegraded': '2024-05-27T06:29:31.321588+0000', 'last_fullsized': '2024-05-27T06:29:31.321588+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-27T06:29:37.243 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3c is not active+clean 2024-05-27T06:29:37.243 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.316361+0000', 'last_change': '2024-05-27T06:29:31.316361+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.316361+0000', 'last_undegraded': '2024-05-27T06:29:31.316361+0000', 'last_fullsized': '2024-05-27T06:29:31.316361+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-27T06:29:37.243 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3b is not active+clean 2024-05-27T06:29:37.243 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.322694+0000', 'last_change': '2024-05-27T06:29:31.322694+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.322694+0000', 'last_undegraded': '2024-05-27T06:29:31.322694+0000', 'last_fullsized': '2024-05-27T06:29:31.322694+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-27T06:29:37.243 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3a is not active+clean 2024-05-27T06:29:37.243 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.316328+0000', 'last_change': '2024-05-27T06:29:31.316328+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.316328+0000', 'last_undegraded': '2024-05-27T06:29:31.316328+0000', 'last_fullsized': '2024-05-27T06:29:31.316328+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T06:29:37.243 INFO:tasks.ceph.ceph_manager.ceph:PG 9.39 is not active+clean 2024-05-27T06:29:37.243 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.328222+0000', 'last_change': '2024-05-27T06:29:31.328222+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.328222+0000', 'last_undegraded': '2024-05-27T06:29:31.328222+0000', 'last_fullsized': '2024-05-27T06:29:31.328222+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-27T06:29:37.243 INFO:tasks.ceph.ceph_manager.ceph:PG 9.38 is not active+clean 2024-05-27T06:29:37.243 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.329940+0000', 'last_change': '2024-05-27T06:29:31.329940+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.329940+0000', 'last_undegraded': '2024-05-27T06:29:31.329940+0000', 'last_fullsized': '2024-05-27T06:29:31.329940+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-27T06:29:37.243 INFO:tasks.ceph.ceph_manager.ceph:PG 9.37 is not active+clean 2024-05-27T06:29:37.244 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.324127+0000', 'last_change': '2024-05-27T06:29:31.324127+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.324127+0000', 'last_undegraded': '2024-05-27T06:29:31.324127+0000', 'last_fullsized': '2024-05-27T06:29:31.324127+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-27T06:29:37.244 INFO:tasks.ceph.ceph_manager.ceph:PG 9.36 is not active+clean 2024-05-27T06:29:37.244 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.314719+0000', 'last_change': '2024-05-27T06:29:31.314719+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.314719+0000', 'last_undegraded': '2024-05-27T06:29:31.314719+0000', 'last_fullsized': '2024-05-27T06:29:31.314719+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-27T06:29:37.244 INFO:tasks.ceph.ceph_manager.ceph:PG 9.35 is not active+clean 2024-05-27T06:29:37.244 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.314718+0000', 'last_change': '2024-05-27T06:29:31.314718+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.314718+0000', 'last_undegraded': '2024-05-27T06:29:31.314718+0000', 'last_fullsized': '2024-05-27T06:29:31.314718+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-27T06:29:37.244 INFO:tasks.ceph.ceph_manager.ceph:PG 9.34 is not active+clean 2024-05-27T06:29:37.244 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.315776+0000', 'last_change': '2024-05-27T06:29:31.315776+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.315776+0000', 'last_undegraded': '2024-05-27T06:29:31.315776+0000', 'last_fullsized': '2024-05-27T06:29:31.315776+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-27T06:29:37.244 INFO:tasks.ceph.ceph_manager.ceph:PG 9.33 is not active+clean 2024-05-27T06:29:37.244 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.326291+0000', 'last_change': '2024-05-27T06:29:31.326291+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.326291+0000', 'last_undegraded': '2024-05-27T06:29:31.326291+0000', 'last_fullsized': '2024-05-27T06:29:31.326291+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-27T06:29:37.244 INFO:tasks.ceph.ceph_manager.ceph:PG 9.32 is not active+clean 2024-05-27T06:29:37.244 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.324937+0000', 'last_change': '2024-05-27T06:29:31.324937+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.324937+0000', 'last_undegraded': '2024-05-27T06:29:31.324937+0000', 'last_fullsized': '2024-05-27T06:29:31.324937+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-27T06:29:37.244 INFO:tasks.ceph.ceph_manager.ceph:PG 9.31 is not active+clean 2024-05-27T06:29:37.245 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.323137+0000', 'last_change': '2024-05-27T06:29:31.323137+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.323137+0000', 'last_undegraded': '2024-05-27T06:29:31.323137+0000', 'last_fullsized': '2024-05-27T06:29:31.323137+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-27T06:29:37.245 INFO:tasks.ceph.ceph_manager.ceph:PG 9.30 is not active+clean 2024-05-27T06:29:37.245 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.315935+0000', 'last_change': '2024-05-27T06:29:31.315935+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.315935+0000', 'last_undegraded': '2024-05-27T06:29:31.315935+0000', 'last_fullsized': '2024-05-27T06:29:31.315935+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T06:29:37.245 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2f is not active+clean 2024-05-27T06:29:37.245 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.331611+0000', 'last_change': '2024-05-27T06:29:31.331611+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.331611+0000', 'last_undegraded': '2024-05-27T06:29:31.331611+0000', 'last_fullsized': '2024-05-27T06:29:31.331611+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-27T06:29:37.245 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2e is not active+clean 2024-05-27T06:29:37.245 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.323762+0000', 'last_change': '2024-05-27T06:29:31.323762+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.323762+0000', 'last_undegraded': '2024-05-27T06:29:31.323762+0000', 'last_fullsized': '2024-05-27T06:29:31.323762+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-27T06:29:37.245 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2d is not active+clean 2024-05-27T06:29:37.245 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.324275+0000', 'last_change': '2024-05-27T06:29:31.324275+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.324275+0000', 'last_undegraded': '2024-05-27T06:29:31.324275+0000', 'last_fullsized': '2024-05-27T06:29:31.324275+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-27T06:29:37.245 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2c is not active+clean 2024-05-27T06:29:37.245 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.330730+0000', 'last_change': '2024-05-27T06:29:31.330730+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.330730+0000', 'last_undegraded': '2024-05-27T06:29:31.330730+0000', 'last_fullsized': '2024-05-27T06:29:31.330730+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-27T06:29:37.245 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2b is not active+clean 2024-05-27T06:29:37.246 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.321230+0000', 'last_change': '2024-05-27T06:29:31.321230+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.321230+0000', 'last_undegraded': '2024-05-27T06:29:31.321230+0000', 'last_fullsized': '2024-05-27T06:29:31.321230+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-27T06:29:37.246 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2a is not active+clean 2024-05-27T06:29:37.246 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.331015+0000', 'last_change': '2024-05-27T06:29:31.331015+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.331015+0000', 'last_undegraded': '2024-05-27T06:29:31.331015+0000', 'last_fullsized': '2024-05-27T06:29:31.331015+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-27T06:29:37.246 INFO:tasks.ceph.ceph_manager.ceph:PG 9.29 is not active+clean 2024-05-27T06:29:37.246 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.319934+0000', 'last_change': '2024-05-27T06:29:31.319934+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.319934+0000', 'last_undegraded': '2024-05-27T06:29:31.319934+0000', 'last_fullsized': '2024-05-27T06:29:31.319934+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-27T06:29:37.246 INFO:tasks.ceph.ceph_manager.ceph:PG 9.28 is not active+clean 2024-05-27T06:29:37.246 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.325828+0000', 'last_change': '2024-05-27T06:29:31.325828+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.325828+0000', 'last_undegraded': '2024-05-27T06:29:31.325828+0000', 'last_fullsized': '2024-05-27T06:29:31.325828+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-27T06:29:37.246 INFO:tasks.ceph.ceph_manager.ceph:PG 9.27 is not active+clean 2024-05-27T06:29:37.246 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.323843+0000', 'last_change': '2024-05-27T06:29:31.323843+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.323843+0000', 'last_undegraded': '2024-05-27T06:29:31.323843+0000', 'last_fullsized': '2024-05-27T06:29:31.323843+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-27T06:29:37.247 INFO:tasks.ceph.ceph_manager.ceph:PG 9.26 is not active+clean 2024-05-27T06:29:37.247 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.316929+0000', 'last_change': '2024-05-27T06:29:31.316929+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.316929+0000', 'last_undegraded': '2024-05-27T06:29:31.316929+0000', 'last_fullsized': '2024-05-27T06:29:31.316929+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-27T06:29:37.247 INFO:tasks.ceph.ceph_manager.ceph:PG 9.25 is not active+clean 2024-05-27T06:29:37.247 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.319583+0000', 'last_change': '2024-05-27T06:29:31.319583+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.319583+0000', 'last_undegraded': '2024-05-27T06:29:31.319583+0000', 'last_fullsized': '2024-05-27T06:29:31.319583+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T06:29:37.247 INFO:tasks.ceph.ceph_manager.ceph:PG 9.24 is not active+clean 2024-05-27T06:29:37.247 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.322732+0000', 'last_change': '2024-05-27T06:29:31.322732+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.322732+0000', 'last_undegraded': '2024-05-27T06:29:31.322732+0000', 'last_fullsized': '2024-05-27T06:29:31.322732+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-27T06:29:37.247 INFO:tasks.ceph.ceph_manager.ceph:PG 9.23 is not active+clean 2024-05-27T06:29:37.247 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.326867+0000', 'last_change': '2024-05-27T06:29:31.326867+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.326867+0000', 'last_undegraded': '2024-05-27T06:29:31.326867+0000', 'last_fullsized': '2024-05-27T06:29:31.326867+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-27T06:29:37.247 INFO:tasks.ceph.ceph_manager.ceph:PG 9.22 is not active+clean 2024-05-27T06:29:37.248 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.318606+0000', 'last_change': '2024-05-27T06:29:31.318606+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.318606+0000', 'last_undegraded': '2024-05-27T06:29:31.318606+0000', 'last_fullsized': '2024-05-27T06:29:31.318606+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-27T06:29:37.248 INFO:tasks.ceph.ceph_manager.ceph:PG 9.21 is not active+clean 2024-05-27T06:29:37.248 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.322669+0000', 'last_change': '2024-05-27T06:29:31.322669+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.322669+0000', 'last_undegraded': '2024-05-27T06:29:31.322669+0000', 'last_fullsized': '2024-05-27T06:29:31.322669+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-27T06:29:37.248 INFO:tasks.ceph.ceph_manager.ceph:PG 9.20 is not active+clean 2024-05-27T06:29:37.248 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.315121+0000', 'last_change': '2024-05-27T06:29:31.315121+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.315121+0000', 'last_undegraded': '2024-05-27T06:29:31.315121+0000', 'last_fullsized': '2024-05-27T06:29:31.315121+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T06:29:37.248 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1e is not active+clean 2024-05-27T06:29:37.248 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.318800+0000', 'last_change': '2024-05-27T06:29:31.318800+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.318800+0000', 'last_undegraded': '2024-05-27T06:29:31.318800+0000', 'last_fullsized': '2024-05-27T06:29:31.318800+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T06:29:37.248 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1f is not active+clean 2024-05-27T06:29:37.248 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.314740+0000', 'last_change': '2024-05-27T06:29:31.314740+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.314740+0000', 'last_undegraded': '2024-05-27T06:29:31.314740+0000', 'last_fullsized': '2024-05-27T06:29:31.314740+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-27T06:29:37.249 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1c is not active+clean 2024-05-27T06:29:37.249 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.317761+0000', 'last_change': '2024-05-27T06:29:31.317761+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.317761+0000', 'last_undegraded': '2024-05-27T06:29:31.317761+0000', 'last_fullsized': '2024-05-27T06:29:31.317761+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T06:29:37.249 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1d is not active+clean 2024-05-27T06:29:37.249 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.319138+0000', 'last_change': '2024-05-27T06:29:31.319138+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.319138+0000', 'last_undegraded': '2024-05-27T06:29:31.319138+0000', 'last_fullsized': '2024-05-27T06:29:31.319138+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T06:29:37.249 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1a is not active+clean 2024-05-27T06:29:37.249 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.328009+0000', 'last_change': '2024-05-27T06:29:31.328009+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.328009+0000', 'last_undegraded': '2024-05-27T06:29:31.328009+0000', 'last_fullsized': '2024-05-27T06:29:31.328009+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-27T06:29:37.249 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1b is not active+clean 2024-05-27T06:29:37.250 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.326491+0000', 'last_change': '2024-05-27T06:29:31.326491+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.326491+0000', 'last_undegraded': '2024-05-27T06:29:31.326491+0000', 'last_fullsized': '2024-05-27T06:29:31.326491+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-27T06:29:37.250 INFO:tasks.ceph.ceph_manager.ceph:PG 9.18 is not active+clean 2024-05-27T06:29:37.250 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.325035+0000', 'last_change': '2024-05-27T06:29:31.325035+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.325035+0000', 'last_undegraded': '2024-05-27T06:29:31.325035+0000', 'last_fullsized': '2024-05-27T06:29:31.325035+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-27T06:29:37.250 INFO:tasks.ceph.ceph_manager.ceph:PG 9.19 is not active+clean 2024-05-27T06:29:37.250 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.321350+0000', 'last_change': '2024-05-27T06:29:31.321350+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.321350+0000', 'last_undegraded': '2024-05-27T06:29:31.321350+0000', 'last_fullsized': '2024-05-27T06:29:31.321350+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-27T06:29:37.250 INFO:tasks.ceph.ceph_manager.ceph:PG 9.16 is not active+clean 2024-05-27T06:29:37.250 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.322484+0000', 'last_change': '2024-05-27T06:29:31.322484+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.322484+0000', 'last_undegraded': '2024-05-27T06:29:31.322484+0000', 'last_fullsized': '2024-05-27T06:29:31.322484+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-27T06:29:37.251 INFO:tasks.ceph.ceph_manager.ceph:PG 9.17 is not active+clean 2024-05-27T06:29:37.251 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.319216+0000', 'last_change': '2024-05-27T06:29:31.319216+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.319216+0000', 'last_undegraded': '2024-05-27T06:29:31.319216+0000', 'last_fullsized': '2024-05-27T06:29:31.319216+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-27T06:29:37.251 INFO:tasks.ceph.ceph_manager.ceph:PG 9.14 is not active+clean 2024-05-27T06:29:37.251 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.315321+0000', 'last_change': '2024-05-27T06:29:31.315321+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.315321+0000', 'last_undegraded': '2024-05-27T06:29:31.315321+0000', 'last_fullsized': '2024-05-27T06:29:31.315321+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-27T06:29:37.251 INFO:tasks.ceph.ceph_manager.ceph:PG 9.15 is not active+clean 2024-05-27T06:29:37.251 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.321073+0000', 'last_change': '2024-05-27T06:29:31.321073+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.321073+0000', 'last_undegraded': '2024-05-27T06:29:31.321073+0000', 'last_fullsized': '2024-05-27T06:29:31.321073+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-27T06:29:37.251 INFO:tasks.ceph.ceph_manager.ceph:PG 9.12 is not active+clean 2024-05-27T06:29:37.252 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.318280+0000', 'last_change': '2024-05-27T06:29:31.318280+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.318280+0000', 'last_undegraded': '2024-05-27T06:29:31.318280+0000', 'last_fullsized': '2024-05-27T06:29:31.318280+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-27T06:29:37.252 INFO:tasks.ceph.ceph_manager.ceph:PG 9.13 is not active+clean 2024-05-27T06:29:37.252 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.320720+0000', 'last_change': '2024-05-27T06:29:31.320720+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.320720+0000', 'last_undegraded': '2024-05-27T06:29:31.320720+0000', 'last_fullsized': '2024-05-27T06:29:31.320720+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-27T06:29:37.252 INFO:tasks.ceph.ceph_manager.ceph:PG 9.10 is not active+clean 2024-05-27T06:29:37.252 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.322872+0000', 'last_change': '2024-05-27T06:29:31.322872+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.322872+0000', 'last_undegraded': '2024-05-27T06:29:31.322872+0000', 'last_fullsized': '2024-05-27T06:29:31.322872+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-27T06:29:37.252 INFO:tasks.ceph.ceph_manager.ceph:PG 9.11 is not active+clean 2024-05-27T06:29:37.252 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.318732+0000', 'last_change': '2024-05-27T06:29:31.318732+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.318732+0000', 'last_undegraded': '2024-05-27T06:29:31.318732+0000', 'last_fullsized': '2024-05-27T06:29:31.318732+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-27T06:29:37.253 INFO:tasks.ceph.ceph_manager.ceph:PG 9.e is not active+clean 2024-05-27T06:29:37.253 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.320036+0000', 'last_change': '2024-05-27T06:29:31.320036+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.320036+0000', 'last_undegraded': '2024-05-27T06:29:31.320036+0000', 'last_fullsized': '2024-05-27T06:29:31.320036+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-27T06:29:37.253 INFO:tasks.ceph.ceph_manager.ceph:PG 9.f is not active+clean 2024-05-27T06:29:37.253 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.316739+0000', 'last_change': '2024-05-27T06:29:31.316739+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.316739+0000', 'last_undegraded': '2024-05-27T06:29:31.316739+0000', 'last_fullsized': '2024-05-27T06:29:31.316739+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-27T06:29:37.253 INFO:tasks.ceph.ceph_manager.ceph:PG 9.c is not active+clean 2024-05-27T06:29:37.253 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.325710+0000', 'last_change': '2024-05-27T06:29:31.325710+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.325710+0000', 'last_undegraded': '2024-05-27T06:29:31.325710+0000', 'last_fullsized': '2024-05-27T06:29:31.325710+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-27T06:29:37.253 INFO:tasks.ceph.ceph_manager.ceph:PG 9.d is not active+clean 2024-05-27T06:29:37.253 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.320595+0000', 'last_change': '2024-05-27T06:29:31.320595+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.320595+0000', 'last_undegraded': '2024-05-27T06:29:31.320595+0000', 'last_fullsized': '2024-05-27T06:29:31.320595+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-27T06:29:37.254 INFO:tasks.ceph.ceph_manager.ceph:PG 9.a is not active+clean 2024-05-27T06:29:37.254 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.316837+0000', 'last_change': '2024-05-27T06:29:31.316837+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.316837+0000', 'last_undegraded': '2024-05-27T06:29:31.316837+0000', 'last_fullsized': '2024-05-27T06:29:31.316837+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-27T06:29:37.254 INFO:tasks.ceph.ceph_manager.ceph:PG 9.b is not active+clean 2024-05-27T06:29:37.254 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.316374+0000', 'last_change': '2024-05-27T06:29:31.316374+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.316374+0000', 'last_undegraded': '2024-05-27T06:29:31.316374+0000', 'last_fullsized': '2024-05-27T06:29:31.316374+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T06:29:37.255 INFO:tasks.ceph.ceph_manager.ceph:PG 9.9 is not active+clean 2024-05-27T06:29:37.255 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.315692+0000', 'last_change': '2024-05-27T06:29:31.315692+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.315692+0000', 'last_undegraded': '2024-05-27T06:29:31.315692+0000', 'last_fullsized': '2024-05-27T06:29:31.315692+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T06:29:37.255 INFO:tasks.ceph.ceph_manager.ceph:PG 9.6 is not active+clean 2024-05-27T06:29:37.255 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.316490+0000', 'last_change': '2024-05-27T06:29:31.316490+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.316490+0000', 'last_undegraded': '2024-05-27T06:29:31.316490+0000', 'last_fullsized': '2024-05-27T06:29:31.316490+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-27T06:29:37.255 INFO:tasks.ceph.ceph_manager.ceph:PG 9.7 is not active+clean 2024-05-27T06:29:37.255 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.316199+0000', 'last_change': '2024-05-27T06:29:31.316199+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.316199+0000', 'last_undegraded': '2024-05-27T06:29:31.316199+0000', 'last_fullsized': '2024-05-27T06:29:31.316199+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-27T06:29:37.256 INFO:tasks.ceph.ceph_manager.ceph:PG 9.4 is not active+clean 2024-05-27T06:29:37.256 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.314819+0000', 'last_change': '2024-05-27T06:29:31.314819+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.314819+0000', 'last_undegraded': '2024-05-27T06:29:31.314819+0000', 'last_fullsized': '2024-05-27T06:29:31.314819+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-27T06:29:37.256 INFO:tasks.ceph.ceph_manager.ceph:PG 9.5 is not active+clean 2024-05-27T06:29:37.256 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.317184+0000', 'last_change': '2024-05-27T06:29:31.317184+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.317184+0000', 'last_undegraded': '2024-05-27T06:29:31.317184+0000', 'last_fullsized': '2024-05-27T06:29:31.317184+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T06:29:37.256 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2 is not active+clean 2024-05-27T06:29:37.256 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.321809+0000', 'last_change': '2024-05-27T06:29:31.321809+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.321809+0000', 'last_undegraded': '2024-05-27T06:29:31.321809+0000', 'last_fullsized': '2024-05-27T06:29:31.321809+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-27T06:29:37.256 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3 is not active+clean 2024-05-27T06:29:37.256 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.320106+0000', 'last_change': '2024-05-27T06:29:31.320106+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.320106+0000', 'last_undegraded': '2024-05-27T06:29:31.320106+0000', 'last_fullsized': '2024-05-27T06:29:31.320106+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-27T06:29:37.257 INFO:tasks.ceph.ceph_manager.ceph:PG 9.0 is not active+clean 2024-05-27T06:29:37.257 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.314897+0000', 'last_change': '2024-05-27T06:29:31.314897+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.314897+0000', 'last_undegraded': '2024-05-27T06:29:31.314897+0000', 'last_fullsized': '2024-05-27T06:29:31.314897+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-27T06:29:37.257 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1 is not active+clean 2024-05-27T06:29:37.257 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.320910+0000', 'last_change': '2024-05-27T06:29:31.320910+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.320910+0000', 'last_undegraded': '2024-05-27T06:29:31.320910+0000', 'last_fullsized': '2024-05-27T06:29:31.320910+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-27T06:29:37.257 INFO:tasks.ceph.ceph_manager.ceph:PG 9.8 is not active+clean 2024-05-27T06:29:37.257 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-05-27T06:29:31.319519+0000', 'last_change': '2024-05-27T06:29:31.319519+0000', 'last_active': '2024-05-27T06:29:31.299642+0000', 'last_peered': '2024-05-27T06:29:31.299642+0000', 'last_clean': '2024-05-27T06:29:31.299642+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T06:29:31.319519+0000', 'last_undegraded': '2024-05-27T06:29:31.319519+0000', 'last_fullsized': '2024-05-27T06:29:31.319519+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'last_clean_scrub_stamp': '2024-05-27T06:29:31.299642+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-27T06:29:37.258 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-27T06:29:37.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.432+0000 7f1f08400640 1 Processor -- start 2024-05-27T06:29:37.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.432+0000 7f1f08400640 1 -- start start 2024-05-27T06:29:37.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.432+0000 7f1f08400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1f000cea40 0x7f1f00158360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:37.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.432+0000 7f1f08400640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f000b2cd0 con 0x7f1f000d2010 2024-05-27T06:29:37.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.432+0000 7f1f08400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f000cdc80 con 0x7f1f000b2fb0 2024-05-27T06:29:37.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.432+0000 7f1f08400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f1f000ce5b0 con 0x7f1f000cea40 2024-05-27T06:29:37.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.432+0000 7f1f05000640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f1f000d2010 0x7f1f000d2420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:32950/0 (socket says 172.21.15.87:32950) 2024-05-27T06:29:37.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.432+0000 7f1f05a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1f000cea40 0x7f1f00158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:37.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.432+0000 7f1f05000640 1 -- 172.21.15.87:0/1257209870 learned_addr learned my addr 172.21.15.87:0/1257209870 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:29:37.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.432+0000 7f1effe00640 1 -- 172.21.15.87:0/1257209870 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2458284484 0 0) 0x7f1f000b2cd0 con 0x7f1f000d2010 2024-05-27T06:29:37.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.432+0000 7f1effe00640 1 -- 172.21.15.87:0/1257209870 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ee8003530 con 0x7f1f000d2010 2024-05-27T06:29:37.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.432+0000 7f1f05a00640 1 -- 172.21.15.87:0/1257209870 >> v1:172.21.15.149:6789/0 conn(0x7f1f000b2fb0 legacy=0x7f1f000b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:37.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.432+0000 7f1f05a00640 1 -- 172.21.15.87:0/1257209870 >> v1:172.21.15.87:6789/0 conn(0x7f1f000d2010 legacy=0x7f1f000d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:37.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.432+0000 7f1f05a00640 1 -- 172.21.15.87:0/1257209870 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f000cdf60 con 0x7f1f000cea40 2024-05-27T06:29:37.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.436+0000 7f1f05a00640 1 --2- 172.21.15.87:0/1257209870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f000cea40 0x7f1f00158360 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1ef40097c0 tx=0x7f1ef401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4f01a0a8ac4897 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:37.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.436+0000 7f1effe00640 1 -- 172.21.15.87:0/1257209870 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef40b2070 con 0x7f1f000cea40 2024-05-27T06:29:37.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.436+0000 7f1effe00640 1 -- 172.21.15.87:0/1257209870 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ef40ad640 con 0x7f1f000cea40 2024-05-27T06:29:37.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.436+0000 7f1effe00640 1 -- 172.21.15.87:0/1257209870 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef40ada10 con 0x7f1f000cea40 2024-05-27T06:29:37.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.436+0000 7f1f08400640 1 -- 172.21.15.87:0/1257209870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f000cea40 msgr2=0x7f1f00158360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:37.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.436+0000 7f1f08400640 1 --2- 172.21.15.87:0/1257209870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f000cea40 0x7f1f00158360 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1ef40097c0 tx=0x7f1ef401c4a0 comp rx=0 tx=0).stop 2024-05-27T06:29:37.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.436+0000 7f1f08400640 1 -- 172.21.15.87:0/1257209870 shutdown_connections 2024-05-27T06:29:37.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.436+0000 7f1f08400640 1 --2- 172.21.15.87:0/1257209870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f000cea40 0x7f1f00158360 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:37.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.436+0000 7f1f08400640 1 -- 172.21.15.87:0/1257209870 >> 172.21.15.87:0/1257209870 conn(0x7f1f000d3590 msgr2=0x7f1f000d39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:37.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.436+0000 7f1f08400640 1 -- 172.21.15.87:0/1257209870 shutdown_connections 2024-05-27T06:29:37.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.436+0000 7f1f08400640 1 -- 172.21.15.87:0/1257209870 wait complete. 2024-05-27T06:29:37.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.440+0000 7f1f08400640 1 Processor -- start 2024-05-27T06:29:37.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.440+0000 7f1f08400640 1 -- start start 2024-05-27T06:29:37.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.440+0000 7f1f08400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f000b2fb0 0x7f1f000cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:37.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.440+0000 7f1f08400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f000cea40 0x7f1f00162060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:37.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.440+0000 7f1f08400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f000d2010 0x7f1f000b8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:37.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.440+0000 7f1f08400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1f000d2ee0 con 0x7f1f000cea40 2024-05-27T06:29:37.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.440+0000 7f1f08400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1f000d2d60 con 0x7f1f000b2fb0 2024-05-27T06:29:37.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.440+0000 7f1f08400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1f000cee50 con 0x7f1f000d2010 2024-05-27T06:29:37.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.440+0000 7f1f05000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f000cea40 0x7f1f00162060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:37.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.440+0000 7f1f05000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f000cea40 0x7f1f00162060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57152/0 (socket says 172.21.15.87:57152) 2024-05-27T06:29:37.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.440+0000 7f1f05000640 1 -- 172.21.15.87:0/713120515 learned_addr learned my addr 172.21.15.87:0/713120515 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:37.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.440+0000 7f1f05a00640 1 --2- 172.21.15.87:0/713120515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f000b2fb0 0x7f1f000cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:37.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.440+0000 7f1f06400640 1 --2- 172.21.15.87:0/713120515 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f000d2010 0x7f1f000b8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:37.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.440+0000 7f1f05000640 1 -- 172.21.15.87:0/713120515 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f000d2010 msgr2=0x7f1f000b8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:37.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.440+0000 7f1f05000640 1 --2- 172.21.15.87:0/713120515 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f000d2010 0x7f1f000b8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:37.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.440+0000 7f1f05000640 1 -- 172.21.15.87:0/713120515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f000b2fb0 msgr2=0x7f1f000cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:37.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.440+0000 7f1f05000640 1 --2- 172.21.15.87:0/713120515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f000b2fb0 0x7f1f000cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:37.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.440+0000 7f1f05000640 1 -- 172.21.15.87:0/713120515 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f001fd990 con 0x7f1f000cea40 2024-05-27T06:29:37.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.440+0000 7f1f05000640 1 --2- 172.21.15.87:0/713120515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f000cea40 0x7f1f00162060 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00c430 tx=0x7f1eec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:37.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.440+0000 7f1efd600640 1 -- 172.21.15.87:0/713120515 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eec017070 con 0x7f1f000cea40 2024-05-27T06:29:37.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.440+0000 7f1efd600640 1 -- 172.21.15.87:0/713120515 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eec005cf0 con 0x7f1f000cea40 2024-05-27T06:29:37.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.440+0000 7f1f08400640 1 -- 172.21.15.87:0/713120515 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f001fdc70 con 0x7f1f000cea40 2024-05-27T06:29:37.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.440+0000 7f1efd600640 1 -- 172.21.15.87:0/713120515 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eec0072d0 con 0x7f1f000cea40 2024-05-27T06:29:37.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.444+0000 7f1f08400640 1 -- 172.21.15.87:0/713120515 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f001f9f30 con 0x7f1f000cea40 2024-05-27T06:29:37.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.444+0000 7f1f08400640 1 -- 172.21.15.87:0/713120515 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f0006aa30 con 0x7f1f000cea40 2024-05-27T06:29:37.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.444+0000 7f1efd600640 1 -- 172.21.15.87:0/713120515 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1eec01a070 con 0x7f1f000cea40 2024-05-27T06:29:37.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.444+0000 7f1efd600640 1 --2- 172.21.15.87:0/713120515 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f1ee006f400 0x7f1ee0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:37.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.444+0000 7f1efd600640 1 -- 172.21.15.87:0/713120515 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f1eec08e750 con 0x7f1f000cea40 2024-05-27T06:29:37.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.444+0000 7f1f05a00640 1 --2- 172.21.15.87:0/713120515 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f1ee006f400 0x7f1ee0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:37.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.444+0000 7f1f05a00640 1 --2- 172.21.15.87:0/713120515 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f1ee006f400 0x7f1ee0071910 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1ef40af000 tx=0x7f1ef4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:37.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.448+0000 7f1efd600640 1 -- 172.21.15.87:0/713120515 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f1eec05ae50 con 0x7f1f000cea40 2024-05-27T06:29:37.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.660+0000 7f1f08400640 1 -- 172.21.15.87:0/713120515 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f1f001fd720 con 0x7f1f000cea40 2024-05-27T06:29:37.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.660+0000 7f1efd600640 1 -- 172.21.15.87:0/713120515 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1195 (secure 0 0 0) 0x7f1eec05f150 con 0x7f1f000cea40 2024-05-27T06:29:37.661 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:29:37.661 INFO:teuthology.orchestra.run.smithi087.stdout:{"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":144,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":54,"num_osds":8,"num_up_osds":8,"osd_up_since":1716791245,"num_in_osds":8,"osd_in_since":1716791236,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":231727104,"bytes_avail":772862386176,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":27,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5382}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-05-27T06:28:34.580166+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-05-27T06:29:37.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.664+0000 7f1f08400640 1 -- 172.21.15.87:0/713120515 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f1ee006f400 msgr2=0x7f1ee0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:37.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.664+0000 7f1f08400640 1 --2- 172.21.15.87:0/713120515 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f1ee006f400 0x7f1ee0071910 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1ef40af000 tx=0x7f1ef4008040 comp rx=0 tx=0).stop 2024-05-27T06:29:37.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.664+0000 7f1f08400640 1 -- 172.21.15.87:0/713120515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f000cea40 msgr2=0x7f1f00162060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:37.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.664+0000 7f1f08400640 1 --2- 172.21.15.87:0/713120515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f000cea40 0x7f1f00162060 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00c430 tx=0x7f1eec00c8f0 comp rx=0 tx=0).stop 2024-05-27T06:29:37.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.664+0000 7f1f08400640 1 -- 172.21.15.87:0/713120515 shutdown_connections 2024-05-27T06:29:37.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.664+0000 7f1f08400640 1 --2- 172.21.15.87:0/713120515 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f1ee006f400 0x7f1ee0071910 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:37.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.664+0000 7f1f08400640 1 --2- 172.21.15.87:0/713120515 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f000d2010 0x7f1f000b8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:37.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.664+0000 7f1f08400640 1 --2- 172.21.15.87:0/713120515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f000cea40 0x7f1f00162060 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:37.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.664+0000 7f1f08400640 1 --2- 172.21.15.87:0/713120515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f000b2fb0 0x7f1f000cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:37.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.664+0000 7f1f08400640 1 -- 172.21.15.87:0/713120515 >> 172.21.15.87:0/713120515 conn(0x7f1f000d3590 msgr2=0x7f1f000b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:37.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.664+0000 7f1f08400640 1 -- 172.21.15.87:0/713120515 shutdown_connections 2024-05-27T06:29:37.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.664+0000 7f1f08400640 1 -- 172.21.15.87:0/713120515 wait complete. 2024-05-27T06:29:37.683 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-27T06:29:37.683 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T06:29:37.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.832+0000 7fadf3200640 1 Processor -- start 2024-05-27T06:29:37.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.832+0000 7fadf3200640 1 -- start start 2024-05-27T06:29:37.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.832+0000 7fadf3200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fadf415ebc0 0x7fadf40cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:37.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.832+0000 7fadf3200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fadf40d2d50 0x7fadf40b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:37.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.832+0000 7fadf3200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadf415e450 con 0x7fadf40d02c0 2024-05-27T06:29:37.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.832+0000 7fadf3200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fadf40d1230 con 0x7fadf415ebc0 2024-05-27T06:29:37.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.832+0000 7fadf3200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fadf40b7170 con 0x7fadf40d2d50 2024-05-27T06:29:37.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.832+0000 7fadf1e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fadf415ebc0 0x7fadf40cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:37.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.832+0000 7fadf1e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fadf415ebc0 0x7fadf40cfd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57160/0 (socket says 172.21.15.87:57160) 2024-05-27T06:29:37.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.832+0000 7fadf1e00640 1 -- 172.21.15.87:0/1359158823 learned_addr learned my addr 172.21.15.87:0/1359158823 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:37.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.832+0000 7fadf2800640 1 --2- 172.21.15.87:0/1359158823 >> v2:172.21.15.149:3300/0 conn(0x7fadf40d2d50 0x7fadf40b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:37.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.832+0000 7fadf1e00640 1 -- 172.21.15.87:0/1359158823 >> v2:172.21.15.149:3300/0 conn(0x7fadf40d2d50 msgr2=0x7fadf40b78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:37.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.832+0000 7fadf1e00640 1 --2- 172.21.15.87:0/1359158823 >> v2:172.21.15.149:3300/0 conn(0x7fadf40d2d50 0x7fadf40b78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:37.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.832+0000 7fadf1e00640 1 -- 172.21.15.87:0/1359158823 >> v1:172.21.15.149:6789/0 conn(0x7fadf40d02c0 legacy=0x7fadf40d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:37.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.832+0000 7fadf1e00640 1 -- 172.21.15.87:0/1359158823 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf40d06d0 con 0x7fadf415ebc0 2024-05-27T06:29:37.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.836+0000 7fadf1e00640 1 --2- 172.21.15.87:0/1359158823 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadf415ebc0 0x7fadf40cfd80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fadf4074aa0 tx=0x7fade401c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6155a6bd771695b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:37.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.836+0000 7fadf0a00640 1 -- 172.21.15.87:0/1359158823 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade40b0070 con 0x7fadf415ebc0 2024-05-27T06:29:37.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.836+0000 7fadf0a00640 1 -- 172.21.15.87:0/1359158823 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade40ab400 con 0x7fadf415ebc0 2024-05-27T06:29:37.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.836+0000 7fadf0a00640 1 -- 172.21.15.87:0/1359158823 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade40ab7d0 con 0x7fadf415ebc0 2024-05-27T06:29:37.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.836+0000 7fadf3200640 1 -- 172.21.15.87:0/1359158823 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadf415ebc0 msgr2=0x7fadf40cfd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:37.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.836+0000 7fadf3200640 1 --2- 172.21.15.87:0/1359158823 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadf415ebc0 0x7fadf40cfd80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fadf4074aa0 tx=0x7fade401c340 comp rx=0 tx=0).stop 2024-05-27T06:29:37.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.836+0000 7fadf3200640 1 -- 172.21.15.87:0/1359158823 shutdown_connections 2024-05-27T06:29:37.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.836+0000 7fadf3200640 1 --2- 172.21.15.87:0/1359158823 >> v2:172.21.15.149:3300/0 conn(0x7fadf40d2d50 0x7fadf40b78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:37.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.836+0000 7fadf3200640 1 --2- 172.21.15.87:0/1359158823 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadf415ebc0 0x7fadf40cfd80 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:37.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.836+0000 7fadf3200640 1 -- 172.21.15.87:0/1359158823 >> 172.21.15.87:0/1359158823 conn(0x7fadf40d34b0 msgr2=0x7fadf40d38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:37.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.836+0000 7fadf3200640 1 -- 172.21.15.87:0/1359158823 shutdown_connections 2024-05-27T06:29:37.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.836+0000 7fadf3200640 1 -- 172.21.15.87:0/1359158823 wait complete. 2024-05-27T06:29:37.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.840+0000 7fadf3200640 1 Processor -- start 2024-05-27T06:29:37.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.840+0000 7fadf3200640 1 -- start start 2024-05-27T06:29:37.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.840+0000 7fadf3200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadf40d02c0 0x7fadf415b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:37.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.840+0000 7fadf3200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadf40d2d50 0x7fadf415ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:37.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.840+0000 7fadf3200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fadf415ebc0 0x7fadf415d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:37.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.840+0000 7fadf3200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fadf416aa40 con 0x7fadf40d2d50 2024-05-27T06:29:37.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.840+0000 7fadf3200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fadf415efd0 con 0x7fadf40d02c0 2024-05-27T06:29:37.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.840+0000 7fadf3200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fadf416abc0 con 0x7fadf415ebc0 2024-05-27T06:29:37.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.840+0000 7fadf1400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadf40d2d50 0x7fadf415ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:37.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.840+0000 7fadf1400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadf40d2d50 0x7fadf415ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57170/0 (socket says 172.21.15.87:57170) 2024-05-27T06:29:37.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.840+0000 7fadf1400640 1 -- 172.21.15.87:0/1693640109 learned_addr learned my addr 172.21.15.87:0/1693640109 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:37.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.840+0000 7fadf1e00640 1 --2- 172.21.15.87:0/1693640109 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadf40d02c0 0x7fadf415b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:37.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.840+0000 7fadf2800640 1 --2- 172.21.15.87:0/1693640109 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fadf415ebc0 0x7fadf415d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:37.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.840+0000 7fadf1400640 1 -- 172.21.15.87:0/1693640109 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fadf415ebc0 msgr2=0x7fadf415d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:37.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.840+0000 7fadf1400640 1 --2- 172.21.15.87:0/1693640109 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fadf415ebc0 0x7fadf415d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:37.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.840+0000 7fadf1400640 1 -- 172.21.15.87:0/1693640109 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadf40d02c0 msgr2=0x7fadf415b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:37.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.840+0000 7fadf1400640 1 --2- 172.21.15.87:0/1693640109 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadf40d02c0 0x7fadf415b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:37.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.840+0000 7fadf1400640 1 -- 172.21.15.87:0/1693640109 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf40d3ad0 con 0x7fadf40d2d50 2024-05-27T06:29:37.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.840+0000 7fadf1400640 1 --2- 172.21.15.87:0/1693640109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadf40d2d50 0x7fadf415ce00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fade000b440 tx=0x7fade000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:37.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.840+0000 7fadea000640 1 -- 172.21.15.87:0/1693640109 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade0015020 con 0x7fadf40d2d50 2024-05-27T06:29:37.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.840+0000 7fadea000640 1 -- 172.21.15.87:0/1693640109 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade0011890 con 0x7fadf40d2d50 2024-05-27T06:29:37.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.840+0000 7fadea000640 1 -- 172.21.15.87:0/1693640109 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade0011c80 con 0x7fadf40d2d50 2024-05-27T06:29:37.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.840+0000 7fadf3200640 1 -- 172.21.15.87:0/1693640109 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf4150220 con 0x7fadf40d2d50 2024-05-27T06:29:37.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.844+0000 7fadf3200640 1 -- 172.21.15.87:0/1693640109 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf41558e0 con 0x7fadf40d2d50 2024-05-27T06:29:37.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.844+0000 7fadf3200640 1 -- 172.21.15.87:0/1693640109 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadf4155430 con 0x7fadf40d2d50 2024-05-27T06:29:37.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.844+0000 7fadea000640 1 -- 172.21.15.87:0/1693640109 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fade0018020 con 0x7fadf40d2d50 2024-05-27T06:29:37.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.844+0000 7fadea000640 1 --2- 172.21.15.87:0/1693640109 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fadd406f400 0x7fadd4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:37.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.844+0000 7fadea000640 1 -- 172.21.15.87:0/1693640109 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fade008f140 con 0x7fadf40d2d50 2024-05-27T06:29:37.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.844+0000 7fadf1e00640 1 --2- 172.21.15.87:0/1693640109 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fadd406f400 0x7fadd4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:37.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.848+0000 7fadf1e00640 1 --2- 172.21.15.87:0/1693640109 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fadd406f400 0x7fadd4071910 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fade40ad000 tx=0x7fade4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:37.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:37.848+0000 7fadea000640 1 -- 172.21.15.87:0/1693640109 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fade001f030 con 0x7fadf40d2d50 2024-05-27T06:29:38.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:38.004+0000 7fadf3200640 1 -- 172.21.15.87:0/1693640109 --> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fadf406aa30 con 0x7fadd406f400 2024-05-27T06:29:38.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:38.008+0000 7fadea000640 1 -- 172.21.15.87:0/1693640109 <== mgr.4111 v2:172.21.15.87:6832/2724754260 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246624 (secure 0 0 0) 0x7fadf406aa30 con 0x7fadd406f400 2024-05-27T06:29:38.010 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:29:38.011 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-27T06:29:38.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:38.012+0000 7fadf3200640 1 -- 172.21.15.87:0/1693640109 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fadd406f400 msgr2=0x7fadd4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:38.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:38.012+0000 7fadf3200640 1 --2- 172.21.15.87:0/1693640109 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fadd406f400 0x7fadd4071910 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fade40ad000 tx=0x7fade4008040 comp rx=0 tx=0).stop 2024-05-27T06:29:38.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:38.012+0000 7fadf3200640 1 -- 172.21.15.87:0/1693640109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadf40d2d50 msgr2=0x7fadf415ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:38.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:38.012+0000 7fadf3200640 1 --2- 172.21.15.87:0/1693640109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadf40d2d50 0x7fadf415ce00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fade000b440 tx=0x7fade000b900 comp rx=0 tx=0).stop 2024-05-27T06:29:38.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:38.012+0000 7fadf3200640 1 -- 172.21.15.87:0/1693640109 shutdown_connections 2024-05-27T06:29:38.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:38.012+0000 7fadf3200640 1 --2- 172.21.15.87:0/1693640109 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fadd406f400 0x7fadd4071910 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:38.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:38.012+0000 7fadf3200640 1 --2- 172.21.15.87:0/1693640109 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fadf415ebc0 0x7fadf415d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:38.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:38.012+0000 7fadf3200640 1 --2- 172.21.15.87:0/1693640109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadf40d2d50 0x7fadf415ce00 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:38.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:38.012+0000 7fadf3200640 1 --2- 172.21.15.87:0/1693640109 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadf40d02c0 0x7fadf415b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:38.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:38.012+0000 7fadf3200640 1 -- 172.21.15.87:0/1693640109 >> 172.21.15.87:0/1693640109 conn(0x7fadf40d34b0 msgr2=0x7fadf40717e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:38.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:38.012+0000 7fadf3200640 1 -- 172.21.15.87:0/1693640109 shutdown_connections 2024-05-27T06:29:38.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:38.012+0000 7fadf3200640 1 -- 172.21.15.87:0/1693640109 wait complete. 2024-05-27T06:29:38.031 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2024-05-27T06:29:36.592865+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226296,"kb_used_data":5964,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748424,"statfs":{"total":773094113280,"available":772862386176,"internally_reserved":0,"allocated":6107136,"data_stored":3380513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000957"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.325351+0000","last_change":"2024-05-27T06:29:31.325351+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.325351+0000","last_undegraded":"2024-05-27T06:29:31.325351+0000","last_fullsized":"2024-05-27T06:29:31.325351+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.331688+0000","last_change":"2024-05-27T06:29:31.331688+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.331688+0000","last_undegraded":"2024-05-27T06:29:31.331688+0000","last_fullsized":"2024-05-27T06:29:31.331688+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.321588+0000","last_change":"2024-05-27T06:29:31.321588+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.321588+0000","last_undegraded":"2024-05-27T06:29:31.321588+0000","last_fullsized":"2024-05-27T06:29:31.321588+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316361+0000","last_change":"2024-05-27T06:29:31.316361+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316361+0000","last_undegraded":"2024-05-27T06:29:31.316361+0000","last_fullsized":"2024-05-27T06:29:31.316361+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.322694+0000","last_change":"2024-05-27T06:29:31.322694+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.322694+0000","last_undegraded":"2024-05-27T06:29:31.322694+0000","last_fullsized":"2024-05-27T06:29:31.322694+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316328+0000","last_change":"2024-05-27T06:29:31.316328+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316328+0000","last_undegraded":"2024-05-27T06:29:31.316328+0000","last_fullsized":"2024-05-27T06:29:31.316328+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.328222+0000","last_change":"2024-05-27T06:29:31.328222+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.328222+0000","last_undegraded":"2024-05-27T06:29:31.328222+0000","last_fullsized":"2024-05-27T06:29:31.328222+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.329940+0000","last_change":"2024-05-27T06:29:31.329940+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.329940+0000","last_undegraded":"2024-05-27T06:29:31.329940+0000","last_fullsized":"2024-05-27T06:29:31.329940+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.324127+0000","last_change":"2024-05-27T06:29:31.324127+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.324127+0000","last_undegraded":"2024-05-27T06:29:31.324127+0000","last_fullsized":"2024-05-27T06:29:31.324127+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.314719+0000","last_change":"2024-05-27T06:29:31.314719+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.314719+0000","last_undegraded":"2024-05-27T06:29:31.314719+0000","last_fullsized":"2024-05-27T06:29:31.314719+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.314718+0000","last_change":"2024-05-27T06:29:31.314718+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.314718+0000","last_undegraded":"2024-05-27T06:29:31.314718+0000","last_fullsized":"2024-05-27T06:29:31.314718+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.315776+0000","last_change":"2024-05-27T06:29:31.315776+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.315776+0000","last_undegraded":"2024-05-27T06:29:31.315776+0000","last_fullsized":"2024-05-27T06:29:31.315776+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.326291+0000","last_change":"2024-05-27T06:29:31.326291+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.326291+0000","last_undegraded":"2024-05-27T06:29:31.326291+0000","last_fullsized":"2024-05-27T06:29:31.326291+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.324937+0000","last_change":"2024-05-27T06:29:31.324937+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.324937+0000","last_undegraded":"2024-05-27T06:29:31.324937+0000","last_fullsized":"2024-05-27T06:29:31.324937+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.323137+0000","last_change":"2024-05-27T06:29:31.323137+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.323137+0000","last_undegraded":"2024-05-27T06:29:31.323137+0000","last_fullsized":"2024-05-27T06:29:31.323137+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.315935+0000","last_change":"2024-05-27T06:29:31.315935+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.315935+0000","last_undegraded":"2024-05-27T06:29:31.315935+0000","last_fullsized":"2024-05-27T06:29:31.315935+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.331611+0000","last_change":"2024-05-27T06:29:31.331611+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.331611+0000","last_undegraded":"2024-05-27T06:29:31.331611+0000","last_fullsized":"2024-05-27T06:29:31.331611+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.323762+0000","last_change":"2024-05-27T06:29:31.323762+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.323762+0000","last_undegraded":"2024-05-27T06:29:31.323762+0000","last_fullsized":"2024-05-27T06:29:31.323762+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.324275+0000","last_change":"2024-05-27T06:29:31.324275+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.324275+0000","last_undegraded":"2024-05-27T06:29:31.324275+0000","last_fullsized":"2024-05-27T06:29:31.324275+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.330730+0000","last_change":"2024-05-27T06:29:31.330730+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.330730+0000","last_undegraded":"2024-05-27T06:29:31.330730+0000","last_fullsized":"2024-05-27T06:29:31.330730+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.321230+0000","last_change":"2024-05-27T06:29:31.321230+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.321230+0000","last_undegraded":"2024-05-27T06:29:31.321230+0000","last_fullsized":"2024-05-27T06:29:31.321230+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.331015+0000","last_change":"2024-05-27T06:29:31.331015+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.331015+0000","last_undegraded":"2024-05-27T06:29:31.331015+0000","last_fullsized":"2024-05-27T06:29:31.331015+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.319934+0000","last_change":"2024-05-27T06:29:31.319934+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.319934+0000","last_undegraded":"2024-05-27T06:29:31.319934+0000","last_fullsized":"2024-05-27T06:29:31.319934+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.325828+0000","last_change":"2024-05-27T06:29:31.325828+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.325828+0000","last_undegraded":"2024-05-27T06:29:31.325828+0000","last_fullsized":"2024-05-27T06:29:31.325828+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.323843+0000","last_change":"2024-05-27T06:29:31.323843+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.323843+0000","last_undegraded":"2024-05-27T06:29:31.323843+0000","last_fullsized":"2024-05-27T06:29:31.323843+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316929+0000","last_change":"2024-05-27T06:29:31.316929+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316929+0000","last_undegraded":"2024-05-27T06:29:31.316929+0000","last_fullsized":"2024-05-27T06:29:31.316929+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.319583+0000","last_change":"2024-05-27T06:29:31.319583+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.319583+0000","last_undegraded":"2024-05-27T06:29:31.319583+0000","last_fullsized":"2024-05-27T06:29:31.319583+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.322732+0000","last_change":"2024-05-27T06:29:31.322732+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.322732+0000","last_undegraded":"2024-05-27T06:29:31.322732+0000","last_fullsized":"2024-05-27T06:29:31.322732+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.326867+0000","last_change":"2024-05-27T06:29:31.326867+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.326867+0000","last_undegraded":"2024-05-27T06:29:31.326867+0000","last_fullsized":"2024-05-27T06:29:31.326867+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.318606+0000","last_change":"2024-05-27T06:29:31.318606+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.318606+0000","last_undegraded":"2024-05-27T06:29:31.318606+0000","last_fullsized":"2024-05-27T06:29:31.318606+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.322669+0000","last_change":"2024-05-27T06:29:31.322669+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.322669+0000","last_undegraded":"2024-05-27T06:29:31.322669+0000","last_fullsized":"2024-05-27T06:29:31.322669+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.315121+0000","last_change":"2024-05-27T06:29:31.315121+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.315121+0000","last_undegraded":"2024-05-27T06:29:31.315121+0000","last_fullsized":"2024-05-27T06:29:31.315121+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.318800+0000","last_change":"2024-05-27T06:29:31.318800+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.318800+0000","last_undegraded":"2024-05-27T06:29:31.318800+0000","last_fullsized":"2024-05-27T06:29:31.318800+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.342721+0000","last_change":"2024-05-27T06:29:31.337912+0000","last_active":"2024-05-27T06:29:31.342721+0000","last_peered":"2024-05-27T06:29:31.342721+0000","last_clean":"2024-05-27T06:29:31.342721+0000","last_became_active":"2024-05-27T06:29:31.337076+0000","last_became_peered":"2024-05-27T06:29:31.337076+0000","last_unstale":"2024-05-27T06:29:31.342721+0000","last_undegraded":"2024-05-27T06:29:31.342721+0000","last_fullsized":"2024-05-27T06:29:31.342721+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:49:26.326325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.314740+0000","last_change":"2024-05-27T06:29:31.314740+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.314740+0000","last_undegraded":"2024-05-27T06:29:31.314740+0000","last_fullsized":"2024-05-27T06:29:31.314740+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.345646+0000","last_change":"2024-05-27T06:29:31.340901+0000","last_active":"2024-05-27T06:29:31.345646+0000","last_peered":"2024-05-27T06:29:31.345646+0000","last_clean":"2024-05-27T06:29:31.345646+0000","last_became_active":"2024-05-27T06:29:31.340584+0000","last_became_peered":"2024-05-27T06:29:31.340584+0000","last_unstale":"2024-05-27T06:29:31.345646+0000","last_undegraded":"2024-05-27T06:29:31.345646+0000","last_fullsized":"2024-05-27T06:29:31.345646+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:16:07.331463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.317761+0000","last_change":"2024-05-27T06:29:31.317761+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.317761+0000","last_undegraded":"2024-05-27T06:29:31.317761+0000","last_fullsized":"2024-05-27T06:29:31.317761+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.325224+0000","last_change":"2024-05-27T06:29:31.321412+0000","last_active":"2024-05-27T06:29:31.325224+0000","last_peered":"2024-05-27T06:29:31.325224+0000","last_clean":"2024-05-27T06:29:31.325224+0000","last_became_active":"2024-05-27T06:29:31.321110+0000","last_became_peered":"2024-05-27T06:29:31.321110+0000","last_unstale":"2024-05-27T06:29:31.325224+0000","last_undegraded":"2024-05-27T06:29:31.325224+0000","last_fullsized":"2024-05-27T06:29:31.325224+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:18:17.279684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.319138+0000","last_change":"2024-05-27T06:29:31.319138+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.319138+0000","last_undegraded":"2024-05-27T06:29:31.319138+0000","last_fullsized":"2024-05-27T06:29:31.319138+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.336819+0000","last_change":"2024-05-27T06:29:31.324922+0000","last_active":"2024-05-27T06:29:31.336819+0000","last_peered":"2024-05-27T06:29:31.336819+0000","last_clean":"2024-05-27T06:29:31.336819+0000","last_became_active":"2024-05-27T06:29:31.324534+0000","last_became_peered":"2024-05-27T06:29:31.324534+0000","last_unstale":"2024-05-27T06:29:31.336819+0000","last_undegraded":"2024-05-27T06:29:31.336819+0000","last_fullsized":"2024-05-27T06:29:31.336819+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:07:45.468162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.328009+0000","last_change":"2024-05-27T06:29:31.328009+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.328009+0000","last_undegraded":"2024-05-27T06:29:31.328009+0000","last_fullsized":"2024-05-27T06:29:31.328009+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.335743+0000","last_change":"2024-05-27T06:29:31.328972+0000","last_active":"2024-05-27T06:29:31.335743+0000","last_peered":"2024-05-27T06:29:31.335743+0000","last_clean":"2024-05-27T06:29:31.335743+0000","last_became_active":"2024-05-27T06:29:31.328662+0000","last_became_peered":"2024-05-27T06:29:31.328662+0000","last_unstale":"2024-05-27T06:29:31.335743+0000","last_undegraded":"2024-05-27T06:29:31.335743+0000","last_fullsized":"2024-05-27T06:29:31.335743+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:21:50.798081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.326491+0000","last_change":"2024-05-27T06:29:31.326491+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.326491+0000","last_undegraded":"2024-05-27T06:29:31.326491+0000","last_fullsized":"2024-05-27T06:29:31.326491+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.340527+0000","last_change":"2024-05-27T06:29:31.333973+0000","last_active":"2024-05-27T06:29:31.340527+0000","last_peered":"2024-05-27T06:29:31.340527+0000","last_clean":"2024-05-27T06:29:31.340527+0000","last_became_active":"2024-05-27T06:29:31.333665+0000","last_became_peered":"2024-05-27T06:29:31.333665+0000","last_unstale":"2024-05-27T06:29:31.340527+0000","last_undegraded":"2024-05-27T06:29:31.340527+0000","last_fullsized":"2024-05-27T06:29:31.340527+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:55:11.170951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.325035+0000","last_change":"2024-05-27T06:29:31.325035+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.325035+0000","last_undegraded":"2024-05-27T06:29:31.325035+0000","last_fullsized":"2024-05-27T06:29:31.325035+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.337686+0000","last_change":"2024-05-27T06:29:31.332145+0000","last_active":"2024-05-27T06:29:31.337686+0000","last_peered":"2024-05-27T06:29:31.337686+0000","last_clean":"2024-05-27T06:29:31.337686+0000","last_became_active":"2024-05-27T06:29:31.331328+0000","last_became_peered":"2024-05-27T06:29:31.331328+0000","last_unstale":"2024-05-27T06:29:31.337686+0000","last_undegraded":"2024-05-27T06:29:31.337686+0000","last_fullsized":"2024-05-27T06:29:31.337686+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:50:20.583108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.321350+0000","last_change":"2024-05-27T06:29:31.321350+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.321350+0000","last_undegraded":"2024-05-27T06:29:31.321350+0000","last_fullsized":"2024-05-27T06:29:31.321350+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.341435+0000","last_change":"2024-05-27T06:29:31.339195+0000","last_active":"2024-05-27T06:29:31.341435+0000","last_peered":"2024-05-27T06:29:31.341435+0000","last_clean":"2024-05-27T06:29:31.341435+0000","last_became_active":"2024-05-27T06:29:31.338863+0000","last_became_peered":"2024-05-27T06:29:31.338863+0000","last_unstale":"2024-05-27T06:29:31.341435+0000","last_undegraded":"2024-05-27T06:29:31.341435+0000","last_fullsized":"2024-05-27T06:29:31.341435+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:05:26.579241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.322484+0000","last_change":"2024-05-27T06:29:31.322484+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.322484+0000","last_undegraded":"2024-05-27T06:29:31.322484+0000","last_fullsized":"2024-05-27T06:29:31.322484+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.342900+0000","last_change":"2024-05-27T06:29:31.340841+0000","last_active":"2024-05-27T06:29:31.342900+0000","last_peered":"2024-05-27T06:29:31.342900+0000","last_clean":"2024-05-27T06:29:31.342900+0000","last_became_active":"2024-05-27T06:29:31.340483+0000","last_became_peered":"2024-05-27T06:29:31.340483+0000","last_unstale":"2024-05-27T06:29:31.342900+0000","last_undegraded":"2024-05-27T06:29:31.342900+0000","last_fullsized":"2024-05-27T06:29:31.342900+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:07:45.468162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.319216+0000","last_change":"2024-05-27T06:29:31.319216+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.319216+0000","last_undegraded":"2024-05-27T06:29:31.319216+0000","last_fullsized":"2024-05-27T06:29:31.319216+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.343028+0000","last_change":"2024-05-27T06:29:31.336123+0000","last_active":"2024-05-27T06:29:31.343028+0000","last_peered":"2024-05-27T06:29:31.343028+0000","last_clean":"2024-05-27T06:29:31.343028+0000","last_became_active":"2024-05-27T06:29:31.335682+0000","last_became_peered":"2024-05-27T06:29:31.335682+0000","last_unstale":"2024-05-27T06:29:31.343028+0000","last_undegraded":"2024-05-27T06:29:31.343028+0000","last_fullsized":"2024-05-27T06:29:31.343028+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:49:26.326325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.315321+0000","last_change":"2024-05-27T06:29:31.315321+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.315321+0000","last_undegraded":"2024-05-27T06:29:31.315321+0000","last_fullsized":"2024-05-27T06:29:31.315321+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.342881+0000","last_change":"2024-05-27T06:29:31.340823+0000","last_active":"2024-05-27T06:29:31.342881+0000","last_peered":"2024-05-27T06:29:31.342881+0000","last_clean":"2024-05-27T06:29:31.342881+0000","last_became_active":"2024-05-27T06:29:31.340446+0000","last_became_peered":"2024-05-27T06:29:31.340446+0000","last_unstale":"2024-05-27T06:29:31.342881+0000","last_undegraded":"2024-05-27T06:29:31.342881+0000","last_fullsized":"2024-05-27T06:29:31.342881+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:18:17.279684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.321073+0000","last_change":"2024-05-27T06:29:31.321073+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.321073+0000","last_undegraded":"2024-05-27T06:29:31.321073+0000","last_fullsized":"2024-05-27T06:29:31.321073+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.336747+0000","last_change":"2024-05-27T06:29:31.331195+0000","last_active":"2024-05-27T06:29:31.336747+0000","last_peered":"2024-05-27T06:29:31.336747+0000","last_clean":"2024-05-27T06:29:31.336747+0000","last_became_active":"2024-05-27T06:29:31.330881+0000","last_became_peered":"2024-05-27T06:29:31.330881+0000","last_unstale":"2024-05-27T06:29:31.336747+0000","last_undegraded":"2024-05-27T06:29:31.336747+0000","last_fullsized":"2024-05-27T06:29:31.336747+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:24:48.091681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.318280+0000","last_change":"2024-05-27T06:29:31.318280+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.318280+0000","last_undegraded":"2024-05-27T06:29:31.318280+0000","last_fullsized":"2024-05-27T06:29:31.318280+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.343187+0000","last_change":"2024-05-27T06:29:31.336599+0000","last_active":"2024-05-27T06:29:31.343187+0000","last_peered":"2024-05-27T06:29:31.343187+0000","last_clean":"2024-05-27T06:29:31.343187+0000","last_became_active":"2024-05-27T06:29:31.336273+0000","last_became_peered":"2024-05-27T06:29:31.336273+0000","last_unstale":"2024-05-27T06:29:31.343187+0000","last_undegraded":"2024-05-27T06:29:31.343187+0000","last_fullsized":"2024-05-27T06:29:31.343187+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:10:34.186274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.320720+0000","last_change":"2024-05-27T06:29:31.320720+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.320720+0000","last_undegraded":"2024-05-27T06:29:31.320720+0000","last_fullsized":"2024-05-27T06:29:31.320720+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.341063+0000","last_change":"2024-05-27T06:29:31.335657+0000","last_active":"2024-05-27T06:29:31.341063+0000","last_peered":"2024-05-27T06:29:31.341063+0000","last_clean":"2024-05-27T06:29:31.341063+0000","last_became_active":"2024-05-27T06:29:31.335285+0000","last_became_peered":"2024-05-27T06:29:31.335285+0000","last_unstale":"2024-05-27T06:29:31.341063+0000","last_undegraded":"2024-05-27T06:29:31.341063+0000","last_fullsized":"2024-05-27T06:29:31.341063+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:48:45.545585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.322872+0000","last_change":"2024-05-27T06:29:31.322872+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.322872+0000","last_undegraded":"2024-05-27T06:29:31.322872+0000","last_fullsized":"2024-05-27T06:29:31.322872+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.331881+0000","last_change":"2024-05-27T06:29:31.323676+0000","last_active":"2024-05-27T06:29:31.331881+0000","last_peered":"2024-05-27T06:29:31.331881+0000","last_clean":"2024-05-27T06:29:31.331881+0000","last_became_active":"2024-05-27T06:29:31.323378+0000","last_became_peered":"2024-05-27T06:29:31.323378+0000","last_unstale":"2024-05-27T06:29:31.331881+0000","last_undegraded":"2024-05-27T06:29:31.331881+0000","last_fullsized":"2024-05-27T06:29:31.331881+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:18:17.279684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.318732+0000","last_change":"2024-05-27T06:29:31.318732+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.318732+0000","last_undegraded":"2024-05-27T06:29:31.318732+0000","last_fullsized":"2024-05-27T06:29:31.318732+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.342845+0000","last_change":"2024-05-27T06:29:31.340500+0000","last_active":"2024-05-27T06:29:31.342845+0000","last_peered":"2024-05-27T06:29:31.342845+0000","last_clean":"2024-05-27T06:29:31.342845+0000","last_became_active":"2024-05-27T06:29:31.340151+0000","last_became_peered":"2024-05-27T06:29:31.340151+0000","last_unstale":"2024-05-27T06:29:31.342845+0000","last_undegraded":"2024-05-27T06:29:31.342845+0000","last_fullsized":"2024-05-27T06:29:31.342845+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:25:39.940766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.320036+0000","last_change":"2024-05-27T06:29:31.320036+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.320036+0000","last_undegraded":"2024-05-27T06:29:31.320036+0000","last_fullsized":"2024-05-27T06:29:31.320036+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.343239+0000","last_change":"2024-05-27T06:29:31.336677+0000","last_active":"2024-05-27T06:29:31.343239+0000","last_peered":"2024-05-27T06:29:31.343239+0000","last_clean":"2024-05-27T06:29:31.343239+0000","last_became_active":"2024-05-27T06:29:31.336379+0000","last_became_peered":"2024-05-27T06:29:31.336379+0000","last_unstale":"2024-05-27T06:29:31.343239+0000","last_undegraded":"2024-05-27T06:29:31.343239+0000","last_fullsized":"2024-05-27T06:29:31.343239+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:24:21.069227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316739+0000","last_change":"2024-05-27T06:29:31.316739+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316739+0000","last_undegraded":"2024-05-27T06:29:31.316739+0000","last_fullsized":"2024-05-27T06:29:31.316739+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.335883+0000","last_change":"2024-05-27T06:29:31.329550+0000","last_active":"2024-05-27T06:29:31.335883+0000","last_peered":"2024-05-27T06:29:31.335883+0000","last_clean":"2024-05-27T06:29:31.335883+0000","last_became_active":"2024-05-27T06:29:31.329294+0000","last_became_peered":"2024-05-27T06:29:31.329294+0000","last_unstale":"2024-05-27T06:29:31.335883+0000","last_undegraded":"2024-05-27T06:29:31.335883+0000","last_fullsized":"2024-05-27T06:29:31.335883+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:07:45.468162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.325710+0000","last_change":"2024-05-27T06:29:31.325710+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.325710+0000","last_undegraded":"2024-05-27T06:29:31.325710+0000","last_fullsized":"2024-05-27T06:29:31.325710+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.336602+0000","last_change":"2024-05-27T06:29:31.330141+0000","last_active":"2024-05-27T06:29:31.336602+0000","last_peered":"2024-05-27T06:29:31.336602+0000","last_clean":"2024-05-27T06:29:31.336602+0000","last_became_active":"2024-05-27T06:29:31.329830+0000","last_became_peered":"2024-05-27T06:29:31.329830+0000","last_unstale":"2024-05-27T06:29:31.336602+0000","last_undegraded":"2024-05-27T06:29:31.336602+0000","last_fullsized":"2024-05-27T06:29:31.336602+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:51:42.711265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.320595+0000","last_change":"2024-05-27T06:29:31.320595+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.320595+0000","last_undegraded":"2024-05-27T06:29:31.320595+0000","last_fullsized":"2024-05-27T06:29:31.320595+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.336058+0000","last_change":"2024-05-27T06:29:31.332562+0000","last_active":"2024-05-27T06:29:31.336058+0000","last_peered":"2024-05-27T06:29:31.336058+0000","last_clean":"2024-05-27T06:29:31.336058+0000","last_became_active":"2024-05-27T06:29:31.332221+0000","last_became_peered":"2024-05-27T06:29:31.332221+0000","last_unstale":"2024-05-27T06:29:31.336058+0000","last_undegraded":"2024-05-27T06:29:31.336058+0000","last_fullsized":"2024-05-27T06:29:31.336058+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:51:42.711265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316837+0000","last_change":"2024-05-27T06:29:31.316837+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316837+0000","last_undegraded":"2024-05-27T06:29:31.316837+0000","last_fullsized":"2024-05-27T06:29:31.316837+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.343207+0000","last_change":"2024-05-27T06:29:31.336613+0000","last_active":"2024-05-27T06:29:31.343207+0000","last_peered":"2024-05-27T06:29:31.343207+0000","last_clean":"2024-05-27T06:29:31.343207+0000","last_became_active":"2024-05-27T06:29:31.336319+0000","last_became_peered":"2024-05-27T06:29:31.336319+0000","last_unstale":"2024-05-27T06:29:31.343207+0000","last_undegraded":"2024-05-27T06:29:31.343207+0000","last_fullsized":"2024-05-27T06:29:31.343207+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:16:41.521107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316374+0000","last_change":"2024-05-27T06:29:31.316374+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316374+0000","last_undegraded":"2024-05-27T06:29:31.316374+0000","last_fullsized":"2024-05-27T06:29:31.316374+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.331552+0000","last_change":"2024-05-27T06:29:31.326223+0000","last_active":"2024-05-27T06:29:31.331552+0000","last_peered":"2024-05-27T06:29:31.331552+0000","last_clean":"2024-05-27T06:29:31.331552+0000","last_became_active":"2024-05-27T06:29:31.325962+0000","last_became_peered":"2024-05-27T06:29:31.325962+0000","last_unstale":"2024-05-27T06:29:31.331552+0000","last_undegraded":"2024-05-27T06:29:31.331552+0000","last_fullsized":"2024-05-27T06:29:31.331552+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:21:17.064386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.315692+0000","last_change":"2024-05-27T06:29:31.315692+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.315692+0000","last_undegraded":"2024-05-27T06:29:31.315692+0000","last_fullsized":"2024-05-27T06:29:31.315692+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.337644+0000","last_change":"2024-05-27T06:29:31.332841+0000","last_active":"2024-05-27T06:29:31.337644+0000","last_peered":"2024-05-27T06:29:31.337644+0000","last_clean":"2024-05-27T06:29:31.337644+0000","last_became_active":"2024-05-27T06:29:31.332404+0000","last_became_peered":"2024-05-27T06:29:31.332404+0000","last_unstale":"2024-05-27T06:29:31.337644+0000","last_undegraded":"2024-05-27T06:29:31.337644+0000","last_fullsized":"2024-05-27T06:29:31.337644+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:55:11.170951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316490+0000","last_change":"2024-05-27T06:29:31.316490+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316490+0000","last_undegraded":"2024-05-27T06:29:31.316490+0000","last_fullsized":"2024-05-27T06:29:31.316490+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.342953+0000","last_change":"2024-05-27T06:29:31.338844+0000","last_active":"2024-05-27T06:29:31.342953+0000","last_peered":"2024-05-27T06:29:31.342953+0000","last_clean":"2024-05-27T06:29:31.342953+0000","last_became_active":"2024-05-27T06:29:31.338521+0000","last_became_peered":"2024-05-27T06:29:31.338521+0000","last_unstale":"2024-05-27T06:29:31.342953+0000","last_undegraded":"2024-05-27T06:29:31.342953+0000","last_fullsized":"2024-05-27T06:29:31.342953+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:31:46.375058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.316199+0000","last_change":"2024-05-27T06:29:31.316199+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.316199+0000","last_undegraded":"2024-05-27T06:29:31.316199+0000","last_fullsized":"2024-05-27T06:29:31.316199+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.336114+0000","last_change":"2024-05-27T06:29:31.333344+0000","last_active":"2024-05-27T06:29:31.336114+0000","last_peered":"2024-05-27T06:29:31.336114+0000","last_clean":"2024-05-27T06:29:31.336114+0000","last_became_active":"2024-05-27T06:29:31.333044+0000","last_became_peered":"2024-05-27T06:29:31.333044+0000","last_unstale":"2024-05-27T06:29:31.336114+0000","last_undegraded":"2024-05-27T06:29:31.336114+0000","last_fullsized":"2024-05-27T06:29:31.336114+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:50:20.583108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.314819+0000","last_change":"2024-05-27T06:29:31.314819+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.314819+0000","last_undegraded":"2024-05-27T06:29:31.314819+0000","last_fullsized":"2024-05-27T06:29:31.314819+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.337606+0000","last_change":"2024-05-27T06:29:31.335481+0000","last_active":"2024-05-27T06:29:31.337606+0000","last_peered":"2024-05-27T06:29:31.337606+0000","last_clean":"2024-05-27T06:29:31.337606+0000","last_became_active":"2024-05-27T06:29:31.334999+0000","last_became_peered":"2024-05-27T06:29:31.334999+0000","last_unstale":"2024-05-27T06:29:31.337606+0000","last_undegraded":"2024-05-27T06:29:31.337606+0000","last_fullsized":"2024-05-27T06:29:31.337606+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:05:26.579241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.317184+0000","last_change":"2024-05-27T06:29:31.317184+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.317184+0000","last_undegraded":"2024-05-27T06:29:31.317184+0000","last_fullsized":"2024-05-27T06:29:31.317184+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.339998+0000","last_change":"2024-05-27T06:29:31.336050+0000","last_active":"2024-05-27T06:29:31.339998+0000","last_peered":"2024-05-27T06:29:31.339998+0000","last_clean":"2024-05-27T06:29:31.339998+0000","last_became_active":"2024-05-27T06:29:31.335730+0000","last_became_peered":"2024-05-27T06:29:31.335730+0000","last_unstale":"2024-05-27T06:29:31.339998+0000","last_undegraded":"2024-05-27T06:29:31.339998+0000","last_fullsized":"2024-05-27T06:29:31.339998+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:49:26.326325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.321809+0000","last_change":"2024-05-27T06:29:31.321809+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.321809+0000","last_undegraded":"2024-05-27T06:29:31.321809+0000","last_fullsized":"2024-05-27T06:29:31.321809+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.330550+0000","last_change":"2024-05-27T06:29:31.322798+0000","last_active":"2024-05-27T06:29:31.330550+0000","last_peered":"2024-05-27T06:29:31.330550+0000","last_clean":"2024-05-27T06:29:31.330550+0000","last_became_active":"2024-05-27T06:29:31.322512+0000","last_became_peered":"2024-05-27T06:29:31.322512+0000","last_unstale":"2024-05-27T06:29:31.330550+0000","last_undegraded":"2024-05-27T06:29:31.330550+0000","last_fullsized":"2024-05-27T06:29:31.330550+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:48:45.545585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.320106+0000","last_change":"2024-05-27T06:29:31.320106+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.320106+0000","last_undegraded":"2024-05-27T06:29:31.320106+0000","last_fullsized":"2024-05-27T06:29:31.320106+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.335841+0000","last_change":"2024-05-27T06:29:31.333682+0000","last_active":"2024-05-27T06:29:31.335841+0000","last_peered":"2024-05-27T06:29:31.335841+0000","last_clean":"2024-05-27T06:29:31.335841+0000","last_became_active":"2024-05-27T06:29:31.333356+0000","last_became_peered":"2024-05-27T06:29:31.333356+0000","last_unstale":"2024-05-27T06:29:31.335841+0000","last_undegraded":"2024-05-27T06:29:31.335841+0000","last_fullsized":"2024-05-27T06:29:31.335841+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:50:50.388948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.314897+0000","last_change":"2024-05-27T06:29:31.314897+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.314897+0000","last_undegraded":"2024-05-27T06:29:31.314897+0000","last_fullsized":"2024-05-27T06:29:31.314897+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.321473+0000","last_change":"2024-05-27T06:29:31.319544+0000","last_active":"2024-05-27T06:29:31.321473+0000","last_peered":"2024-05-27T06:29:31.321473+0000","last_clean":"2024-05-27T06:29:31.321473+0000","last_became_active":"2024-05-27T06:29:31.319187+0000","last_became_peered":"2024-05-27T06:29:31.319187+0000","last_unstale":"2024-05-27T06:29:31.321473+0000","last_undegraded":"2024-05-27T06:29:31.321473+0000","last_fullsized":"2024-05-27T06:29:31.321473+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:05:26.579241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.320910+0000","last_change":"2024-05-27T06:29:31.320910+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.320910+0000","last_undegraded":"2024-05-27T06:29:31.320910+0000","last_fullsized":"2024-05-27T06:29:31.320910+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.337788+0000","last_change":"2024-05-27T06:29:31.330242+0000","last_active":"2024-05-27T06:29:31.337788+0000","last_peered":"2024-05-27T06:29:31.337788+0000","last_clean":"2024-05-27T06:29:31.337788+0000","last_became_active":"2024-05-27T06:29:31.329531+0000","last_became_peered":"2024-05-27T06:29:31.329531+0000","last_unstale":"2024-05-27T06:29:31.337788+0000","last_undegraded":"2024-05-27T06:29:31.337788+0000","last_fullsized":"2024-05-27T06:29:31.337788+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:55:11.170951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-05-27T06:29:31.319519+0000","last_change":"2024-05-27T06:29:31.319519+0000","last_active":"2024-05-27T06:29:31.299642+0000","last_peered":"2024-05-27T06:29:31.299642+0000","last_clean":"2024-05-27T06:29:31.299642+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T06:29:31.319519+0000","last_undegraded":"2024-05-27T06:29:31.319519+0000","last_fullsized":"2024-05-27T06:29:31.319519+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.342691+0000","last_change":"2024-05-27T06:29:31.338455+0000","last_active":"2024-05-27T06:29:31.342691+0000","last_peered":"2024-05-27T06:29:31.342691+0000","last_clean":"2024-05-27T06:29:31.342691+0000","last_became_active":"2024-05-27T06:29:31.338096+0000","last_became_peered":"2024-05-27T06:29:31.338096+0000","last_unstale":"2024-05-27T06:29:31.342691+0000","last_undegraded":"2024-05-27T06:29:31.342691+0000","last_fullsized":"2024-05-27T06:29:31.342691+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:21:17.064386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":169,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-27T06:29:31.328335+0000","last_change":"2024-05-27T06:27:28.692457+0000","last_active":"2024-05-27T06:29:31.328335+0000","last_peered":"2024-05-27T06:29:31.328335+0000","last_clean":"2024-05-27T06:29:31.328335+0000","last_became_active":"2024-05-27T06:27:28.691290+0000","last_became_peered":"2024-05-27T06:27:28.691290+0000","last_unstale":"2024-05-27T06:29:31.328335+0000","last_undegraded":"2024-05-27T06:29:31.328335+0000","last_fullsized":"2024-05-27T06:29:31.328335+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_clean_scrub_stamp":"2024-05-27T06:27:26.991915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:45.563728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28212,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343628,"statfs":{"total":96636764160,"available":96607875072,"internally_reserved":0,"allocated":1216512,"data_stored":869502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":272475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":272475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":272475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":272475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":279134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":272475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32372,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":1216512,"data_stored":869502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T06:29:41.036 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T06:29:41.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.196+0000 7f5afd000640 1 Processor -- start 2024-05-27T06:29:41.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.196+0000 7f5afd000640 1 -- start start 2024-05-27T06:29:41.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.200+0000 7f5afd000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5af80cbf90 0x7f5af806cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:41.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.200+0000 7f5afd000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5af815d6f0 0x7f5af80d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:41.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.200+0000 7f5afd000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5af815dbb0 con 0x7f5af806d500 2024-05-27T06:29:41.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.200+0000 7f5afd000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f5af806d910 con 0x7f5af80cbf90 2024-05-27T06:29:41.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.200+0000 7f5afd000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f5af815de90 con 0x7f5af815d6f0 2024-05-27T06:29:41.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.200+0000 7f5af5e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5af80cbf90 0x7f5af806cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:41.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.200+0000 7f5af5400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f5af806d500 0x7f5af815cfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:32956/0 (socket says 172.21.15.87:32956) 2024-05-27T06:29:41.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.200+0000 7f5af5400640 1 -- 172.21.15.87:0/517871551 learned_addr learned my addr 172.21.15.87:0/517871551 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:29:41.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.200+0000 7f5af6800640 1 --2- 172.21.15.87:0/517871551 >> v2:172.21.15.149:3300/0 conn(0x7f5af815d6f0 0x7f5af80d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:41.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.200+0000 7f5af4a00640 1 -- 172.21.15.87:0/517871551 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 280618253 0 0) 0x7f5af815dbb0 con 0x7f5af806d500 2024-05-27T06:29:41.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.200+0000 7f5af5e00640 1 -- 172.21.15.87:0/517871551 >> v2:172.21.15.149:3300/0 conn(0x7f5af815d6f0 msgr2=0x7f5af80d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:41.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.200+0000 7f5af5e00640 1 --2- 172.21.15.87:0/517871551 >> v2:172.21.15.149:3300/0 conn(0x7f5af815d6f0 0x7f5af80d1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:41.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.200+0000 7f5af5e00640 1 -- 172.21.15.87:0/517871551 >> v1:172.21.15.87:6789/0 conn(0x7f5af806d500 legacy=0x7f5af815cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:41.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.200+0000 7f5af5e00640 1 -- 172.21.15.87:0/517871551 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af806c7c0 con 0x7f5af80cbf90 2024-05-27T06:29:41.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.204+0000 7f5af5e00640 1 --2- 172.21.15.87:0/517871551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5af80cbf90 0x7f5af806cfc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5af8071c90 tx=0x7f5ae801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a369a97e4e5caa9 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:41.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.204+0000 7f5af4a00640 1 -- 172.21.15.87:0/517871551 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae80b5070 con 0x7f5af80cbf90 2024-05-27T06:29:41.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.204+0000 7f5af4a00640 1 -- 172.21.15.87:0/517871551 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae80a8970 con 0x7f5af80cbf90 2024-05-27T06:29:41.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.204+0000 7f5af4a00640 1 -- 172.21.15.87:0/517871551 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae80a8d40 con 0x7f5af80cbf90 2024-05-27T06:29:41.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.204+0000 7f5afd000640 1 -- 172.21.15.87:0/517871551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5af80cbf90 msgr2=0x7f5af806cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:41.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.204+0000 7f5afd000640 1 --2- 172.21.15.87:0/517871551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5af80cbf90 0x7f5af806cfc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5af8071c90 tx=0x7f5ae801ec70 comp rx=0 tx=0).stop 2024-05-27T06:29:41.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.204+0000 7f5afd000640 1 -- 172.21.15.87:0/517871551 shutdown_connections 2024-05-27T06:29:41.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.204+0000 7f5afd000640 1 --2- 172.21.15.87:0/517871551 >> v2:172.21.15.149:3300/0 conn(0x7f5af815d6f0 0x7f5af80d1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:41.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.204+0000 7f5afd000640 1 --2- 172.21.15.87:0/517871551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5af80cbf90 0x7f5af806cfc0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:41.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.204+0000 7f5afd000640 1 -- 172.21.15.87:0/517871551 >> 172.21.15.87:0/517871551 conn(0x7f5af80b46b0 msgr2=0x7f5af80b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:41.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.204+0000 7f5afd000640 1 -- 172.21.15.87:0/517871551 shutdown_connections 2024-05-27T06:29:41.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.204+0000 7f5afd000640 1 -- 172.21.15.87:0/517871551 wait complete. 2024-05-27T06:29:41.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.204+0000 7f5afd000640 1 Processor -- start 2024-05-27T06:29:41.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.204+0000 7f5afd000640 1 -- start start 2024-05-27T06:29:41.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.208+0000 7f5afd000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5af806d500 0x7f5af8074270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:41.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.208+0000 7f5afd000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5af80cbf90 0x7f5af80ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:41.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.208+0000 7f5afd000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5af80ca620 0x7f5af81f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:41.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.208+0000 7f5afd000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5af80cc3a0 con 0x7f5af806d500 2024-05-27T06:29:41.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.208+0000 7f5afd000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5af815e170 con 0x7f5af80cbf90 2024-05-27T06:29:41.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.208+0000 7f5afd000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5af806ec50 con 0x7f5af80ca620 2024-05-27T06:29:41.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.208+0000 7f5af5e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5af806d500 0x7f5af8074270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:41.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.208+0000 7f5af5e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5af806d500 0x7f5af8074270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57184/0 (socket says 172.21.15.87:57184) 2024-05-27T06:29:41.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.208+0000 7f5af5e00640 1 -- 172.21.15.87:0/3945653397 learned_addr learned my addr 172.21.15.87:0/3945653397 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:41.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.208+0000 7f5af5400640 1 --2- 172.21.15.87:0/3945653397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5af80cbf90 0x7f5af80ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:41.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.208+0000 7f5af6800640 1 --2- 172.21.15.87:0/3945653397 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5af80ca620 0x7f5af81f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:41.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.208+0000 7f5af5e00640 1 -- 172.21.15.87:0/3945653397 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5af80ca620 msgr2=0x7f5af81f5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:41.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.208+0000 7f5af5e00640 1 --2- 172.21.15.87:0/3945653397 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5af80ca620 0x7f5af81f5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:41.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.208+0000 7f5af5e00640 1 -- 172.21.15.87:0/3945653397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5af80cbf90 msgr2=0x7f5af80ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:41.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.208+0000 7f5af5e00640 1 --2- 172.21.15.87:0/3945653397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5af80cbf90 0x7f5af80ca0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:41.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.208+0000 7f5af5e00640 1 -- 172.21.15.87:0/3945653397 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af80c6e40 con 0x7f5af806d500 2024-05-27T06:29:41.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.208+0000 7f5af5400640 1 --2- 172.21.15.87:0/3945653397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5af80cbf90 0x7f5af80ca0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:29:41.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.208+0000 7f5af6800640 1 --2- 172.21.15.87:0/3945653397 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5af80ca620 0x7f5af81f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:29:41.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.208+0000 7f5af5e00640 1 --2- 172.21.15.87:0/3945653397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5af806d500 0x7f5af8074270 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5ae801b880 tx=0x7f5ae801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:41.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.208+0000 7f5aee000640 1 -- 172.21.15.87:0/3945653397 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae80b5040 con 0x7f5af806d500 2024-05-27T06:29:41.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.208+0000 7f5aee000640 1 -- 172.21.15.87:0/3945653397 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae8004220 con 0x7f5af806d500 2024-05-27T06:29:41.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.208+0000 7f5afd000640 1 -- 172.21.15.87:0/3945653397 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af80c7120 con 0x7f5af806d500 2024-05-27T06:29:41.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.208+0000 7f5aee000640 1 -- 172.21.15.87:0/3945653397 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8003620 con 0x7f5af806d500 2024-05-27T06:29:41.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.208+0000 7f5afd000640 1 -- 172.21.15.87:0/3945653397 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af80c76e0 con 0x7f5af806d500 2024-05-27T06:29:41.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.208+0000 7f5afd000640 1 -- 172.21.15.87:0/3945653397 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5af806aa30 con 0x7f5af806d500 2024-05-27T06:29:41.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.212+0000 7f5aee000640 1 -- 172.21.15.87:0/3945653397 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5ae80c2060 con 0x7f5af806d500 2024-05-27T06:29:41.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.212+0000 7f5aee000640 1 --2- 172.21.15.87:0/3945653397 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5ad806f400 0x7f5ad8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:41.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.212+0000 7f5aee000640 1 -- 172.21.15.87:0/3945653397 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f5ae812c090 con 0x7f5af806d500 2024-05-27T06:29:41.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.212+0000 7f5af5400640 1 --2- 172.21.15.87:0/3945653397 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5ad806f400 0x7f5ad8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:41.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.212+0000 7f5af5400640 1 --2- 172.21.15.87:0/3945653397 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5ad806f400 0x7f5ad8071910 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5af80b0260 tx=0x7f5ae4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:41.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.216+0000 7f5aee000640 1 -- 172.21.15.87:0/3945653397 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f5ae80187d0 con 0x7f5af806d500 2024-05-27T06:29:41.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.368+0000 7f5afd000640 1 -- 172.21.15.87:0/3945653397 --> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5af8159850 con 0x7f5ad806f400 2024-05-27T06:29:41.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.376+0000 7f5aee000640 1 -- 172.21.15.87:0/3945653397 <== mgr.4111 v2:172.21.15.87:6832/2724754260 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251944 (secure 0 0 0) 0x7f5af8159850 con 0x7f5ad806f400 2024-05-27T06:29:41.378 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:29:41.379 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-27T06:29:41.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.380+0000 7f5afd000640 1 -- 172.21.15.87:0/3945653397 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5ad806f400 msgr2=0x7f5ad8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:41.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.380+0000 7f5afd000640 1 --2- 172.21.15.87:0/3945653397 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5ad806f400 0x7f5ad8071910 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5af80b0260 tx=0x7f5ae4009040 comp rx=0 tx=0).stop 2024-05-27T06:29:41.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.380+0000 7f5afd000640 1 -- 172.21.15.87:0/3945653397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5af806d500 msgr2=0x7f5af8074270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:41.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.380+0000 7f5afd000640 1 --2- 172.21.15.87:0/3945653397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5af806d500 0x7f5af8074270 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5ae801b880 tx=0x7f5ae801ba10 comp rx=0 tx=0).stop 2024-05-27T06:29:41.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.380+0000 7f5afd000640 1 -- 172.21.15.87:0/3945653397 shutdown_connections 2024-05-27T06:29:41.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.380+0000 7f5afd000640 1 --2- 172.21.15.87:0/3945653397 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f5ad806f400 0x7f5ad8071910 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:41.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.380+0000 7f5afd000640 1 --2- 172.21.15.87:0/3945653397 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5af80ca620 0x7f5af81f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:41.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.380+0000 7f5afd000640 1 --2- 172.21.15.87:0/3945653397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5af80cbf90 0x7f5af80ca0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:41.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.380+0000 7f5afd000640 1 --2- 172.21.15.87:0/3945653397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5af806d500 0x7f5af8074270 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:41.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.380+0000 7f5afd000640 1 -- 172.21.15.87:0/3945653397 >> 172.21.15.87:0/3945653397 conn(0x7f5af80b46b0 msgr2=0x7f5af80b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:41.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.380+0000 7f5afd000640 1 -- 172.21.15.87:0/3945653397 shutdown_connections 2024-05-27T06:29:41.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.380+0000 7f5afd000640 1 -- 172.21.15.87:0/3945653397 wait complete. 2024-05-27T06:29:41.399 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2024-05-27T06:29:40.593815+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226600,"kb_used_data":6280,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748120,"statfs":{"total":773094113280,"available":772862074880,"internally_reserved":0,"allocated":6430720,"data_stored":3529500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.281327"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.427122+0000","last_change":"2024-05-27T06:29:32.349778+0000","last_active":"2024-05-27T06:29:34.427122+0000","last_peered":"2024-05-27T06:29:34.427122+0000","last_clean":"2024-05-27T06:29:34.427122+0000","last_became_active":"2024-05-27T06:29:32.349390+0000","last_became_peered":"2024-05-27T06:29:32.349390+0000","last_unstale":"2024-05-27T06:29:34.427122+0000","last_undegraded":"2024-05-27T06:29:34.427122+0000","last_fullsized":"2024-05-27T06:29:34.427122+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:48:49.434584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.427192+0000","last_change":"2024-05-27T06:29:32.348585+0000","last_active":"2024-05-27T06:29:34.427192+0000","last_peered":"2024-05-27T06:29:34.427192+0000","last_clean":"2024-05-27T06:29:34.427192+0000","last_became_active":"2024-05-27T06:29:32.348422+0000","last_became_peered":"2024-05-27T06:29:32.348422+0000","last_unstale":"2024-05-27T06:29:34.427192+0000","last_undegraded":"2024-05-27T06:29:34.427192+0000","last_fullsized":"2024-05-27T06:29:34.427192+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:51:25.756823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426373+0000","last_change":"2024-05-27T06:29:32.341751+0000","last_active":"2024-05-27T06:29:34.426373+0000","last_peered":"2024-05-27T06:29:34.426373+0000","last_clean":"2024-05-27T06:29:34.426373+0000","last_became_active":"2024-05-27T06:29:32.335685+0000","last_became_peered":"2024-05-27T06:29:32.335685+0000","last_unstale":"2024-05-27T06:29:34.426373+0000","last_undegraded":"2024-05-27T06:29:34.426373+0000","last_fullsized":"2024-05-27T06:29:34.426373+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:15:12.721697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.334090+0000","last_change":"2024-05-27T06:29:32.339006+0000","last_active":"2024-05-27T06:29:33.334090+0000","last_peered":"2024-05-27T06:29:33.334090+0000","last_clean":"2024-05-27T06:29:33.334090+0000","last_became_active":"2024-05-27T06:29:32.338686+0000","last_became_peered":"2024-05-27T06:29:32.338686+0000","last_unstale":"2024-05-27T06:29:33.334090+0000","last_undegraded":"2024-05-27T06:29:33.334090+0000","last_fullsized":"2024-05-27T06:29:33.334090+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:16:57.410413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426037+0000","last_change":"2024-05-27T06:29:32.343964+0000","last_active":"2024-05-27T06:29:34.426037+0000","last_peered":"2024-05-27T06:29:34.426037+0000","last_clean":"2024-05-27T06:29:34.426037+0000","last_became_active":"2024-05-27T06:29:32.343630+0000","last_became_peered":"2024-05-27T06:29:32.343630+0000","last_unstale":"2024-05-27T06:29:34.426037+0000","last_undegraded":"2024-05-27T06:29:34.426037+0000","last_fullsized":"2024-05-27T06:29:34.426037+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:58:41.197938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.113968+0000","last_change":"2024-05-27T06:29:32.339089+0000","last_active":"2024-05-27T06:29:34.113968+0000","last_peered":"2024-05-27T06:29:34.113968+0000","last_clean":"2024-05-27T06:29:34.113968+0000","last_became_active":"2024-05-27T06:29:32.338779+0000","last_became_peered":"2024-05-27T06:29:32.338779+0000","last_unstale":"2024-05-27T06:29:34.113968+0000","last_undegraded":"2024-05-27T06:29:34.113968+0000","last_fullsized":"2024-05-27T06:29:34.113968+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:07:04.204042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.377170+0000","last_change":"2024-05-27T06:29:32.343558+0000","last_active":"2024-05-27T06:29:33.377170+0000","last_peered":"2024-05-27T06:29:33.377170+0000","last_clean":"2024-05-27T06:29:33.377170+0000","last_became_active":"2024-05-27T06:29:32.343238+0000","last_became_peered":"2024-05-27T06:29:32.343238+0000","last_unstale":"2024-05-27T06:29:33.377170+0000","last_undegraded":"2024-05-27T06:29:33.377170+0000","last_fullsized":"2024-05-27T06:29:33.377170+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:48:07.007157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426163+0000","last_change":"2024-05-27T06:29:32.334690+0000","last_active":"2024-05-27T06:29:34.426163+0000","last_peered":"2024-05-27T06:29:34.426163+0000","last_clean":"2024-05-27T06:29:34.426163+0000","last_became_active":"2024-05-27T06:29:32.334407+0000","last_became_peered":"2024-05-27T06:29:32.334407+0000","last_unstale":"2024-05-27T06:29:34.426163+0000","last_undegraded":"2024-05-27T06:29:34.426163+0000","last_fullsized":"2024-05-27T06:29:34.426163+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:40:15.211464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.377429+0000","last_change":"2024-05-27T06:29:32.342477+0000","last_active":"2024-05-27T06:29:33.377429+0000","last_peered":"2024-05-27T06:29:33.377429+0000","last_clean":"2024-05-27T06:29:33.377429+0000","last_became_active":"2024-05-27T06:29:32.342133+0000","last_became_peered":"2024-05-27T06:29:32.342133+0000","last_unstale":"2024-05-27T06:29:33.377429+0000","last_undegraded":"2024-05-27T06:29:33.377429+0000","last_fullsized":"2024-05-27T06:29:33.377429+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:17:45.207106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.336639+0000","last_change":"2024-05-27T06:29:32.342021+0000","last_active":"2024-05-27T06:29:33.336639+0000","last_peered":"2024-05-27T06:29:33.336639+0000","last_clean":"2024-05-27T06:29:33.336639+0000","last_became_active":"2024-05-27T06:29:32.341737+0000","last_became_peered":"2024-05-27T06:29:32.341737+0000","last_unstale":"2024-05-27T06:29:33.336639+0000","last_undegraded":"2024-05-27T06:29:33.336639+0000","last_fullsized":"2024-05-27T06:29:33.336639+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:50:21.585956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.336561+0000","last_change":"2024-05-27T06:29:32.337918+0000","last_active":"2024-05-27T06:29:33.336561+0000","last_peered":"2024-05-27T06:29:33.336561+0000","last_clean":"2024-05-27T06:29:33.336561+0000","last_became_active":"2024-05-27T06:29:32.336693+0000","last_became_peered":"2024-05-27T06:29:32.336693+0000","last_unstale":"2024-05-27T06:29:33.336561+0000","last_undegraded":"2024-05-27T06:29:33.336561+0000","last_fullsized":"2024-05-27T06:29:33.336561+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:07:46.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.334111+0000","last_change":"2024-05-27T06:29:32.338556+0000","last_active":"2024-05-27T06:29:33.334111+0000","last_peered":"2024-05-27T06:29:33.334111+0000","last_clean":"2024-05-27T06:29:33.334111+0000","last_became_active":"2024-05-27T06:29:32.338228+0000","last_became_peered":"2024-05-27T06:29:32.338228+0000","last_unstale":"2024-05-27T06:29:33.334111+0000","last_undegraded":"2024-05-27T06:29:33.334111+0000","last_fullsized":"2024-05-27T06:29:33.334111+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:11:03.302337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.119507+0000","last_change":"2024-05-27T06:29:32.344268+0000","last_active":"2024-05-27T06:29:34.119507+0000","last_peered":"2024-05-27T06:29:34.119507+0000","last_clean":"2024-05-27T06:29:34.119507+0000","last_became_active":"2024-05-27T06:29:32.344023+0000","last_became_peered":"2024-05-27T06:29:32.344023+0000","last_unstale":"2024-05-27T06:29:34.119507+0000","last_undegraded":"2024-05-27T06:29:34.119507+0000","last_fullsized":"2024-05-27T06:29:34.119507+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:48:07.007157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.377265+0000","last_change":"2024-05-27T06:29:32.345189+0000","last_active":"2024-05-27T06:29:33.377265+0000","last_peered":"2024-05-27T06:29:33.377265+0000","last_clean":"2024-05-27T06:29:33.377265+0000","last_became_active":"2024-05-27T06:29:32.344912+0000","last_became_peered":"2024-05-27T06:29:32.344912+0000","last_unstale":"2024-05-27T06:29:33.377265+0000","last_undegraded":"2024-05-27T06:29:33.377265+0000","last_fullsized":"2024-05-27T06:29:33.377265+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:25:40.943615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.377488+0000","last_change":"2024-05-27T06:29:32.346695+0000","last_active":"2024-05-27T06:29:33.377488+0000","last_peered":"2024-05-27T06:29:33.377488+0000","last_clean":"2024-05-27T06:29:33.377488+0000","last_became_active":"2024-05-27T06:29:32.346274+0000","last_became_peered":"2024-05-27T06:29:32.346274+0000","last_unstale":"2024-05-27T06:29:33.377488+0000","last_undegraded":"2024-05-27T06:29:33.377488+0000","last_fullsized":"2024-05-27T06:29:33.377488+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:18:18.282532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.113872+0000","last_change":"2024-05-27T06:29:32.335464+0000","last_active":"2024-05-27T06:29:34.113872+0000","last_peered":"2024-05-27T06:29:34.113872+0000","last_clean":"2024-05-27T06:29:34.113872+0000","last_became_active":"2024-05-27T06:29:32.335235+0000","last_became_peered":"2024-05-27T06:29:32.335235+0000","last_unstale":"2024-05-27T06:29:34.113872+0000","last_undegraded":"2024-05-27T06:29:34.113872+0000","last_fullsized":"2024-05-27T06:29:34.113872+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:16:57.410413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426736+0000","last_change":"2024-05-27T06:29:32.342256+0000","last_active":"2024-05-27T06:29:34.426736+0000","last_peered":"2024-05-27T06:29:34.426736+0000","last_clean":"2024-05-27T06:29:34.426736+0000","last_became_active":"2024-05-27T06:29:32.342081+0000","last_became_peered":"2024-05-27T06:29:32.342081+0000","last_unstale":"2024-05-27T06:29:34.426736+0000","last_undegraded":"2024-05-27T06:29:34.426736+0000","last_fullsized":"2024-05-27T06:29:34.426736+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:51:05.700335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426691+0000","last_change":"2024-05-27T06:29:32.344648+0000","last_active":"2024-05-27T06:29:34.426691+0000","last_peered":"2024-05-27T06:29:34.426691+0000","last_clean":"2024-05-27T06:29:34.426691+0000","last_became_active":"2024-05-27T06:29:32.344296+0000","last_became_peered":"2024-05-27T06:29:32.344296+0000","last_unstale":"2024-05-27T06:29:34.426691+0000","last_undegraded":"2024-05-27T06:29:34.426691+0000","last_fullsized":"2024-05-27T06:29:34.426691+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:07:04.204042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426591+0000","last_change":"2024-05-27T06:29:32.345130+0000","last_active":"2024-05-27T06:29:34.426591+0000","last_peered":"2024-05-27T06:29:34.426591+0000","last_clean":"2024-05-27T06:29:34.426591+0000","last_became_active":"2024-05-27T06:29:32.344836+0000","last_became_peered":"2024-05-27T06:29:32.344836+0000","last_unstale":"2024-05-27T06:29:34.426591+0000","last_undegraded":"2024-05-27T06:29:34.426591+0000","last_fullsized":"2024-05-27T06:29:34.426591+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:35:04.444831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426889+0000","last_change":"2024-05-27T06:29:32.347321+0000","last_active":"2024-05-27T06:29:34.426889+0000","last_peered":"2024-05-27T06:29:34.426889+0000","last_clean":"2024-05-27T06:29:34.426889+0000","last_became_active":"2024-05-27T06:29:32.347003+0000","last_became_peered":"2024-05-27T06:29:32.347003+0000","last_unstale":"2024-05-27T06:29:34.426889+0000","last_undegraded":"2024-05-27T06:29:34.426889+0000","last_fullsized":"2024-05-27T06:29:34.426889+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T06:50:06.617445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426289+0000","last_change":"2024-05-27T06:29:32.348901+0000","last_active":"2024-05-27T06:29:34.426289+0000","last_peered":"2024-05-27T06:29:34.426289+0000","last_clean":"2024-05-27T06:29:34.426289+0000","last_became_active":"2024-05-27T06:29:32.347933+0000","last_became_peered":"2024-05-27T06:29:32.347933+0000","last_unstale":"2024-05-27T06:29:34.426289+0000","last_undegraded":"2024-05-27T06:29:34.426289+0000","last_fullsized":"2024-05-27T06:29:34.426289+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:16:57.410413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426247+0000","last_change":"2024-05-27T06:29:32.344423+0000","last_active":"2024-05-27T06:29:34.426247+0000","last_peered":"2024-05-27T06:29:34.426247+0000","last_clean":"2024-05-27T06:29:34.426247+0000","last_became_active":"2024-05-27T06:29:32.343839+0000","last_became_peered":"2024-05-27T06:29:32.343839+0000","last_unstale":"2024-05-27T06:29:34.426247+0000","last_undegraded":"2024-05-27T06:29:34.426247+0000","last_fullsized":"2024-05-27T06:29:34.426247+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:01:35.407022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426424+0000","last_change":"2024-05-27T06:29:32.349188+0000","last_active":"2024-05-27T06:29:34.426424+0000","last_peered":"2024-05-27T06:29:34.426424+0000","last_clean":"2024-05-27T06:29:34.426424+0000","last_became_active":"2024-05-27T06:29:32.347665+0000","last_became_peered":"2024-05-27T06:29:32.347665+0000","last_unstale":"2024-05-27T06:29:34.426424+0000","last_undegraded":"2024-05-27T06:29:34.426424+0000","last_fullsized":"2024-05-27T06:29:34.426424+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:09:33.672659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.119321+0000","last_change":"2024-05-27T06:29:32.344174+0000","last_active":"2024-05-27T06:29:34.119321+0000","last_peered":"2024-05-27T06:29:34.119321+0000","last_clean":"2024-05-27T06:29:34.119321+0000","last_became_active":"2024-05-27T06:29:32.343721+0000","last_became_peered":"2024-05-27T06:29:32.343721+0000","last_unstale":"2024-05-27T06:29:34.119321+0000","last_undegraded":"2024-05-27T06:29:34.119321+0000","last_fullsized":"2024-05-27T06:29:34.119321+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:25:32.201347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.427259+0000","last_change":"2024-05-27T06:29:32.346087+0000","last_active":"2024-05-27T06:29:34.427259+0000","last_peered":"2024-05-27T06:29:34.427259+0000","last_clean":"2024-05-27T06:29:34.427259+0000","last_became_active":"2024-05-27T06:29:32.345870+0000","last_became_peered":"2024-05-27T06:29:32.345870+0000","last_unstale":"2024-05-27T06:29:34.427259+0000","last_undegraded":"2024-05-27T06:29:34.427259+0000","last_fullsized":"2024-05-27T06:29:34.427259+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:24:10.952394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.334274+0000","last_change":"2024-05-27T06:29:32.333740+0000","last_active":"2024-05-27T06:29:33.334274+0000","last_peered":"2024-05-27T06:29:33.334274+0000","last_clean":"2024-05-27T06:29:33.334274+0000","last_became_active":"2024-05-27T06:29:32.333352+0000","last_became_peered":"2024-05-27T06:29:32.333352+0000","last_unstale":"2024-05-27T06:29:33.334274+0000","last_undegraded":"2024-05-27T06:29:33.334274+0000","last_fullsized":"2024-05-27T06:29:33.334274+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:07:04.204042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.114329+0000","last_change":"2024-05-27T06:29:32.335916+0000","last_active":"2024-05-27T06:29:34.114329+0000","last_peered":"2024-05-27T06:29:34.114329+0000","last_clean":"2024-05-27T06:29:34.114329+0000","last_became_active":"2024-05-27T06:29:32.334174+0000","last_became_peered":"2024-05-27T06:29:32.334174+0000","last_unstale":"2024-05-27T06:29:34.114329+0000","last_undegraded":"2024-05-27T06:29:34.114329+0000","last_fullsized":"2024-05-27T06:29:34.114329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:52:18.882398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426132+0000","last_change":"2024-05-27T06:29:32.348092+0000","last_active":"2024-05-27T06:29:34.426132+0000","last_peered":"2024-05-27T06:29:34.426132+0000","last_clean":"2024-05-27T06:29:34.426132+0000","last_became_active":"2024-05-27T06:29:32.347758+0000","last_became_peered":"2024-05-27T06:29:32.347758+0000","last_unstale":"2024-05-27T06:29:34.426132+0000","last_undegraded":"2024-05-27T06:29:34.426132+0000","last_fullsized":"2024-05-27T06:29:34.426132+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:56:46.494425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426888+0000","last_change":"2024-05-27T06:29:32.344458+0000","last_active":"2024-05-27T06:29:34.426888+0000","last_peered":"2024-05-27T06:29:34.426888+0000","last_clean":"2024-05-27T06:29:34.426888+0000","last_became_active":"2024-05-27T06:29:32.343292+0000","last_became_peered":"2024-05-27T06:29:32.343292+0000","last_unstale":"2024-05-27T06:29:34.426888+0000","last_undegraded":"2024-05-27T06:29:34.426888+0000","last_fullsized":"2024-05-27T06:29:34.426888+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:09:34.879778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426293+0000","last_change":"2024-05-27T06:29:32.342671+0000","last_active":"2024-05-27T06:29:34.426293+0000","last_peered":"2024-05-27T06:29:34.426293+0000","last_clean":"2024-05-27T06:29:34.426293+0000","last_became_active":"2024-05-27T06:29:32.342363+0000","last_became_peered":"2024-05-27T06:29:32.342363+0000","last_unstale":"2024-05-27T06:29:34.426293+0000","last_undegraded":"2024-05-27T06:29:34.426293+0000","last_fullsized":"2024-05-27T06:29:34.426293+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:46:41.196268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.425753+0000","last_change":"2024-05-27T06:29:32.341224+0000","last_active":"2024-05-27T06:29:34.425753+0000","last_peered":"2024-05-27T06:29:34.425753+0000","last_clean":"2024-05-27T06:29:34.425753+0000","last_became_active":"2024-05-27T06:29:32.340879+0000","last_became_peered":"2024-05-27T06:29:32.340879+0000","last_unstale":"2024-05-27T06:29:34.425753+0000","last_undegraded":"2024-05-27T06:29:34.425753+0000","last_fullsized":"2024-05-27T06:29:34.425753+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:49:44.902829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.114001+0000","last_change":"2024-05-27T06:29:32.330547+0000","last_active":"2024-05-27T06:29:34.114001+0000","last_peered":"2024-05-27T06:29:34.114001+0000","last_clean":"2024-05-27T06:29:34.114001+0000","last_became_active":"2024-05-27T06:29:32.330216+0000","last_became_peered":"2024-05-27T06:29:32.330216+0000","last_unstale":"2024-05-27T06:29:34.114001+0000","last_undegraded":"2024-05-27T06:29:34.114001+0000","last_fullsized":"2024-05-27T06:29:34.114001+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:04:04.974934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.114505+0000","last_change":"2024-05-27T06:29:32.337491+0000","last_active":"2024-05-27T06:29:34.114505+0000","last_peered":"2024-05-27T06:29:34.114505+0000","last_clean":"2024-05-27T06:29:34.114505+0000","last_became_active":"2024-05-27T06:29:32.337180+0000","last_became_peered":"2024-05-27T06:29:32.337180+0000","last_unstale":"2024-05-27T06:29:34.114505+0000","last_undegraded":"2024-05-27T06:29:34.114505+0000","last_fullsized":"2024-05-27T06:29:34.114505+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:40:15.211464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"53'4","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.114526+0000","last_change":"2024-05-27T06:29:31.337912+0000","last_active":"2024-05-27T06:29:34.114526+0000","last_peered":"2024-05-27T06:29:34.114526+0000","last_clean":"2024-05-27T06:29:34.114526+0000","last_became_active":"2024-05-27T06:29:31.337076+0000","last_became_peered":"2024-05-27T06:29:31.337076+0000","last_unstale":"2024-05-27T06:29:34.114526+0000","last_undegraded":"2024-05-27T06:29:34.114526+0000","last_fullsized":"2024-05-27T06:29:34.114526+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:24:21.069227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.336640+0000","last_change":"2024-05-27T06:29:32.339438+0000","last_active":"2024-05-27T06:29:33.336640+0000","last_peered":"2024-05-27T06:29:33.336640+0000","last_clean":"2024-05-27T06:29:33.336640+0000","last_became_active":"2024-05-27T06:29:32.339150+0000","last_became_peered":"2024-05-27T06:29:32.339150+0000","last_unstale":"2024-05-27T06:29:33.336640+0000","last_undegraded":"2024-05-27T06:29:33.336640+0000","last_fullsized":"2024-05-27T06:29:33.336640+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:51:43.714113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.427165+0000","last_change":"2024-05-27T06:29:31.340901+0000","last_active":"2024-05-27T06:29:34.427165+0000","last_peered":"2024-05-27T06:29:34.427165+0000","last_clean":"2024-05-27T06:29:34.427165+0000","last_became_active":"2024-05-27T06:29:31.340584+0000","last_became_peered":"2024-05-27T06:29:31.340584+0000","last_unstale":"2024-05-27T06:29:34.427165+0000","last_undegraded":"2024-05-27T06:29:34.427165+0000","last_fullsized":"2024-05-27T06:29:34.427165+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:11:21.173839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.114369+0000","last_change":"2024-05-27T06:29:32.340440+0000","last_active":"2024-05-27T06:29:34.114369+0000","last_peered":"2024-05-27T06:29:34.114369+0000","last_clean":"2024-05-27T06:29:34.114369+0000","last_became_active":"2024-05-27T06:29:32.340129+0000","last_became_peered":"2024-05-27T06:29:32.340129+0000","last_unstale":"2024-05-27T06:29:34.114369+0000","last_undegraded":"2024-05-27T06:29:34.114369+0000","last_fullsized":"2024-05-27T06:29:34.114369+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:12:48.424152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.114655+0000","last_change":"2024-05-27T06:29:31.321412+0000","last_active":"2024-05-27T06:29:34.114655+0000","last_peered":"2024-05-27T06:29:34.114655+0000","last_clean":"2024-05-27T06:29:34.114655+0000","last_became_active":"2024-05-27T06:29:31.321110+0000","last_became_peered":"2024-05-27T06:29:31.321110+0000","last_unstale":"2024-05-27T06:29:34.114655+0000","last_undegraded":"2024-05-27T06:29:34.114655+0000","last_fullsized":"2024-05-27T06:29:34.114655+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:16:41.521107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.114373+0000","last_change":"2024-05-27T06:29:32.332150+0000","last_active":"2024-05-27T06:29:34.114373+0000","last_peered":"2024-05-27T06:29:34.114373+0000","last_clean":"2024-05-27T06:29:34.114373+0000","last_became_active":"2024-05-27T06:29:32.331266+0000","last_became_peered":"2024-05-27T06:29:32.331266+0000","last_unstale":"2024-05-27T06:29:34.114373+0000","last_undegraded":"2024-05-27T06:29:34.114373+0000","last_fullsized":"2024-05-27T06:29:34.114373+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:01:35.407022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.334295+0000","last_change":"2024-05-27T06:29:31.324922+0000","last_active":"2024-05-27T06:29:33.334295+0000","last_peered":"2024-05-27T06:29:33.334295+0000","last_clean":"2024-05-27T06:29:33.334295+0000","last_became_active":"2024-05-27T06:29:31.324534+0000","last_became_peered":"2024-05-27T06:29:31.324534+0000","last_unstale":"2024-05-27T06:29:33.334295+0000","last_undegraded":"2024-05-27T06:29:33.334295+0000","last_fullsized":"2024-05-27T06:29:33.334295+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:43:39.204168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426337+0000","last_change":"2024-05-27T06:29:32.344125+0000","last_active":"2024-05-27T06:29:34.426337+0000","last_peered":"2024-05-27T06:29:34.426337+0000","last_clean":"2024-05-27T06:29:34.426337+0000","last_became_active":"2024-05-27T06:29:32.343434+0000","last_became_peered":"2024-05-27T06:29:32.343434+0000","last_unstale":"2024-05-27T06:29:34.426337+0000","last_undegraded":"2024-05-27T06:29:34.426337+0000","last_fullsized":"2024-05-27T06:29:34.426337+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:30:34.053746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.377417+0000","last_change":"2024-05-27T06:29:31.328972+0000","last_active":"2024-05-27T06:29:33.377417+0000","last_peered":"2024-05-27T06:29:33.377417+0000","last_clean":"2024-05-27T06:29:33.377417+0000","last_became_active":"2024-05-27T06:29:31.328662+0000","last_became_peered":"2024-05-27T06:29:31.328662+0000","last_unstale":"2024-05-27T06:29:33.377417+0000","last_undegraded":"2024-05-27T06:29:33.377417+0000","last_fullsized":"2024-05-27T06:29:33.377417+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:31:46.375058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426667+0000","last_change":"2024-05-27T06:29:32.346132+0000","last_active":"2024-05-27T06:29:34.426667+0000","last_peered":"2024-05-27T06:29:34.426667+0000","last_clean":"2024-05-27T06:29:34.426667+0000","last_became_active":"2024-05-27T06:29:32.345835+0000","last_became_peered":"2024-05-27T06:29:32.345835+0000","last_unstale":"2024-05-27T06:29:34.426667+0000","last_undegraded":"2024-05-27T06:29:34.426667+0000","last_fullsized":"2024-05-27T06:29:34.426667+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:03:29.582796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.113958+0000","last_change":"2024-05-27T06:29:31.333973+0000","last_active":"2024-05-27T06:29:34.113958+0000","last_peered":"2024-05-27T06:29:34.113958+0000","last_clean":"2024-05-27T06:29:34.113958+0000","last_became_active":"2024-05-27T06:29:31.333665+0000","last_became_peered":"2024-05-27T06:29:31.333665+0000","last_unstale":"2024-05-27T06:29:34.113958+0000","last_undegraded":"2024-05-27T06:29:34.113958+0000","last_fullsized":"2024-05-27T06:29:34.113958+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:10:34.186274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.119346+0000","last_change":"2024-05-27T06:29:32.350452+0000","last_active":"2024-05-27T06:29:34.119346+0000","last_peered":"2024-05-27T06:29:34.119346+0000","last_clean":"2024-05-27T06:29:34.119346+0000","last_became_active":"2024-05-27T06:29:32.350029+0000","last_became_peered":"2024-05-27T06:29:32.350029+0000","last_unstale":"2024-05-27T06:29:34.119346+0000","last_undegraded":"2024-05-27T06:29:34.119346+0000","last_fullsized":"2024-05-27T06:29:34.119346+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:16:38.864183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.333478+0000","last_change":"2024-05-27T06:29:31.332145+0000","last_active":"2024-05-27T06:29:33.333478+0000","last_peered":"2024-05-27T06:29:33.333478+0000","last_clean":"2024-05-27T06:29:33.333478+0000","last_became_active":"2024-05-27T06:29:31.331328+0000","last_became_peered":"2024-05-27T06:29:31.331328+0000","last_unstale":"2024-05-27T06:29:33.333478+0000","last_undegraded":"2024-05-27T06:29:33.333478+0000","last_fullsized":"2024-05-27T06:29:33.333478+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:10:34.186274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426396+0000","last_change":"2024-05-27T06:29:32.338538+0000","last_active":"2024-05-27T06:29:34.426396+0000","last_peered":"2024-05-27T06:29:34.426396+0000","last_clean":"2024-05-27T06:29:34.426396+0000","last_became_active":"2024-05-27T06:29:32.337965+0000","last_became_peered":"2024-05-27T06:29:32.337965+0000","last_unstale":"2024-05-27T06:29:34.426396+0000","last_undegraded":"2024-05-27T06:29:34.426396+0000","last_fullsized":"2024-05-27T06:29:34.426396+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:22:25.693316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.377144+0000","last_change":"2024-05-27T06:29:31.339195+0000","last_active":"2024-05-27T06:29:33.377144+0000","last_peered":"2024-05-27T06:29:33.377144+0000","last_clean":"2024-05-27T06:29:33.377144+0000","last_became_active":"2024-05-27T06:29:31.338863+0000","last_became_peered":"2024-05-27T06:29:31.338863+0000","last_unstale":"2024-05-27T06:29:33.377144+0000","last_undegraded":"2024-05-27T06:29:33.377144+0000","last_fullsized":"2024-05-27T06:29:33.377144+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:48:45.545585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.377580+0000","last_change":"2024-05-27T06:29:32.346976+0000","last_active":"2024-05-27T06:29:33.377580+0000","last_peered":"2024-05-27T06:29:33.377580+0000","last_clean":"2024-05-27T06:29:33.377580+0000","last_became_active":"2024-05-27T06:29:32.346694+0000","last_became_peered":"2024-05-27T06:29:32.346694+0000","last_unstale":"2024-05-27T06:29:33.377580+0000","last_undegraded":"2024-05-27T06:29:33.377580+0000","last_fullsized":"2024-05-27T06:29:33.377580+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:07:46.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426862+0000","last_change":"2024-05-27T06:29:31.340841+0000","last_active":"2024-05-27T06:29:34.426862+0000","last_peered":"2024-05-27T06:29:34.426862+0000","last_clean":"2024-05-27T06:29:34.426862+0000","last_became_active":"2024-05-27T06:29:31.340483+0000","last_became_peered":"2024-05-27T06:29:31.340483+0000","last_unstale":"2024-05-27T06:29:34.426862+0000","last_undegraded":"2024-05-27T06:29:34.426862+0000","last_fullsized":"2024-05-27T06:29:34.426862+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:49:26.326325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426858+0000","last_change":"2024-05-27T06:29:32.347421+0000","last_active":"2024-05-27T06:29:34.426858+0000","last_peered":"2024-05-27T06:29:34.426858+0000","last_clean":"2024-05-27T06:29:34.426858+0000","last_became_active":"2024-05-27T06:29:32.346997+0000","last_became_peered":"2024-05-27T06:29:32.346997+0000","last_unstale":"2024-05-27T06:29:34.426858+0000","last_undegraded":"2024-05-27T06:29:34.426858+0000","last_fullsized":"2024-05-27T06:29:34.426858+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:52:18.882398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.427269+0000","last_change":"2024-05-27T06:29:31.336123+0000","last_active":"2024-05-27T06:29:34.427269+0000","last_peered":"2024-05-27T06:29:34.427269+0000","last_clean":"2024-05-27T06:29:34.427269+0000","last_became_active":"2024-05-27T06:29:31.335682+0000","last_became_peered":"2024-05-27T06:29:31.335682+0000","last_unstale":"2024-05-27T06:29:34.427269+0000","last_undegraded":"2024-05-27T06:29:34.427269+0000","last_fullsized":"2024-05-27T06:29:34.427269+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:08:27.832750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.336330+0000","last_change":"2024-05-27T06:29:32.333831+0000","last_active":"2024-05-27T06:29:33.336330+0000","last_peered":"2024-05-27T06:29:33.336330+0000","last_clean":"2024-05-27T06:29:33.336330+0000","last_became_active":"2024-05-27T06:29:32.333524+0000","last_became_peered":"2024-05-27T06:29:32.333524+0000","last_unstale":"2024-05-27T06:29:33.336330+0000","last_undegraded":"2024-05-27T06:29:33.336330+0000","last_fullsized":"2024-05-27T06:29:33.336330+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:25:40.943615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"53'3","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426868+0000","last_change":"2024-05-27T06:29:31.340823+0000","last_active":"2024-05-27T06:29:34.426868+0000","last_peered":"2024-05-27T06:29:34.426868+0000","last_clean":"2024-05-27T06:29:34.426868+0000","last_became_active":"2024-05-27T06:29:31.340446+0000","last_became_peered":"2024-05-27T06:29:31.340446+0000","last_unstale":"2024-05-27T06:29:34.426868+0000","last_undegraded":"2024-05-27T06:29:34.426868+0000","last_fullsized":"2024-05-27T06:29:34.426868+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:55:11.170951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426801+0000","last_change":"2024-05-27T06:29:32.338906+0000","last_active":"2024-05-27T06:29:34.426801+0000","last_peered":"2024-05-27T06:29:34.426801+0000","last_clean":"2024-05-27T06:29:34.426801+0000","last_became_active":"2024-05-27T06:29:32.338541+0000","last_became_peered":"2024-05-27T06:29:32.338541+0000","last_unstale":"2024-05-27T06:29:34.426801+0000","last_undegraded":"2024-05-27T06:29:34.426801+0000","last_fullsized":"2024-05-27T06:29:34.426801+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:12:48.424152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"53'6","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.377638+0000","last_change":"2024-05-27T06:29:31.331195+0000","last_active":"2024-05-27T06:29:33.377638+0000","last_peered":"2024-05-27T06:29:33.377638+0000","last_clean":"2024-05-27T06:29:33.377638+0000","last_became_active":"2024-05-27T06:29:31.330881+0000","last_became_peered":"2024-05-27T06:29:31.330881+0000","last_unstale":"2024-05-27T06:29:33.377638+0000","last_undegraded":"2024-05-27T06:29:33.377638+0000","last_fullsized":"2024-05-27T06:29:33.377638+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:21:17.064386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.333520+0000","last_change":"2024-05-27T06:29:32.340508+0000","last_active":"2024-05-27T06:29:33.333520+0000","last_peered":"2024-05-27T06:29:33.333520+0000","last_clean":"2024-05-27T06:29:33.333520+0000","last_became_active":"2024-05-27T06:29:32.340212+0000","last_became_peered":"2024-05-27T06:29:32.340212+0000","last_unstale":"2024-05-27T06:29:33.333520+0000","last_undegraded":"2024-05-27T06:29:33.333520+0000","last_fullsized":"2024-05-27T06:29:33.333520+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T08:15:12.721697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426609+0000","last_change":"2024-05-27T06:29:31.336599+0000","last_active":"2024-05-27T06:29:34.426609+0000","last_peered":"2024-05-27T06:29:34.426609+0000","last_clean":"2024-05-27T06:29:34.426609+0000","last_became_active":"2024-05-27T06:29:31.336273+0000","last_became_peered":"2024-05-27T06:29:31.336273+0000","last_unstale":"2024-05-27T06:29:34.426609+0000","last_undegraded":"2024-05-27T06:29:34.426609+0000","last_fullsized":"2024-05-27T06:29:34.426609+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:32:41.265993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426427+0000","last_change":"2024-05-27T06:29:32.339883+0000","last_active":"2024-05-27T06:29:34.426427+0000","last_peered":"2024-05-27T06:29:34.426427+0000","last_clean":"2024-05-27T06:29:34.426427+0000","last_became_active":"2024-05-27T06:29:32.339582+0000","last_became_peered":"2024-05-27T06:29:32.339582+0000","last_unstale":"2024-05-27T06:29:34.426427+0000","last_undegraded":"2024-05-27T06:29:34.426427+0000","last_fullsized":"2024-05-27T06:29:34.426427+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:11:03.302337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.119288+0000","last_change":"2024-05-27T06:29:31.335657+0000","last_active":"2024-05-27T06:29:34.119288+0000","last_peered":"2024-05-27T06:29:34.119288+0000","last_clean":"2024-05-27T06:29:34.119288+0000","last_became_active":"2024-05-27T06:29:31.335285+0000","last_became_peered":"2024-05-27T06:29:31.335285+0000","last_unstale":"2024-05-27T06:29:34.119288+0000","last_undegraded":"2024-05-27T06:29:34.119288+0000","last_fullsized":"2024-05-27T06:29:34.119288+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:31:46.375058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.377189+0000","last_change":"2024-05-27T06:29:32.337927+0000","last_active":"2024-05-27T06:29:33.377189+0000","last_peered":"2024-05-27T06:29:33.377189+0000","last_clean":"2024-05-27T06:29:33.377189+0000","last_became_active":"2024-05-27T06:29:32.337628+0000","last_became_peered":"2024-05-27T06:29:32.337628+0000","last_unstale":"2024-05-27T06:29:33.377189+0000","last_undegraded":"2024-05-27T06:29:33.377189+0000","last_fullsized":"2024-05-27T06:29:33.377189+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:35:15.519733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.333493+0000","last_change":"2024-05-27T06:29:31.323676+0000","last_active":"2024-05-27T06:29:33.333493+0000","last_peered":"2024-05-27T06:29:33.333493+0000","last_clean":"2024-05-27T06:29:33.333493+0000","last_became_active":"2024-05-27T06:29:31.323378+0000","last_became_peered":"2024-05-27T06:29:31.323378+0000","last_unstale":"2024-05-27T06:29:33.333493+0000","last_undegraded":"2024-05-27T06:29:33.333493+0000","last_fullsized":"2024-05-27T06:29:33.333493+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:16:07.331463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426342+0000","last_change":"2024-05-27T06:29:32.348555+0000","last_active":"2024-05-27T06:29:34.426342+0000","last_peered":"2024-05-27T06:29:34.426342+0000","last_clean":"2024-05-27T06:29:34.426342+0000","last_became_active":"2024-05-27T06:29:32.347880+0000","last_became_peered":"2024-05-27T06:29:32.347880+0000","last_unstale":"2024-05-27T06:29:34.426342+0000","last_undegraded":"2024-05-27T06:29:34.426342+0000","last_fullsized":"2024-05-27T06:29:34.426342+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:08:20.004780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"53'8","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426202+0000","last_change":"2024-05-27T06:29:31.340500+0000","last_active":"2024-05-27T06:29:34.426202+0000","last_peered":"2024-05-27T06:29:34.426202+0000","last_clean":"2024-05-27T06:29:34.426202+0000","last_became_active":"2024-05-27T06:29:31.340151+0000","last_became_peered":"2024-05-27T06:29:31.340151+0000","last_unstale":"2024-05-27T06:29:34.426202+0000","last_undegraded":"2024-05-27T06:29:34.426202+0000","last_fullsized":"2024-05-27T06:29:34.426202+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:50:20.583108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426795+0000","last_change":"2024-05-27T06:29:32.337339+0000","last_active":"2024-05-27T06:29:34.426795+0000","last_peered":"2024-05-27T06:29:34.426795+0000","last_clean":"2024-05-27T06:29:34.426795+0000","last_became_active":"2024-05-27T06:29:32.337028+0000","last_became_peered":"2024-05-27T06:29:32.337028+0000","last_unstale":"2024-05-27T06:29:34.426795+0000","last_undegraded":"2024-05-27T06:29:34.426795+0000","last_fullsized":"2024-05-27T06:29:34.426795+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:44:05.567512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.427025+0000","last_change":"2024-05-27T06:29:31.336677+0000","last_active":"2024-05-27T06:29:34.427025+0000","last_peered":"2024-05-27T06:29:34.427025+0000","last_clean":"2024-05-27T06:29:34.427025+0000","last_became_active":"2024-05-27T06:29:31.336379+0000","last_became_peered":"2024-05-27T06:29:31.336379+0000","last_unstale":"2024-05-27T06:29:34.427025+0000","last_undegraded":"2024-05-27T06:29:34.427025+0000","last_fullsized":"2024-05-27T06:29:34.427025+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:38:56.999055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.334573+0000","last_change":"2024-05-27T06:29:32.339049+0000","last_active":"2024-05-27T06:29:33.334573+0000","last_peered":"2024-05-27T06:29:33.334573+0000","last_clean":"2024-05-27T06:29:33.334573+0000","last_became_active":"2024-05-27T06:29:32.338731+0000","last_became_peered":"2024-05-27T06:29:32.338731+0000","last_unstale":"2024-05-27T06:29:33.334573+0000","last_undegraded":"2024-05-27T06:29:33.334573+0000","last_fullsized":"2024-05-27T06:29:33.334573+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:04:04.974934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.114494+0000","last_change":"2024-05-27T06:29:31.329550+0000","last_active":"2024-05-27T06:29:34.114494+0000","last_peered":"2024-05-27T06:29:34.114494+0000","last_clean":"2024-05-27T06:29:34.114494+0000","last_became_active":"2024-05-27T06:29:31.329294+0000","last_became_peered":"2024-05-27T06:29:31.329294+0000","last_unstale":"2024-05-27T06:29:34.114494+0000","last_undegraded":"2024-05-27T06:29:34.114494+0000","last_fullsized":"2024-05-27T06:29:34.114494+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:43:39.204168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.427012+0000","last_change":"2024-05-27T06:29:32.337344+0000","last_active":"2024-05-27T06:29:34.427012+0000","last_peered":"2024-05-27T06:29:34.427012+0000","last_clean":"2024-05-27T06:29:34.427012+0000","last_became_active":"2024-05-27T06:29:32.337032+0000","last_became_peered":"2024-05-27T06:29:32.337032+0000","last_unstale":"2024-05-27T06:29:34.427012+0000","last_undegraded":"2024-05-27T06:29:34.427012+0000","last_fullsized":"2024-05-27T06:29:34.427012+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:05:14.607709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.334176+0000","last_change":"2024-05-27T06:29:31.330141+0000","last_active":"2024-05-27T06:29:33.334176+0000","last_peered":"2024-05-27T06:29:33.334176+0000","last_clean":"2024-05-27T06:29:33.334176+0000","last_became_active":"2024-05-27T06:29:31.329830+0000","last_became_peered":"2024-05-27T06:29:31.329830+0000","last_unstale":"2024-05-27T06:29:33.334176+0000","last_undegraded":"2024-05-27T06:29:33.334176+0000","last_fullsized":"2024-05-27T06:29:33.334176+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:16:41.521107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426610+0000","last_change":"2024-05-27T06:29:32.352734+0000","last_active":"2024-05-27T06:29:34.426610+0000","last_peered":"2024-05-27T06:29:34.426610+0000","last_clean":"2024-05-27T06:29:34.426610+0000","last_became_active":"2024-05-27T06:29:32.351826+0000","last_became_peered":"2024-05-27T06:29:32.351826+0000","last_unstale":"2024-05-27T06:29:34.426610+0000","last_undegraded":"2024-05-27T06:29:34.426610+0000","last_fullsized":"2024-05-27T06:29:34.426610+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:25:29.859998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.114311+0000","last_change":"2024-05-27T06:29:31.332562+0000","last_active":"2024-05-27T06:29:34.114311+0000","last_peered":"2024-05-27T06:29:34.114311+0000","last_clean":"2024-05-27T06:29:34.114311+0000","last_became_active":"2024-05-27T06:29:31.332221+0000","last_became_peered":"2024-05-27T06:29:31.332221+0000","last_unstale":"2024-05-27T06:29:34.114311+0000","last_undegraded":"2024-05-27T06:29:34.114311+0000","last_fullsized":"2024-05-27T06:29:34.114311+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:11:21.173839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.333639+0000","last_change":"2024-05-27T06:29:32.341136+0000","last_active":"2024-05-27T06:29:33.333639+0000","last_peered":"2024-05-27T06:29:33.333639+0000","last_clean":"2024-05-27T06:29:33.333639+0000","last_became_active":"2024-05-27T06:29:32.340788+0000","last_became_peered":"2024-05-27T06:29:32.340788+0000","last_unstale":"2024-05-27T06:29:33.333639+0000","last_undegraded":"2024-05-27T06:29:33.333639+0000","last_fullsized":"2024-05-27T06:29:33.333639+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:09:33.672659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426778+0000","last_change":"2024-05-27T06:29:31.336613+0000","last_active":"2024-05-27T06:29:34.426778+0000","last_peered":"2024-05-27T06:29:34.426778+0000","last_clean":"2024-05-27T06:29:34.426778+0000","last_became_active":"2024-05-27T06:29:31.336319+0000","last_became_peered":"2024-05-27T06:29:31.336319+0000","last_unstale":"2024-05-27T06:29:34.426778+0000","last_undegraded":"2024-05-27T06:29:34.426778+0000","last_fullsized":"2024-05-27T06:29:34.426778+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:44:24.115176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.114249+0000","last_change":"2024-05-27T06:29:32.336479+0000","last_active":"2024-05-27T06:29:34.114249+0000","last_peered":"2024-05-27T06:29:34.114249+0000","last_clean":"2024-05-27T06:29:34.114249+0000","last_became_active":"2024-05-27T06:29:32.336229+0000","last_became_peered":"2024-05-27T06:29:32.336229+0000","last_unstale":"2024-05-27T06:29:34.114249+0000","last_undegraded":"2024-05-27T06:29:34.114249+0000","last_fullsized":"2024-05-27T06:29:34.114249+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:44:05.567512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.336097+0000","last_change":"2024-05-27T06:29:31.326223+0000","last_active":"2024-05-27T06:29:33.336097+0000","last_peered":"2024-05-27T06:29:33.336097+0000","last_clean":"2024-05-27T06:29:33.336097+0000","last_became_active":"2024-05-27T06:29:31.325962+0000","last_became_peered":"2024-05-27T06:29:31.325962+0000","last_unstale":"2024-05-27T06:29:33.336097+0000","last_undegraded":"2024-05-27T06:29:33.336097+0000","last_fullsized":"2024-05-27T06:29:33.336097+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:52:22.773165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.113932+0000","last_change":"2024-05-27T06:29:32.338826+0000","last_active":"2024-05-27T06:29:34.113932+0000","last_peered":"2024-05-27T06:29:34.113932+0000","last_clean":"2024-05-27T06:29:34.113932+0000","last_became_active":"2024-05-27T06:29:32.338521+0000","last_became_peered":"2024-05-27T06:29:32.338521+0000","last_unstale":"2024-05-27T06:29:34.113932+0000","last_undegraded":"2024-05-27T06:29:34.113932+0000","last_fullsized":"2024-05-27T06:29:34.113932+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:25:29.859998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.333413+0000","last_change":"2024-05-27T06:29:31.332841+0000","last_active":"2024-05-27T06:29:33.333413+0000","last_peered":"2024-05-27T06:29:33.333413+0000","last_clean":"2024-05-27T06:29:33.333413+0000","last_became_active":"2024-05-27T06:29:31.332404+0000","last_became_peered":"2024-05-27T06:29:31.332404+0000","last_unstale":"2024-05-27T06:29:33.333413+0000","last_undegraded":"2024-05-27T06:29:33.333413+0000","last_fullsized":"2024-05-27T06:29:33.333413+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:24:21.069227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.334253+0000","last_change":"2024-05-27T06:29:32.341106+0000","last_active":"2024-05-27T06:29:33.334253+0000","last_peered":"2024-05-27T06:29:33.334253+0000","last_clean":"2024-05-27T06:29:33.334253+0000","last_became_active":"2024-05-27T06:29:32.340808+0000","last_became_peered":"2024-05-27T06:29:32.340808+0000","last_unstale":"2024-05-27T06:29:33.334253+0000","last_undegraded":"2024-05-27T06:29:33.334253+0000","last_fullsized":"2024-05-27T06:29:33.334253+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:25:29.859998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.336698+0000","last_change":"2024-05-27T06:29:31.338844+0000","last_active":"2024-05-27T06:29:33.336698+0000","last_peered":"2024-05-27T06:29:33.336698+0000","last_clean":"2024-05-27T06:29:33.336698+0000","last_became_active":"2024-05-27T06:29:31.338521+0000","last_became_peered":"2024-05-27T06:29:31.338521+0000","last_unstale":"2024-05-27T06:29:33.336698+0000","last_undegraded":"2024-05-27T06:29:33.336698+0000","last_fullsized":"2024-05-27T06:29:33.336698+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:20:13.982079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.334600+0000","last_change":"2024-05-27T06:29:32.339927+0000","last_active":"2024-05-27T06:29:33.334600+0000","last_peered":"2024-05-27T06:29:33.334600+0000","last_clean":"2024-05-27T06:29:33.334600+0000","last_became_active":"2024-05-27T06:29:32.339606+0000","last_became_peered":"2024-05-27T06:29:32.339606+0000","last_unstale":"2024-05-27T06:29:33.334600+0000","last_undegraded":"2024-05-27T06:29:33.334600+0000","last_fullsized":"2024-05-27T06:29:33.334600+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:44:05.567512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.114627+0000","last_change":"2024-05-27T06:29:31.333344+0000","last_active":"2024-05-27T06:29:34.114627+0000","last_peered":"2024-05-27T06:29:34.114627+0000","last_clean":"2024-05-27T06:29:34.114627+0000","last_became_active":"2024-05-27T06:29:31.333044+0000","last_became_peered":"2024-05-27T06:29:31.333044+0000","last_unstale":"2024-05-27T06:29:34.114627+0000","last_undegraded":"2024-05-27T06:29:34.114627+0000","last_fullsized":"2024-05-27T06:29:34.114627+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:16:07.331463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.336350+0000","last_change":"2024-05-27T06:29:32.332886+0000","last_active":"2024-05-27T06:29:33.336350+0000","last_peered":"2024-05-27T06:29:33.336350+0000","last_clean":"2024-05-27T06:29:33.336350+0000","last_became_active":"2024-05-27T06:29:32.332522+0000","last_became_peered":"2024-05-27T06:29:32.332522+0000","last_unstale":"2024-05-27T06:29:33.336350+0000","last_undegraded":"2024-05-27T06:29:33.336350+0000","last_fullsized":"2024-05-27T06:29:33.336350+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:18:18.282532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.119515+0000","last_change":"2024-05-27T06:29:31.335481+0000","last_active":"2024-05-27T06:29:34.119515+0000","last_peered":"2024-05-27T06:29:34.119515+0000","last_clean":"2024-05-27T06:29:34.119515+0000","last_became_active":"2024-05-27T06:29:31.334999+0000","last_became_peered":"2024-05-27T06:29:31.334999+0000","last_unstale":"2024-05-27T06:29:34.119515+0000","last_undegraded":"2024-05-27T06:29:34.119515+0000","last_fullsized":"2024-05-27T06:29:34.119515+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:39:37.050901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.114603+0000","last_change":"2024-05-27T06:29:32.330927+0000","last_active":"2024-05-27T06:29:34.114603+0000","last_peered":"2024-05-27T06:29:34.114603+0000","last_clean":"2024-05-27T06:29:34.114603+0000","last_became_active":"2024-05-27T06:29:32.330538+0000","last_became_peered":"2024-05-27T06:29:32.330538+0000","last_unstale":"2024-05-27T06:29:34.114603+0000","last_undegraded":"2024-05-27T06:29:34.114603+0000","last_fullsized":"2024-05-27T06:29:34.114603+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T07:30:34.053746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.334297+0000","last_change":"2024-05-27T06:29:31.336050+0000","last_active":"2024-05-27T06:29:33.334297+0000","last_peered":"2024-05-27T06:29:33.334297+0000","last_clean":"2024-05-27T06:29:33.334297+0000","last_became_active":"2024-05-27T06:29:31.335730+0000","last_became_peered":"2024-05-27T06:29:31.335730+0000","last_unstale":"2024-05-27T06:29:33.334297+0000","last_undegraded":"2024-05-27T06:29:33.334297+0000","last_fullsized":"2024-05-27T06:29:33.334297+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:11:21.173839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426545+0000","last_change":"2024-05-27T06:29:32.351461+0000","last_active":"2024-05-27T06:29:34.426545+0000","last_peered":"2024-05-27T06:29:34.426545+0000","last_clean":"2024-05-27T06:29:34.426545+0000","last_became_active":"2024-05-27T06:29:32.351121+0000","last_became_peered":"2024-05-27T06:29:32.351121+0000","last_unstale":"2024-05-27T06:29:34.426545+0000","last_undegraded":"2024-05-27T06:29:34.426545+0000","last_fullsized":"2024-05-27T06:29:34.426545+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:22:23.655465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.336137+0000","last_change":"2024-05-27T06:29:31.322798+0000","last_active":"2024-05-27T06:29:33.336137+0000","last_peered":"2024-05-27T06:29:33.336137+0000","last_clean":"2024-05-27T06:29:33.336137+0000","last_became_active":"2024-05-27T06:29:31.322512+0000","last_became_peered":"2024-05-27T06:29:31.322512+0000","last_unstale":"2024-05-27T06:29:33.336137+0000","last_undegraded":"2024-05-27T06:29:33.336137+0000","last_fullsized":"2024-05-27T06:29:33.336137+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:39:37.050901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426765+0000","last_change":"2024-05-27T06:29:32.349201+0000","last_active":"2024-05-27T06:29:34.426765+0000","last_peered":"2024-05-27T06:29:34.426765+0000","last_clean":"2024-05-27T06:29:34.426765+0000","last_became_active":"2024-05-27T06:29:32.348917+0000","last_became_peered":"2024-05-27T06:29:32.348917+0000","last_unstale":"2024-05-27T06:29:34.426765+0000","last_undegraded":"2024-05-27T06:29:34.426765+0000","last_fullsized":"2024-05-27T06:29:34.426765+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:04:04.974934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.377265+0000","last_change":"2024-05-27T06:29:31.333682+0000","last_active":"2024-05-27T06:29:33.377265+0000","last_peered":"2024-05-27T06:29:33.377265+0000","last_clean":"2024-05-27T06:29:33.377265+0000","last_became_active":"2024-05-27T06:29:31.333356+0000","last_became_peered":"2024-05-27T06:29:31.333356+0000","last_unstale":"2024-05-27T06:29:33.377265+0000","last_undegraded":"2024-05-27T06:29:33.377265+0000","last_fullsized":"2024-05-27T06:29:33.377265+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:39:37.050901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.335931+0000","last_change":"2024-05-27T06:29:32.342932+0000","last_active":"2024-05-27T06:29:33.335931+0000","last_peered":"2024-05-27T06:29:33.335931+0000","last_clean":"2024-05-27T06:29:33.335931+0000","last_became_active":"2024-05-27T06:29:32.342661+0000","last_became_peered":"2024-05-27T06:29:32.342661+0000","last_unstale":"2024-05-27T06:29:33.335931+0000","last_undegraded":"2024-05-27T06:29:33.335931+0000","last_fullsized":"2024-05-27T06:29:33.335931+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T10:17:45.207106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:33.335968+0000","last_change":"2024-05-27T06:29:31.319544+0000","last_active":"2024-05-27T06:29:33.335968+0000","last_peered":"2024-05-27T06:29:33.335968+0000","last_clean":"2024-05-27T06:29:33.335968+0000","last_became_active":"2024-05-27T06:29:31.319187+0000","last_became_peered":"2024-05-27T06:29:31.319187+0000","last_unstale":"2024-05-27T06:29:33.335968+0000","last_undegraded":"2024-05-27T06:29:33.335968+0000","last_fullsized":"2024-05-27T06:29:33.335968+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:32:13.594371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426471+0000","last_change":"2024-05-27T06:29:32.338773+0000","last_active":"2024-05-27T06:29:34.426471+0000","last_peered":"2024-05-27T06:29:34.426471+0000","last_clean":"2024-05-27T06:29:34.426471+0000","last_became_active":"2024-05-27T06:29:32.338313+0000","last_became_peered":"2024-05-27T06:29:32.338313+0000","last_unstale":"2024-05-27T06:29:34.426471+0000","last_undegraded":"2024-05-27T06:29:34.426471+0000","last_fullsized":"2024-05-27T06:29:34.426471+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:56:14.927923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426308+0000","last_change":"2024-05-27T06:29:31.330242+0000","last_active":"2024-05-27T06:29:34.426308+0000","last_peered":"2024-05-27T06:29:34.426308+0000","last_clean":"2024-05-27T06:29:34.426308+0000","last_became_active":"2024-05-27T06:29:31.329531+0000","last_became_peered":"2024-05-27T06:29:31.329531+0000","last_unstale":"2024-05-27T06:29:34.426308+0000","last_undegraded":"2024-05-27T06:29:34.426308+0000","last_fullsized":"2024-05-27T06:29:34.426308+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T06:58:12.247825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426366+0000","last_change":"2024-05-27T06:29:32.345950+0000","last_active":"2024-05-27T06:29:34.426366+0000","last_peered":"2024-05-27T06:29:34.426366+0000","last_clean":"2024-05-27T06:29:34.426366+0000","last_became_active":"2024-05-27T06:29:32.345637+0000","last_became_peered":"2024-05-27T06:29:32.345637+0000","last_unstale":"2024-05-27T06:29:34.426366+0000","last_undegraded":"2024-05-27T06:29:34.426366+0000","last_fullsized":"2024-05-27T06:29:34.426366+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:31.299642+0000","last_clean_scrub_stamp":"2024-05-27T06:29:31.299642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T09:02:27.625935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.119305+0000","last_change":"2024-05-27T06:29:31.338455+0000","last_active":"2024-05-27T06:29:34.119305+0000","last_peered":"2024-05-27T06:29:34.119305+0000","last_clean":"2024-05-27T06:29:34.119305+0000","last_became_active":"2024-05-27T06:29:31.338096+0000","last_became_peered":"2024-05-27T06:29:31.338096+0000","last_unstale":"2024-05-27T06:29:34.119305+0000","last_undegraded":"2024-05-27T06:29:34.119305+0000","last_fullsized":"2024-05-27T06:29:34.119305+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:29:30.296794+0000","last_clean_scrub_stamp":"2024-05-27T06:29:30.296794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:20:13.982079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":173,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426212+0000","last_change":"2024-05-27T06:27:28.692457+0000","last_active":"2024-05-27T06:29:34.426212+0000","last_peered":"2024-05-27T06:29:34.426212+0000","last_clean":"2024-05-27T06:29:34.426212+0000","last_became_active":"2024-05-27T06:27:28.691290+0000","last_became_peered":"2024-05-27T06:27:28.691290+0000","last_unstale":"2024-05-27T06:29:34.426212+0000","last_undegraded":"2024-05-27T06:29:34.426212+0000","last_fullsized":"2024-05-27T06:29:34.426212+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_clean_scrub_stamp":"2024-05-27T06:27:26.991915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:45.563728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28240,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343600,"statfs":{"total":96636764160,"available":96607846400,"internally_reserved":0,"allocated":1249280,"data_stored":883521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":647168,"data_stored":292993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":293645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":659456,"data_stored":294605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":293049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":293049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":293083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1257472,"data_stored":885555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T06:29:41.403 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-27T06:29:41.404 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-27T06:29:41.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.596+0000 7f3dbf200640 1 Processor -- start 2024-05-27T06:29:41.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.596+0000 7f3dbf200640 1 -- start start 2024-05-27T06:29:41.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.596+0000 7f3dbf200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3db8156890 0x7f3db8163600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:41.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.596+0000 7f3dbf200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3db8156ca0 0x7f3db8163b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:41.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.596+0000 7f3dbf200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3db8160010 0x7f3db8160420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:41.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.596+0000 7f3dbf200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f3db80b52a0 con 0x7f3db8156ca0 2024-05-27T06:29:41.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.596+0000 7f3dbf200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f3db80d0e90 con 0x7f3db8156890 2024-05-27T06:29:41.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.596+0000 7f3dbf200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3db80d1170 con 0x7f3db8160010 2024-05-27T06:29:41.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.596+0000 7f3dbd400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3db8156ca0 0x7f3db8163b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:41.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.596+0000 7f3dbd400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3db8156ca0 0x7f3db8163b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57188/0 (socket says 172.21.15.87:57188) 2024-05-27T06:29:41.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.596+0000 7f3dbd400640 1 -- 172.21.15.87:0/493654286 learned_addr learned my addr 172.21.15.87:0/493654286 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:41.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.596+0000 7f3dbde00640 1 --2- 172.21.15.87:0/493654286 >> v2:172.21.15.149:3300/0 conn(0x7f3db8156890 0x7f3db8163600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:41.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.596+0000 7f3dbe800640 1 --2- 172.21.15.87:0/493654286 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3db8160010 0x7f3db8160420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:41.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.596+0000 7f3dbd400640 1 -- 172.21.15.87:0/493654286 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3db8160010 msgr2=0x7f3db8160420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:41.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.596+0000 7f3dbd400640 1 --2- 172.21.15.87:0/493654286 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3db8160010 0x7f3db8160420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:41.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.596+0000 7f3dbd400640 1 -- 172.21.15.87:0/493654286 >> v2:172.21.15.149:3300/0 conn(0x7f3db8156890 msgr2=0x7f3db8163600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:41.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.596+0000 7f3dbd400640 1 --2- 172.21.15.87:0/493654286 >> v2:172.21.15.149:3300/0 conn(0x7f3db8156890 0x7f3db8163600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:41.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.596+0000 7f3dbd400640 1 -- 172.21.15.87:0/493654286 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db80d1450 con 0x7f3db8156ca0 2024-05-27T06:29:41.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.600+0000 7f3dbd400640 1 --2- 172.21.15.87:0/493654286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3db8156ca0 0x7f3db8163b40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3db80732f0 tx=0x7f3da801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d779476f58a0223e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:41.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.600+0000 7f3dbca00640 1 -- 172.21.15.87:0/493654286 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da80b0070 con 0x7f3db8156ca0 2024-05-27T06:29:41.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.600+0000 7f3dbca00640 1 -- 172.21.15.87:0/493654286 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3da80ab600 con 0x7f3db8156ca0 2024-05-27T06:29:41.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.600+0000 7f3dbca00640 1 -- 172.21.15.87:0/493654286 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da80ab9d0 con 0x7f3db8156ca0 2024-05-27T06:29:41.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.600+0000 7f3dbf200640 1 -- 172.21.15.87:0/493654286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3db8156ca0 msgr2=0x7f3db8163b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:41.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.600+0000 7f3dbf200640 1 --2- 172.21.15.87:0/493654286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3db8156ca0 0x7f3db8163b40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3db80732f0 tx=0x7f3da801c520 comp rx=0 tx=0).stop 2024-05-27T06:29:41.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.600+0000 7f3dbf200640 1 -- 172.21.15.87:0/493654286 shutdown_connections 2024-05-27T06:29:41.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.600+0000 7f3dbf200640 1 --2- 172.21.15.87:0/493654286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3db8156ca0 0x7f3db8163b40 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:41.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.600+0000 7f3dbf200640 1 --2- 172.21.15.87:0/493654286 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3db8160010 0x7f3db8160420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:41.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.600+0000 7f3dbf200640 1 --2- 172.21.15.87:0/493654286 >> v2:172.21.15.149:3300/0 conn(0x7f3db8156890 0x7f3db8163600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:41.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.600+0000 7f3dbf200640 1 -- 172.21.15.87:0/493654286 >> 172.21.15.87:0/493654286 conn(0x7f3db80d2610 msgr2=0x7f3db80d2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:41.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.600+0000 7f3dbf200640 1 -- 172.21.15.87:0/493654286 shutdown_connections 2024-05-27T06:29:41.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.600+0000 7f3dbf200640 1 -- 172.21.15.87:0/493654286 wait complete. 2024-05-27T06:29:41.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.604+0000 7f3dbf200640 1 Processor -- start 2024-05-27T06:29:41.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.604+0000 7f3dbf200640 1 -- start start 2024-05-27T06:29:41.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.604+0000 7f3dbf200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3db8156890 0x7f3db814b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:41.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.604+0000 7f3dbf200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3db8156ca0 0x7f3db814bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:41.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.604+0000 7f3dbf200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3db8160010 0x7f3db8149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:41.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.604+0000 7f3dbf200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3db80cf890 con 0x7f3db8160010 2024-05-27T06:29:41.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.604+0000 7f3dbf200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3db80cf710 con 0x7f3db8156890 2024-05-27T06:29:41.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.604+0000 7f3dbf200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3db80cfa10 con 0x7f3db8156ca0 2024-05-27T06:29:41.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.604+0000 7f3dbe800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3db8160010 0x7f3db8149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:41.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.604+0000 7f3dbe800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3db8160010 0x7f3db8149d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57198/0 (socket says 172.21.15.87:57198) 2024-05-27T06:29:41.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.604+0000 7f3dbe800640 1 -- 172.21.15.87:0/3203850724 learned_addr learned my addr 172.21.15.87:0/3203850724 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:41.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.604+0000 7f3dbde00640 1 --2- 172.21.15.87:0/3203850724 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3db8156890 0x7f3db814b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:41.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.604+0000 7f3dbd400640 1 --2- 172.21.15.87:0/3203850724 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3db8156ca0 0x7f3db814bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:41.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.608+0000 7f3dbe800640 1 -- 172.21.15.87:0/3203850724 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3db8156ca0 msgr2=0x7f3db814bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:41.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.608+0000 7f3dbe800640 1 --2- 172.21.15.87:0/3203850724 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3db8156ca0 0x7f3db814bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:41.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.608+0000 7f3dbe800640 1 -- 172.21.15.87:0/3203850724 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3db8156890 msgr2=0x7f3db814b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:41.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.608+0000 7f3dbe800640 1 --2- 172.21.15.87:0/3203850724 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3db8156890 0x7f3db814b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:41.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.608+0000 7f3dbe800640 1 -- 172.21.15.87:0/3203850724 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db814c7a0 con 0x7f3db8160010 2024-05-27T06:29:41.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.608+0000 7f3dbe800640 1 --2- 172.21.15.87:0/3203850724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3db8160010 0x7f3db8149d10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3db4007e90 tx=0x7f3db400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:41.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.608+0000 7f3db2000640 1 -- 172.21.15.87:0/3203850724 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db4014420 con 0x7f3db8160010 2024-05-27T06:29:41.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.608+0000 7f3db2000640 1 -- 172.21.15.87:0/3203850724 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3db4019070 con 0x7f3db8160010 2024-05-27T06:29:41.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.608+0000 7f3dbf200640 1 -- 172.21.15.87:0/3203850724 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3db814a940 con 0x7f3db8160010 2024-05-27T06:29:41.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.608+0000 7f3db2000640 1 -- 172.21.15.87:0/3203850724 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db4014800 con 0x7f3db8160010 2024-05-27T06:29:41.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.608+0000 7f3dbf200640 1 -- 172.21.15.87:0/3203850724 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3db814c260 con 0x7f3db8160010 2024-05-27T06:29:41.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.608+0000 7f3dbf200640 1 -- 172.21.15.87:0/3203850724 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3db80508e0 con 0x7f3db8160010 2024-05-27T06:29:41.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.608+0000 7f3db2000640 1 -- 172.21.15.87:0/3203850724 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3db40149a0 con 0x7f3db8160010 2024-05-27T06:29:41.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.608+0000 7f3db2000640 1 --2- 172.21.15.87:0/3203850724 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3d9c06f400 0x7f3d9c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:41.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.612+0000 7f3db2000640 1 -- 172.21.15.87:0/3203850724 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f3db408fa90 con 0x7f3db8160010 2024-05-27T06:29:41.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.612+0000 7f3dbde00640 1 --2- 172.21.15.87:0/3203850724 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3d9c06f400 0x7f3d9c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:41.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.612+0000 7f3dbde00640 1 --2- 172.21.15.87:0/3203850724 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3d9c06f400 0x7f3d9c071910 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0079c0 tx=0x7f3dac008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:41.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.616+0000 7f3db2000640 1 -- 172.21.15.87:0/3203850724 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f3db405c230 con 0x7f3db8160010 2024-05-27T06:29:41.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.828+0000 7f3dbf200640 1 -- 172.21.15.87:0/3203850724 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f3db80b8020 con 0x7f3db8160010 2024-05-27T06:29:41.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.832+0000 7f3db2000640 1 -- 172.21.15.87:0/3203850724 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f3db4060530 con 0x7f3db8160010 2024-05-27T06:29:41.831 INFO:teuthology.orchestra.run.smithi087.stdout:[client.0] 2024-05-27T06:29:41.831 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCfJ1RmAld8BxAAigqU2F3mGXtAfw0L9Bfp2A== 2024-05-27T06:29:41.831 INFO:teuthology.orchestra.run.smithi087.stdout: caps mds = "allow" 2024-05-27T06:29:41.831 INFO:teuthology.orchestra.run.smithi087.stdout: caps mon = "allow r" 2024-05-27T06:29:41.831 INFO:teuthology.orchestra.run.smithi087.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-27T06:29:41.831 INFO:teuthology.orchestra.run.smithi087.stderr:updated caps for client.0 2024-05-27T06:29:41.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.832+0000 7f3dbf200640 1 -- 172.21.15.87:0/3203850724 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3d9c06f400 msgr2=0x7f3d9c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:41.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.832+0000 7f3dbf200640 1 --2- 172.21.15.87:0/3203850724 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3d9c06f400 0x7f3d9c071910 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0079c0 tx=0x7f3dac008040 comp rx=0 tx=0).stop 2024-05-27T06:29:41.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.832+0000 7f3dbf200640 1 -- 172.21.15.87:0/3203850724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3db8160010 msgr2=0x7f3db8149d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:41.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.832+0000 7f3dbf200640 1 --2- 172.21.15.87:0/3203850724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3db8160010 0x7f3db8149d10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3db4007e90 tx=0x7f3db400e4b0 comp rx=0 tx=0).stop 2024-05-27T06:29:41.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.832+0000 7f3dbf200640 1 -- 172.21.15.87:0/3203850724 shutdown_connections 2024-05-27T06:29:41.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.832+0000 7f3dbf200640 1 --2- 172.21.15.87:0/3203850724 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3d9c06f400 0x7f3d9c071910 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:41.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.832+0000 7f3dbf200640 1 --2- 172.21.15.87:0/3203850724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3db8160010 0x7f3db8149d10 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:41.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.832+0000 7f3dbf200640 1 --2- 172.21.15.87:0/3203850724 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3db8156ca0 0x7f3db814bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:41.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.832+0000 7f3dbf200640 1 --2- 172.21.15.87:0/3203850724 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3db8156890 0x7f3db814b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:41.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.832+0000 7f3dbf200640 1 -- 172.21.15.87:0/3203850724 >> 172.21.15.87:0/3203850724 conn(0x7f3db80d2610 msgr2=0x7f3db815e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:41.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.832+0000 7f3dbf200640 1 -- 172.21.15.87:0/3203850724 shutdown_connections 2024-05-27T06:29:41.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:41.832+0000 7f3dbf200640 1 -- 172.21.15.87:0/3203850724 wait complete. 2024-05-27T06:29:41.853 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T06:29:42.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.004+0000 7fbb35200640 1 Processor -- start 2024-05-27T06:29:42.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.004+0000 7fbb35200640 1 -- start start 2024-05-27T06:29:42.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.004+0000 7fbb35200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb300d1e70 0x7fbb3015d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:42.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.004+0000 7fbb35200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbb300b5540 0x7fbb300b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:42.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.004+0000 7fbb35200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb3006e160 con 0x7fbb30073b80 2024-05-27T06:29:42.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.004+0000 7fbb35200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fbb3006ed00 con 0x7fbb300b5540 2024-05-27T06:29:42.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.004+0000 7fbb35200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbb3006e3d0 con 0x7fbb300d1e70 2024-05-27T06:29:42.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.004+0000 7fbb2e800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbb300b5540 0x7fbb300b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:42.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.004+0000 7fbb25400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fbb30073b80 0x7fbb30073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:32966/0 (socket says 172.21.15.87:32966) 2024-05-27T06:29:42.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.004+0000 7fbb25400640 1 -- 172.21.15.87:0/4262242858 learned_addr learned my addr 172.21.15.87:0/4262242858 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:29:42.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.004+0000 7fbb2de00640 1 --2- 172.21.15.87:0/4262242858 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb300d1e70 0x7fbb3015d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:42.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.004+0000 7fbb2e800640 1 -- 172.21.15.87:0/4262242858 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb300d1e70 msgr2=0x7fbb3015d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:42.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.004+0000 7fbb2e800640 1 --2- 172.21.15.87:0/4262242858 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb300d1e70 0x7fbb3015d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.004+0000 7fbb2e800640 1 -- 172.21.15.87:0/4262242858 >> v1:172.21.15.87:6789/0 conn(0x7fbb30073b80 legacy=0x7fbb30073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:42.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.004+0000 7fbb2e800640 1 -- 172.21.15.87:0/4262242858 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3006e6b0 con 0x7fbb300b5540 2024-05-27T06:29:42.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.004+0000 7fbb2d400640 1 -- 172.21.15.87:0/4262242858 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3611787618 0 0) 0x7fbb3006e160 con 0x7fbb30073b80 2024-05-27T06:29:42.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.008+0000 7fbb2e800640 1 --2- 172.21.15.87:0/4262242858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb300b5540 0x7fbb300b5950 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fbb280097c0 tx=0x7fbb2801cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fcedee6eddf02d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:42.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.008+0000 7fbb2d400640 1 -- 172.21.15.87:0/4262242858 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb280b1070 con 0x7fbb300b5540 2024-05-27T06:29:42.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.008+0000 7fbb2d400640 1 -- 172.21.15.87:0/4262242858 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb280ac630 con 0x7fbb300b5540 2024-05-27T06:29:42.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.008+0000 7fbb2d400640 1 -- 172.21.15.87:0/4262242858 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb280a8050 con 0x7fbb300b5540 2024-05-27T06:29:42.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.008+0000 7fbb35200640 1 -- 172.21.15.87:0/4262242858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb300b5540 msgr2=0x7fbb300b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:42.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.008+0000 7fbb35200640 1 --2- 172.21.15.87:0/4262242858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb300b5540 0x7fbb300b5950 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fbb280097c0 tx=0x7fbb2801cf20 comp rx=0 tx=0).stop 2024-05-27T06:29:42.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.008+0000 7fbb35200640 1 -- 172.21.15.87:0/4262242858 shutdown_connections 2024-05-27T06:29:42.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.008+0000 7fbb35200640 1 --2- 172.21.15.87:0/4262242858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb300b5540 0x7fbb300b5950 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.008+0000 7fbb35200640 1 --2- 172.21.15.87:0/4262242858 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb300d1e70 0x7fbb3015d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.008+0000 7fbb35200640 1 -- 172.21.15.87:0/4262242858 >> 172.21.15.87:0/4262242858 conn(0x7fbb300700d0 msgr2=0x7fbb300704e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:42.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.008+0000 7fbb35200640 1 -- 172.21.15.87:0/4262242858 shutdown_connections 2024-05-27T06:29:42.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.008+0000 7fbb35200640 1 -- 172.21.15.87:0/4262242858 wait complete. 2024-05-27T06:29:42.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.012+0000 7fbb35200640 1 Processor -- start 2024-05-27T06:29:42.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.012+0000 7fbb35200640 1 -- start start 2024-05-27T06:29:42.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.012+0000 7fbb35200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb30073b80 0x7fbb30147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:42.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.012+0000 7fbb35200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb300b5540 0x7fbb30154e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:42.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.012+0000 7fbb35200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb300d1e70 0x7fbb300b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:42.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.012+0000 7fbb35200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbb301697e0 con 0x7fbb30073b80 2024-05-27T06:29:42.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.012+0000 7fbb35200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbb30169660 con 0x7fbb300d1e70 2024-05-27T06:29:42.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.012+0000 7fbb35200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbb30169960 con 0x7fbb300b5540 2024-05-27T06:29:42.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.012+0000 7fbb2de00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb30073b80 0x7fbb30147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:42.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.012+0000 7fbb2de00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb30073b80 0x7fbb30147ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57226/0 (socket says 172.21.15.87:57226) 2024-05-27T06:29:42.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.012+0000 7fbb2de00640 1 -- 172.21.15.87:0/1987078194 learned_addr learned my addr 172.21.15.87:0/1987078194 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:42.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.016+0000 7fbb25400640 1 --2- 172.21.15.87:0/1987078194 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb300b5540 0x7fbb30154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:42.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.016+0000 7fbb2e800640 1 --2- 172.21.15.87:0/1987078194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb300d1e70 0x7fbb300b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:42.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.016+0000 7fbb2de00640 1 -- 172.21.15.87:0/1987078194 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb300b5540 msgr2=0x7fbb30154e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:42.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.016+0000 7fbb2de00640 1 --2- 172.21.15.87:0/1987078194 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb300b5540 0x7fbb30154e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.016+0000 7fbb2de00640 1 -- 172.21.15.87:0/1987078194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb300d1e70 msgr2=0x7fbb300b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:42.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.016+0000 7fbb2de00640 1 --2- 172.21.15.87:0/1987078194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb300d1e70 0x7fbb300b3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.016+0000 7fbb2de00640 1 -- 172.21.15.87:0/1987078194 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb30155340 con 0x7fbb30073b80 2024-05-27T06:29:42.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.016+0000 7fbb2e800640 1 --2- 172.21.15.87:0/1987078194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb300d1e70 0x7fbb300b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:29:42.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.016+0000 7fbb25400640 1 --2- 172.21.15.87:0/1987078194 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb300b5540 0x7fbb30154e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:29:42.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.016+0000 7fbb2de00640 1 --2- 172.21.15.87:0/1987078194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb30073b80 0x7fbb30147ab0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fbb2000efc0 tx=0x7fbb2000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:42.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.016+0000 7fbb26a00640 1 -- 172.21.15.87:0/1987078194 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb20018020 con 0x7fbb30073b80 2024-05-27T06:29:42.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.016+0000 7fbb26a00640 1 -- 172.21.15.87:0/1987078194 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb20014480 con 0x7fbb30073b80 2024-05-27T06:29:42.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.016+0000 7fbb26a00640 1 -- 172.21.15.87:0/1987078194 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb20014850 con 0x7fbb30073b80 2024-05-27T06:29:42.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.016+0000 7fbb35200640 1 -- 172.21.15.87:0/1987078194 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb30154140 con 0x7fbb30073b80 2024-05-27T06:29:42.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.016+0000 7fbb35200640 1 -- 172.21.15.87:0/1987078194 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb30154700 con 0x7fbb30073b80 2024-05-27T06:29:42.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.016+0000 7fbb35200640 1 -- 172.21.15.87:0/1987078194 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb3006aa30 con 0x7fbb30073b80 2024-05-27T06:29:42.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.016+0000 7fbb26a00640 1 -- 172.21.15.87:0/1987078194 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbb2001b020 con 0x7fbb30073b80 2024-05-27T06:29:42.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.016+0000 7fbb26a00640 1 --2- 172.21.15.87:0/1987078194 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbb0c06f430 0x7fbb0c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:42.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.020+0000 7fbb26a00640 1 -- 172.21.15.87:0/1987078194 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fbb2008fe20 con 0x7fbb30073b80 2024-05-27T06:29:42.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.020+0000 7fbb25400640 1 --2- 172.21.15.87:0/1987078194 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbb0c06f430 0x7fbb0c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:42.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.020+0000 7fbb25400640 1 --2- 172.21.15.87:0/1987078194 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbb0c06f430 0x7fbb0c071940 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbb18000f70 tx=0x7fbb18007d10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:42.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.024+0000 7fbb26a00640 1 -- 172.21.15.87:0/1987078194 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fbb20022070 con 0x7fbb30073b80 2024-05-27T06:29:42.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.212+0000 7fbb35200640 1 -- 172.21.15.87:0/1987078194 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb3006f160 con 0x7fbb30073b80 2024-05-27T06:29:42.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.212+0000 7fbb26a00640 1 -- 172.21.15.87:0/1987078194 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5187 (secure 0 0 0) 0x7fbb20010040 con 0x7fbb30073b80 2024-05-27T06:29:42.213 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:29:42.213 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5254,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/1883124200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1883124200},{"type":"v1","addr":"172.21.15.149:6834","nonce":1883124200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3525413342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":3525413342},{"type":"v1","addr":"172.21.15.149:6835","nonce":3525413342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5373,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1517601928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1517601928},{"type":"v1","addr":"172.21.15.87:6835","nonce":1517601928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T06:29:31.715627+0000","modified":"2024-05-27T06:29:34.730216+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5382":{"gid":5382,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/3958980223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":3958980223},{"type":"v1","addr":"172.21.15.87:6837","nonce":3958980223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5382,"qdb_cluster":[5382]},"id":3}]} 2024-05-27T06:29:42.213 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 27 2024-05-27T06:29:42.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.216+0000 7fbb35200640 1 -- 172.21.15.87:0/1987078194 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbb0c06f430 msgr2=0x7fbb0c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:42.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.216+0000 7fbb35200640 1 --2- 172.21.15.87:0/1987078194 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbb0c06f430 0x7fbb0c071940 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbb18000f70 tx=0x7fbb18007d10 comp rx=0 tx=0).stop 2024-05-27T06:29:42.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.216+0000 7fbb35200640 1 -- 172.21.15.87:0/1987078194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb30073b80 msgr2=0x7fbb30147ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:42.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.216+0000 7fbb35200640 1 --2- 172.21.15.87:0/1987078194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb30073b80 0x7fbb30147ab0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fbb2000efc0 tx=0x7fbb2000c490 comp rx=0 tx=0).stop 2024-05-27T06:29:42.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.216+0000 7fbb35200640 1 -- 172.21.15.87:0/1987078194 shutdown_connections 2024-05-27T06:29:42.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.216+0000 7fbb35200640 1 --2- 172.21.15.87:0/1987078194 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbb0c06f430 0x7fbb0c071940 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.216+0000 7fbb35200640 1 --2- 172.21.15.87:0/1987078194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb300d1e70 0x7fbb300b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.216+0000 7fbb35200640 1 --2- 172.21.15.87:0/1987078194 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb300b5540 0x7fbb30154e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.216+0000 7fbb35200640 1 --2- 172.21.15.87:0/1987078194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb30073b80 0x7fbb30147ab0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.216+0000 7fbb35200640 1 -- 172.21.15.87:0/1987078194 >> 172.21.15.87:0/1987078194 conn(0x7fbb300700d0 msgr2=0x7fbb30071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:42.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.216+0000 7fbb35200640 1 -- 172.21.15.87:0/1987078194 shutdown_connections 2024-05-27T06:29:42.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.216+0000 7fbb35200640 1 -- 172.21.15.87:0/1987078194 wait complete. 2024-05-27T06:29:42.638 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-27T06:29:31.715627+0000', 'modified': '2024-05-27T06:29:34.730216+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5382}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5382': {'gid': 5382, 'name': 'a', 'rank': 0, 'incarnation': 24, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.87:6837/3958980223', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6836', 'nonce': 3958980223}, {'type': 'v1', 'addr': '172.21.15.87:6837', 'nonce': 3958980223}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5382, 'qdb_cluster': [5382]} 2024-05-27T06:29:42.638 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-27T06:29:42.638 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-27T06:29:42.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.788+0000 7fe42c400640 1 Processor -- start 2024-05-27T06:29:42.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.788+0000 7fe42c400640 1 -- start start 2024-05-27T06:29:42.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.792+0000 7fe42c400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4240aec30 0x7fe4240702b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:42.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.792+0000 7fe42c400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe42406c720 0x7fe42406cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:42.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.792+0000 7fe42c400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe42406fe20 con 0x7fe42406efc0 2024-05-27T06:29:42.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.792+0000 7fe42c400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fe4240b0ba0 con 0x7fe42406c720 2024-05-27T06:29:42.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.792+0000 7fe42c400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe42415ef50 con 0x7fe4240aec30 2024-05-27T06:29:42.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.792+0000 7fe42a400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe42406c720 0x7fe42406cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:42.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.792+0000 7fe429a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4240aec30 0x7fe4240702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:42.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.792+0000 7fe42a400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe42406c720 0x7fe42406cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:48680/0 (socket says 172.21.15.87:48680) 2024-05-27T06:29:42.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.792+0000 7fe42a400640 1 -- 172.21.15.87:0/1287363032 learned_addr learned my addr 172.21.15.87:0/1287363032 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:42.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.792+0000 7fe42a400640 1 -- 172.21.15.87:0/1287363032 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4240aec30 msgr2=0x7fe4240702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:42.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.792+0000 7fe42a400640 1 --2- 172.21.15.87:0/1287363032 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4240aec30 0x7fe4240702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.792+0000 7fe42a400640 1 -- 172.21.15.87:0/1287363032 >> v1:172.21.15.149:6789/0 conn(0x7fe42406efc0 legacy=0x7fe42406f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:42.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.792+0000 7fe42a400640 1 -- 172.21.15.87:0/1287363032 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4240b08c0 con 0x7fe42406c720 2024-05-27T06:29:42.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.792+0000 7fe429a00640 1 --2- 172.21.15.87:0/1287363032 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4240aec30 0x7fe4240702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:29:42.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.792+0000 7fe423e00640 1 -- 172.21.15.87:0/1287363032 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1609636509 0 0) 0x7fe42406fe20 con 0x7fe42406efc0 2024-05-27T06:29:42.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.796+0000 7fe42a400640 1 --2- 172.21.15.87:0/1287363032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe42406c720 0x7fe42406cb30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe41c009e50 tx=0x7fe41c01c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60b4ba4d6f94ecb2 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:42.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.796+0000 7fe423e00640 1 -- 172.21.15.87:0/1287363032 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c0a56e0 con 0x7fe42406c720 2024-05-27T06:29:42.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.796+0000 7fe423e00640 1 -- 172.21.15.87:0/1287363032 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe41c0a5880 con 0x7fe42406c720 2024-05-27T06:29:42.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.796+0000 7fe423e00640 1 -- 172.21.15.87:0/1287363032 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c0a5c50 con 0x7fe42406c720 2024-05-27T06:29:42.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.796+0000 7fe42c400640 1 -- 172.21.15.87:0/1287363032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe42406c720 msgr2=0x7fe42406cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:42.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.796+0000 7fe42c400640 1 --2- 172.21.15.87:0/1287363032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe42406c720 0x7fe42406cb30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe41c009e50 tx=0x7fe41c01c910 comp rx=0 tx=0).stop 2024-05-27T06:29:42.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.796+0000 7fe42c400640 1 -- 172.21.15.87:0/1287363032 shutdown_connections 2024-05-27T06:29:42.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.796+0000 7fe42c400640 1 --2- 172.21.15.87:0/1287363032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe42406c720 0x7fe42406cb30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.796+0000 7fe42c400640 1 --2- 172.21.15.87:0/1287363032 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4240aec30 0x7fe4240702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.796+0000 7fe42c400640 1 -- 172.21.15.87:0/1287363032 >> 172.21.15.87:0/1287363032 conn(0x7fe4240b2fb0 msgr2=0x7fe4240b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:42.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.796+0000 7fe42c400640 1 -- 172.21.15.87:0/1287363032 shutdown_connections 2024-05-27T06:29:42.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.796+0000 7fe42c400640 1 -- 172.21.15.87:0/1287363032 wait complete. 2024-05-27T06:29:42.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.800+0000 7fe42c400640 1 Processor -- start 2024-05-27T06:29:42.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.800+0000 7fe42c400640 1 -- start start 2024-05-27T06:29:42.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.800+0000 7fe42c400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe42406c720 0x7fe42413a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:42.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.800+0000 7fe42c400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe42406efc0 0x7fe424072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:42.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.800+0000 7fe42c400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4240aec30 0x7fe4241602d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:42.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.800+0000 7fe42c400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe42406e0c0 con 0x7fe42406c720 2024-05-27T06:29:42.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.800+0000 7fe42c400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe42406df40 con 0x7fe42406efc0 2024-05-27T06:29:42.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.800+0000 7fe42c400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe42406d070 con 0x7fe4240aec30 2024-05-27T06:29:42.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.800+0000 7fe429a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe42406c720 0x7fe42413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:42.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.800+0000 7fe429a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe42406c720 0x7fe42413a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57238/0 (socket says 172.21.15.87:57238) 2024-05-27T06:29:42.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.800+0000 7fe429a00640 1 -- 172.21.15.87:0/4290372463 learned_addr learned my addr 172.21.15.87:0/4290372463 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:42.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.800+0000 7fe429000640 1 --2- 172.21.15.87:0/4290372463 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe42406efc0 0x7fe424072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:42.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.800+0000 7fe42a400640 1 --2- 172.21.15.87:0/4290372463 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4240aec30 0x7fe4241602d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:42.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.800+0000 7fe429a00640 1 -- 172.21.15.87:0/4290372463 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4240aec30 msgr2=0x7fe4241602d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:42.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.800+0000 7fe429a00640 1 --2- 172.21.15.87:0/4290372463 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4240aec30 0x7fe4241602d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.800+0000 7fe429a00640 1 -- 172.21.15.87:0/4290372463 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe42406efc0 msgr2=0x7fe424072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:42.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.800+0000 7fe429a00640 1 --2- 172.21.15.87:0/4290372463 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe42406efc0 0x7fe424072a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.800+0000 7fe429a00640 1 -- 172.21.15.87:0/4290372463 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe424073350 con 0x7fe42406c720 2024-05-27T06:29:42.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.800+0000 7fe429000640 1 --2- 172.21.15.87:0/4290372463 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe42406efc0 0x7fe424072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:29:42.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.800+0000 7fe429a00640 1 --2- 172.21.15.87:0/4290372463 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe42406c720 0x7fe42413a980 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe41800e980 tx=0x7fe41800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:42.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.800+0000 7fe421600640 1 -- 172.21.15.87:0/4290372463 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418017070 con 0x7fe42406c720 2024-05-27T06:29:42.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.800+0000 7fe421600640 1 -- 172.21.15.87:0/4290372463 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe41800c9a0 con 0x7fe42406c720 2024-05-27T06:29:42.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.800+0000 7fe42c400640 1 -- 172.21.15.87:0/4290372463 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe42414fd70 con 0x7fe42406c720 2024-05-27T06:29:42.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.800+0000 7fe421600640 1 -- 172.21.15.87:0/4290372463 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41800cd70 con 0x7fe42406c720 2024-05-27T06:29:42.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.804+0000 7fe42c400640 1 -- 172.21.15.87:0/4290372463 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe424139ac0 con 0x7fe42406c720 2024-05-27T06:29:42.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.804+0000 7fe421600640 1 -- 172.21.15.87:0/4290372463 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe41801a070 con 0x7fe42406c720 2024-05-27T06:29:42.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.804+0000 7fe421600640 1 --2- 172.21.15.87:0/4290372463 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe40406f400 0x7fe404071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:42.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.808+0000 7fe421600640 1 -- 172.21.15.87:0/4290372463 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fe41808f6a0 con 0x7fe42406c720 2024-05-27T06:29:42.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.808+0000 7fe429000640 1 --2- 172.21.15.87:0/4290372463 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe40406f400 0x7fe404071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:42.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.808+0000 7fe4339b3000 1 Processor -- start 2024-05-27T06:29:42.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.808+0000 7fe4339b3000 1 -- start start 2024-05-27T06:29:42.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.808+0000 7fe429000640 1 --2- 172.21.15.87:0/4290372463 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe40406f400 0x7fe404071910 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe424154f90 tx=0x7fe410009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:42.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.808+0000 7fe4339b3000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56058815c1f0 0x5605882a5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:42.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.808+0000 7fe4339b3000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560588154f90 0x5605882a61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:42.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.808+0000 7fe4339b3000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56058813ea60 0x5605882a66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:42.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.808+0000 7fe4339b3000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5605880b86f0 con 0x56058813ea60 2024-05-27T06:29:42.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.808+0000 7fe4339b3000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5605880a8290 con 0x56058815c1f0 2024-05-27T06:29:42.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.808+0000 7fe4339b3000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x5605880ac2d0 con 0x560588154f90 2024-05-27T06:29:42.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.808+0000 7fe42a400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56058813ea60 0x5605882a66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:42.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.808+0000 7fe42a400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56058813ea60 0x5605882a66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57254/0 (socket says 172.21.15.87:57254) 2024-05-27T06:29:42.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.808+0000 7fe42a400640 1 -- 172.21.15.87:0/3924630511 learned_addr learned my addr 172.21.15.87:0/3924630511 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:42.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.808+0000 7fe429000640 1 --2- 172.21.15.87:0/3924630511 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560588154f90 0x5605882a61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:42.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.808+0000 7fe429a00640 1 --2- 172.21.15.87:0/3924630511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56058815c1f0 0x5605882a5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:42.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.808+0000 7fe42a400640 1 -- 172.21.15.87:0/3924630511 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560588154f90 msgr2=0x5605882a61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:42.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.808+0000 7fe42a400640 1 --2- 172.21.15.87:0/3924630511 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560588154f90 0x5605882a61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.808+0000 7fe42a400640 1 -- 172.21.15.87:0/3924630511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56058815c1f0 msgr2=0x5605882a5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:42.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.808+0000 7fe42a400640 1 --2- 172.21.15.87:0/3924630511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56058815c1f0 0x5605882a5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.808+0000 7fe42a400640 1 -- 172.21.15.87:0/3924630511 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560588086c10 con 0x56058813ea60 2024-05-27T06:29:42.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.808+0000 7fe42a400640 1 --2- 172.21.15.87:0/3924630511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56058813ea60 0x5605882a66e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe41c0af040 tx=0x7fe41c004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22cf610a2ece9ef server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:42.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.808+0000 7fe416000640 1 -- 172.21.15.87:0/3924630511 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c0a56e0 con 0x56058813ea60 2024-05-27T06:29:42.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.808+0000 7fe416000640 1 -- 172.21.15.87:0/3924630511 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe41c0a5880 con 0x56058813ea60 2024-05-27T06:29:42.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.808+0000 7fe416000640 1 -- 172.21.15.87:0/3924630511 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c0a5c30 con 0x56058813ea60 2024-05-27T06:29:42.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe4339b3000 1 -- 172.21.15.87:0/3924630511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56058813ea60 msgr2=0x5605882a66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:42.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe4339b3000 1 --2- 172.21.15.87:0/3924630511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56058813ea60 0x5605882a66e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe41c0af040 tx=0x7fe41c004ac0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe4339b3000 1 -- 172.21.15.87:0/3924630511 shutdown_connections 2024-05-27T06:29:42.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe4339b3000 1 --2- 172.21.15.87:0/3924630511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56058813ea60 0x5605882a66e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe4339b3000 1 --2- 172.21.15.87:0/3924630511 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560588154f90 0x5605882a61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe4339b3000 1 --2- 172.21.15.87:0/3924630511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56058815c1f0 0x5605882a5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe4339b3000 1 -- 172.21.15.87:0/3924630511 >> 172.21.15.87:0/3924630511 conn(0x560588162db0 msgr2=0x560588288c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:42.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe4339b3000 1 -- 172.21.15.87:0/3924630511 shutdown_connections 2024-05-27T06:29:42.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe4339b3000 1 -- 172.21.15.87:0/3924630511 wait complete. 2024-05-27T06:29:42.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe4339b3000 1 -- start start 2024-05-27T06:29:42.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe4339b3000 1 Processor -- start 2024-05-27T06:29:42.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe4339b3000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56058813ea60 0x5605882642d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:42.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe4339b3000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560588154f90 0x560588267640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:42.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe4339b3000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56058815c1f0 0x560588267b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:42.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe4339b3000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5605880407d0 con 0x560588154f90 2024-05-27T06:29:42.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe4339b3000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5605880b0900 con 0x56058815c1f0 2024-05-27T06:29:42.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe4339b3000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x5605880551a0 con 0x56058813ea60 2024-05-27T06:29:42.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe4339b3000 10 client.0 _ll_register_callbacks cb 0x560588247560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T06:29:42.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe429000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560588154f90 0x560588267640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:42.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe429000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560588154f90 0x560588267640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57258/0 (socket says 172.21.15.87:57258) 2024-05-27T06:29:42.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe429000640 1 -- 172.21.15.87:0/3111605792 learned_addr learned my addr 172.21.15.87:0/3111605792 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:42.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe429a00640 1 --2- 172.21.15.87:0/3111605792 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56058813ea60 0x5605882642d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:42.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe42a400640 1 --2- 172.21.15.87:0/3111605792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56058815c1f0 0x560588267b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:42.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe429000640 1 -- 172.21.15.87:0/3111605792 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56058813ea60 msgr2=0x5605882642d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:42.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe429000640 1 --2- 172.21.15.87:0/3111605792 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56058813ea60 0x5605882642d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe429000640 1 -- 172.21.15.87:0/3111605792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56058815c1f0 msgr2=0x560588267b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:42.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe429000640 1 --2- 172.21.15.87:0/3111605792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56058815c1f0 0x560588267b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe429000640 1 -- 172.21.15.87:0/3111605792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605880f09d0 con 0x560588154f90 2024-05-27T06:29:42.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.812+0000 7fe429a00640 1 --2- 172.21.15.87:0/3111605792 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56058813ea60 0x5605882642d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:29:42.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe429000640 1 --2- 172.21.15.87:0/3111605792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560588154f90 0x560588267640 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe41000ea60 tx=0x7fe410001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f7e4811d96bb8f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:42.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe40aa00640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-27T06:29:42.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe40aa00640 1 -- 172.21.15.87:0/3111605792 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe410028060 con 0x560588154f90 2024-05-27T06:29:42.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe40aa00640 1 -- 172.21.15.87:0/3111605792 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fe410010040 con 0x560588154f90 2024-05-27T06:29:42.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe4339b3000 1 -- 172.21.15.87:0/3111605792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe41c0a5880 con 0x560588154f90 2024-05-27T06:29:42.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe40aa00640 1 -- 172.21.15.87:0/3111605792 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe41000ee60 con 0x560588154f90 2024-05-27T06:29:42.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe4339b3000 10 client.5535 fetch_fsmap learned FSMap version 27 2024-05-27T06:29:42.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe4339b3000 1 -- 172.21.15.87:0/3111605792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x560588083530 con 0x560588154f90 2024-05-27T06:29:42.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe40aa00640 1 -- 172.21.15.87:0/3111605792 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe41c0a5880 con 0x560588154f90 2024-05-27T06:29:42.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe40aa00640 1 -- 172.21.15.87:0/3111605792 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 27) ==== 3494+0+0 (secure 0 0 0) 0x7fe410013420 con 0x560588154f90 2024-05-27T06:29:42.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe4339b3000 10 client.5535 fetch_fsmap finished waiting for FSMap version 27 2024-05-27T06:29:42.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe4339b3000 10 client.5535 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-27T06:29:42.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe4339b3000 20 client.5535 populate_metadata read hostname 'smithi087' 2024-05-27T06:29:42.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe4339b3000 1 --2- 172.21.15.87:0/3111605792 >> [v2:172.21.15.87:6836/3958980223,v1:172.21.15.87:6837/3958980223] conn(0x560587d507d0 0x5605882acb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:42.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe4339b3000 4 client.5535 mds_command: new command op to 5382 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T06:29:42.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe4339b3000 1 -- 172.21.15.87:0/3111605792 --> [v2:172.21.15.87:6836/3958980223,v1:172.21.15.87:6837/3958980223] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560588043be0 con 0x560587d507d0 2024-05-27T06:29:42.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe429a00640 1 --2- 172.21.15.87:0/3111605792 >> [v2:172.21.15.87:6836/3958980223,v1:172.21.15.87:6837/3958980223] conn(0x560587d507d0 0x5605882acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:42.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe429a00640 1 --2- 172.21.15.87:0/3111605792 >> [v2:172.21.15.87:6836/3958980223,v1:172.21.15.87:6837/3958980223] conn(0x560587d507d0 0x5605882acb70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c1e8822807dc270 server_cookie=6fee3ee5450f59e6 in_seq=0 out_seq=0 2024-05-27T06:29:42.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe40aa00640 10 client.5535 ms_handle_connect on v2:172.21.15.87:6836/3958980223 2024-05-27T06:29:42.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe40aa00640 1 -- 172.21.15.87:0/3111605792 <== mds.0 v2:172.21.15.87:6836/3958980223 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x560588043be0 con 0x560587d507d0 2024-05-27T06:29:42.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe40aa00640 10 client.5535 handle_command_reply: tid=0 2024-05-27T06:29:42.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe4339b3000 1 client.5535 shutdown 2024-05-27T06:29:42.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe4339b3000 1 -- 172.21.15.87:0/3111605792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560588154f90 msgr2=0x560588267640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:42.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe4339b3000 1 --2- 172.21.15.87:0/3111605792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560588154f90 0x560588267640 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe41000ea60 tx=0x7fe410001090 comp rx=0 tx=0).stop 2024-05-27T06:29:42.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe4339b3000 1 -- 172.21.15.87:0/3111605792 shutdown_connections 2024-05-27T06:29:42.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe4339b3000 1 --2- 172.21.15.87:0/3111605792 >> [v2:172.21.15.87:6836/3958980223,v1:172.21.15.87:6837/3958980223] conn(0x560587d507d0 0x5605882acb70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe4339b3000 1 --2- 172.21.15.87:0/3111605792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56058815c1f0 0x560588267b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe4339b3000 1 --2- 172.21.15.87:0/3111605792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560588154f90 0x560588267640 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe4339b3000 1 --2- 172.21.15.87:0/3111605792 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56058813ea60 0x5605882642d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe4339b3000 1 -- 172.21.15.87:0/3111605792 >> 172.21.15.87:0/3111605792 conn(0x560588162db0 msgr2=0x56058825d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:42.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe40aa00640 0 client.5535 ms_handle_reset on v2:172.21.15.87:6836/3958980223 2024-05-27T06:29:42.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe4339b3000 1 -- 172.21.15.87:0/3111605792 shutdown_connections 2024-05-27T06:29:42.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe4339b3000 1 -- 172.21.15.87:0/3111605792 wait complete. 2024-05-27T06:29:42.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.816+0000 7fe4339b3000 20 client.5535 trim_cache size 0 max 16384 2024-05-27T06:29:42.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.836+0000 7fe4339b3000 1 Processor -- start 2024-05-27T06:29:42.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.836+0000 7fe4339b3000 1 -- start start 2024-05-27T06:29:42.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.836+0000 7fe4339b3000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56058813ea60 0x5605883144d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:42.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.836+0000 7fe4339b3000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560588154f90 0x560588314a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:42.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.836+0000 7fe4339b3000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56058815c1f0 0x560588314f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:42.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.836+0000 7fe4339b3000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe424205fa0 con 0x56058813ea60 2024-05-27T06:29:42.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.836+0000 7fe4339b3000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe424205060 con 0x56058815c1f0 2024-05-27T06:29:42.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.836+0000 7fe4339b3000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe42414f810 con 0x560588154f90 2024-05-27T06:29:42.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.836+0000 7fe429a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56058813ea60 0x5605883144d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:42.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.836+0000 7fe429a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56058813ea60 0x5605883144d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57262/0 (socket says 172.21.15.87:57262) 2024-05-27T06:29:42.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.836+0000 7fe429a00640 1 -- 172.21.15.87:0/4119746363 learned_addr learned my addr 172.21.15.87:0/4119746363 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:42.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.836+0000 7fe429000640 1 --2- 172.21.15.87:0/4119746363 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560588154f90 0x560588314a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:42.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.836+0000 7fe42a400640 1 --2- 172.21.15.87:0/4119746363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56058815c1f0 0x560588314f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:42.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.836+0000 7fe429a00640 1 -- 172.21.15.87:0/4119746363 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560588154f90 msgr2=0x560588314a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:42.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.836+0000 7fe429a00640 1 --2- 172.21.15.87:0/4119746363 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560588154f90 0x560588314a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.836+0000 7fe429a00640 1 -- 172.21.15.87:0/4119746363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56058815c1f0 msgr2=0x560588314f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:42.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.836+0000 7fe429a00640 1 --2- 172.21.15.87:0/4119746363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56058815c1f0 0x560588314f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.836+0000 7fe429a00640 1 -- 172.21.15.87:0/4119746363 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560588049880 con 0x56058813ea60 2024-05-27T06:29:42.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.836+0000 7fe42a400640 1 --2- 172.21.15.87:0/4119746363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56058815c1f0 0x560588314f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:29:42.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.840+0000 7fe429a00640 1 --2- 172.21.15.87:0/4119746363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56058813ea60 0x5605883144d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe418059010 tx=0x7fe41808f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a5e97b72731cdd server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:42.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.840+0000 7fe415600640 1 -- 172.21.15.87:0/4119746363 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418079070 con 0x56058813ea60 2024-05-27T06:29:42.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.840+0000 7fe415600640 1 -- 172.21.15.87:0/4119746363 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe418009400 con 0x56058813ea60 2024-05-27T06:29:42.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.840+0000 7fe415600640 1 -- 172.21.15.87:0/4119746363 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418021040 con 0x56058813ea60 2024-05-27T06:29:42.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.840+0000 7fe4339b3000 1 -- 172.21.15.87:0/4119746363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56058813ea60 msgr2=0x5605883144d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:42.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.840+0000 7fe4339b3000 1 --2- 172.21.15.87:0/4119746363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56058813ea60 0x5605883144d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe418059010 tx=0x7fe41808f040 comp rx=0 tx=0).stop 2024-05-27T06:29:42.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.840+0000 7fe4339b3000 1 -- 172.21.15.87:0/4119746363 shutdown_connections 2024-05-27T06:29:42.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.840+0000 7fe4339b3000 1 --2- 172.21.15.87:0/4119746363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56058815c1f0 0x560588314f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.840+0000 7fe4339b3000 1 --2- 172.21.15.87:0/4119746363 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560588154f90 0x560588314a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.840+0000 7fe4339b3000 1 --2- 172.21.15.87:0/4119746363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56058813ea60 0x5605883144d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.840+0000 7fe4339b3000 1 -- 172.21.15.87:0/4119746363 >> 172.21.15.87:0/4119746363 conn(0x560588162db0 msgr2=0x560588288e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:42.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.840+0000 7fe4339b3000 1 -- 172.21.15.87:0/4119746363 shutdown_connections 2024-05-27T06:29:42.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.840+0000 7fe4339b3000 1 -- 172.21.15.87:0/4119746363 wait complete. 2024-05-27T06:29:42.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.840+0000 7fe4339b3000 1 -- start start 2024-05-27T06:29:42.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.840+0000 7fe4339b3000 1 Processor -- start 2024-05-27T06:29:42.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.840+0000 7fe4339b3000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56058813ea60 0x5605883187d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:42.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.840+0000 7fe4339b3000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560588154f90 0x560588318d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:42.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.840+0000 7fe4339b3000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56058815c1f0 0x5605882b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:42.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.840+0000 7fe4339b3000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x56058812c590 con 0x560588154f90 2024-05-27T06:29:42.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe4339b3000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56058806b650 con 0x56058815c1f0 2024-05-27T06:29:42.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe4339b3000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x5605880b74c0 con 0x56058813ea60 2024-05-27T06:29:42.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe4339b3000 10 client.0 _ll_register_callbacks cb 0x7fe4100053f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T06:29:42.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe429000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560588154f90 0x560588318d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:42.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe429000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560588154f90 0x560588318d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57276/0 (socket says 172.21.15.87:57276) 2024-05-27T06:29:42.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe429000640 1 -- 172.21.15.87:0/4051756526 learned_addr learned my addr 172.21.15.87:0/4051756526 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:42.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe42a400640 1 --2- 172.21.15.87:0/4051756526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56058815c1f0 0x5605882b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe429a00640 1 --2- 172.21.15.87:0/4051756526 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56058813ea60 0x5605883187d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe429000640 1 -- 172.21.15.87:0/4051756526 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56058813ea60 msgr2=0x5605883187d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe429000640 1 --2- 172.21.15.87:0/4051756526 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56058813ea60 0x5605883187d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe429000640 1 -- 172.21.15.87:0/4051756526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56058815c1f0 msgr2=0x5605882b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe429000640 1 --2- 172.21.15.87:0/4051756526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56058815c1f0 0x5605882b11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe429000640 1 -- 172.21.15.87:0/4051756526 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56058805fea0 con 0x560588154f90 2024-05-27T06:29:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe429000640 1 --2- 172.21.15.87:0/4051756526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560588154f90 0x560588318d10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe410003a00 tx=0x7fe410020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b342898cdf46c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe40aa00640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-27T06:29:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe40aa00640 1 -- 172.21.15.87:0/4051756526 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe410013b80 con 0x560588154f90 2024-05-27T06:29:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe40aa00640 1 -- 172.21.15.87:0/4051756526 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fe410010040 con 0x560588154f90 2024-05-27T06:29:42.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe4339b3000 1 -- 172.21.15.87:0/4051756526 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe418009400 con 0x560588154f90 2024-05-27T06:29:42.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe40aa00640 1 -- 172.21.15.87:0/4051756526 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe41003e050 con 0x560588154f90 2024-05-27T06:29:42.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe4339b3000 10 client.5541 fetch_fsmap learned FSMap version 27 2024-05-27T06:29:42.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe4339b3000 1 -- 172.21.15.87:0/4051756526 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x56058812ca20 con 0x560588154f90 2024-05-27T06:29:42.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe40aa00640 1 -- 172.21.15.87:0/4051756526 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe418009400 con 0x560588154f90 2024-05-27T06:29:42.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe40aa00640 1 -- 172.21.15.87:0/4051756526 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 27) ==== 3494+0+0 (secure 0 0 0) 0x7fe410041020 con 0x560588154f90 2024-05-27T06:29:42.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe4339b3000 10 client.5541 fetch_fsmap finished waiting for FSMap version 27 2024-05-27T06:29:42.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe4339b3000 10 client.5541 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-27T06:29:42.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe4339b3000 20 client.5541 populate_metadata read hostname 'smithi087' 2024-05-27T06:29:42.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe4339b3000 1 --2- 172.21.15.87:0/4051756526 >> [v2:172.21.15.87:6836/3958980223,v1:172.21.15.87:6837/3958980223] conn(0x560587d3e830 0x5605883216b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:42.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe4339b3000 4 client.5541 mds_command: new command op to 5382 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-27T06:29:42.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe4339b3000 1 -- 172.21.15.87:0/4051756526 --> [v2:172.21.15.87:6836/3958980223,v1:172.21.15.87:6837/3958980223] -- command(tid 0: {"prefix": "status"}) -- 0x560588047de0 con 0x560587d3e830 2024-05-27T06:29:42.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe429a00640 1 --2- 172.21.15.87:0/4051756526 >> [v2:172.21.15.87:6836/3958980223,v1:172.21.15.87:6837/3958980223] conn(0x560587d3e830 0x5605883216b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:42.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe429a00640 1 --2- 172.21.15.87:0/4051756526 >> [v2:172.21.15.87:6836/3958980223,v1:172.21.15.87:6837/3958980223] conn(0x560587d3e830 0x5605883216b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a7d40766031f4a3 server_cookie=bfdd4e75b524f5f in_seq=0 out_seq=0 2024-05-27T06:29:42.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe40aa00640 10 client.5541 ms_handle_connect on v2:172.21.15.87:6836/3958980223 2024-05-27T06:29:42.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe40aa00640 1 -- 172.21.15.87:0/4051756526 <== mds.0 v2:172.21.15.87:6836/3958980223 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x560588047de0 con 0x560587d3e830 2024-05-27T06:29:42.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe40aa00640 10 client.5541 handle_command_reply: tid=0 2024-05-27T06:29:42.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe4339b3000 1 client.5541 shutdown 2024-05-27T06:29:42.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe4339b3000 1 -- 172.21.15.87:0/4051756526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560588154f90 msgr2=0x560588318d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:42.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe4339b3000 1 --2- 172.21.15.87:0/4051756526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560588154f90 0x560588318d10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe410003a00 tx=0x7fe410020000 comp rx=0 tx=0).stop 2024-05-27T06:29:42.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe4339b3000 1 -- 172.21.15.87:0/4051756526 shutdown_connections 2024-05-27T06:29:42.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe4339b3000 1 --2- 172.21.15.87:0/4051756526 >> [v2:172.21.15.87:6836/3958980223,v1:172.21.15.87:6837/3958980223] conn(0x560587d3e830 0x5605883216b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe4339b3000 1 --2- 172.21.15.87:0/4051756526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56058815c1f0 0x5605882b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe4339b3000 1 --2- 172.21.15.87:0/4051756526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x560588154f90 0x560588318d10 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe4339b3000 1 --2- 172.21.15.87:0/4051756526 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x56058813ea60 0x5605883187d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe40aa00640 0 client.5541 ms_handle_reset on v2:172.21.15.87:6836/3958980223 2024-05-27T06:29:42.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe4339b3000 1 -- 172.21.15.87:0/4051756526 >> 172.21.15.87:0/4051756526 conn(0x560588162db0 msgr2=0x560588267020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:42.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe4339b3000 1 -- 172.21.15.87:0/4051756526 shutdown_connections 2024-05-27T06:29:42.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe4339b3000 1 -- 172.21.15.87:0/4051756526 wait complete. 2024-05-27T06:29:42.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.844+0000 7fe4339b3000 20 client.5541 trim_cache size 0 max 16384 2024-05-27T06:29:42.849 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-27T06:29:42.849 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_fsid": "0412686d-4f35-45cc-b082-ef9741c1aff5", 2024-05-27T06:29:42.849 INFO:teuthology.orchestra.run.smithi087.stdout: "whoami": 0, 2024-05-27T06:29:42.850 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 5382, 2024-05-27T06:29:42.850 INFO:teuthology.orchestra.run.smithi087.stdout: "want_state": "up:active", 2024-05-27T06:29:42.850 INFO:teuthology.orchestra.run.smithi087.stdout: "state": "up:active", 2024-05-27T06:29:42.850 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs", 2024-05-27T06:29:42.850 INFO:teuthology.orchestra.run.smithi087.stdout: "rank_uptime": 10.537938430000001, 2024-05-27T06:29:42.850 INFO:teuthology.orchestra.run.smithi087.stdout: "mdsmap_epoch": 27, 2024-05-27T06:29:42.850 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch": 54, 2024-05-27T06:29:42.850 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch_barrier": 54, 2024-05-27T06:29:42.850 INFO:teuthology.orchestra.run.smithi087.stdout: "uptime": 15.383235235000001 2024-05-27T06:29:42.850 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-27T06:29:42.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.848+0000 7fe42c400640 1 -- 172.21.15.87:0/4290372463 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe40406f400 msgr2=0x7fe404071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:42.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.848+0000 7fe42c400640 1 --2- 172.21.15.87:0/4290372463 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe40406f400 0x7fe404071910 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe424154f90 tx=0x7fe410009040 comp rx=0 tx=0).stop 2024-05-27T06:29:42.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.848+0000 7fe42c400640 1 -- 172.21.15.87:0/4290372463 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe42406c720 msgr2=0x7fe42413a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:42.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.848+0000 7fe42c400640 1 --2- 172.21.15.87:0/4290372463 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe42406c720 0x7fe42413a980 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe41800e980 tx=0x7fe41800ee40 comp rx=0 tx=0).stop 2024-05-27T06:29:42.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.848+0000 7fe42c400640 1 -- 172.21.15.87:0/4290372463 shutdown_connections 2024-05-27T06:29:42.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.848+0000 7fe42c400640 1 --2- 172.21.15.87:0/4290372463 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe40406f400 0x7fe404071910 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.848+0000 7fe42c400640 1 --2- 172.21.15.87:0/4290372463 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4240aec30 0x7fe4241602d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.848+0000 7fe42c400640 1 --2- 172.21.15.87:0/4290372463 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe42406efc0 0x7fe424072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.848+0000 7fe42c400640 1 --2- 172.21.15.87:0/4290372463 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe42406c720 0x7fe42413a980 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:42.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.848+0000 7fe42c400640 1 -- 172.21.15.87:0/4290372463 >> 172.21.15.87:0/4290372463 conn(0x7fe4240b2fb0 msgr2=0x7fe4240b26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:42.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.848+0000 7fe42c400640 1 -- 172.21.15.87:0/4290372463 shutdown_connections 2024-05-27T06:29:42.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:42.848+0000 7fe42c400640 1 -- 172.21.15.87:0/4290372463 wait complete. 2024-05-27T06:29:42.865 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-27T06:29:43.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.012+0000 7fc9cb000640 1 Processor -- start 2024-05-27T06:29:43.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.012+0000 7fc9cb000640 1 -- start start 2024-05-27T06:29:43.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9cb000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc9c415cfe0 0x7fc9c415d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:43.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9cb000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9c415d930 con 0x7fc9c40d1740 2024-05-27T06:29:43.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9cb000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9c415dbb0 con 0x7fc9c40cbf90 2024-05-27T06:29:43.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9cb000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fc9c415de90 con 0x7fc9c415cfe0 2024-05-27T06:29:43.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9c9000640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fc9c40d1740 0x7fc9c40d1b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:32970/0 (socket says 172.21.15.87:32970) 2024-05-27T06:29:43.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9c9000640 1 -- 172.21.15.87:0/999300698 learned_addr learned my addr 172.21.15.87:0/999300698 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:29:43.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9bb400640 1 --2- 172.21.15.87:0/999300698 >> v2:172.21.15.149:3300/0 conn(0x7fc9c415cfe0 0x7fc9c415d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:43.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9c3400640 1 -- 172.21.15.87:0/999300698 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1551667984 0 0) 0x7fc9bc001120 con 0x7fc9c40d1740 2024-05-27T06:29:43.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9c3400640 1 -- 172.21.15.87:0/999300698 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9a8003530 con 0x7fc9c40d1740 2024-05-27T06:29:43.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9c3400640 1 -- 172.21.15.87:0/999300698 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1123681754 0 0) 0x7fc9a8003530 con 0x7fc9c40d1740 2024-05-27T06:29:43.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9c3400640 1 -- 172.21.15.87:0/999300698 >> v2:172.21.15.149:3300/0 conn(0x7fc9c415cfe0 msgr2=0x7fc9c415d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:43.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9c3400640 1 --2- 172.21.15.87:0/999300698 >> v2:172.21.15.149:3300/0 conn(0x7fc9c415cfe0 0x7fc9c415d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:43.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9c3400640 1 -- 172.21.15.87:0/999300698 >> v1:172.21.15.149:6789/0 conn(0x7fc9c40cbf90 legacy=0x7fc9c406cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:43.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9c3400640 1 -- 172.21.15.87:0/999300698 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c406c7c0 con 0x7fc9c40d1740 2024-05-27T06:29:43.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9c3400640 1 -- 172.21.15.87:0/999300698 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7fc9bc0018f0 con 0x7fc9c40d1740 2024-05-27T06:29:43.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9c3400640 1 -- 172.21.15.87:0/999300698 >> v1:172.21.15.87:6789/0 conn(0x7fc9c40d1740 legacy=0x7fc9c40d1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:43.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9c3400640 1 --2- 172.21.15.87:0/999300698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a8003ad0 0x7fc9a8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:43.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9c3400640 1 --2- 172.21.15.87:0/999300698 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9a8004810 0x7fc9a8004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:43.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9c3400640 1 --2- 172.21.15.87:0/999300698 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9a8005360 0x7fc9a800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:43.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9c3400640 1 -- 172.21.15.87:0/999300698 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c415de90 con 0x7fc9a8003ad0 2024-05-27T06:29:43.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9c3400640 1 -- 172.21.15.87:0/999300698 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a800c250 con 0x7fc9a8004810 2024-05-27T06:29:43.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9c3400640 1 -- 172.21.15.87:0/999300698 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc9a800c450 con 0x7fc9a8005360 2024-05-27T06:29:43.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9c3e00640 1 --2- 172.21.15.87:0/999300698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a8003ad0 0x7fc9a8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:43.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9c9000640 1 --2- 172.21.15.87:0/999300698 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9a8005360 0x7fc9a800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:43.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9bb400640 1 --2- 172.21.15.87:0/999300698 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9a8004810 0x7fc9a8004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:43.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9c3e00640 1 -- 172.21.15.87:0/999300698 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9a8005360 msgr2=0x7fc9a800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:43.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9c3e00640 1 --2- 172.21.15.87:0/999300698 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9a8005360 0x7fc9a800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:43.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9c3e00640 1 -- 172.21.15.87:0/999300698 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9a8004810 msgr2=0x7fc9a8004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:43.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9c3e00640 1 --2- 172.21.15.87:0/999300698 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9a8004810 0x7fc9a8004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:43.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9c3e00640 1 -- 172.21.15.87:0/999300698 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a8003530 con 0x7fc9a8003ad0 2024-05-27T06:29:43.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9c9000640 1 --2- 172.21.15.87:0/999300698 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9a8005360 0x7fc9a800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:29:43.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9bb400640 1 --2- 172.21.15.87:0/999300698 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9a8004810 0x7fc9a8004c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:29:43.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.016+0000 7fc9c9000640 1 -- 172.21.15.87:0/999300698 reap_dead start 2024-05-27T06:29:43.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.020+0000 7fc9c3e00640 1 --2- 172.21.15.87:0/999300698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a8003ad0 0x7fc9a8003f40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4001790 tx=0x7fc9b401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a00f97883f22940 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:43.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.020+0000 7fc9c3400640 1 -- 172.21.15.87:0/999300698 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b40013e0 con 0x7fc9a8003ad0 2024-05-27T06:29:43.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.020+0000 7fc9c3400640 1 -- 172.21.15.87:0/999300698 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b40052d0 con 0x7fc9a8003ad0 2024-05-27T06:29:43.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.020+0000 7fc9c3400640 1 -- 172.21.15.87:0/999300698 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4003840 con 0x7fc9a8003ad0 2024-05-27T06:29:43.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.020+0000 7fc9cb000640 1 -- 172.21.15.87:0/999300698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a8003ad0 msgr2=0x7fc9a8003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:43.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.020+0000 7fc9cb000640 1 --2- 172.21.15.87:0/999300698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a8003ad0 0x7fc9a8003f40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4001790 tx=0x7fc9b401c390 comp rx=0 tx=0).stop 2024-05-27T06:29:43.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.020+0000 7fc9cb000640 1 -- 172.21.15.87:0/999300698 shutdown_connections 2024-05-27T06:29:43.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.020+0000 7fc9cb000640 1 --2- 172.21.15.87:0/999300698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a8003ad0 0x7fc9a8003f40 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:43.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.020+0000 7fc9cb000640 1 -- 172.21.15.87:0/999300698 >> 172.21.15.87:0/999300698 conn(0x7fc9c40b46b0 msgr2=0x7fc9c40b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:43.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.020+0000 7fc9cb000640 1 -- 172.21.15.87:0/999300698 shutdown_connections 2024-05-27T06:29:43.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.020+0000 7fc9cb000640 1 -- 172.21.15.87:0/999300698 wait complete. 2024-05-27T06:29:43.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.024+0000 7fc9cb000640 1 Processor -- start 2024-05-27T06:29:43.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.024+0000 7fc9cb000640 1 -- start start 2024-05-27T06:29:43.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.024+0000 7fc9cb000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a8003ad0 0x7fc9c41f6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:43.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.024+0000 7fc9cb000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9c40caa80 0x7fc9c40cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:43.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.024+0000 7fc9cb000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9c41fa2d0 0x7fc9c41fa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:43.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.024+0000 7fc9cb000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c40cc3a0 con 0x7fc9a8003ad0 2024-05-27T06:29:43.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.024+0000 7fc9cb000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c415e170 con 0x7fc9c40caa80 2024-05-27T06:29:43.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.024+0000 7fc9cb000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc9c406ec50 con 0x7fc9c41fa2d0 2024-05-27T06:29:43.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.024+0000 7fc9c3e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a8003ad0 0x7fc9c41f6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:43.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.024+0000 7fc9c3e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a8003ad0 0x7fc9c41f6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57302/0 (socket says 172.21.15.87:57302) 2024-05-27T06:29:43.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.024+0000 7fc9c3e00640 1 -- 172.21.15.87:0/3617962728 learned_addr learned my addr 172.21.15.87:0/3617962728 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:43.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.024+0000 7fc9c3e00640 1 -- 172.21.15.87:0/3617962728 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9c41fa2d0 msgr2=0x7fc9c41fa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:43.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.024+0000 7fc9c3e00640 1 --2- 172.21.15.87:0/3617962728 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9c41fa2d0 0x7fc9c41fa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:43.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.024+0000 7fc9c3e00640 1 -- 172.21.15.87:0/3617962728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9c40caa80 msgr2=0x7fc9c40cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:43.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.024+0000 7fc9bb400640 1 --2- 172.21.15.87:0/3617962728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9c40caa80 0x7fc9c40cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:43.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.024+0000 7fc9c3e00640 1 --2- 172.21.15.87:0/3617962728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9c40caa80 0x7fc9c40cae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:43.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.024+0000 7fc9c3e00640 1 -- 172.21.15.87:0/3617962728 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c41fac20 con 0x7fc9a8003ad0 2024-05-27T06:29:43.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.024+0000 7fc9c3e00640 1 --2- 172.21.15.87:0/3617962728 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a8003ad0 0x7fc9c41f6750 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40ad040 tx=0x7fc9a8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:43.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.024+0000 7fc9c0c00640 1 -- 172.21.15.87:0/3617962728 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b40013c0 con 0x7fc9a8003ad0 2024-05-27T06:29:43.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.028+0000 7fc9c0c00640 1 -- 172.21.15.87:0/3617962728 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b40ba070 con 0x7fc9a8003ad0 2024-05-27T06:29:43.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.028+0000 7fc9cb000640 1 -- 172.21.15.87:0/3617962728 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c409cba0 con 0x7fc9a8003ad0 2024-05-27T06:29:43.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.028+0000 7fc9c0c00640 1 -- 172.21.15.87:0/3617962728 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b40069e0 con 0x7fc9a8003ad0 2024-05-27T06:29:43.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.028+0000 7fc9cb000640 1 -- 172.21.15.87:0/3617962728 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c409c8c0 con 0x7fc9a8003ad0 2024-05-27T06:29:43.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.028+0000 7fc9cb000640 1 -- 172.21.15.87:0/3617962728 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9c406aa30 con 0x7fc9a8003ad0 2024-05-27T06:29:43.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.028+0000 7fc9c0c00640 1 -- 172.21.15.87:0/3617962728 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc9b4005270 con 0x7fc9a8003ad0 2024-05-27T06:29:43.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.028+0000 7fc9c0c00640 1 --2- 172.21.15.87:0/3617962728 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc9a006f400 0x7fc9a0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:43.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.028+0000 7fc9c0c00640 1 -- 172.21.15.87:0/3617962728 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fc9b41296b0 con 0x7fc9a8003ad0 2024-05-27T06:29:43.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.028+0000 7fc9bb400640 1 --2- 172.21.15.87:0/3617962728 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc9a006f400 0x7fc9a0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:43.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.032+0000 7fc9bb400640 1 --2- 172.21.15.87:0/3617962728 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc9a006f400 0x7fc9a0071910 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009670 tx=0x7fc9ac00b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:43.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.032+0000 7fc9c0c00640 1 -- 172.21.15.87:0/3617962728 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fc9c41fac20 con 0x7fc9a8003ad0 2024-05-27T06:29:43.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.228+0000 7fc9cb000640 1 -- 172.21.15.87:0/3617962728 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc9c40b27b0 con 0x7fc9a8003ad0 2024-05-27T06:29:43.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.228+0000 7fc9c0c00640 1 -- 172.21.15.87:0/3617962728 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7fc9b40160f0 con 0x7fc9a8003ad0 2024-05-27T06:29:43.227 INFO:teuthology.orchestra.run.smithi087.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-27T06:29:43.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.228+0000 7fc9cb000640 1 -- 172.21.15.87:0/3617962728 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc9a006f400 msgr2=0x7fc9a0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:43.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.228+0000 7fc9cb000640 1 --2- 172.21.15.87:0/3617962728 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc9a006f400 0x7fc9a0071910 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009670 tx=0x7fc9ac00b040 comp rx=0 tx=0).stop 2024-05-27T06:29:43.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.228+0000 7fc9cb000640 1 -- 172.21.15.87:0/3617962728 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a8003ad0 msgr2=0x7fc9c41f6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:43.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.228+0000 7fc9cb000640 1 --2- 172.21.15.87:0/3617962728 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a8003ad0 0x7fc9c41f6750 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40ad040 tx=0x7fc9a8005840 comp rx=0 tx=0).stop 2024-05-27T06:29:43.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.228+0000 7fc9cb000640 1 -- 172.21.15.87:0/3617962728 shutdown_connections 2024-05-27T06:29:43.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.228+0000 7fc9cb000640 1 --2- 172.21.15.87:0/3617962728 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc9a006f400 0x7fc9a0071910 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:43.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.228+0000 7fc9cb000640 1 --2- 172.21.15.87:0/3617962728 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9c41fa2d0 0x7fc9c41fa6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:43.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.228+0000 7fc9cb000640 1 --2- 172.21.15.87:0/3617962728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9c40caa80 0x7fc9c40cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:43.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.228+0000 7fc9cb000640 1 --2- 172.21.15.87:0/3617962728 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9a8003ad0 0x7fc9c41f6750 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:43.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.228+0000 7fc9cb000640 1 -- 172.21.15.87:0/3617962728 >> 172.21.15.87:0/3617962728 conn(0x7fc9c40b46b0 msgr2=0x7fc9c40cc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:43.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.228+0000 7fc9cb000640 1 -- 172.21.15.87:0/3617962728 shutdown_connections 2024-05-27T06:29:43.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43.228+0000 7fc9cb000640 1 -- 172.21.15.87:0/3617962728 wait complete. 2024-05-27T06:29:43.248 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-27T06:29:43.248 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-27T06:29:43.248 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-05-27T06:29:43.248 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-27T06:29:43.248 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-27T06:29:43.248 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-27T06:29:43.248 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-27T06:29:43.249 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-27T06:29:43.249 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-27T06:29:43.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:43.249 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-05-27T06:29:43.258 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T06:29:43.258 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T06:29:43.258 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T06:29:43.258 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:29:43.258 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-05-27T06:29:43.259 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:29:43.259 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:29:43.259 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-05-27T06:29:43.259 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-05-27T06:29:43.259 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:29:43.259 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-05-27T06:29:43.259 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-05-27T06:29:43.259 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:29:43.259 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:29:43.259 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-27T06:29:43.259 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:29:43.259 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-27T06:29:43.260 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42358sec preferred_lft 42358sec 2024-05-27T06:29:43.260 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-05-27T06:29:43.260 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:29:43.260 INFO:teuthology.orchestra.run.smithi087.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-27T06:29:43.260 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 02:42:75:41:48:14 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:29:43.260 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-27T06:29:43.260 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:29:43.260 INFO:teuthology.orchestra.run.smithi087.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-27T06:29:43.260 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-27T06:29:43.260 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-27T06:29:43.260 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:29:43.260 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-27T06:29:43.260 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:29:43.261 INFO:teuthology.orchestra.run.smithi087.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-27T06:29:43.261 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:29:43.261 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-27T06:29:43.261 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:29:43.261 INFO:teuthology.orchestra.run.smithi087.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-27T06:29:43.261 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:29:43.261 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-05-27T06:29:43.261 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:29:43.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:43.261 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-27T06:29:43.322 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-05-27T06:29:43.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:43.325 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-05-27T06:29:43.380 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-05-27T06:29:43.380 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-27T06:29:43.380 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-27T06:29:43.380 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-27T06:29:43.380 INFO:teuthology.orchestra.run.smithi087.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-27T06:29:43.380 INFO:teuthology.orchestra.run.smithi087.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-27T06:29:43.380 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-27T06:29:43.380 INFO:teuthology.orchestra.run.smithi087.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:29:43.380 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:29:43.381 INFO:teuthology.orchestra.run.smithi087.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:29:43.381 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-27T06:29:43.381 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:29:43.381 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-27T06:29:43.381 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-27T06:29:43.381 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-27T06:29:43.381 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-27T06:29:43.381 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-27T06:29:43.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:29:43.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:29:43.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:43.518 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-05-27T06:29:43.526 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-27T06:29:43.527 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-27T06:29:43.527 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-27T06:29:43.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:43.528 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-05-27T06:29:43.588 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-27T06:29:43.588 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T06:29:43.588 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-27T06:29:43.636 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-27T06:29:43.637 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T06:29:43.637 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-27T06:29:43.684 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-05-27T06:29:43.744 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T06:29:43.798 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-05-27T06:29:43.798 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-05-27T06:29:43.798 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-05-27T06:29:43.798 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-05-27T06:29:43.798 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-05-27T06:29:43.798 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-05-27T06:29:43.798 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-05-27T06:29:43.798 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-05-27T06:29:43.798 INFO:teuthology.orchestra.run.smithi087.stdout:/run/lock 2024-05-27T06:29:43.798 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-05-27T06:29:43.798 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-05-27T06:29:43.799 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-05-27T06:29:43.799 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T06:29:43.799 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-05-27T06:29:43.799 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-05-27T06:29:43.799 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-05-27T06:29:43.799 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-05-27T06:29:43.799 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/fs/nfsd 2024-05-27T06:29:43.799 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-05-27T06:29:43.799 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-05-27T06:29:43.799 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysusers.service 2024-05-27T06:29:43.799 INFO:teuthology.orchestra.run.smithi087.stdout:/run/rpc_pipefs 2024-05-27T06:29:43.799 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-05-27T06:29:43.799 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-05-27T06:29:43.800 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2024-05-27T06:29:43.800 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2024-05-27T06:29:43.800 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2024-05-27T06:29:43.800 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2024-05-27T06:29:43.800 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-05-27T06:29:43.800 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:29:43.800 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:29:43.800 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:29:43.800 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:29:43.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:43.801 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-05-27T06:29:43.856 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-27T06:29:43.857 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-27T06:29:43.903 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-05-27T06:29:43.924 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T06:29:43.974 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-05-27T06:29:43.974 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-05-27T06:29:43.974 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-05-27T06:29:43.974 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-05-27T06:29:43.974 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-05-27T06:29:43.974 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-05-27T06:29:43.975 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-05-27T06:29:43.975 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-05-27T06:29:43.975 INFO:teuthology.orchestra.run.smithi087.stdout:/run/lock 2024-05-27T06:29:43.975 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-05-27T06:29:43.975 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-05-27T06:29:43.975 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-05-27T06:29:43.975 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T06:29:43.975 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-05-27T06:29:43.975 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-05-27T06:29:43.975 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-05-27T06:29:43.975 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-05-27T06:29:43.975 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/fs/nfsd 2024-05-27T06:29:43.975 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-05-27T06:29:43.976 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-05-27T06:29:43.976 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysusers.service 2024-05-27T06:29:43.976 INFO:teuthology.orchestra.run.smithi087.stdout:/run/rpc_pipefs 2024-05-27T06:29:43.976 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-05-27T06:29:43.976 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-05-27T06:29:43.976 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2024-05-27T06:29:43.976 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2024-05-27T06:29:43.976 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2024-05-27T06:29:43.976 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2024-05-27T06:29:43.976 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-05-27T06:29:43.976 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:29:43.976 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:29:43.977 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:29:43.977 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:29:43.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:43.978 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-05-27T06:29:44.008 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:2024-05-27T06:29:44.008+0000 7f617fc2a580 -1 init, newargv = 0x7f616801b580 newargc=15 2024-05-27T06:29:44.008 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[39157]: starting ceph client 2024-05-27T06:29:44.015 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[39157]: starting fuse 2024-05-27T06:29:44.017 INFO:teuthology.orchestra.run.smithi087.stdout:44 2024-05-27T06:29:44.017 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-05-27T06:29:44.018 DEBUG:teuthology.orchestra.run.smithi087:> sudo stdin-killer -- python3 -c ' 2024-05-27T06:29:44.018 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-05-27T06:29:44.018 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-05-27T06:29:44.018 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-05-27T06:29:44.018 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-05-27T06:29:44.018 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:29:44.018 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-05-27T06:29:44.018 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-27T06:29:44.018 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-05-27T06:29:44.018 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-27T06:29:44.018 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:29:44.019 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-05-27T06:29:44.019 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-05-27T06:29:44.019 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-05-27T06:29:44.019 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-05-27T06:29:44.019 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:29:44.019 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-05-27T06:29:44.019 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-27T06:29:44.019 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-27T06:29:44.019 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-27T06:29:44.019 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-05-27T06:29:44.019 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-05-27T06:29:44.019 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-05-27T06:29:44.019 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-27T06:29:44.020 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:29:44.020 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.0")) 2024-05-27T06:29:44.020 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-05-27T06:29:44.141 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.0.39157.asok 2024-05-27T06:29:44.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:29:44.152 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.39157.asok 2024-05-27T06:29:44.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:44.152 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.39157.asok status 2024-05-27T06:29:44.333 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-27T06:29:44.333 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-05-27T06:29:44.333 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "38f9d900c83c63799fbdbe61acc9a11b0d3554a6", 2024-05-27T06:29:44.333 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 19.0.0-3872-g38f9d900 (38f9d900c83c63799fbdbe61acc9a11b0d3554a6) squid (dev)", 2024-05-27T06:29:44.334 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "0", 2024-05-27T06:29:44.334 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-05-27T06:29:44.334 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-27T06:29:44.334 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "39157", 2024-05-27T06:29:44.334 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-05-27T06:29:44.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:44.334 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-05-27T06:29:44.334 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-05-27T06:29:44.334 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 5553, 2024-05-27T06:29:44.334 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-05-27T06:29:44.334 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-05-27T06:29:44.334 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-05-27T06:29:44.334 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 5553 2024-05-27T06:29:44.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:44.335 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-05-27T06:29:44.335 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-05-27T06:29:44.335 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-05-27T06:29:44.335 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2488525283 2024-05-27T06:29:44.335 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:29:44.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:44.335 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-05-27T06:29:44.335 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-05-27T06:29:44.335 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-05-27T06:29:44.335 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2488525283 2024-05-27T06:29:44.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:44.335 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.5553 192.168.0.1:0/2488525283", 2024-05-27T06:29:44.335 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/2488525283", 2024-05-27T06:29:44.335 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-05-27T06:29:44.336 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 27, 2024-05-27T06:29:44.336 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 54, 2024-05-27T06:29:44.336 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-05-27T06:29:44.336 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-05-27T06:29:44.336 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-05-27T06:29:44.336 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-27T06:29:44.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:44.349 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-05-27T06:29:44.349 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-27T06:29:44.358 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-05-27T06:29:44.359 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-27T06:29:44.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:44.359 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-27T06:29:44.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:44.420 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch test_file) 2024-05-27T06:29:44.477 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow r pool=cephfs_data' 2024-05-27T06:29:44.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.680+0000 7fa8a6000640 1 Processor -- start 2024-05-27T06:29:44.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.680+0000 7fa8a6000640 1 -- start start 2024-05-27T06:29:44.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa8a6000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa8a01610c0 0x7fa8a00d02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:44.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa8a6000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8a00d1e10 0x7fa8a006eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:44.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa8a6000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8a00d1130 con 0x7fa8a00d0810 2024-05-27T06:29:44.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa8a6000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fa8a00d0c20 con 0x7fa8a01610c0 2024-05-27T06:29:44.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa8a6000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa8a00d0e50 con 0x7fa8a00d1e10 2024-05-27T06:29:44.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa896a00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fa8a00d0810 0x7fa8a00d1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:32980/0 (socket says 172.21.15.87:32980) 2024-05-27T06:29:44.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa896a00640 1 -- 172.21.15.87:0/1630489977 learned_addr learned my addr 172.21.15.87:0/1630489977 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:29:44.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa89fe00640 1 --2- 172.21.15.87:0/1630489977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8a00d1e10 0x7fa8a006eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:44.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa89f400640 1 --2- 172.21.15.87:0/1630489977 >> v2:172.21.15.149:3300/0 conn(0x7fa8a01610c0 0x7fa8a00d02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:44.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa89ea00640 1 -- 172.21.15.87:0/1630489977 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 44656647 0 0) 0x7fa8a00d1130 con 0x7fa8a00d0810 2024-05-27T06:29:44.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa89ea00640 1 -- 172.21.15.87:0/1630489977 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa884003530 con 0x7fa8a00d0810 2024-05-27T06:29:44.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa89ea00640 1 -- 172.21.15.87:0/1630489977 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3684501432 0 0) 0x7fa884003530 con 0x7fa8a00d0810 2024-05-27T06:29:44.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa89ea00640 1 -- 172.21.15.87:0/1630489977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8a00d1e10 msgr2=0x7fa8a006eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:44.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa89ea00640 1 --2- 172.21.15.87:0/1630489977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8a00d1e10 0x7fa8a006eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:44.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa89ea00640 1 -- 172.21.15.87:0/1630489977 >> v2:172.21.15.149:3300/0 conn(0x7fa8a01610c0 msgr2=0x7fa8a00d02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:44.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa89ea00640 1 --2- 172.21.15.87:0/1630489977 >> v2:172.21.15.149:3300/0 conn(0x7fa8a01610c0 0x7fa8a00d02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:44.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa89ea00640 1 -- 172.21.15.87:0/1630489977 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8a0161a00 con 0x7fa8a00d0810 2024-05-27T06:29:44.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa89ea00640 1 -- 172.21.15.87:0/1630489977 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7fa888001700 con 0x7fa8a00d0810 2024-05-27T06:29:44.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa89ea00640 1 -- 172.21.15.87:0/1630489977 >> v1:172.21.15.87:6789/0 conn(0x7fa8a00d0810 legacy=0x7fa8a00d1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:44.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa89ea00640 1 --2- 172.21.15.87:0/1630489977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa884003a10 0x7fa884003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:44.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa89ea00640 1 --2- 172.21.15.87:0/1630489977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa884004810 0x7fa884004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:44.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa89ea00640 1 --2- 172.21.15.87:0/1630489977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa884005160 0x7fa88400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:44.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa89ea00640 1 -- 172.21.15.87:0/1630489977 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a00d0e50 con 0x7fa884003a10 2024-05-27T06:29:44.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa89ea00640 1 -- 172.21.15.87:0/1630489977 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa88400bf10 con 0x7fa884005160 2024-05-27T06:29:44.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa89ea00640 1 -- 172.21.15.87:0/1630489977 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa88400c090 con 0x7fa884004810 2024-05-27T06:29:44.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa89f400640 1 --2- 172.21.15.87:0/1630489977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa884003a10 0x7fa884003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:44.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa896a00640 1 --2- 172.21.15.87:0/1630489977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa884004810 0x7fa884004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:44.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa89fe00640 1 --2- 172.21.15.87:0/1630489977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa884005160 0x7fa88400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:44.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa89f400640 1 -- 172.21.15.87:0/1630489977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa884004810 msgr2=0x7fa884004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:44.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa89f400640 1 --2- 172.21.15.87:0/1630489977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa884004810 0x7fa884004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:44.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa89f400640 1 -- 172.21.15.87:0/1630489977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa884005160 msgr2=0x7fa88400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:44.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa89f400640 1 --2- 172.21.15.87:0/1630489977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa884005160 0x7fa88400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:44.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.684+0000 7fa89f400640 1 -- 172.21.15.87:0/1630489977 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa884003530 con 0x7fa884003a10 2024-05-27T06:29:44.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.688+0000 7fa89f400640 1 --2- 172.21.15.87:0/1630489977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa884003a10 0x7fa884003e80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa890009ab0 tx=0x7fa89001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2bce1f5b23ffb1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:44.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.688+0000 7fa89ea00640 1 -- 172.21.15.87:0/1630489977 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8900b2070 con 0x7fa884003a10 2024-05-27T06:29:44.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.688+0000 7fa89ea00640 1 -- 172.21.15.87:0/1630489977 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8900a5660 con 0x7fa884003a10 2024-05-27T06:29:44.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.688+0000 7fa89ea00640 1 -- 172.21.15.87:0/1630489977 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8900096b0 con 0x7fa884003a10 2024-05-27T06:29:44.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.688+0000 7fa8a6000640 1 -- 172.21.15.87:0/1630489977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa884003a10 msgr2=0x7fa884003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:44.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.688+0000 7fa8a6000640 1 --2- 172.21.15.87:0/1630489977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa884003a10 0x7fa884003e80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa890009ab0 tx=0x7fa89001ca30 comp rx=0 tx=0).stop 2024-05-27T06:29:44.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.688+0000 7fa89fe00640 1 -- 172.21.15.87:0/1630489977 reap_dead start 2024-05-27T06:29:44.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.688+0000 7fa8a6000640 1 -- 172.21.15.87:0/1630489977 shutdown_connections 2024-05-27T06:29:44.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.688+0000 7fa8a6000640 1 -- 172.21.15.87:0/1630489977 >> 172.21.15.87:0/1630489977 conn(0x7fa8a00b46b0 msgr2=0x7fa8a00b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:44.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.688+0000 7fa8a6000640 1 -- 172.21.15.87:0/1630489977 shutdown_connections 2024-05-27T06:29:44.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.688+0000 7fa8a6000640 1 -- 172.21.15.87:0/1630489977 wait complete. 2024-05-27T06:29:44.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.692+0000 7fa8a6000640 1 Processor -- start 2024-05-27T06:29:44.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.692+0000 7fa8a6000640 1 -- start start 2024-05-27T06:29:44.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.692+0000 7fa8a6000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa884003a10 0x7fa8a00cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:44.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.692+0000 7fa8a6000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8a01fc170 0x7fa8a00afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:44.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.692+0000 7fa8a6000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a01fc580 0x7fa8a00b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:44.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.692+0000 7fa8a6000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a0161650 con 0x7fa884003a10 2024-05-27T06:29:44.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.692+0000 7fa8a6000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a01614d0 con 0x7fa8a01fc580 2024-05-27T06:29:44.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.692+0000 7fa8a6000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa8a00d1e10 con 0x7fa8a01fc170 2024-05-27T06:29:44.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.692+0000 7fa89f400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa884003a10 0x7fa8a00cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:44.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.692+0000 7fa89f400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa884003a10 0x7fa8a00cc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57330/0 (socket says 172.21.15.87:57330) 2024-05-27T06:29:44.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.692+0000 7fa89f400640 1 -- 172.21.15.87:0/1026320896 learned_addr learned my addr 172.21.15.87:0/1026320896 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:44.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.692+0000 7fa89f400640 1 -- 172.21.15.87:0/1026320896 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8a01fc170 msgr2=0x7fa8a00afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:44.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.692+0000 7fa89f400640 1 --2- 172.21.15.87:0/1026320896 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8a01fc170 0x7fa8a00afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:44.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.692+0000 7fa89f400640 1 -- 172.21.15.87:0/1026320896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a01fc580 msgr2=0x7fa8a00b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:44.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.692+0000 7fa89f400640 1 --2- 172.21.15.87:0/1026320896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a01fc580 0x7fa8a00b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:44.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.692+0000 7fa89f400640 1 -- 172.21.15.87:0/1026320896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8a00cc930 con 0x7fa884003a10 2024-05-27T06:29:44.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.692+0000 7fa89f400640 1 --2- 172.21.15.87:0/1026320896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa884003a10 0x7fa8a00cc3f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa89001d2d0 tx=0x7fa884005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:44.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.692+0000 7fa897e00640 1 -- 172.21.15.87:0/1026320896 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8900be070 con 0x7fa884003a10 2024-05-27T06:29:44.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.692+0000 7fa897e00640 1 -- 172.21.15.87:0/1026320896 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8900ad440 con 0x7fa884003a10 2024-05-27T06:29:44.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.692+0000 7fa897e00640 1 -- 172.21.15.87:0/1026320896 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8900b2040 con 0x7fa884003a10 2024-05-27T06:29:44.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.692+0000 7fa8a6000640 1 -- 172.21.15.87:0/1026320896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8a00ccdb0 con 0x7fa884003a10 2024-05-27T06:29:44.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.692+0000 7fa8a6000640 1 -- 172.21.15.87:0/1026320896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8a00cd370 con 0x7fa884003a10 2024-05-27T06:29:44.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.696+0000 7fa8a6000640 1 -- 172.21.15.87:0/1026320896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8a006aa30 con 0x7fa884003a10 2024-05-27T06:29:44.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.696+0000 7fa897e00640 1 -- 172.21.15.87:0/1026320896 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa8900c1070 con 0x7fa884003a10 2024-05-27T06:29:44.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.696+0000 7fa897e00640 1 --2- 172.21.15.87:0/1026320896 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa87c06f400 0x7fa87c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:44.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.696+0000 7fa897e00640 1 -- 172.21.15.87:0/1026320896 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fa890128ee0 con 0x7fa884003a10 2024-05-27T06:29:44.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.696+0000 7fa896a00640 1 --2- 172.21.15.87:0/1026320896 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa87c06f400 0x7fa87c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:44.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.696+0000 7fa896a00640 1 --2- 172.21.15.87:0/1026320896 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa87c06f400 0x7fa87c071910 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa888000f70 tx=0x7fa888000ee0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:44.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.700+0000 7fa897e00640 1 -- 172.21.15.87:0/1026320896 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa8900167a0 con 0x7fa884003a10 2024-05-27T06:29:44.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.912+0000 7fa8a6000640 1 -- 172.21.15.87:0/1026320896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]} v 0) -- 0x7fa8a0070de0 con 0x7fa884003a10 2024-05-27T06:29:44.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.916+0000 7fa897e00640 1 -- 172.21.15.87:0/1026320896 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]}]=0 updated caps for client.0 v18) ==== 183+0+140 (secure 0 0 0) 0x7fa8900f5660 con 0x7fa884003a10 2024-05-27T06:29:44.916 INFO:teuthology.orchestra.run.smithi087.stdout:[client.0] 2024-05-27T06:29:44.916 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCfJ1RmAld8BxAAigqU2F3mGXtAfw0L9Bfp2A== 2024-05-27T06:29:44.916 INFO:teuthology.orchestra.run.smithi087.stdout: caps mds = "allow" 2024-05-27T06:29:44.916 INFO:teuthology.orchestra.run.smithi087.stdout: caps mon = "allow r" 2024-05-27T06:29:44.916 INFO:teuthology.orchestra.run.smithi087.stdout: caps osd = "allow r pool=cephfs_data" 2024-05-27T06:29:44.916 INFO:teuthology.orchestra.run.smithi087.stderr:updated caps for client.0 2024-05-27T06:29:44.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.920+0000 7fa8a6000640 1 -- 172.21.15.87:0/1026320896 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa87c06f400 msgr2=0x7fa87c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:44.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.920+0000 7fa8a6000640 1 --2- 172.21.15.87:0/1026320896 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa87c06f400 0x7fa87c071910 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa888000f70 tx=0x7fa888000ee0 comp rx=0 tx=0).stop 2024-05-27T06:29:44.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.920+0000 7fa8a6000640 1 -- 172.21.15.87:0/1026320896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa884003a10 msgr2=0x7fa8a00cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:44.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.920+0000 7fa8a6000640 1 --2- 172.21.15.87:0/1026320896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa884003a10 0x7fa8a00cc3f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa89001d2d0 tx=0x7fa884005840 comp rx=0 tx=0).stop 2024-05-27T06:29:44.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.920+0000 7fa8a6000640 1 -- 172.21.15.87:0/1026320896 shutdown_connections 2024-05-27T06:29:44.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.920+0000 7fa8a6000640 1 --2- 172.21.15.87:0/1026320896 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa87c06f400 0x7fa87c071910 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:44.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.920+0000 7fa8a6000640 1 --2- 172.21.15.87:0/1026320896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a01fc580 0x7fa8a00b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:44.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.920+0000 7fa8a6000640 1 --2- 172.21.15.87:0/1026320896 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8a01fc170 0x7fa8a00afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:44.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.920+0000 7fa8a6000640 1 --2- 172.21.15.87:0/1026320896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa884003a10 0x7fa8a00cc3f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:44.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.920+0000 7fa8a6000640 1 -- 172.21.15.87:0/1026320896 >> 172.21.15.87:0/1026320896 conn(0x7fa8a00b46b0 msgr2=0x7fa8a0160780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:44.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.920+0000 7fa8a6000640 1 -- 172.21.15.87:0/1026320896 shutdown_connections 2024-05-27T06:29:44.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:44.920+0000 7fa8a6000640 1 -- 172.21.15.87:0/1026320896 wait complete. 2024-05-27T06:29:44.937 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:29:44.937 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:29:44.946 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T06:29:45.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.136+0000 7f7680c00640 1 Processor -- start 2024-05-27T06:29:45.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.136+0000 7f7680c00640 1 -- start start 2024-05-27T06:29:45.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.136+0000 7f7680c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f767c0aec30 0x7f767c0702b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:45.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.136+0000 7f7680c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f767c06efc0 0x7f767c06f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:45.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.140+0000 7f7680c00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f767c06f910 con 0x7f767c06c720 2024-05-27T06:29:45.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.140+0000 7f7680c00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f767c06fe20 con 0x7f767c0aec30 2024-05-27T06:29:45.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.140+0000 7f7680c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f767c0b0ba0 con 0x7f767c06efc0 2024-05-27T06:29:45.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.140+0000 7f7679e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f767c0aec30 0x7f767c0702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:45.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.140+0000 7f767a800640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f767c06c720 0x7f767c06cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41720/0 (socket says 172.21.15.87:41720) 2024-05-27T06:29:45.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.140+0000 7f7679e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f767c0aec30 0x7f767c0702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33580/0 (socket says 172.21.15.87:33580) 2024-05-27T06:29:45.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.140+0000 7f767a800640 1 -- 172.21.15.87:0/3969345088 learned_addr learned my addr 172.21.15.87:0/3969345088 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:29:45.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.140+0000 7f7671400640 1 --2- 172.21.15.87:0/3969345088 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f767c06efc0 0x7f767c06f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:45.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.140+0000 7f7679e00640 1 -- 172.21.15.87:0/3969345088 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f767c06efc0 msgr2=0x7f767c06f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:45.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.140+0000 7f7679e00640 1 --2- 172.21.15.87:0/3969345088 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f767c06efc0 0x7f767c06f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:45.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.140+0000 7f7679e00640 1 -- 172.21.15.87:0/3969345088 >> v1:172.21.15.87:6789/0 conn(0x7f767c06c720 legacy=0x7f767c06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:45.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.140+0000 7f7679400640 1 -- 172.21.15.87:0/3969345088 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1798596208 0 0) 0x7f7674001120 con 0x7f767c06c720 2024-05-27T06:29:45.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.140+0000 7f7679e00640 1 -- 172.21.15.87:0/3969345088 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767c15ef50 con 0x7f767c0aec30 2024-05-27T06:29:45.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.140+0000 7f7679e00640 1 --2- 172.21.15.87:0/3969345088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f767c0aec30 0x7f767c0702b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f766c009d90 tx=0x7f766c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5850eb29efbbd954 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:45.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.140+0000 7f7679400640 1 -- 172.21.15.87:0/3969345088 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766c0b2070 con 0x7f767c0aec30 2024-05-27T06:29:45.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.144+0000 7f7679400640 1 -- 172.21.15.87:0/3969345088 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f766c0a5820 con 0x7f767c0aec30 2024-05-27T06:29:45.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.144+0000 7f7679400640 1 -- 172.21.15.87:0/3969345088 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766c0a5bf0 con 0x7f767c0aec30 2024-05-27T06:29:45.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.144+0000 7f7680c00640 1 -- 172.21.15.87:0/3969345088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f767c0aec30 msgr2=0x7f767c0702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:45.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.144+0000 7f7680c00640 1 --2- 172.21.15.87:0/3969345088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f767c0aec30 0x7f767c0702b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f766c009d90 tx=0x7f766c01c850 comp rx=0 tx=0).stop 2024-05-27T06:29:45.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.144+0000 7f7680c00640 1 -- 172.21.15.87:0/3969345088 shutdown_connections 2024-05-27T06:29:45.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.144+0000 7f7680c00640 1 --2- 172.21.15.87:0/3969345088 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f767c06efc0 0x7f767c06f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:45.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.144+0000 7f7680c00640 1 --2- 172.21.15.87:0/3969345088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f767c0aec30 0x7f767c0702b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:45.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.144+0000 7f7680c00640 1 -- 172.21.15.87:0/3969345088 >> 172.21.15.87:0/3969345088 conn(0x7f767c0b2fb0 msgr2=0x7f767c0b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:45.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.144+0000 7f7680c00640 1 -- 172.21.15.87:0/3969345088 shutdown_connections 2024-05-27T06:29:45.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.144+0000 7f7680c00640 1 -- 172.21.15.87:0/3969345088 wait complete. 2024-05-27T06:29:45.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.144+0000 7f7680c00640 1 Processor -- start 2024-05-27T06:29:45.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.144+0000 7f7680c00640 1 -- start start 2024-05-27T06:29:45.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.148+0000 7f7680c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f767c06c720 0x7f767c147630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:45.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.148+0000 7f7680c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f767c06efc0 0x7f767c0d1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:45.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.148+0000 7f7680c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f767c0aec30 0x7f767c0d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:45.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.148+0000 7f7680c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f767c06df40 con 0x7f767c06efc0 2024-05-27T06:29:45.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.148+0000 7f7680c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f767c0af040 con 0x7f767c06c720 2024-05-27T06:29:45.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.148+0000 7f7680c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f767c06e0c0 con 0x7f767c0aec30 2024-05-27T06:29:45.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.148+0000 7f7671400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f767c06efc0 0x7f767c0d1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:45.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.148+0000 7f7671400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f767c06efc0 0x7f767c0d1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33594/0 (socket says 172.21.15.87:33594) 2024-05-27T06:29:45.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.148+0000 7f7671400640 1 -- 172.21.15.87:0/1787297527 learned_addr learned my addr 172.21.15.87:0/1787297527 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:45.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.148+0000 7f7679e00640 1 --2- 172.21.15.87:0/1787297527 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f767c06c720 0x7f767c147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:45.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.148+0000 7f767a800640 1 --2- 172.21.15.87:0/1787297527 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f767c0aec30 0x7f767c0d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:45.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.148+0000 7f7671400640 1 -- 172.21.15.87:0/1787297527 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f767c0aec30 msgr2=0x7f767c0d1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:45.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.148+0000 7f7671400640 1 --2- 172.21.15.87:0/1787297527 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f767c0aec30 0x7f767c0d1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:45.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.148+0000 7f7671400640 1 -- 172.21.15.87:0/1787297527 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f767c06c720 msgr2=0x7f767c147630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:45.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.148+0000 7f7671400640 1 --2- 172.21.15.87:0/1787297527 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f767c06c720 0x7f767c147630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:45.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.148+0000 7f7671400640 1 -- 172.21.15.87:0/1787297527 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767c156430 con 0x7f767c06efc0 2024-05-27T06:29:45.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.148+0000 7f7671400640 1 --2- 172.21.15.87:0/1787297527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f767c06efc0 0x7f767c0d1730 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f766400e870 tx=0x7f766400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:45.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.148+0000 7f7672a00640 1 -- 172.21.15.87:0/1787297527 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7664017070 con 0x7f767c06efc0 2024-05-27T06:29:45.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.148+0000 7f7672a00640 1 -- 172.21.15.87:0/1787297527 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f766400c940 con 0x7f767c06efc0 2024-05-27T06:29:45.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.148+0000 7f7680c00640 1 -- 172.21.15.87:0/1787297527 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f767c160770 con 0x7f767c06efc0 2024-05-27T06:29:45.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.148+0000 7f7672a00640 1 -- 172.21.15.87:0/1787297527 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766400ccf0 con 0x7f767c06efc0 2024-05-27T06:29:45.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.148+0000 7f7680c00640 1 -- 172.21.15.87:0/1787297527 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f767c072cc0 con 0x7f767c06efc0 2024-05-27T06:29:45.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.148+0000 7f7680c00640 1 -- 172.21.15.87:0/1787297527 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f767c06aa30 con 0x7f767c06efc0 2024-05-27T06:29:45.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.152+0000 7f7672a00640 1 -- 172.21.15.87:0/1787297527 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f766401a070 con 0x7f767c06efc0 2024-05-27T06:29:45.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.152+0000 7f7672a00640 1 --2- 172.21.15.87:0/1787297527 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f765806f400 0x7f7658071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:45.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.152+0000 7f7672a00640 1 -- 172.21.15.87:0/1787297527 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f766408f400 con 0x7f767c06efc0 2024-05-27T06:29:45.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.152+0000 7f7679e00640 1 --2- 172.21.15.87:0/1787297527 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f765806f400 0x7f7658071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:45.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.152+0000 7f7679e00640 1 --2- 172.21.15.87:0/1787297527 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f765806f400 0x7f7658071910 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f766c0af000 tx=0x7f766c0a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:45.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.156+0000 7f7672a00640 1 -- 172.21.15.87:0/1787297527 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f766405c0c0 con 0x7f767c06efc0 2024-05-27T06:29:45.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.324+0000 7f7680c00640 1 -- 172.21.15.87:0/1787297527 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f767c1601b0 con 0x7f767c06efc0 2024-05-27T06:29:45.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.324+0000 7f7672a00640 1 -- 172.21.15.87:0/1787297527 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) ==== 80+0+0 (secure 0 0 0) 0x7f766405b9c0 con 0x7f767c06efc0 2024-05-27T06:29:45.325 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2024-05-27T06:29:45.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.328+0000 7f7680c00640 1 -- 172.21.15.87:0/1787297527 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f765806f400 msgr2=0x7f7658071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:45.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.328+0000 7f7680c00640 1 --2- 172.21.15.87:0/1787297527 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f765806f400 0x7f7658071910 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f766c0af000 tx=0x7f766c0a7070 comp rx=0 tx=0).stop 2024-05-27T06:29:45.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.328+0000 7f7680c00640 1 -- 172.21.15.87:0/1787297527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f767c06efc0 msgr2=0x7f767c0d1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:45.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.328+0000 7f7680c00640 1 --2- 172.21.15.87:0/1787297527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f767c06efc0 0x7f767c0d1730 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f766400e870 tx=0x7f766400ec70 comp rx=0 tx=0).stop 2024-05-27T06:29:45.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.328+0000 7f7680c00640 1 -- 172.21.15.87:0/1787297527 shutdown_connections 2024-05-27T06:29:45.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.328+0000 7f7680c00640 1 --2- 172.21.15.87:0/1787297527 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f765806f400 0x7f7658071910 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:45.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.328+0000 7f7680c00640 1 --2- 172.21.15.87:0/1787297527 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f767c0aec30 0x7f767c0d1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:45.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.328+0000 7f7680c00640 1 --2- 172.21.15.87:0/1787297527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f767c06efc0 0x7f767c0d1730 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:45.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.328+0000 7f7680c00640 1 --2- 172.21.15.87:0/1787297527 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f767c06c720 0x7f767c147630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:45.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.328+0000 7f7680c00640 1 -- 172.21.15.87:0/1787297527 >> 172.21.15.87:0/1787297527 conn(0x7f767c0b2fb0 msgr2=0x7f767c155b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:45.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.328+0000 7f7680c00640 1 -- 172.21.15.87:0/1787297527 shutdown_connections 2024-05-27T06:29:45.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.328+0000 7f7680c00640 1 -- 172.21.15.87:0/1787297527 wait complete. 2024-05-27T06:29:45.347 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:29:45.347 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:29:45.355 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T06:29:45.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.548+0000 7f176ea00640 1 Processor -- start 2024-05-27T06:29:45.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.548+0000 7f176ea00640 1 -- start start 2024-05-27T06:29:45.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.552+0000 7f176ea00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f176806efc0 0x7f176806f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:45.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.552+0000 7f176ea00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f176806f910 con 0x7f176806c720 2024-05-27T06:29:45.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.552+0000 7f176ea00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f176806fe20 con 0x7f17680aec30 2024-05-27T06:29:45.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.552+0000 7f176ea00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f17680b0ba0 con 0x7f176806efc0 2024-05-27T06:29:45.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.552+0000 7f176ca00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f176806c720 0x7f176806cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41726/0 (socket says 172.21.15.87:41726) 2024-05-27T06:29:45.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.552+0000 7f176ca00640 1 -- 172.21.15.87:0/1698222981 learned_addr learned my addr 172.21.15.87:0/1698222981 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:29:45.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.552+0000 7f175fe00640 1 --2- 172.21.15.87:0/1698222981 >> v2:172.21.15.149:3300/0 conn(0x7f176806efc0 0x7f176806f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:45.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.552+0000 7f1767400640 1 -- 172.21.15.87:0/1698222981 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 276926011 0 0) 0x7f17600014a0 con 0x7f176806c720 2024-05-27T06:29:45.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.552+0000 7f1767400640 1 -- 172.21.15.87:0/1698222981 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f174c003530 con 0x7f176806c720 2024-05-27T06:29:45.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.552+0000 7f175fe00640 1 -- 172.21.15.87:0/1698222981 >> v1:172.21.15.149:6789/0 conn(0x7f17680aec30 legacy=0x7f17680702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:45.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.552+0000 7f175fe00640 1 -- 172.21.15.87:0/1698222981 >> v1:172.21.15.87:6789/0 conn(0x7f176806c720 legacy=0x7f176806cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:45.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.552+0000 7f175fe00640 1 -- 172.21.15.87:0/1698222981 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f176815ef50 con 0x7f176806efc0 2024-05-27T06:29:45.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.556+0000 7f175fe00640 1 --2- 172.21.15.87:0/1698222981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f176806efc0 0x7f176806f3d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f17500097c0 tx=0x7f175001c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30b0ec8d9c317ea5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:45.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.556+0000 7f1767400640 1 -- 172.21.15.87:0/1698222981 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17500b0070 con 0x7f176806efc0 2024-05-27T06:29:45.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.556+0000 7f1767400640 1 -- 172.21.15.87:0/1698222981 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17500ab600 con 0x7f176806efc0 2024-05-27T06:29:45.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.556+0000 7f1767400640 1 -- 172.21.15.87:0/1698222981 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17500ab9d0 con 0x7f176806efc0 2024-05-27T06:29:45.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.556+0000 7f176ea00640 1 -- 172.21.15.87:0/1698222981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f176806efc0 msgr2=0x7f176806f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:45.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.556+0000 7f176ea00640 1 --2- 172.21.15.87:0/1698222981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f176806efc0 0x7f176806f3d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f17500097c0 tx=0x7f175001c380 comp rx=0 tx=0).stop 2024-05-27T06:29:45.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.556+0000 7f176ea00640 1 -- 172.21.15.87:0/1698222981 shutdown_connections 2024-05-27T06:29:45.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.556+0000 7f176ea00640 1 --2- 172.21.15.87:0/1698222981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f176806efc0 0x7f176806f3d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:45.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.556+0000 7f176ea00640 1 -- 172.21.15.87:0/1698222981 >> 172.21.15.87:0/1698222981 conn(0x7f17680b2fb0 msgr2=0x7f17680b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:45.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.556+0000 7f176ea00640 1 -- 172.21.15.87:0/1698222981 shutdown_connections 2024-05-27T06:29:45.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.556+0000 7f176ea00640 1 -- 172.21.15.87:0/1698222981 wait complete. 2024-05-27T06:29:45.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.560+0000 7f176ea00640 1 Processor -- start 2024-05-27T06:29:45.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.560+0000 7f176ea00640 1 -- start start 2024-05-27T06:29:45.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.560+0000 7f176ea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f176806c720 0x7f176809bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:45.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.560+0000 7f176ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f176806efc0 0x7f176809d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:45.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.560+0000 7f176ea00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17680aec30 0x7f176809d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:45.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.560+0000 7f176ea00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f176806df40 con 0x7f17680aec30 2024-05-27T06:29:45.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.560+0000 7f176ea00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f17680af040 con 0x7f176806c720 2024-05-27T06:29:45.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.560+0000 7f176ea00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f176806e0c0 con 0x7f176806efc0 2024-05-27T06:29:45.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.560+0000 7f176ca00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17680aec30 0x7f176809d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:45.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.560+0000 7f176ca00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17680aec30 0x7f176809d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33602/0 (socket says 172.21.15.87:33602) 2024-05-27T06:29:45.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.560+0000 7f176ca00640 1 -- 172.21.15.87:0/2446070380 learned_addr learned my addr 172.21.15.87:0/2446070380 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:45.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.560+0000 7f175fe00640 1 --2- 172.21.15.87:0/2446070380 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f176806efc0 0x7f176809d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:45.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.560+0000 7f176ca00640 1 -- 172.21.15.87:0/2446070380 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f176806efc0 msgr2=0x7f176809d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:45.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.560+0000 7f176ca00640 1 --2- 172.21.15.87:0/2446070380 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f176806efc0 0x7f176809d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:45.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.560+0000 7f176ca00640 1 -- 172.21.15.87:0/2446070380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f176806c720 msgr2=0x7f176809bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:45.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.560+0000 7f1767e00640 1 --2- 172.21.15.87:0/2446070380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f176806c720 0x7f176809bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:45.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.560+0000 7f176ca00640 1 --2- 172.21.15.87:0/2446070380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f176806c720 0x7f176809bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:45.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.560+0000 7f176ca00640 1 -- 172.21.15.87:0/2446070380 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f176809c2f0 con 0x7f17680aec30 2024-05-27T06:29:45.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.560+0000 7f175fe00640 1 --2- 172.21.15.87:0/2446070380 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f176806efc0 0x7f176809d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:29:45.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.560+0000 7f1767e00640 1 --2- 172.21.15.87:0/2446070380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f176806c720 0x7f176809bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:29:45.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.560+0000 7f176ca00640 1 --2- 172.21.15.87:0/2446070380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17680aec30 0x7f176809d8c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f176000cae0 tx=0x7f176000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:45.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.564+0000 7f1764c00640 1 -- 172.21.15.87:0/2446070380 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176000ac40 con 0x7f17680aec30 2024-05-27T06:29:45.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.564+0000 7f1764c00640 1 -- 172.21.15.87:0/2446070380 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f176000ade0 con 0x7f17680aec30 2024-05-27T06:29:45.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.564+0000 7f1764c00640 1 -- 172.21.15.87:0/2446070380 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1760012620 con 0x7f17680aec30 2024-05-27T06:29:45.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.564+0000 7f176ea00640 1 -- 172.21.15.87:0/2446070380 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f176809c770 con 0x7f17680aec30 2024-05-27T06:29:45.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.564+0000 7f176ea00640 1 -- 172.21.15.87:0/2446070380 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1768151900 con 0x7f17680aec30 2024-05-27T06:29:45.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.564+0000 7f176ea00640 1 -- 172.21.15.87:0/2446070380 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f176809c4c0 con 0x7f17680aec30 2024-05-27T06:29:45.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.564+0000 7f1764c00640 1 -- 172.21.15.87:0/2446070380 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f17600127c0 con 0x7f17680aec30 2024-05-27T06:29:45.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.564+0000 7f1764c00640 1 --2- 172.21.15.87:0/2446070380 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f174406f400 0x7f1744071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:45.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.564+0000 7f1764c00640 1 -- 172.21.15.87:0/2446070380 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f176008fb00 con 0x7f17680aec30 2024-05-27T06:29:45.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.564+0000 7f1767e00640 1 --2- 172.21.15.87:0/2446070380 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f174406f400 0x7f1744071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:45.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.568+0000 7f1767e00640 1 --2- 172.21.15.87:0/2446070380 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f174406f400 0x7f1744071910 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1758000f70 tx=0x7f1758009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:45.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.568+0000 7f1764c00640 1 -- 172.21.15.87:0/2446070380 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f176806f910 con 0x7f17680aec30 2024-05-27T06:29:45.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.736+0000 7f176ea00640 1 -- 172.21.15.87:0/2446070380 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f176806d000 con 0x7f17680aec30 2024-05-27T06:29:45.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.736+0000 7f1764c00640 1 -- 172.21.15.87:0/2446070380 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) ==== 80+0+0 (secure 0 0 0) 0x7f176005c7c0 con 0x7f17680aec30 2024-05-27T06:29:45.737 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2024-05-27T06:29:45.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.740+0000 7f176ea00640 1 -- 172.21.15.87:0/2446070380 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f174406f400 msgr2=0x7f1744071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:45.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.740+0000 7f176ea00640 1 --2- 172.21.15.87:0/2446070380 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f174406f400 0x7f1744071910 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1758000f70 tx=0x7f1758009040 comp rx=0 tx=0).stop 2024-05-27T06:29:45.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.740+0000 7f176ea00640 1 -- 172.21.15.87:0/2446070380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17680aec30 msgr2=0x7f176809d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:45.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.740+0000 7f176ea00640 1 --2- 172.21.15.87:0/2446070380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17680aec30 0x7f176809d8c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f176000cae0 tx=0x7f176000a060 comp rx=0 tx=0).stop 2024-05-27T06:29:45.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.740+0000 7f176ea00640 1 -- 172.21.15.87:0/2446070380 shutdown_connections 2024-05-27T06:29:45.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.740+0000 7f176ea00640 1 --2- 172.21.15.87:0/2446070380 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f174406f400 0x7f1744071910 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:45.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.740+0000 7f176ea00640 1 --2- 172.21.15.87:0/2446070380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17680aec30 0x7f176809d8c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:45.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.740+0000 7f176ea00640 1 --2- 172.21.15.87:0/2446070380 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f176806efc0 0x7f176809d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:45.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.740+0000 7f176ea00640 1 --2- 172.21.15.87:0/2446070380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f176806c720 0x7f176809bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:45.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.740+0000 7f176ea00640 1 -- 172.21.15.87:0/2446070380 >> 172.21.15.87:0/2446070380 conn(0x7f17680b2fb0 msgr2=0x7f176815fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:45.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.740+0000 7f176ea00640 1 -- 172.21.15.87:0/2446070380 shutdown_connections 2024-05-27T06:29:45.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:45.740+0000 7f176ea00640 1 -- 172.21.15.87:0/2446070380 wait complete. 2024-05-27T06:29:45.759 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-05-27T06:29:45.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:45.759 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-27T06:29:45.777 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[39157]: fuse finished with error 0 and tester_r 0 2024-05-27T06:29:45.780 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:29:51.881 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-05-27T06:29:51.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:51.882 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-27T06:29:51.892 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-27T06:29:52.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.096+0000 7f172b000640 1 Processor -- start 2024-05-27T06:29:52.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.096+0000 7f172b000640 1 -- start start 2024-05-27T06:29:52.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.096+0000 7f172b000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17240c4a20 0x7f17240cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:52.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.096+0000 7f172b000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f172406f5e0 0x7f172406f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:52.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.096+0000 7f172b000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f172406eb40 con 0x7f17240cf820 2024-05-27T06:29:52.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.096+0000 7f172b000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f172406ff30 con 0x7f172406f5e0 2024-05-27T06:29:52.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.096+0000 7f172b000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f172406dd00 con 0x7f17240c4a20 2024-05-27T06:29:52.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.096+0000 7f1723e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f17240cf820 0x7f17240c4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41738/0 (socket says 172.21.15.87:41738) 2024-05-27T06:29:52.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.096+0000 7f1723e00640 1 -- 172.21.15.87:0/176298545 learned_addr learned my addr 172.21.15.87:0/176298545 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:29:52.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.096+0000 7f1729000640 1 --2- 172.21.15.87:0/176298545 >> v2:172.21.15.87:3300/0 conn(0x7f172406f5e0 0x7f172406f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:52.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.096+0000 7f1723400640 1 --2- 172.21.15.87:0/176298545 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17240c4a20 0x7f17240cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:52.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.096+0000 7f1722a00640 1 -- 172.21.15.87:0/176298545 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2087957588 0 0) 0x7f172406eb40 con 0x7f17240cf820 2024-05-27T06:29:52.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.096+0000 7f1722a00640 1 -- 172.21.15.87:0/176298545 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1708003530 con 0x7f17240cf820 2024-05-27T06:29:52.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.096+0000 7f1729000640 1 -- 172.21.15.87:0/176298545 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17240c4a20 msgr2=0x7f17240cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:52.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.096+0000 7f1729000640 1 --2- 172.21.15.87:0/176298545 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17240c4a20 0x7f17240cfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:52.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.096+0000 7f1729000640 1 -- 172.21.15.87:0/176298545 >> v1:172.21.15.87:6789/0 conn(0x7f17240cf820 legacy=0x7f17240c4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:52.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.096+0000 7f1729000640 1 -- 172.21.15.87:0/176298545 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f172406ede0 con 0x7f172406f5e0 2024-05-27T06:29:52.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.100+0000 7f1729000640 1 --2- 172.21.15.87:0/176298545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f172406f5e0 0x7f172406f9f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f171c009d90 tx=0x7f171c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68343f22db6a9a9a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:52.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.100+0000 7f1722a00640 1 -- 172.21.15.87:0/176298545 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c0b2070 con 0x7f172406f5e0 2024-05-27T06:29:52.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.100+0000 7f1722a00640 1 -- 172.21.15.87:0/176298545 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f171c0a5a50 con 0x7f172406f5e0 2024-05-27T06:29:52.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.100+0000 7f1722a00640 1 -- 172.21.15.87:0/176298545 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c0a5e20 con 0x7f172406f5e0 2024-05-27T06:29:52.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.100+0000 7f172b000640 1 -- 172.21.15.87:0/176298545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f172406f5e0 msgr2=0x7f172406f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:52.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.100+0000 7f172b000640 1 --2- 172.21.15.87:0/176298545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f172406f5e0 0x7f172406f9f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f171c009d90 tx=0x7f171c01c970 comp rx=0 tx=0).stop 2024-05-27T06:29:52.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.100+0000 7f172b000640 1 -- 172.21.15.87:0/176298545 shutdown_connections 2024-05-27T06:29:52.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.100+0000 7f172b000640 1 --2- 172.21.15.87:0/176298545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f172406f5e0 0x7f172406f9f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:52.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.100+0000 7f172b000640 1 --2- 172.21.15.87:0/176298545 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17240c4a20 0x7f17240cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:52.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.100+0000 7f172b000640 1 -- 172.21.15.87:0/176298545 >> 172.21.15.87:0/176298545 conn(0x7f17240b46b0 msgr2=0x7f17240b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:52.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.100+0000 7f172b000640 1 -- 172.21.15.87:0/176298545 shutdown_connections 2024-05-27T06:29:52.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.100+0000 7f172b000640 1 -- 172.21.15.87:0/176298545 wait complete. 2024-05-27T06:29:52.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.104+0000 7f172b000640 1 Processor -- start 2024-05-27T06:29:52.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.104+0000 7f172b000640 1 -- start start 2024-05-27T06:29:52.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.104+0000 7f172b000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f172406f5e0 0x7f1724153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:52.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.104+0000 7f172b000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17240cf820 0x7f172415d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:52.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.104+0000 7f172b000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1724167170 0x7f172415dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:52.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.104+0000 7f172b000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1724170d60 con 0x7f172406f5e0 2024-05-27T06:29:52.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.104+0000 7f172b000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f172406d9a0 con 0x7f1724167170 2024-05-27T06:29:52.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.104+0000 7f172b000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1724170ee0 con 0x7f17240cf820 2024-05-27T06:29:52.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.104+0000 7f1723e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f172406f5e0 0x7f1724153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:52.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.104+0000 7f1723e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f172406f5e0 0x7f1724153e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33626/0 (socket says 172.21.15.87:33626) 2024-05-27T06:29:52.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.104+0000 7f1723e00640 1 -- 172.21.15.87:0/684544900 learned_addr learned my addr 172.21.15.87:0/684544900 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:52.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.108+0000 7f1723e00640 1 -- 172.21.15.87:0/684544900 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17240cf820 msgr2=0x7f172415d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:52.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.108+0000 7f1723400640 1 --2- 172.21.15.87:0/684544900 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17240cf820 0x7f172415d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:52.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.108+0000 7f1729000640 1 --2- 172.21.15.87:0/684544900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1724167170 0x7f172415dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:52.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.108+0000 7f1723e00640 1 --2- 172.21.15.87:0/684544900 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17240cf820 0x7f172415d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:52.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.108+0000 7f1723e00640 1 -- 172.21.15.87:0/684544900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1724167170 msgr2=0x7f172415dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:52.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.108+0000 7f1723e00640 1 --2- 172.21.15.87:0/684544900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1724167170 0x7f172415dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:52.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.108+0000 7f1723e00640 1 -- 172.21.15.87:0/684544900 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1724155b80 con 0x7f172406f5e0 2024-05-27T06:29:52.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.108+0000 7f1729000640 1 --2- 172.21.15.87:0/684544900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1724167170 0x7f172415dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:29:52.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.108+0000 7f1723e00640 1 --2- 172.21.15.87:0/684544900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f172406f5e0 0x7f1724153e50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f171400c430 tx=0x7f171400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:52.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.108+0000 7f171be00640 1 -- 172.21.15.87:0/684544900 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1714017070 con 0x7f172406f5e0 2024-05-27T06:29:52.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.108+0000 7f171be00640 1 -- 172.21.15.87:0/684544900 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1714005cf0 con 0x7f172406f5e0 2024-05-27T06:29:52.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.108+0000 7f171be00640 1 -- 172.21.15.87:0/684544900 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17140072d0 con 0x7f172406f5e0 2024-05-27T06:29:52.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.108+0000 7f172b000640 1 -- 172.21.15.87:0/684544900 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1724155110 con 0x7f172406f5e0 2024-05-27T06:29:52.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.108+0000 7f172b000640 1 -- 172.21.15.87:0/684544900 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1724154390 con 0x7f172406f5e0 2024-05-27T06:29:52.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.108+0000 7f172b000640 1 -- 172.21.15.87:0/684544900 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f172406aa30 con 0x7f172406f5e0 2024-05-27T06:29:52.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.108+0000 7f171be00640 1 -- 172.21.15.87:0/684544900 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f171401a070 con 0x7f172406f5e0 2024-05-27T06:29:52.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.108+0000 7f171be00640 1 --2- 172.21.15.87:0/684544900 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f170006f400 0x7f1700071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:52.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.112+0000 7f171be00640 1 -- 172.21.15.87:0/684544900 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f171408e800 con 0x7f172406f5e0 2024-05-27T06:29:52.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.112+0000 7f1723400640 1 --2- 172.21.15.87:0/684544900 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f170006f400 0x7f1700071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:52.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.112+0000 7f1723400640 1 --2- 172.21.15.87:0/684544900 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f170006f400 0x7f1700071910 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f172415ed00 tx=0x7f170c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:52.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.116+0000 7f171be00640 1 -- 172.21.15.87:0/684544900 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f171405af30 con 0x7f172406f5e0 2024-05-27T06:29:52.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.308+0000 7f172b000640 1 -- 172.21.15.87:0/684544900 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f17240b5070 con 0x7f172406f5e0 2024-05-27T06:29:52.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.308+0000 7f171be00640 1 -- 172.21.15.87:0/684544900 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7f171405f230 con 0x7f172406f5e0 2024-05-27T06:29:52.307 INFO:teuthology.orchestra.run.smithi087.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-27T06:29:52.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.308+0000 7f172b000640 1 -- 172.21.15.87:0/684544900 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f170006f400 msgr2=0x7f1700071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:52.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.308+0000 7f172b000640 1 --2- 172.21.15.87:0/684544900 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f170006f400 0x7f1700071910 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f172415ed00 tx=0x7f170c008040 comp rx=0 tx=0).stop 2024-05-27T06:29:52.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.308+0000 7f172b000640 1 -- 172.21.15.87:0/684544900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f172406f5e0 msgr2=0x7f1724153e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:52.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.308+0000 7f172b000640 1 --2- 172.21.15.87:0/684544900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f172406f5e0 0x7f1724153e50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f171400c430 tx=0x7f171400c8f0 comp rx=0 tx=0).stop 2024-05-27T06:29:52.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.308+0000 7f172b000640 1 -- 172.21.15.87:0/684544900 shutdown_connections 2024-05-27T06:29:52.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.308+0000 7f172b000640 1 --2- 172.21.15.87:0/684544900 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f170006f400 0x7f1700071910 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:52.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.308+0000 7f172b000640 1 --2- 172.21.15.87:0/684544900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1724167170 0x7f172415dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:52.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.308+0000 7f172b000640 1 --2- 172.21.15.87:0/684544900 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17240cf820 0x7f172415d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:52.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.308+0000 7f172b000640 1 --2- 172.21.15.87:0/684544900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f172406f5e0 0x7f1724153e50 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:52.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.308+0000 7f172b000640 1 -- 172.21.15.87:0/684544900 >> 172.21.15.87:0/684544900 conn(0x7f17240b46b0 msgr2=0x7f1724162970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:52.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.308+0000 7f172b000640 1 -- 172.21.15.87:0/684544900 shutdown_connections 2024-05-27T06:29:52.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52.308+0000 7f172b000640 1 -- 172.21.15.87:0/684544900 wait complete. 2024-05-27T06:29:52.329 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-27T06:29:52.329 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-27T06:29:52.329 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-05-27T06:29:52.329 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-27T06:29:52.329 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-27T06:29:52.329 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-27T06:29:52.329 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-27T06:29:52.329 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-27T06:29:52.329 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-27T06:29:52.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:52.330 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-05-27T06:29:52.338 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T06:29:52.338 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T06:29:52.338 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T06:29:52.338 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:29:52.338 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-05-27T06:29:52.338 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:29:52.339 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:29:52.339 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-05-27T06:29:52.339 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-05-27T06:29:52.339 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:29:52.339 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-05-27T06:29:52.339 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-05-27T06:29:52.339 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:29:52.339 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:29:52.339 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-27T06:29:52.339 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:29:52.339 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-27T06:29:52.339 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42349sec preferred_lft 42349sec 2024-05-27T06:29:52.339 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-05-27T06:29:52.340 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:29:52.340 INFO:teuthology.orchestra.run.smithi087.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-27T06:29:52.340 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 02:42:75:41:48:14 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:29:52.340 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-27T06:29:52.340 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:29:52.340 INFO:teuthology.orchestra.run.smithi087.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-27T06:29:52.340 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-27T06:29:52.340 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-27T06:29:52.340 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:29:52.340 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-27T06:29:52.340 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:29:52.340 INFO:teuthology.orchestra.run.smithi087.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-27T06:29:52.340 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:29:52.340 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-27T06:29:52.341 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:29:52.341 INFO:teuthology.orchestra.run.smithi087.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-27T06:29:52.341 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:29:52.341 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-05-27T06:29:52.341 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:29:52.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:52.342 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-27T06:29:52.402 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-05-27T06:29:52.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:52.405 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-05-27T06:29:52.463 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-05-27T06:29:52.463 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-27T06:29:52.463 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-27T06:29:52.463 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-27T06:29:52.463 INFO:teuthology.orchestra.run.smithi087.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-27T06:29:52.463 INFO:teuthology.orchestra.run.smithi087.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-27T06:29:52.463 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-27T06:29:52.463 INFO:teuthology.orchestra.run.smithi087.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:29:52.464 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:29:52.464 INFO:teuthology.orchestra.run.smithi087.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:29:52.464 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-27T06:29:52.464 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:29:52.464 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-27T06:29:52.464 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-27T06:29:52.464 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-27T06:29:52.464 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-27T06:29:52.464 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-27T06:29:52.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:29:52.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:29:52.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:52.602 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-05-27T06:29:52.610 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-27T06:29:52.610 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-27T06:29:52.611 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-27T06:29:52.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:52.612 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-05-27T06:29:52.672 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-27T06:29:52.672 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T06:29:52.673 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-27T06:29:52.721 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-27T06:29:52.721 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T06:29:52.721 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-27T06:29:52.772 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-05-27T06:29:52.836 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T06:29:52.894 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-05-27T06:29:52.894 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-05-27T06:29:52.894 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-05-27T06:29:52.894 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-05-27T06:29:52.894 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-05-27T06:29:52.894 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-05-27T06:29:52.894 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-05-27T06:29:52.894 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-05-27T06:29:52.895 INFO:teuthology.orchestra.run.smithi087.stdout:/run/lock 2024-05-27T06:29:52.895 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-05-27T06:29:52.895 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-05-27T06:29:52.895 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-05-27T06:29:52.895 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T06:29:52.895 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-05-27T06:29:52.895 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-05-27T06:29:52.895 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-05-27T06:29:52.895 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-05-27T06:29:52.895 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/fs/nfsd 2024-05-27T06:29:52.895 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-05-27T06:29:52.895 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-05-27T06:29:52.895 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysusers.service 2024-05-27T06:29:52.896 INFO:teuthology.orchestra.run.smithi087.stdout:/run/rpc_pipefs 2024-05-27T06:29:52.896 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-05-27T06:29:52.896 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-05-27T06:29:52.896 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2024-05-27T06:29:52.896 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2024-05-27T06:29:52.896 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2024-05-27T06:29:52.896 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2024-05-27T06:29:52.896 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-05-27T06:29:52.896 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:29:52.896 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:29:52.896 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:29:52.896 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:29:52.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:52.897 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-05-27T06:29:52.948 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-27T06:29:52.948 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-27T06:29:52.991 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-05-27T06:29:53.013 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T06:29:53.066 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-05-27T06:29:53.066 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-05-27T06:29:53.066 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-05-27T06:29:53.066 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-05-27T06:29:53.066 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-05-27T06:29:53.066 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-05-27T06:29:53.066 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-05-27T06:29:53.066 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-05-27T06:29:53.066 INFO:teuthology.orchestra.run.smithi087.stdout:/run/lock 2024-05-27T06:29:53.067 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-05-27T06:29:53.067 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-05-27T06:29:53.067 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-05-27T06:29:53.067 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T06:29:53.067 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-05-27T06:29:53.067 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-05-27T06:29:53.067 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-05-27T06:29:53.067 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-05-27T06:29:53.067 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/fs/nfsd 2024-05-27T06:29:53.067 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-05-27T06:29:53.067 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-05-27T06:29:53.067 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysusers.service 2024-05-27T06:29:53.067 INFO:teuthology.orchestra.run.smithi087.stdout:/run/rpc_pipefs 2024-05-27T06:29:53.068 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-05-27T06:29:53.068 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-05-27T06:29:53.068 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2024-05-27T06:29:53.068 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2024-05-27T06:29:53.068 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2024-05-27T06:29:53.068 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2024-05-27T06:29:53.068 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-05-27T06:29:53.068 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:29:53.068 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:29:53.068 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:29:53.068 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:29:53.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:53.070 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-05-27T06:29:53.098 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:2024-05-27T06:29:53.096+0000 7fdbc27d7580 -1 init, newargv = 0x7fdba4001090 newargc=15 2024-05-27T06:29:53.098 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[39347]: starting ceph client 2024-05-27T06:29:53.103 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[39347]: starting fuse 2024-05-27T06:29:53.107 INFO:teuthology.orchestra.run.smithi087.stdout:44 2024-05-27T06:29:53.108 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-05-27T06:29:53.108 DEBUG:teuthology.orchestra.run.smithi087:> sudo stdin-killer -- python3 -c ' 2024-05-27T06:29:53.108 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-05-27T06:29:53.108 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-05-27T06:29:53.108 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-05-27T06:29:53.108 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-05-27T06:29:53.108 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:29:53.108 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-05-27T06:29:53.108 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-27T06:29:53.108 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-05-27T06:29:53.108 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-27T06:29:53.109 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:29:53.109 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-05-27T06:29:53.109 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-05-27T06:29:53.109 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-05-27T06:29:53.109 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-05-27T06:29:53.109 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:29:53.109 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-05-27T06:29:53.109 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-27T06:29:53.109 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-27T06:29:53.109 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-27T06:29:53.109 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-05-27T06:29:53.109 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-05-27T06:29:53.109 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-05-27T06:29:53.109 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-27T06:29:53.109 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:29:53.110 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.0")) 2024-05-27T06:29:53.110 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-05-27T06:29:53.228 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.0.39347.asok 2024-05-27T06:29:53.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:29:53.239 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.39347.asok 2024-05-27T06:29:53.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:53.240 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.39347.asok status 2024-05-27T06:29:53.417 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-27T06:29:53.418 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-05-27T06:29:53.418 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "38f9d900c83c63799fbdbe61acc9a11b0d3554a6", 2024-05-27T06:29:53.418 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 19.0.0-3872-g38f9d900 (38f9d900c83c63799fbdbe61acc9a11b0d3554a6) squid (dev)", 2024-05-27T06:29:53.418 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "0", 2024-05-27T06:29:53.418 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-05-27T06:29:53.418 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-27T06:29:53.418 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "39347", 2024-05-27T06:29:53.418 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-05-27T06:29:53.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:53.418 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-05-27T06:29:53.419 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-05-27T06:29:53.419 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 5586, 2024-05-27T06:29:53.419 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-05-27T06:29:53.419 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-05-27T06:29:53.419 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-05-27T06:29:53.419 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 5586 2024-05-27T06:29:53.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:53.419 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-05-27T06:29:53.419 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-05-27T06:29:53.419 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-05-27T06:29:53.419 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2435803062 2024-05-27T06:29:53.419 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:29:53.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:53.419 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-05-27T06:29:53.419 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-05-27T06:29:53.420 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-05-27T06:29:53.420 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2435803062 2024-05-27T06:29:53.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:29:53.420 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.5586 192.168.0.1:0/2435803062", 2024-05-27T06:29:53.420 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/2435803062", 2024-05-27T06:29:53.420 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-05-27T06:29:53.420 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 27, 2024-05-27T06:29:53.420 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 54, 2024-05-27T06:29:53.420 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-05-27T06:29:53.420 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-05-27T06:29:53.420 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-05-27T06:29:53.420 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-27T06:29:53.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:53.434 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-05-27T06:29:53.434 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-27T06:29:53.443 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-05-27T06:29:53.443 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-27T06:29:53.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:53.443 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-27T06:29:53.503 DEBUG:teuthology.orchestra.run.smithi087:> stdin-killer -- python3 -c ' 2024-05-27T06:29:53.503 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-05-27T06:29:53.503 DEBUG:teuthology.orchestra.run.smithi087:> import errno 2024-05-27T06:29:53.503 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:29:53.503 DEBUG:teuthology.orchestra.run.smithi087:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2024-05-27T06:29:53.503 DEBUG:teuthology.orchestra.run.smithi087:> try: 2024-05-27T06:29:53.503 DEBUG:teuthology.orchestra.run.smithi087:> if False: 2024-05-27T06:29:53.503 DEBUG:teuthology.orchestra.run.smithi087:> ret = os.read(fd, 1024) 2024-05-27T06:29:53.503 DEBUG:teuthology.orchestra.run.smithi087:> else: 2024-05-27T06:29:53.503 DEBUG:teuthology.orchestra.run.smithi087:> os.write(fd, b'"'"'content'"'"') 2024-05-27T06:29:53.503 DEBUG:teuthology.orchestra.run.smithi087:> except OSError as e: 2024-05-27T06:29:53.504 DEBUG:teuthology.orchestra.run.smithi087:> if e.errno != errno.EPERM: 2024-05-27T06:29:53.504 DEBUG:teuthology.orchestra.run.smithi087:> raise 2024-05-27T06:29:53.504 DEBUG:teuthology.orchestra.run.smithi087:> else: 2024-05-27T06:29:53.504 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("client does not check permission of data pool") 2024-05-27T06:29:53.504 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-05-27T06:29:53.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:29:53.623 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow w pool=cephfs_data' 2024-05-27T06:29:53.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.820+0000 7f23e2600640 1 Processor -- start 2024-05-27T06:29:53.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.820+0000 7f23e2600640 1 -- start start 2024-05-27T06:29:53.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.820+0000 7f23e2600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f23dc0d1700 0x7f23dc0d1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:53.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.820+0000 7f23e2600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23dc06c940 0x7f23dc06cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:53.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.820+0000 7f23e2600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23dc0d2050 con 0x7f23dc157310 2024-05-27T06:29:53.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.820+0000 7f23e2600640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f23dc0d0140 con 0x7f23dc0d1700 2024-05-27T06:29:53.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.820+0000 7f23e2600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f23dc0cf530 con 0x7f23dc06c940 2024-05-27T06:29:53.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.820+0000 7f23d2a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f23dc0d1700 0x7f23dc0d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:53.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.820+0000 7f23d2a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f23dc0d1700 0x7f23dc0d1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33630/0 (socket says 172.21.15.87:33630) 2024-05-27T06:29:53.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.820+0000 7f23d2a00640 1 -- 172.21.15.87:0/4222859924 learned_addr learned my addr 172.21.15.87:0/4222859924 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:53.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.820+0000 7f23dbe00640 1 --2- 172.21.15.87:0/4222859924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23dc06c940 0x7f23dc06cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:53.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.820+0000 7f23d2a00640 1 -- 172.21.15.87:0/4222859924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23dc06c940 msgr2=0x7f23dc06cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:53.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.820+0000 7f23d2a00640 1 --2- 172.21.15.87:0/4222859924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23dc06c940 0x7f23dc06cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:53.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.820+0000 7f23d2a00640 1 -- 172.21.15.87:0/4222859924 >> v1:172.21.15.149:6789/0 conn(0x7f23dc157310 legacy=0x7f23dc15dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:53.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.820+0000 7f23d2a00640 1 -- 172.21.15.87:0/4222859924 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23dc0cf810 con 0x7f23dc0d1700 2024-05-27T06:29:53.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.824+0000 7f23d2a00640 1 --2- 172.21.15.87:0/4222859924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23dc0d1700 0x7f23dc0d1b10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f23c40098a0 tx=0x7f23c401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9400f85f49cd13 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:53.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.824+0000 7f23daa00640 1 -- 172.21.15.87:0/4222859924 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c40ab430 con 0x7f23dc0d1700 2024-05-27T06:29:53.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.824+0000 7f23daa00640 1 -- 172.21.15.87:0/4222859924 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23c40b0070 con 0x7f23dc0d1700 2024-05-27T06:29:53.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.824+0000 7f23daa00640 1 -- 172.21.15.87:0/4222859924 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c40ab7f0 con 0x7f23dc0d1700 2024-05-27T06:29:53.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.824+0000 7f23e2600640 1 -- 172.21.15.87:0/4222859924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23dc0d1700 msgr2=0x7f23dc0d1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:53.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.824+0000 7f23e2600640 1 --2- 172.21.15.87:0/4222859924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23dc0d1700 0x7f23dc0d1b10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f23c40098a0 tx=0x7f23c401c540 comp rx=0 tx=0).stop 2024-05-27T06:29:53.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.824+0000 7f23e2600640 1 -- 172.21.15.87:0/4222859924 shutdown_connections 2024-05-27T06:29:53.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.824+0000 7f23e2600640 1 --2- 172.21.15.87:0/4222859924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23dc06c940 0x7f23dc06cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:53.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.824+0000 7f23e2600640 1 --2- 172.21.15.87:0/4222859924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23dc0d1700 0x7f23dc0d1b10 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:53.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.824+0000 7f23e2600640 1 -- 172.21.15.87:0/4222859924 >> 172.21.15.87:0/4222859924 conn(0x7f23dc0b46b0 msgr2=0x7f23dc0b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:53.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.824+0000 7f23e2600640 1 -- 172.21.15.87:0/4222859924 shutdown_connections 2024-05-27T06:29:53.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.824+0000 7f23e2600640 1 -- 172.21.15.87:0/4222859924 wait complete. 2024-05-27T06:29:53.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.828+0000 7f23e2600640 1 Processor -- start 2024-05-27T06:29:53.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.828+0000 7f23e2600640 1 -- start start 2024-05-27T06:29:53.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.828+0000 7f23e2600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23dc06c940 0x7f23dc14fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:53.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.828+0000 7f23e2600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23dc0d1700 0x7f23dc15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:53.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.828+0000 7f23e2600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23dc157310 0x7f23dc15f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:53.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.828+0000 7f23e2600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc070640 con 0x7f23dc06c940 2024-05-27T06:29:53.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.828+0000 7f23e2600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc06d6a0 con 0x7f23dc157310 2024-05-27T06:29:53.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.828+0000 7f23e2600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f23dc0707c0 con 0x7f23dc0d1700 2024-05-27T06:29:53.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.828+0000 7f23db400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23dc06c940 0x7f23dc14fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:53.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.828+0000 7f23db400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23dc06c940 0x7f23dc14fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33644/0 (socket says 172.21.15.87:33644) 2024-05-27T06:29:53.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.828+0000 7f23db400640 1 -- 172.21.15.87:0/2987685899 learned_addr learned my addr 172.21.15.87:0/2987685899 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:53.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.828+0000 7f23d2a00640 1 --2- 172.21.15.87:0/2987685899 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23dc0d1700 0x7f23dc15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:53.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.828+0000 7f23dbe00640 1 --2- 172.21.15.87:0/2987685899 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23dc157310 0x7f23dc15f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:53.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.828+0000 7f23db400640 1 -- 172.21.15.87:0/2987685899 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23dc0d1700 msgr2=0x7f23dc15eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:53.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.828+0000 7f23db400640 1 --2- 172.21.15.87:0/2987685899 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23dc0d1700 0x7f23dc15eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:53.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.828+0000 7f23db400640 1 -- 172.21.15.87:0/2987685899 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23dc157310 msgr2=0x7f23dc15f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:53.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.828+0000 7f23db400640 1 --2- 172.21.15.87:0/2987685899 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23dc157310 0x7f23dc15f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:53.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.828+0000 7f23db400640 1 -- 172.21.15.87:0/2987685899 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23dc2019d0 con 0x7f23dc06c940 2024-05-27T06:29:53.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.828+0000 7f23dbe00640 1 --2- 172.21.15.87:0/2987685899 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23dc157310 0x7f23dc15f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:29:53.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.828+0000 7f23db400640 1 --2- 172.21.15.87:0/2987685899 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23dc06c940 0x7f23dc14fa90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00c760 tx=0x7f23cc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:53.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.828+0000 7f23d3e00640 1 -- 172.21.15.87:0/2987685899 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23cc003b80 con 0x7f23dc06c940 2024-05-27T06:29:53.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.832+0000 7f23d3e00640 1 -- 172.21.15.87:0/2987685899 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23cc003d20 con 0x7f23dc06c940 2024-05-27T06:29:53.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.832+0000 7f23e2600640 1 -- 172.21.15.87:0/2987685899 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23dc201cb0 con 0x7f23dc06c940 2024-05-27T06:29:53.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.832+0000 7f23d3e00640 1 -- 172.21.15.87:0/2987685899 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23cc00aa90 con 0x7f23dc06c940 2024-05-27T06:29:53.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.832+0000 7f23e2600640 1 -- 172.21.15.87:0/2987685899 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23dc202270 con 0x7f23dc06c940 2024-05-27T06:29:53.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.832+0000 7f23e2600640 1 -- 172.21.15.87:0/2987685899 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23dc06aa30 con 0x7f23dc06c940 2024-05-27T06:29:53.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.832+0000 7f23d3e00640 1 -- 172.21.15.87:0/2987685899 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f23cc00ac30 con 0x7f23dc06c940 2024-05-27T06:29:53.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.832+0000 7f23d3e00640 1 --2- 172.21.15.87:0/2987685899 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f23b806f400 0x7f23b8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:53.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.832+0000 7f23d3e00640 1 -- 172.21.15.87:0/2987685899 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f23cc08f2c0 con 0x7f23dc06c940 2024-05-27T06:29:53.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.832+0000 7f23d2a00640 1 --2- 172.21.15.87:0/2987685899 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f23b806f400 0x7f23b8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:53.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.836+0000 7f23d2a00640 1 --2- 172.21.15.87:0/2987685899 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f23b806f400 0x7f23b8071910 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f23c40af000 tx=0x7f23c4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:53.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:53.836+0000 7f23d3e00640 1 -- 172.21.15.87:0/2987685899 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f23dc0d2050 con 0x7f23dc06c940 2024-05-27T06:29:54.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.052+0000 7f23e2600640 1 -- 172.21.15.87:0/2987685899 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]} v 0) -- 0x7f23dc15cb90 con 0x7f23dc06c940 2024-05-27T06:29:54.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.056+0000 7f23d3e00640 1 -- 172.21.15.87:0/2987685899 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]}]=0 updated caps for client.0 v19) ==== 183+0+140 (secure 0 0 0) 0x7f23cc05c010 con 0x7f23dc06c940 2024-05-27T06:29:54.056 INFO:teuthology.orchestra.run.smithi087.stdout:[client.0] 2024-05-27T06:29:54.056 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCfJ1RmAld8BxAAigqU2F3mGXtAfw0L9Bfp2A== 2024-05-27T06:29:54.056 INFO:teuthology.orchestra.run.smithi087.stdout: caps mds = "allow" 2024-05-27T06:29:54.056 INFO:teuthology.orchestra.run.smithi087.stdout: caps mon = "allow r" 2024-05-27T06:29:54.056 INFO:teuthology.orchestra.run.smithi087.stdout: caps osd = "allow w pool=cephfs_data" 2024-05-27T06:29:54.056 INFO:teuthology.orchestra.run.smithi087.stderr:updated caps for client.0 2024-05-27T06:29:54.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.060+0000 7f23e2600640 1 -- 172.21.15.87:0/2987685899 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f23b806f400 msgr2=0x7f23b8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:54.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.060+0000 7f23e2600640 1 --2- 172.21.15.87:0/2987685899 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f23b806f400 0x7f23b8071910 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f23c40af000 tx=0x7f23c4008040 comp rx=0 tx=0).stop 2024-05-27T06:29:54.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.060+0000 7f23e2600640 1 -- 172.21.15.87:0/2987685899 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23dc06c940 msgr2=0x7f23dc14fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:54.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.060+0000 7f23e2600640 1 --2- 172.21.15.87:0/2987685899 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23dc06c940 0x7f23dc14fa90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00c760 tx=0x7f23cc00cc20 comp rx=0 tx=0).stop 2024-05-27T06:29:54.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.060+0000 7f23e2600640 1 -- 172.21.15.87:0/2987685899 shutdown_connections 2024-05-27T06:29:54.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.060+0000 7f23e2600640 1 --2- 172.21.15.87:0/2987685899 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f23b806f400 0x7f23b8071910 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:54.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.060+0000 7f23e2600640 1 --2- 172.21.15.87:0/2987685899 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23dc157310 0x7f23dc15f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:54.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.060+0000 7f23e2600640 1 --2- 172.21.15.87:0/2987685899 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23dc0d1700 0x7f23dc15eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:54.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.060+0000 7f23e2600640 1 --2- 172.21.15.87:0/2987685899 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23dc06c940 0x7f23dc14fa90 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:54.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.060+0000 7f23e2600640 1 -- 172.21.15.87:0/2987685899 >> 172.21.15.87:0/2987685899 conn(0x7f23dc0b46b0 msgr2=0x7f23dc073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:54.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.060+0000 7f23e2600640 1 -- 172.21.15.87:0/2987685899 shutdown_connections 2024-05-27T06:29:54.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.060+0000 7f23e2600640 1 -- 172.21.15.87:0/2987685899 wait complete. 2024-05-27T06:29:54.077 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:29:54.078 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:29:54.086 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T06:29:54.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.280+0000 7fde38e00640 1 Processor -- start 2024-05-27T06:29:54.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.280+0000 7fde38e00640 1 -- start start 2024-05-27T06:29:54.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.284+0000 7fde38e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fde34160f60 0x7fde3406f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:54.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.284+0000 7fde38e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fde3406f8f0 0x7fde340d0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:54.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.284+0000 7fde38e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde340d0ca0 0x7fde340b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:54.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.284+0000 7fde38e00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fde340b6e70 con 0x7fde3406f8f0 2024-05-27T06:29:54.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.284+0000 7fde38e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fde340d02d0 con 0x7fde34160f60 2024-05-27T06:29:54.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.284+0000 7fde38e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fde340b0c60 con 0x7fde340d0ca0 2024-05-27T06:29:54.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.284+0000 7fde29400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fde3406f8f0 0x7fde340d0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:54.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.284+0000 7fde29400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fde3406f8f0 0x7fde340d0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33648/0 (socket says 172.21.15.87:33648) 2024-05-27T06:29:54.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.284+0000 7fde29400640 1 -- 172.21.15.87:0/218462472 learned_addr learned my addr 172.21.15.87:0/218462472 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:54.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.284+0000 7fde31e00640 1 --2- 172.21.15.87:0/218462472 >> v2:172.21.15.149:3300/0 conn(0x7fde34160f60 0x7fde3406f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:54.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.284+0000 7fde32800640 1 --2- 172.21.15.87:0/218462472 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde340d0ca0 0x7fde340b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:54.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.284+0000 7fde29400640 1 -- 172.21.15.87:0/218462472 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde340d0ca0 msgr2=0x7fde340b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:54.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.284+0000 7fde29400640 1 --2- 172.21.15.87:0/218462472 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde340d0ca0 0x7fde340b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:54.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.284+0000 7fde29400640 1 -- 172.21.15.87:0/218462472 >> v2:172.21.15.149:3300/0 conn(0x7fde34160f60 msgr2=0x7fde3406f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:54.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.284+0000 7fde29400640 1 --2- 172.21.15.87:0/218462472 >> v2:172.21.15.149:3300/0 conn(0x7fde34160f60 0x7fde3406f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:54.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.284+0000 7fde29400640 1 -- 172.21.15.87:0/218462472 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde34071d60 con 0x7fde3406f8f0 2024-05-27T06:29:54.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.288+0000 7fde29400640 1 --2- 172.21.15.87:0/218462472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde3406f8f0 0x7fde340d0760 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fde34072a80 tx=0x7fde1c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5359d20b12334d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:54.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.288+0000 7fde31400640 1 -- 172.21.15.87:0/218462472 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c0b0070 con 0x7fde3406f8f0 2024-05-27T06:29:54.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.288+0000 7fde31400640 1 -- 172.21.15.87:0/218462472 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde1c0ab600 con 0x7fde3406f8f0 2024-05-27T06:29:54.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.288+0000 7fde31400640 1 -- 172.21.15.87:0/218462472 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c0ab9d0 con 0x7fde3406f8f0 2024-05-27T06:29:54.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.288+0000 7fde38e00640 1 -- 172.21.15.87:0/218462472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde3406f8f0 msgr2=0x7fde340d0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:54.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.288+0000 7fde38e00640 1 --2- 172.21.15.87:0/218462472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde3406f8f0 0x7fde340d0760 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fde34072a80 tx=0x7fde1c01c520 comp rx=0 tx=0).stop 2024-05-27T06:29:54.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.288+0000 7fde38e00640 1 -- 172.21.15.87:0/218462472 shutdown_connections 2024-05-27T06:29:54.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.288+0000 7fde38e00640 1 --2- 172.21.15.87:0/218462472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde3406f8f0 0x7fde340d0760 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:54.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.288+0000 7fde38e00640 1 --2- 172.21.15.87:0/218462472 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde340d0ca0 0x7fde340b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:54.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.288+0000 7fde38e00640 1 --2- 172.21.15.87:0/218462472 >> v2:172.21.15.149:3300/0 conn(0x7fde34160f60 0x7fde3406f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:54.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.288+0000 7fde38e00640 1 -- 172.21.15.87:0/218462472 >> 172.21.15.87:0/218462472 conn(0x7fde340ce610 msgr2=0x7fde340cea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:54.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.288+0000 7fde38e00640 1 -- 172.21.15.87:0/218462472 shutdown_connections 2024-05-27T06:29:54.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.288+0000 7fde38e00640 1 -- 172.21.15.87:0/218462472 wait complete. 2024-05-27T06:29:54.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.288+0000 7fde38e00640 1 Processor -- start 2024-05-27T06:29:54.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.288+0000 7fde38e00640 1 -- start start 2024-05-27T06:29:54.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.292+0000 7fde38e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde3406f8f0 0x7fde34158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:54.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.292+0000 7fde38e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde340d0ca0 0x7fde341455c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:54.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.292+0000 7fde38e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde34160f60 0x7fde340b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:54.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.292+0000 7fde38e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fde34161370 con 0x7fde340d0ca0 2024-05-27T06:29:54.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.292+0000 7fde38e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fde340b5450 con 0x7fde34160f60 2024-05-27T06:29:54.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.292+0000 7fde38e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fde3415dd00 con 0x7fde3406f8f0 2024-05-27T06:29:54.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.292+0000 7fde29400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde340d0ca0 0x7fde341455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:54.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.292+0000 7fde29400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde340d0ca0 0x7fde341455c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33658/0 (socket says 172.21.15.87:33658) 2024-05-27T06:29:54.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.292+0000 7fde29400640 1 -- 172.21.15.87:0/3790430651 learned_addr learned my addr 172.21.15.87:0/3790430651 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:54.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.292+0000 7fde31e00640 1 --2- 172.21.15.87:0/3790430651 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde3406f8f0 0x7fde34158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:54.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.292+0000 7fde32800640 1 --2- 172.21.15.87:0/3790430651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde34160f60 0x7fde340b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:54.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.292+0000 7fde29400640 1 -- 172.21.15.87:0/3790430651 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde3406f8f0 msgr2=0x7fde34158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:54.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.292+0000 7fde29400640 1 --2- 172.21.15.87:0/3790430651 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde3406f8f0 0x7fde34158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:54.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.292+0000 7fde29400640 1 -- 172.21.15.87:0/3790430651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde34160f60 msgr2=0x7fde340b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:54.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.292+0000 7fde29400640 1 --2- 172.21.15.87:0/3790430651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde34160f60 0x7fde340b02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:54.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.292+0000 7fde29400640 1 -- 172.21.15.87:0/3790430651 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde340af4e0 con 0x7fde340d0ca0 2024-05-27T06:29:54.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.292+0000 7fde32800640 1 --2- 172.21.15.87:0/3790430651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde34160f60 0x7fde340b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:29:54.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.292+0000 7fde29400640 1 --2- 172.21.15.87:0/3790430651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde340d0ca0 0x7fde341455c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fde1c0ae040 tx=0x7fde1c0192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:54.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.292+0000 7fde2aa00640 1 -- 172.21.15.87:0/3790430651 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c0ba070 con 0x7fde340d0ca0 2024-05-27T06:29:54.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.292+0000 7fde2aa00640 1 -- 172.21.15.87:0/3790430651 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde1c0b4620 con 0x7fde340d0ca0 2024-05-27T06:29:54.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.292+0000 7fde2aa00640 1 -- 172.21.15.87:0/3790430651 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c0b0040 con 0x7fde340d0ca0 2024-05-27T06:29:54.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.292+0000 7fde38e00640 1 -- 172.21.15.87:0/3790430651 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde340af7c0 con 0x7fde340d0ca0 2024-05-27T06:29:54.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.292+0000 7fde38e00640 1 -- 172.21.15.87:0/3790430651 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde34145b00 con 0x7fde340d0ca0 2024-05-27T06:29:54.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.292+0000 7fde38e00640 1 -- 172.21.15.87:0/3790430651 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde3406aa30 con 0x7fde340d0ca0 2024-05-27T06:29:54.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.296+0000 7fde2aa00640 1 -- 172.21.15.87:0/3790430651 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fde1c0bd070 con 0x7fde340d0ca0 2024-05-27T06:29:54.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.296+0000 7fde2aa00640 1 --2- 172.21.15.87:0/3790430651 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fde1006f430 0x7fde10071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:54.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.296+0000 7fde2aa00640 1 -- 172.21.15.87:0/3790430651 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fde1c1286d0 con 0x7fde340d0ca0 2024-05-27T06:29:54.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.296+0000 7fde31e00640 1 --2- 172.21.15.87:0/3790430651 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fde1006f430 0x7fde10071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:54.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.296+0000 7fde31e00640 1 --2- 172.21.15.87:0/3790430651 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fde1006f430 0x7fde10071940 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fde24011340 tx=0x7fde2400b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:54.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.300+0000 7fde2aa00640 1 -- 172.21.15.87:0/3790430651 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fde1c0eff50 con 0x7fde340d0ca0 2024-05-27T06:29:54.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.472+0000 7fde38e00640 1 -- 172.21.15.87:0/3790430651 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fde34159640 con 0x7fde340d0ca0 2024-05-27T06:29:54.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.472+0000 7fde2aa00640 1 -- 172.21.15.87:0/3790430651 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) ==== 80+0+0 (secure 0 0 0) 0x7fde1c016110 con 0x7fde340d0ca0 2024-05-27T06:29:54.471 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2024-05-27T06:29:54.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.472+0000 7fde38e00640 1 -- 172.21.15.87:0/3790430651 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fde1006f430 msgr2=0x7fde10071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:54.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.472+0000 7fde38e00640 1 --2- 172.21.15.87:0/3790430651 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fde1006f430 0x7fde10071940 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fde24011340 tx=0x7fde2400b040 comp rx=0 tx=0).stop 2024-05-27T06:29:54.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.472+0000 7fde38e00640 1 -- 172.21.15.87:0/3790430651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde340d0ca0 msgr2=0x7fde341455c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:54.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.472+0000 7fde38e00640 1 --2- 172.21.15.87:0/3790430651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde340d0ca0 0x7fde341455c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fde1c0ae040 tx=0x7fde1c0192c0 comp rx=0 tx=0).stop 2024-05-27T06:29:54.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.472+0000 7fde38e00640 1 -- 172.21.15.87:0/3790430651 shutdown_connections 2024-05-27T06:29:54.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.472+0000 7fde38e00640 1 --2- 172.21.15.87:0/3790430651 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fde1006f430 0x7fde10071940 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:54.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.472+0000 7fde38e00640 1 --2- 172.21.15.87:0/3790430651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde34160f60 0x7fde340b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:54.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.472+0000 7fde38e00640 1 --2- 172.21.15.87:0/3790430651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde340d0ca0 0x7fde341455c0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:54.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.472+0000 7fde38e00640 1 --2- 172.21.15.87:0/3790430651 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde3406f8f0 0x7fde34158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:54.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.472+0000 7fde38e00640 1 -- 172.21.15.87:0/3790430651 >> 172.21.15.87:0/3790430651 conn(0x7fde340ce610 msgr2=0x7fde3415ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:54.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.472+0000 7fde38e00640 1 -- 172.21.15.87:0/3790430651 shutdown_connections 2024-05-27T06:29:54.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.472+0000 7fde38e00640 1 -- 172.21.15.87:0/3790430651 wait complete. 2024-05-27T06:29:54.492 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:29:54.493 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:29:54.501 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T06:29:54.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.692+0000 7f3b93c00640 1 Processor -- start 2024-05-27T06:29:54.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.692+0000 7f3b93c00640 1 -- start start 2024-05-27T06:29:54.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.696+0000 7f3b93c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b8c0cddb0 0x7f3b8c0b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:54.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.696+0000 7f3b93c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3b8c0b0a20 0x7f3b8c161f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:54.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.696+0000 7f3b93c00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b8c071d60 con 0x7f3b8c0ce1c0 2024-05-27T06:29:54.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.696+0000 7f3b93c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f3b8c141080 con 0x7f3b8c0b0a20 2024-05-27T06:29:54.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.696+0000 7f3b93c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3b8c0b0e30 con 0x7f3b8c0cddb0 2024-05-27T06:29:54.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.696+0000 7f3b91200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b8c0cddb0 0x7f3b8c0b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:54.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.696+0000 7f3b91c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3b8c0b0a20 0x7f3b8c161f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:54.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.696+0000 7f3b91200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b8c0cddb0 0x7f3b8c0b04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.87:42748/0 (socket says 172.21.15.87:42748) 2024-05-27T06:29:54.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.696+0000 7f3b91200640 1 -- 172.21.15.87:0/1014512592 learned_addr learned my addr 172.21.15.87:0/1014512592 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:54.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.696+0000 7f3b83e00640 1 --1- 172.21.15.87:0/1014512592 >> v1:172.21.15.149:6789/0 conn(0x7f3b8c0ce1c0 0x7f3b8c161860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.87:45870/0 (socket says 172.21.15.87:45870) 2024-05-27T06:29:54.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.696+0000 7f3b91200640 1 -- 172.21.15.87:0/1014512592 >> v2:172.21.15.149:3300/0 conn(0x7f3b8c0b0a20 msgr2=0x7f3b8c161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:29:54.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.696+0000 7f3b91200640 1 --2- 172.21.15.87:0/1014512592 >> v2:172.21.15.149:3300/0 conn(0x7f3b8c0b0a20 0x7f3b8c161f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:54.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.696+0000 7f3b91200640 1 -- 172.21.15.87:0/1014512592 >> v1:172.21.15.149:6789/0 conn(0x7f3b8c0ce1c0 legacy=0x7f3b8c161860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:54.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.696+0000 7f3b91200640 1 -- 172.21.15.87:0/1014512592 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8c06cd80 con 0x7f3b8c0cddb0 2024-05-27T06:29:54.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.696+0000 7f3b8be00640 1 -- 172.21.15.87:0/1014512592 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1308534985 0 0) 0x7f3b8c071d60 con 0x7f3b8c0ce1c0 2024-05-27T06:29:54.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.696+0000 7f3b91c00640 1 --2- 172.21.15.87:0/1014512592 >> v2:172.21.15.149:3300/0 conn(0x7f3b8c0b0a20 0x7f3b8c161f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:29:54.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.700+0000 7f3b91200640 1 --2- 172.21.15.87:0/1014512592 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b8c0cddb0 0x7f3b8c0b04e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009870 tx=0x7f3b7c01c580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8826be6c2ea6a66b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:54.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.700+0000 7f3b8be00640 1 -- 172.21.15.87:0/1014512592 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c0b2070 con 0x7f3b8c0cddb0 2024-05-27T06:29:54.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.700+0000 7f3b8be00640 1 -- 172.21.15.87:0/1014512592 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b7c0ad680 con 0x7f3b8c0cddb0 2024-05-27T06:29:54.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.700+0000 7f3b8be00640 1 -- 172.21.15.87:0/1014512592 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c0ada50 con 0x7f3b8c0cddb0 2024-05-27T06:29:54.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.700+0000 7f3b93c00640 1 -- 172.21.15.87:0/1014512592 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b8c0cddb0 msgr2=0x7f3b8c0b04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:54.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.700+0000 7f3b93c00640 1 --2- 172.21.15.87:0/1014512592 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b8c0cddb0 0x7f3b8c0b04e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009870 tx=0x7f3b7c01c580 comp rx=0 tx=0).stop 2024-05-27T06:29:54.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.700+0000 7f3b93c00640 1 -- 172.21.15.87:0/1014512592 shutdown_connections 2024-05-27T06:29:54.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.700+0000 7f3b93c00640 1 --2- 172.21.15.87:0/1014512592 >> v2:172.21.15.149:3300/0 conn(0x7f3b8c0b0a20 0x7f3b8c161f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:54.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.700+0000 7f3b93c00640 1 --2- 172.21.15.87:0/1014512592 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b8c0cddb0 0x7f3b8c0b04e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:54.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.700+0000 7f3b93c00640 1 -- 172.21.15.87:0/1014512592 >> 172.21.15.87:0/1014512592 conn(0x7f3b8c0ce610 msgr2=0x7f3b8c0cea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:54.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.700+0000 7f3b93c00640 1 -- 172.21.15.87:0/1014512592 shutdown_connections 2024-05-27T06:29:54.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.700+0000 7f3b93c00640 1 -- 172.21.15.87:0/1014512592 wait complete. 2024-05-27T06:29:54.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.704+0000 7f3b93c00640 1 Processor -- start 2024-05-27T06:29:54.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.704+0000 7f3b93c00640 1 -- start start 2024-05-27T06:29:54.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.704+0000 7f3b93c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b8c0b0a20 0x7f3b8c160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:54.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.704+0000 7f3b93c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b8c0cddb0 0x7f3b8c15f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:54.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.704+0000 7f3b93c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b8c0ce1c0 0x7f3b8c15f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:54.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.704+0000 7f3b93c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c15f0c0 con 0x7f3b8c0b0a20 2024-05-27T06:29:54.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.704+0000 7f3b93c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c06e6d0 con 0x7f3b8c0ce1c0 2024-05-27T06:29:54.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.704+0000 7f3b93c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3b8c15f240 con 0x7f3b8c0cddb0 2024-05-27T06:29:54.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.704+0000 7f3b91200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b8c0b0a20 0x7f3b8c160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:54.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.704+0000 7f3b91200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b8c0b0a20 0x7f3b8c160fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33664/0 (socket says 172.21.15.87:33664) 2024-05-27T06:29:54.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.704+0000 7f3b91200640 1 -- 172.21.15.87:0/795865558 learned_addr learned my addr 172.21.15.87:0/795865558 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:29:54.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.704+0000 7f3b83e00640 1 --2- 172.21.15.87:0/795865558 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b8c0cddb0 0x7f3b8c15f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:54.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.704+0000 7f3b91c00640 1 --2- 172.21.15.87:0/795865558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b8c0ce1c0 0x7f3b8c15f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:54.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.704+0000 7f3b91200640 1 -- 172.21.15.87:0/795865558 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b8c0cddb0 msgr2=0x7f3b8c15f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:54.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.704+0000 7f3b91200640 1 --2- 172.21.15.87:0/795865558 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b8c0cddb0 0x7f3b8c15f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:54.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.704+0000 7f3b91200640 1 -- 172.21.15.87:0/795865558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b8c0ce1c0 msgr2=0x7f3b8c15f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:54.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.704+0000 7f3b91200640 1 --2- 172.21.15.87:0/795865558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b8c0ce1c0 0x7f3b8c15f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:54.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.704+0000 7f3b91200640 1 -- 172.21.15.87:0/795865558 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8c13d6c0 con 0x7f3b8c0b0a20 2024-05-27T06:29:54.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.704+0000 7f3b91c00640 1 --2- 172.21.15.87:0/795865558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b8c0ce1c0 0x7f3b8c15f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:29:54.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.704+0000 7f3b83e00640 1 --2- 172.21.15.87:0/795865558 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b8c0cddb0 0x7f3b8c15f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:29:54.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.704+0000 7f3b91200640 1 --2- 172.21.15.87:0/795865558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b8c0b0a20 0x7f3b8c160fa0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c01ac30 tx=0x7f3b7c01adc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:54.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.704+0000 7f3b89600640 1 -- 172.21.15.87:0/795865558 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c0bd070 con 0x7f3b8c0b0a20 2024-05-27T06:29:54.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.704+0000 7f3b89600640 1 -- 172.21.15.87:0/795865558 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b7c0b8410 con 0x7f3b8c0b0a20 2024-05-27T06:29:54.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.704+0000 7f3b89600640 1 -- 172.21.15.87:0/795865558 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c0b2040 con 0x7f3b8c0b0a20 2024-05-27T06:29:54.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.704+0000 7f3b93c00640 1 -- 172.21.15.87:0/795865558 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b8c13d9a0 con 0x7f3b8c0b0a20 2024-05-27T06:29:54.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.704+0000 7f3b93c00640 1 -- 172.21.15.87:0/795865558 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b8c157e90 con 0x7f3b8c0b0a20 2024-05-27T06:29:54.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.708+0000 7f3b93c00640 1 -- 172.21.15.87:0/795865558 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b8c15fe90 con 0x7f3b8c0b0a20 2024-05-27T06:29:54.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.708+0000 7f3b89600640 1 -- 172.21.15.87:0/795865558 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3b7c0b73b0 con 0x7f3b8c0b0a20 2024-05-27T06:29:54.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.708+0000 7f3b89600640 1 --2- 172.21.15.87:0/795865558 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3b6806f400 0x7f3b68071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:29:54.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.708+0000 7f3b89600640 1 -- 172.21.15.87:0/795865558 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f3b7c128c90 con 0x7f3b8c0b0a20 2024-05-27T06:29:54.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.708+0000 7f3b83e00640 1 --2- 172.21.15.87:0/795865558 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3b6806f400 0x7f3b68071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:29:54.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.708+0000 7f3b83e00640 1 --2- 172.21.15.87:0/795865558 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3b6806f400 0x7f3b68071910 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0d1550 tx=0x7f3b74009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:29:54.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.712+0000 7f3b89600640 1 -- 172.21.15.87:0/795865558 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f3b8c15fe90 con 0x7f3b8c0b0a20 2024-05-27T06:29:54.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.880+0000 7f3b93c00640 1 -- 172.21.15.87:0/795865558 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3b8c06aa30 con 0x7f3b8c0b0a20 2024-05-27T06:29:54.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.884+0000 7f3b89600640 1 -- 172.21.15.87:0/795865558 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) ==== 80+0+0 (secure 0 0 0) 0x7f3b7c016170 con 0x7f3b8c0b0a20 2024-05-27T06:29:54.881 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2024-05-27T06:29:54.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.884+0000 7f3b93c00640 1 -- 172.21.15.87:0/795865558 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3b6806f400 msgr2=0x7f3b68071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:54.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.884+0000 7f3b93c00640 1 --2- 172.21.15.87:0/795865558 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3b6806f400 0x7f3b68071910 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0d1550 tx=0x7f3b74009040 comp rx=0 tx=0).stop 2024-05-27T06:29:54.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.884+0000 7f3b93c00640 1 -- 172.21.15.87:0/795865558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b8c0b0a20 msgr2=0x7f3b8c160fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:29:54.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.884+0000 7f3b93c00640 1 --2- 172.21.15.87:0/795865558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b8c0b0a20 0x7f3b8c160fa0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c01ac30 tx=0x7f3b7c01adc0 comp rx=0 tx=0).stop 2024-05-27T06:29:54.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.884+0000 7f3b93c00640 1 -- 172.21.15.87:0/795865558 shutdown_connections 2024-05-27T06:29:54.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.884+0000 7f3b93c00640 1 --2- 172.21.15.87:0/795865558 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3b6806f400 0x7f3b68071910 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:54.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.884+0000 7f3b93c00640 1 --2- 172.21.15.87:0/795865558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b8c0ce1c0 0x7f3b8c15f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:54.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.884+0000 7f3b93c00640 1 --2- 172.21.15.87:0/795865558 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b8c0cddb0 0x7f3b8c15f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:54.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.884+0000 7f3b93c00640 1 --2- 172.21.15.87:0/795865558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b8c0b0a20 0x7f3b8c160fa0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:29:54.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.884+0000 7f3b93c00640 1 -- 172.21.15.87:0/795865558 >> 172.21.15.87:0/795865558 conn(0x7f3b8c0ce610 msgr2=0x7f3b8c13b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:29:54.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.884+0000 7f3b93c00640 1 -- 172.21.15.87:0/795865558 shutdown_connections 2024-05-27T06:29:54.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:29:54.884+0000 7f3b93c00640 1 -- 172.21.15.87:0/795865558 wait complete. 2024-05-27T06:29:54.903 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-05-27T06:29:54.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:29:54.903 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-27T06:29:54.921 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[39347]: fuse finished with error 0 and tester_r 0 2024-05-27T06:29:54.923 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:30:01.024 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-05-27T06:30:01.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:30:01.025 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-27T06:30:01.035 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-27T06:30:01.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.232+0000 7f15a3000640 1 Processor -- start 2024-05-27T06:30:01.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.232+0000 7f15a3000640 1 -- start start 2024-05-27T06:30:01.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.232+0000 7f15a3000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f159c0d2010 0x7f159c0d2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:01.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.232+0000 7f15a3000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f159c0d2960 con 0x7f159c0cea40 2024-05-27T06:30:01.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.232+0000 7f15a3000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f159c0b2cd0 con 0x7f159c0b2fb0 2024-05-27T06:30:01.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.232+0000 7f15a3000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f159c0ce5b0 con 0x7f159c0d2010 2024-05-27T06:30:01.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.232+0000 7f1593e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f159c0d2010 0x7f159c0d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:01.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.232+0000 7f159be00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f159c0cea40 0x7f159c158360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:46786/0 (socket says 172.21.15.87:46786) 2024-05-27T06:30:01.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.232+0000 7f159be00640 1 -- 172.21.15.87:0/3167693227 learned_addr learned my addr 172.21.15.87:0/3167693227 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:30:01.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.232+0000 7f1593e00640 1 -- 172.21.15.87:0/3167693227 >> v1:172.21.15.149:6789/0 conn(0x7f159c0b2fb0 legacy=0x7f159c0b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:01.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.232+0000 7f1593e00640 1 -- 172.21.15.87:0/3167693227 >> v1:172.21.15.87:6789/0 conn(0x7f159c0cea40 legacy=0x7f159c158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:01.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.232+0000 7f1593e00640 1 -- 172.21.15.87:0/3167693227 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f159c0cdc80 con 0x7f159c0d2010 2024-05-27T06:30:01.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.232+0000 7f159b400640 1 -- 172.21.15.87:0/3167693227 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 427649402 0 0) 0x7f158c001120 con 0x7f159c0cea40 2024-05-27T06:30:01.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.236+0000 7f1593e00640 1 --2- 172.21.15.87:0/3167693227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f159c0d2010 0x7f159c0d2420 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f15840097c0 tx=0x7f158401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586e2b02efdc592c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:01.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.236+0000 7f159b400640 1 -- 172.21.15.87:0/3167693227 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15840b2070 con 0x7f159c0d2010 2024-05-27T06:30:01.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.236+0000 7f159b400640 1 -- 172.21.15.87:0/3167693227 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15840ad640 con 0x7f159c0d2010 2024-05-27T06:30:01.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.236+0000 7f159b400640 1 -- 172.21.15.87:0/3167693227 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15840ada10 con 0x7f159c0d2010 2024-05-27T06:30:01.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.236+0000 7f15a3000640 1 -- 172.21.15.87:0/3167693227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f159c0d2010 msgr2=0x7f159c0d2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:01.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.236+0000 7f15a3000640 1 --2- 172.21.15.87:0/3167693227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f159c0d2010 0x7f159c0d2420 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f15840097c0 tx=0x7f158401c4a0 comp rx=0 tx=0).stop 2024-05-27T06:30:01.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.236+0000 7f15a3000640 1 -- 172.21.15.87:0/3167693227 shutdown_connections 2024-05-27T06:30:01.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.236+0000 7f15a3000640 1 --2- 172.21.15.87:0/3167693227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f159c0d2010 0x7f159c0d2420 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:01.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.236+0000 7f15a3000640 1 -- 172.21.15.87:0/3167693227 >> 172.21.15.87:0/3167693227 conn(0x7f159c0d3590 msgr2=0x7f159c0d39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:01.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.236+0000 7f15a3000640 1 -- 172.21.15.87:0/3167693227 shutdown_connections 2024-05-27T06:30:01.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.236+0000 7f15a3000640 1 -- 172.21.15.87:0/3167693227 wait complete. 2024-05-27T06:30:01.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.240+0000 7f15a3000640 1 Processor -- start 2024-05-27T06:30:01.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.240+0000 7f15a3000640 1 -- start start 2024-05-27T06:30:01.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.240+0000 7f15a3000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f159c0b2fb0 0x7f159c160730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:01.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.240+0000 7f15a3000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f159c0cea40 0x7f159c15a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:01.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.240+0000 7f15a3000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f159c0d2010 0x7f159c15aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:01.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.240+0000 7f15a3000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f159c0d2ee0 con 0x7f159c0b2fb0 2024-05-27T06:30:01.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.240+0000 7f15a3000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f159c0d2d60 con 0x7f159c0cea40 2024-05-27T06:30:01.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.240+0000 7f15a3000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f159c0cee50 con 0x7f159c0d2010 2024-05-27T06:30:01.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.240+0000 7f159be00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f159c0b2fb0 0x7f159c160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:01.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.240+0000 7f159be00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f159c0b2fb0 0x7f159c160730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46938/0 (socket says 172.21.15.87:46938) 2024-05-27T06:30:01.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.240+0000 7f159be00640 1 -- 172.21.15.87:0/1865578312 learned_addr learned my addr 172.21.15.87:0/1865578312 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:01.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.240+0000 7f1593e00640 1 --2- 172.21.15.87:0/1865578312 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f159c0cea40 0x7f159c15a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:01.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.240+0000 7f15a1000640 1 --2- 172.21.15.87:0/1865578312 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f159c0d2010 0x7f159c15aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:01.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.240+0000 7f159be00640 1 -- 172.21.15.87:0/1865578312 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f159c0d2010 msgr2=0x7f159c15aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:01.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.240+0000 7f159be00640 1 --2- 172.21.15.87:0/1865578312 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f159c0d2010 0x7f159c15aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:01.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.240+0000 7f159be00640 1 -- 172.21.15.87:0/1865578312 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f159c0cea40 msgr2=0x7f159c15a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:01.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.240+0000 7f159be00640 1 --2- 172.21.15.87:0/1865578312 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f159c0cea40 0x7f159c15a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:01.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.240+0000 7f159be00640 1 -- 172.21.15.87:0/1865578312 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f159c161460 con 0x7f159c0b2fb0 2024-05-27T06:30:01.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.244+0000 7f159be00640 1 --2- 172.21.15.87:0/1865578312 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f159c0b2fb0 0x7f159c160730 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f158c00c400 tx=0x7f158c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:01.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.244+0000 7f1598c00640 1 -- 172.21.15.87:0/1865578312 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158c0074e0 con 0x7f159c0b2fb0 2024-05-27T06:30:01.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.244+0000 7f1598c00640 1 -- 172.21.15.87:0/1865578312 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f158c0047f0 con 0x7f159c0b2fb0 2024-05-27T06:30:01.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.244+0000 7f15a3000640 1 -- 172.21.15.87:0/1865578312 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f159c161740 con 0x7f159c0b2fb0 2024-05-27T06:30:01.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.244+0000 7f1598c00640 1 -- 172.21.15.87:0/1865578312 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158c007680 con 0x7f159c0b2fb0 2024-05-27T06:30:01.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.244+0000 7f15a3000640 1 -- 172.21.15.87:0/1865578312 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f159c161d00 con 0x7f159c0b2fb0 2024-05-27T06:30:01.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.244+0000 7f15a3000640 1 -- 172.21.15.87:0/1865578312 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f159c06aa30 con 0x7f159c0b2fb0 2024-05-27T06:30:01.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.244+0000 7f1598c00640 1 -- 172.21.15.87:0/1865578312 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f158c011070 con 0x7f159c0b2fb0 2024-05-27T06:30:01.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.244+0000 7f1598c00640 1 --2- 172.21.15.87:0/1865578312 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f157806f400 0x7f1578071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:01.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.248+0000 7f1598c00640 1 -- 172.21.15.87:0/1865578312 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f158c08ee90 con 0x7f159c0b2fb0 2024-05-27T06:30:01.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.248+0000 7f1593e00640 1 --2- 172.21.15.87:0/1865578312 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f157806f400 0x7f1578071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:01.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.248+0000 7f1593e00640 1 --2- 172.21.15.87:0/1865578312 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f157806f400 0x7f1578071910 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f15840af000 tx=0x7f1584008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:01.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.252+0000 7f1598c00640 1 -- 172.21.15.87:0/1865578312 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f159c0d2960 con 0x7f159c0b2fb0 2024-05-27T06:30:01.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.444+0000 7f15a3000640 1 -- 172.21.15.87:0/1865578312 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f159c169c20 con 0x7f159c0b2fb0 2024-05-27T06:30:01.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.444+0000 7f1598c00640 1 -- 172.21.15.87:0/1865578312 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7f158c05b620 con 0x7f159c0b2fb0 2024-05-27T06:30:01.442 INFO:teuthology.orchestra.run.smithi087.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-27T06:30:01.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.444+0000 7f15a3000640 1 -- 172.21.15.87:0/1865578312 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f157806f400 msgr2=0x7f1578071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:01.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.444+0000 7f15a3000640 1 --2- 172.21.15.87:0/1865578312 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f157806f400 0x7f1578071910 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f15840af000 tx=0x7f1584008040 comp rx=0 tx=0).stop 2024-05-27T06:30:01.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.444+0000 7f15a3000640 1 -- 172.21.15.87:0/1865578312 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f159c0b2fb0 msgr2=0x7f159c160730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:01.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.444+0000 7f15a3000640 1 --2- 172.21.15.87:0/1865578312 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f159c0b2fb0 0x7f159c160730 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f158c00c400 tx=0x7f158c00c8c0 comp rx=0 tx=0).stop 2024-05-27T06:30:01.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.444+0000 7f15a3000640 1 -- 172.21.15.87:0/1865578312 shutdown_connections 2024-05-27T06:30:01.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.444+0000 7f15a3000640 1 --2- 172.21.15.87:0/1865578312 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f157806f400 0x7f1578071910 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:01.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.444+0000 7f15a3000640 1 --2- 172.21.15.87:0/1865578312 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f159c0d2010 0x7f159c15aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:01.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.444+0000 7f15a3000640 1 --2- 172.21.15.87:0/1865578312 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f159c0cea40 0x7f159c15a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:01.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.444+0000 7f15a3000640 1 --2- 172.21.15.87:0/1865578312 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f159c0b2fb0 0x7f159c160730 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:01.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.444+0000 7f15a3000640 1 -- 172.21.15.87:0/1865578312 >> 172.21.15.87:0/1865578312 conn(0x7f159c0d3590 msgr2=0x7f159c15c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:01.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.444+0000 7f15a3000640 1 -- 172.21.15.87:0/1865578312 shutdown_connections 2024-05-27T06:30:01.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01.444+0000 7f15a3000640 1 -- 172.21.15.87:0/1865578312 wait complete. 2024-05-27T06:30:01.463 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-27T06:30:01.463 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-27T06:30:01.463 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-05-27T06:30:01.463 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-27T06:30:01.463 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-27T06:30:01.464 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-27T06:30:01.464 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-27T06:30:01.464 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-27T06:30:01.464 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-27T06:30:01.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:30:01.464 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-05-27T06:30:01.473 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T06:30:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T06:30:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T06:30:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:30:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-05-27T06:30:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:30:01.473 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:30:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-05-27T06:30:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-05-27T06:30:01.473 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:30:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-05-27T06:30:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-05-27T06:30:01.474 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-27T06:30:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:30:01.474 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-27T06:30:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:30:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-27T06:30:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42340sec preferred_lft 42340sec 2024-05-27T06:30:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-05-27T06:30:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:30:01.474 INFO:teuthology.orchestra.run.smithi087.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-27T06:30:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 02:42:75:41:48:14 brd ff:ff:ff:ff:ff:ff 2024-05-27T06:30:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-27T06:30:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:30:01.474 INFO:teuthology.orchestra.run.smithi087.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-27T06:30:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-27T06:30:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-27T06:30:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:30:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-27T06:30:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:30:01.475 INFO:teuthology.orchestra.run.smithi087.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-27T06:30:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:30:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-27T06:30:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:30:01.475 INFO:teuthology.orchestra.run.smithi087.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-27T06:30:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:30:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-05-27T06:30:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-27T06:30:01.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:30:01.476 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-27T06:30:01.541 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-05-27T06:30:01.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:30:01.544 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-05-27T06:30:01.596 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-05-27T06:30:01.596 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-27T06:30:01.596 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-27T06:30:01.596 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-27T06:30:01.596 INFO:teuthology.orchestra.run.smithi087.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-27T06:30:01.596 INFO:teuthology.orchestra.run.smithi087.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-27T06:30:01.596 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-27T06:30:01.596 INFO:teuthology.orchestra.run.smithi087.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:30:01.596 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:30:01.596 INFO:teuthology.orchestra.run.smithi087.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-27T06:30:01.596 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-27T06:30:01.597 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T06:30:01.597 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-27T06:30:01.597 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-27T06:30:01.597 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-27T06:30:01.597 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-27T06:30:01.597 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-27T06:30:01.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T06:30:01.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:30:01.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:30:01.729 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-05-27T06:30:01.738 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-27T06:30:01.738 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-27T06:30:01.739 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-27T06:30:01.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:30:01.739 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-05-27T06:30:01.800 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-27T06:30:01.800 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T06:30:01.800 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-27T06:30:01.848 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-27T06:30:01.848 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T06:30:01.849 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-27T06:30:01.899 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-05-27T06:30:01.960 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T06:30:02.014 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-05-27T06:30:02.014 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-05-27T06:30:02.014 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-05-27T06:30:02.014 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-05-27T06:30:02.014 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-05-27T06:30:02.014 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-05-27T06:30:02.014 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-05-27T06:30:02.014 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-05-27T06:30:02.014 INFO:teuthology.orchestra.run.smithi087.stdout:/run/lock 2024-05-27T06:30:02.014 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-05-27T06:30:02.015 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-05-27T06:30:02.015 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-05-27T06:30:02.015 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T06:30:02.015 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-05-27T06:30:02.015 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-05-27T06:30:02.015 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-05-27T06:30:02.015 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-05-27T06:30:02.015 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/fs/nfsd 2024-05-27T06:30:02.015 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-05-27T06:30:02.015 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-05-27T06:30:02.015 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysusers.service 2024-05-27T06:30:02.015 INFO:teuthology.orchestra.run.smithi087.stdout:/run/rpc_pipefs 2024-05-27T06:30:02.015 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-05-27T06:30:02.015 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-05-27T06:30:02.016 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2024-05-27T06:30:02.016 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2024-05-27T06:30:02.016 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2024-05-27T06:30:02.016 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2024-05-27T06:30:02.016 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-05-27T06:30:02.016 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:30:02.016 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:30:02.016 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:30:02.016 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:30:02.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:30:02.017 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-05-27T06:30:02.068 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-27T06:30:02.068 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-27T06:30:02.111 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-05-27T06:30:02.131 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-05-27T06:30:02.183 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-05-27T06:30:02.183 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-05-27T06:30:02.183 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-05-27T06:30:02.183 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-05-27T06:30:02.183 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-05-27T06:30:02.183 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-05-27T06:30:02.183 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-05-27T06:30:02.183 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-05-27T06:30:02.183 INFO:teuthology.orchestra.run.smithi087.stdout:/run/lock 2024-05-27T06:30:02.184 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-05-27T06:30:02.184 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-05-27T06:30:02.184 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-05-27T06:30:02.184 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-05-27T06:30:02.184 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-05-27T06:30:02.184 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-05-27T06:30:02.184 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-05-27T06:30:02.184 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-05-27T06:30:02.184 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/fs/nfsd 2024-05-27T06:30:02.184 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-05-27T06:30:02.184 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-05-27T06:30:02.184 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysusers.service 2024-05-27T06:30:02.184 INFO:teuthology.orchestra.run.smithi087.stdout:/run/rpc_pipefs 2024-05-27T06:30:02.185 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-05-27T06:30:02.185 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-05-27T06:30:02.185 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2024-05-27T06:30:02.185 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2024-05-27T06:30:02.185 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2024-05-27T06:30:02.185 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2024-05-27T06:30:02.185 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-05-27T06:30:02.185 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:30:02.185 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:30:02.185 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:30:02.185 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:30:02.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:30:02.186 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-05-27T06:30:02.216 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:2024-05-27T06:30:02.216+0000 7fe1029fa580 -1 init, newargv = 0x7fe0e80054f0 newargc=15 2024-05-27T06:30:02.216 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[39537]: starting ceph client 2024-05-27T06:30:02.224 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[39537]: starting fuse 2024-05-27T06:30:02.225 INFO:teuthology.orchestra.run.smithi087.stdout:44 2024-05-27T06:30:02.225 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-05-27T06:30:02.225 DEBUG:teuthology.orchestra.run.smithi087:> sudo stdin-killer -- python3 -c ' 2024-05-27T06:30:02.226 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-05-27T06:30:02.226 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-05-27T06:30:02.226 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-05-27T06:30:02.226 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-05-27T06:30:02.226 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:30:02.226 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-05-27T06:30:02.226 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-27T06:30:02.226 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-05-27T06:30:02.226 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-27T06:30:02.226 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:30:02.226 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-05-27T06:30:02.226 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-05-27T06:30:02.226 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-05-27T06:30:02.226 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-05-27T06:30:02.227 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:30:02.227 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-05-27T06:30:02.227 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-27T06:30:02.227 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-27T06:30:02.227 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-27T06:30:02.227 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-05-27T06:30:02.227 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-05-27T06:30:02.227 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-05-27T06:30:02.227 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-27T06:30:02.227 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:30:02.227 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.0")) 2024-05-27T06:30:02.227 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-05-27T06:30:02.352 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.0.39537.asok 2024-05-27T06:30:02.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T06:30:02.364 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.39537.asok 2024-05-27T06:30:02.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:30:02.364 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.39537.asok status 2024-05-27T06:30:02.546 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-27T06:30:02.546 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-05-27T06:30:02.547 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "38f9d900c83c63799fbdbe61acc9a11b0d3554a6", 2024-05-27T06:30:02.547 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 19.0.0-3872-g38f9d900 (38f9d900c83c63799fbdbe61acc9a11b0d3554a6) squid (dev)", 2024-05-27T06:30:02.547 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "0", 2024-05-27T06:30:02.547 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-05-27T06:30:02.547 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-27T06:30:02.547 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "39537", 2024-05-27T06:30:02.547 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-05-27T06:30:02.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:30:02.547 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-05-27T06:30:02.547 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-05-27T06:30:02.547 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 5616, 2024-05-27T06:30:02.547 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-05-27T06:30:02.547 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-05-27T06:30:02.547 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-05-27T06:30:02.548 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 5616 2024-05-27T06:30:02.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:30:02.548 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-05-27T06:30:02.548 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-05-27T06:30:02.548 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-05-27T06:30:02.548 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1944115420 2024-05-27T06:30:02.548 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-27T06:30:02.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:30:02.548 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-05-27T06:30:02.548 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-05-27T06:30:02.548 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-05-27T06:30:02.548 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1944115420 2024-05-27T06:30:02.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-27T06:30:02.548 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.5616 192.168.0.1:0/1944115420", 2024-05-27T06:30:02.549 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/1944115420", 2024-05-27T06:30:02.549 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-05-27T06:30:02.549 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 27, 2024-05-27T06:30:02.549 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 54, 2024-05-27T06:30:02.549 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-05-27T06:30:02.549 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-05-27T06:30:02.549 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-05-27T06:30:02.549 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-27T06:30:02.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:30:02.562 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-05-27T06:30:02.562 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-27T06:30:02.571 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-05-27T06:30:02.572 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-27T06:30:02.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:30:02.572 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-27T06:30:02.632 DEBUG:teuthology.orchestra.run.smithi087:> stdin-killer -- python3 -c ' 2024-05-27T06:30:02.632 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-05-27T06:30:02.632 DEBUG:teuthology.orchestra.run.smithi087:> import errno 2024-05-27T06:30:02.632 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-27T06:30:02.632 DEBUG:teuthology.orchestra.run.smithi087:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2024-05-27T06:30:02.632 DEBUG:teuthology.orchestra.run.smithi087:> try: 2024-05-27T06:30:02.632 DEBUG:teuthology.orchestra.run.smithi087:> if True: 2024-05-27T06:30:02.632 DEBUG:teuthology.orchestra.run.smithi087:> ret = os.read(fd, 1024) 2024-05-27T06:30:02.632 DEBUG:teuthology.orchestra.run.smithi087:> else: 2024-05-27T06:30:02.632 DEBUG:teuthology.orchestra.run.smithi087:> os.write(fd, b'"'"'content'"'"') 2024-05-27T06:30:02.632 DEBUG:teuthology.orchestra.run.smithi087:> except OSError as e: 2024-05-27T06:30:02.632 DEBUG:teuthology.orchestra.run.smithi087:> if e.errno != errno.EPERM: 2024-05-27T06:30:02.632 DEBUG:teuthology.orchestra.run.smithi087:> raise 2024-05-27T06:30:02.632 DEBUG:teuthology.orchestra.run.smithi087:> else: 2024-05-27T06:30:02.633 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("client does not check permission of data pool") 2024-05-27T06:30:02.633 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-05-27T06:30:02.739 INFO:teuthology.orchestra.run.smithi087.stderr:Traceback (most recent call last): 2024-05-27T06:30:02.740 INFO:teuthology.orchestra.run.smithi087.stderr: File "", line 15, in 2024-05-27T06:30:02.740 INFO:teuthology.orchestra.run.smithi087.stderr:RuntimeError: client does not check permission of data pool 2024-05-27T06:30:02.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02 stdin-killer INFO: command exited with status 1: exiting normally with same code! 2024-05-27T06:30:02.749 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T06:30:02.749 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2024-05-27T06:30:02.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.944+0000 7f17a9600640 1 Processor -- start 2024-05-27T06:30:02.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.948+0000 7f17a9600640 1 -- start start 2024-05-27T06:30:02.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.948+0000 7f17a9600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f17a4070b00 0x7f17a415fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:02.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.948+0000 7f17a9600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17a406e2a0 0x7f17a40aee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:02.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.948+0000 7f17a9600640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17a406f7f0 con 0x7f17a406d780 2024-05-27T06:30:02.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.948+0000 7f17a9600640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f17a406fa60 con 0x7f17a4070b00 2024-05-27T06:30:02.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.948+0000 7f17a9600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f17a406fd40 con 0x7f17a406e2a0 2024-05-27T06:30:02.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.948+0000 7f17a2a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f17a4070b00 0x7f17a415fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:02.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.948+0000 7f179a000640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f17a406d780 0x7f17a406db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:46788/0 (socket says 172.21.15.87:46788) 2024-05-27T06:30:02.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.948+0000 7f179a000640 1 -- 172.21.15.87:0/2058746244 learned_addr learned my addr 172.21.15.87:0/2058746244 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:30:02.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.948+0000 7f17a2a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f17a4070b00 0x7f17a415fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46950/0 (socket says 172.21.15.87:46950) 2024-05-27T06:30:02.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.948+0000 7f17a3400640 1 --2- 172.21.15.87:0/2058746244 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17a406e2a0 0x7f17a40aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:02.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.948+0000 7f17a2a00640 1 -- 172.21.15.87:0/2058746244 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17a406e2a0 msgr2=0x7f17a40aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:02.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.948+0000 7f17a2a00640 1 --2- 172.21.15.87:0/2058746244 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17a406e2a0 0x7f17a40aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:02.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.948+0000 7f17a2a00640 1 -- 172.21.15.87:0/2058746244 >> v1:172.21.15.87:6789/0 conn(0x7f17a406d780 legacy=0x7f17a406db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:02.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.948+0000 7f17a2000640 1 -- 172.21.15.87:0/2058746244 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3909866102 0 0) 0x7f17a406f7f0 con 0x7f17a406d780 2024-05-27T06:30:02.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.948+0000 7f17a2a00640 1 -- 172.21.15.87:0/2058746244 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a4070020 con 0x7f17a4070b00 2024-05-27T06:30:02.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.952+0000 7f17a2a00640 1 --2- 172.21.15.87:0/2058746244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17a4070b00 0x7f17a415fd50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f1794009d90 tx=0x7f179401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=195ec47353ec3f90 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:02.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.952+0000 7f17a2000640 1 -- 172.21.15.87:0/2058746244 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17940b2070 con 0x7f17a4070b00 2024-05-27T06:30:02.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.952+0000 7f17a2000640 1 -- 172.21.15.87:0/2058746244 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17940a5970 con 0x7f17a4070b00 2024-05-27T06:30:02.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.952+0000 7f17a2000640 1 -- 172.21.15.87:0/2058746244 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17940a5d40 con 0x7f17a4070b00 2024-05-27T06:30:02.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.952+0000 7f17a9600640 1 -- 172.21.15.87:0/2058746244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17a4070b00 msgr2=0x7f17a415fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:02.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.952+0000 7f17a9600640 1 --2- 172.21.15.87:0/2058746244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17a4070b00 0x7f17a415fd50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f1794009d90 tx=0x7f179401c8b0 comp rx=0 tx=0).stop 2024-05-27T06:30:02.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.952+0000 7f17a9600640 1 -- 172.21.15.87:0/2058746244 shutdown_connections 2024-05-27T06:30:02.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.952+0000 7f17a9600640 1 --2- 172.21.15.87:0/2058746244 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17a406e2a0 0x7f17a40aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:02.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.952+0000 7f17a9600640 1 --2- 172.21.15.87:0/2058746244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17a4070b00 0x7f17a415fd50 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:02.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.952+0000 7f17a9600640 1 -- 172.21.15.87:0/2058746244 >> 172.21.15.87:0/2058746244 conn(0x7f17a40d1be0 msgr2=0x7f17a40d1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:02.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.952+0000 7f17a9600640 1 -- 172.21.15.87:0/2058746244 shutdown_connections 2024-05-27T06:30:02.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.952+0000 7f17a9600640 1 -- 172.21.15.87:0/2058746244 wait complete. 2024-05-27T06:30:02.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.956+0000 7f17a9600640 1 Processor -- start 2024-05-27T06:30:02.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.956+0000 7f17a9600640 1 -- start start 2024-05-27T06:30:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.956+0000 7f17a9600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17a406d780 0x7f17a413a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.956+0000 7f17a9600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17a406e2a0 0x7f17a41546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.956+0000 7f17a9600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17a4070b00 0x7f17a40b0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.956+0000 7f17a9600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f17a40afd60 con 0x7f17a406e2a0 2024-05-27T06:30:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.956+0000 7f17a9600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f17a40afbe0 con 0x7f17a4070b00 2024-05-27T06:30:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.956+0000 7f17a9600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f17a40afee0 con 0x7f17a406d780 2024-05-27T06:30:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.956+0000 7f179a000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17a406e2a0 0x7f17a41546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.956+0000 7f179a000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17a406e2a0 0x7f17a41546d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46956/0 (socket says 172.21.15.87:46956) 2024-05-27T06:30:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.956+0000 7f179a000640 1 -- 172.21.15.87:0/2618188452 learned_addr learned my addr 172.21.15.87:0/2618188452 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.956+0000 7f17a2a00640 1 --2- 172.21.15.87:0/2618188452 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17a406d780 0x7f17a413a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.956+0000 7f17a3400640 1 --2- 172.21.15.87:0/2618188452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17a4070b00 0x7f17a40b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.956+0000 7f179a000640 1 -- 172.21.15.87:0/2618188452 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17a406d780 msgr2=0x7f17a413a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.956+0000 7f179a000640 1 --2- 172.21.15.87:0/2618188452 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17a406d780 0x7f17a413a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.956+0000 7f179a000640 1 -- 172.21.15.87:0/2618188452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17a4070b00 msgr2=0x7f17a40b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.956+0000 7f179a000640 1 --2- 172.21.15.87:0/2618188452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17a4070b00 0x7f17a40b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.956+0000 7f179a000640 1 -- 172.21.15.87:0/2618188452 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a4149220 con 0x7f17a406e2a0 2024-05-27T06:30:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.956+0000 7f17a2a00640 1 --2- 172.21.15.87:0/2618188452 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17a406d780 0x7f17a413a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:30:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.956+0000 7f17a3400640 1 --2- 172.21.15.87:0/2618188452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17a4070b00 0x7f17a40b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:30:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.956+0000 7f179a000640 1 --2- 172.21.15.87:0/2618188452 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17a406e2a0 0x7f17a41546d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f178c00c390 tx=0x7f178c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:02.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.956+0000 7f179b400640 1 -- 172.21.15.87:0/2618188452 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178c0074e0 con 0x7f17a406e2a0 2024-05-27T06:30:02.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.960+0000 7f179b400640 1 -- 172.21.15.87:0/2618188452 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f178c0047f0 con 0x7f17a406e2a0 2024-05-27T06:30:02.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.960+0000 7f17a9600640 1 -- 172.21.15.87:0/2618188452 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17a4150790 con 0x7f17a406e2a0 2024-05-27T06:30:02.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.960+0000 7f179b400640 1 -- 172.21.15.87:0/2618188452 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178c004be0 con 0x7f17a406e2a0 2024-05-27T06:30:02.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.960+0000 7f17a9600640 1 -- 172.21.15.87:0/2618188452 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17a4150a30 con 0x7f17a406e2a0 2024-05-27T06:30:02.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.960+0000 7f17a9600640 1 -- 172.21.15.87:0/2618188452 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17a406aa30 con 0x7f17a406e2a0 2024-05-27T06:30:02.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.960+0000 7f179b400640 1 -- 172.21.15.87:0/2618188452 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f178c011070 con 0x7f17a406e2a0 2024-05-27T06:30:02.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.960+0000 7f179b400640 1 --2- 172.21.15.87:0/2618188452 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f178006f400 0x7f1780071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:02.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.960+0000 7f179b400640 1 -- 172.21.15.87:0/2618188452 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f178c08efe0 con 0x7f17a406e2a0 2024-05-27T06:30:02.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.960+0000 7f17a2a00640 1 --2- 172.21.15.87:0/2618188452 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f178006f400 0x7f1780071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:02.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.964+0000 7f17a2a00640 1 --2- 172.21.15.87:0/2618188452 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f178006f400 0x7f1780071910 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f17940af000 tx=0x7f17940a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:02.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:02.968+0000 7f179b400640 1 -- 172.21.15.87:0/2618188452 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f178c05bd50 con 0x7f17a406e2a0 2024-05-27T06:30:03.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.176+0000 7f17a9600640 1 -- 172.21.15.87:0/2618188452 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) -- 0x7f17a41493f0 con 0x7f17a406e2a0 2024-05-27T06:30:03.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.180+0000 7f179b400640 1 -- 172.21.15.87:0/2618188452 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v20) ==== 184+0+141 (secure 0 0 0) 0x7f17a41493f0 con 0x7f17a406e2a0 2024-05-27T06:30:03.178 INFO:teuthology.orchestra.run.smithi087.stdout:[client.0] 2024-05-27T06:30:03.178 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCfJ1RmAld8BxAAigqU2F3mGXtAfw0L9Bfp2A== 2024-05-27T06:30:03.178 INFO:teuthology.orchestra.run.smithi087.stdout: caps mds = "allow" 2024-05-27T06:30:03.179 INFO:teuthology.orchestra.run.smithi087.stdout: caps mon = "allow r" 2024-05-27T06:30:03.179 INFO:teuthology.orchestra.run.smithi087.stdout: caps osd = "allow rw pool=cephfs_data" 2024-05-27T06:30:03.179 INFO:teuthology.orchestra.run.smithi087.stderr:updated caps for client.0 2024-05-27T06:30:03.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.180+0000 7f17a9600640 1 -- 172.21.15.87:0/2618188452 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f178006f400 msgr2=0x7f1780071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:03.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.180+0000 7f17a9600640 1 --2- 172.21.15.87:0/2618188452 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f178006f400 0x7f1780071910 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f17940af000 tx=0x7f17940a7070 comp rx=0 tx=0).stop 2024-05-27T06:30:03.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.180+0000 7f17a9600640 1 -- 172.21.15.87:0/2618188452 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17a406e2a0 msgr2=0x7f17a41546d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:03.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.180+0000 7f17a9600640 1 --2- 172.21.15.87:0/2618188452 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17a406e2a0 0x7f17a41546d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f178c00c390 tx=0x7f178c00c850 comp rx=0 tx=0).stop 2024-05-27T06:30:03.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.180+0000 7f17a9600640 1 -- 172.21.15.87:0/2618188452 shutdown_connections 2024-05-27T06:30:03.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.180+0000 7f17a9600640 1 --2- 172.21.15.87:0/2618188452 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f178006f400 0x7f1780071910 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:03.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.180+0000 7f17a9600640 1 --2- 172.21.15.87:0/2618188452 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17a4070b00 0x7f17a40b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:03.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.180+0000 7f17a9600640 1 --2- 172.21.15.87:0/2618188452 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17a406e2a0 0x7f17a41546d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:03.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.180+0000 7f17a9600640 1 --2- 172.21.15.87:0/2618188452 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17a406d780 0x7f17a413a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:03.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.180+0000 7f17a9600640 1 -- 172.21.15.87:0/2618188452 >> 172.21.15.87:0/2618188452 conn(0x7f17a40d1be0 msgr2=0x7f17a406db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:03.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.180+0000 7f17a9600640 1 -- 172.21.15.87:0/2618188452 shutdown_connections 2024-05-27T06:30:03.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.180+0000 7f17a9600640 1 -- 172.21.15.87:0/2618188452 wait complete. 2024-05-27T06:30:03.199 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-27T06:30:03.200 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-27T06:30:03.291 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-27T06:30:03.398 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-27T06:30:03.398 INFO:tasks.cephfs.mount:Terminating background process 2024-05-27T06:30:03.399 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:30:03.399 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:30:03.408 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:30:03.408 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:30:03.456 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T06:30:03.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.648+0000 7f3342e00640 1 Processor -- start 2024-05-27T06:30:03.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.648+0000 7f3342e00640 1 -- start start 2024-05-27T06:30:03.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.648+0000 7f3342e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f333c0aec30 0x7f333c0702b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:03.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.648+0000 7f3342e00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f333c06fe20 con 0x7f333c06c720 2024-05-27T06:30:03.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.648+0000 7f3342e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f333c0b0ba0 con 0x7f333c06efc0 2024-05-27T06:30:03.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.652+0000 7f3342e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f333c15ef50 con 0x7f333c0aec30 2024-05-27T06:30:03.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.652+0000 7f3340e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f333c06c720 0x7f333c06cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:46790/0 (socket says 172.21.15.87:46790) 2024-05-27T06:30:03.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.652+0000 7f3340e00640 1 -- 172.21.15.87:0/456436628 learned_addr learned my addr 172.21.15.87:0/456436628 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:30:03.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.652+0000 7f333be00640 1 --2- 172.21.15.87:0/456436628 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f333c0aec30 0x7f333c0702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:03.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.652+0000 7f333b400640 1 -- 172.21.15.87:0/456436628 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2643928743 0 0) 0x7f333c06fe20 con 0x7f333c06c720 2024-05-27T06:30:03.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.652+0000 7f333b400640 1 -- 172.21.15.87:0/456436628 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3320003530 con 0x7f333c06c720 2024-05-27T06:30:03.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.652+0000 7f333b400640 1 -- 172.21.15.87:0/456436628 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 404973447 0 0) 0x7f333c0b0ba0 con 0x7f333c06efc0 2024-05-27T06:30:03.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.652+0000 7f333b400640 1 -- 172.21.15.87:0/456436628 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f333c06fe20 con 0x7f333c06efc0 2024-05-27T06:30:03.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.652+0000 7f333be00640 1 -- 172.21.15.87:0/456436628 >> v1:172.21.15.149:6789/0 conn(0x7f333c06efc0 legacy=0x7f333c06f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:03.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.652+0000 7f333be00640 1 -- 172.21.15.87:0/456436628 >> v1:172.21.15.87:6789/0 conn(0x7f333c06c720 legacy=0x7f333c06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:03.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.652+0000 7f333b400640 1 -- 172.21.15.87:0/456436628 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3963968291 0 0) 0x7f3320003530 con 0x7f333c06c720 2024-05-27T06:30:03.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.652+0000 7f333be00640 1 -- 172.21.15.87:0/456436628 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333c0b08c0 con 0x7f333c0aec30 2024-05-27T06:30:03.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.656+0000 7f333be00640 1 --2- 172.21.15.87:0/456436628 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f333c0aec30 0x7f333c0702b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f332c0097f0 tx=0x7f332c01c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c984b19e274290de server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:03.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.656+0000 7f333b400640 1 -- 172.21.15.87:0/456436628 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c0b0070 con 0x7f333c0aec30 2024-05-27T06:30:03.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.656+0000 7f333b400640 1 -- 172.21.15.87:0/456436628 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332c0ab400 con 0x7f333c0aec30 2024-05-27T06:30:03.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.656+0000 7f333b400640 1 -- 172.21.15.87:0/456436628 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3334001a80 con 0x7f333c0aec30 2024-05-27T06:30:03.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.656+0000 7f3342e00640 1 -- 172.21.15.87:0/456436628 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f333c0aec30 msgr2=0x7f333c0702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:03.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.656+0000 7f3342e00640 1 --2- 172.21.15.87:0/456436628 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f333c0aec30 0x7f333c0702b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f332c0097f0 tx=0x7f332c01c2e0 comp rx=0 tx=0).stop 2024-05-27T06:30:03.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.656+0000 7f3342e00640 1 -- 172.21.15.87:0/456436628 shutdown_connections 2024-05-27T06:30:03.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.656+0000 7f3342e00640 1 --2- 172.21.15.87:0/456436628 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f333c0aec30 0x7f333c0702b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:03.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.656+0000 7f3342e00640 1 -- 172.21.15.87:0/456436628 >> 172.21.15.87:0/456436628 conn(0x7f333c0b2fb0 msgr2=0x7f333c0b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:03.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.656+0000 7f3342e00640 1 -- 172.21.15.87:0/456436628 shutdown_connections 2024-05-27T06:30:03.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.656+0000 7f3342e00640 1 -- 172.21.15.87:0/456436628 wait complete. 2024-05-27T06:30:03.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.656+0000 7f3342e00640 1 Processor -- start 2024-05-27T06:30:03.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.656+0000 7f3342e00640 1 -- start start 2024-05-27T06:30:03.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.660+0000 7f3342e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f333c06c720 0x7f333c14f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:03.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.660+0000 7f3342e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f333c06efc0 0x7f333c14f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:03.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.660+0000 7f3342e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f333c0aec30 0x7f333c147680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:03.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.660+0000 7f3342e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f333c06e0c0 con 0x7f333c06c720 2024-05-27T06:30:03.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.660+0000 7f3342e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f333c06df40 con 0x7f333c06efc0 2024-05-27T06:30:03.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.660+0000 7f3342e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f333c0707f0 con 0x7f333c0aec30 2024-05-27T06:30:03.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.660+0000 7f333be00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f333c06c720 0x7f333c14f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:03.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.660+0000 7f333be00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f333c06c720 0x7f333c14f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46966/0 (socket says 172.21.15.87:46966) 2024-05-27T06:30:03.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.660+0000 7f333be00640 1 -- 172.21.15.87:0/1729800886 learned_addr learned my addr 172.21.15.87:0/1729800886 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:03.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.660+0000 7f3333400640 1 --2- 172.21.15.87:0/1729800886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f333c06efc0 0x7f333c14f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:03.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.660+0000 7f3340e00640 1 --2- 172.21.15.87:0/1729800886 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f333c0aec30 0x7f333c147680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:03.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.660+0000 7f333be00640 1 -- 172.21.15.87:0/1729800886 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f333c0aec30 msgr2=0x7f333c147680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:03.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.660+0000 7f333be00640 1 --2- 172.21.15.87:0/1729800886 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f333c0aec30 0x7f333c147680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:03.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.660+0000 7f333be00640 1 -- 172.21.15.87:0/1729800886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f333c06efc0 msgr2=0x7f333c14f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:03.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.660+0000 7f333be00640 1 --2- 172.21.15.87:0/1729800886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f333c06efc0 0x7f333c14f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:03.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.660+0000 7f333be00640 1 -- 172.21.15.87:0/1729800886 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333c143af0 con 0x7f333c06c720 2024-05-27T06:30:03.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.660+0000 7f333be00640 1 --2- 172.21.15.87:0/1729800886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f333c06c720 0x7f333c14f0f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f332c000c10 tx=0x7f332c01ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:03.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.660+0000 7f3338c00640 1 -- 172.21.15.87:0/1729800886 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c0b0050 con 0x7f333c06c720 2024-05-27T06:30:03.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.660+0000 7f3338c00640 1 -- 172.21.15.87:0/1729800886 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332c0b1040 con 0x7f333c06c720 2024-05-27T06:30:03.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.660+0000 7f3338c00640 1 -- 172.21.15.87:0/1729800886 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c006e20 con 0x7f333c06c720 2024-05-27T06:30:03.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.660+0000 7f3342e00640 1 -- 172.21.15.87:0/1729800886 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f333c14a5c0 con 0x7f333c06c720 2024-05-27T06:30:03.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.660+0000 7f3342e00640 1 -- 172.21.15.87:0/1729800886 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f333c157360 con 0x7f333c06c720 2024-05-27T06:30:03.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.660+0000 7f3342e00640 1 -- 172.21.15.87:0/1729800886 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f333c06aa30 con 0x7f333c06c720 2024-05-27T06:30:03.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.664+0000 7f3338c00640 1 -- 172.21.15.87:0/1729800886 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f332c0be030 con 0x7f333c06c720 2024-05-27T06:30:03.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.664+0000 7f3338c00640 1 --2- 172.21.15.87:0/1729800886 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f331806f400 0x7f3318071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:03.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.664+0000 7f3338c00640 1 -- 172.21.15.87:0/1729800886 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f332c128ef0 con 0x7f333c06c720 2024-05-27T06:30:03.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.664+0000 7f3333400640 1 --2- 172.21.15.87:0/1729800886 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f331806f400 0x7f3318071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:03.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.664+0000 7f3333400640 1 --2- 172.21.15.87:0/1729800886 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f331806f400 0x7f3318071910 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f333c169830 tx=0x7f3324009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:03.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.668+0000 7f3338c00640 1 -- 172.21.15.87:0/1729800886 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f332c0c5060 con 0x7f333c06c720 2024-05-27T06:30:03.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.836+0000 7f3342e00640 1 -- 172.21.15.87:0/1729800886 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f333c06da20 con 0x7f333c06c720 2024-05-27T06:30:03.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.836+0000 7f3338c00640 1 -- 172.21.15.87:0/1729800886 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) ==== 80+0+0 (secure 0 0 0) 0x7f332c015ff0 con 0x7f333c06c720 2024-05-27T06:30:03.836 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2024-05-27T06:30:03.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.840+0000 7f3342e00640 1 -- 172.21.15.87:0/1729800886 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f331806f400 msgr2=0x7f3318071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:03.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.840+0000 7f3342e00640 1 --2- 172.21.15.87:0/1729800886 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f331806f400 0x7f3318071910 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f333c169830 tx=0x7f3324009040 comp rx=0 tx=0).stop 2024-05-27T06:30:03.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.840+0000 7f3342e00640 1 -- 172.21.15.87:0/1729800886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f333c06c720 msgr2=0x7f333c14f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:03.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.840+0000 7f3342e00640 1 --2- 172.21.15.87:0/1729800886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f333c06c720 0x7f333c14f0f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f332c000c10 tx=0x7f332c01ab20 comp rx=0 tx=0).stop 2024-05-27T06:30:03.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.840+0000 7f3342e00640 1 -- 172.21.15.87:0/1729800886 shutdown_connections 2024-05-27T06:30:03.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.840+0000 7f3342e00640 1 --2- 172.21.15.87:0/1729800886 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f331806f400 0x7f3318071910 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:03.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.840+0000 7f3342e00640 1 --2- 172.21.15.87:0/1729800886 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f333c0aec30 0x7f333c147680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:03.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.840+0000 7f3342e00640 1 --2- 172.21.15.87:0/1729800886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f333c06efc0 0x7f333c14f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:03.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.840+0000 7f3342e00640 1 --2- 172.21.15.87:0/1729800886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f333c06c720 0x7f333c14f0f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:03.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.840+0000 7f3342e00640 1 -- 172.21.15.87:0/1729800886 >> 172.21.15.87:0/1729800886 conn(0x7f333c0b2fb0 msgr2=0x7f333c150180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:03.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.840+0000 7f3342e00640 1 -- 172.21.15.87:0/1729800886 shutdown_connections 2024-05-27T06:30:03.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:03.840+0000 7f3342e00640 1 -- 172.21.15.87:0/1729800886 wait complete. 2024-05-27T06:30:03.857 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-05-27T06:30:03.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:30:03.858 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-27T06:30:03.875 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[39537]: fuse finished with error 0 and tester_r 0 2024-05-27T06:30:03.878 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-05-27T06:30:03.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:30:03.878 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-27T06:30:03.988 INFO:tasks.cephfs.mount:Terminating background process 2024-05-27T06:30:03.989 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:30:03.989 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:30:03.998 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105064k,nr_inodes=2026266,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625948k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6550 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625944k,nr_inodes=406486,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625948k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-27T06:30:03.998 INFO:tasks.cephfs.mount:Terminating background process 2024-05-27T06:30:03.998 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:30:03.998 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:30:04.007 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8583 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274976k,nr_inodes=818744,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-27T06:30:04.007 INFO:tasks.cephfs.mount:Terminating background process 2024-05-27T06:30:04.007 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:30:04.007 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:30:04.048 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105064k,nr_inodes=2026266,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625948k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6550 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625944k,nr_inodes=406486,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625948k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-27T06:30:04.049 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T06:30:04.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.196+0000 7f8786a00640 1 Processor -- start 2024-05-27T06:30:04.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.196+0000 7f8786a00640 1 -- start start 2024-05-27T06:30:04.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.196+0000 7f8786a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f87800cbf90 0x7f878006cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:04.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.196+0000 7f8786a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f878006d500 0x7f878015cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:04.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.196+0000 7f8786a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f878015d520 0x7f87800d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:04.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.196+0000 7f8786a00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f878006d910 con 0x7f87800cbf90 2024-05-27T06:30:04.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.196+0000 7f8786a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f878015d930 con 0x7f878015d520 2024-05-27T06:30:04.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.196+0000 7f8786a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f878015dbb0 con 0x7f878006d500 2024-05-27T06:30:04.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.196+0000 7f877fe00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f87800cbf90 0x7f878006cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:04.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.200+0000 7f877fe00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f87800cbf90 0x7f878006cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46978/0 (socket says 172.21.15.87:46978) 2024-05-27T06:30:04.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.200+0000 7f877fe00640 1 -- 172.21.15.87:0/634474941 learned_addr learned my addr 172.21.15.87:0/634474941 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:04.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.200+0000 7f8777400640 1 --2- 172.21.15.87:0/634474941 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f878006d500 0x7f878015cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:04.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.200+0000 7f8784a00640 1 --2- 172.21.15.87:0/634474941 >> v2:172.21.15.149:3300/0 conn(0x7f878015d520 0x7f87800d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:04.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.200+0000 7f877fe00640 1 -- 172.21.15.87:0/634474941 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f878006d500 msgr2=0x7f878015cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:04.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.200+0000 7f877fe00640 1 --2- 172.21.15.87:0/634474941 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f878006d500 0x7f878015cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:04.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.200+0000 7f877fe00640 1 -- 172.21.15.87:0/634474941 >> v2:172.21.15.149:3300/0 conn(0x7f878015d520 msgr2=0x7f87800d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:04.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.200+0000 7f877fe00640 1 --2- 172.21.15.87:0/634474941 >> v2:172.21.15.149:3300/0 conn(0x7f878015d520 0x7f87800d1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:04.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.200+0000 7f877fe00640 1 -- 172.21.15.87:0/634474941 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f878015de90 con 0x7f87800cbf90 2024-05-27T06:30:04.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.200+0000 7f877fe00640 1 --2- 172.21.15.87:0/634474941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87800cbf90 0x7f878006cfc0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8780072550 tx=0x7f877001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad26ae02d8799d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:04.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.200+0000 7f877f400640 1 -- 172.21.15.87:0/634474941 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87700b5070 con 0x7f87800cbf90 2024-05-27T06:30:04.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.200+0000 7f877f400640 1 -- 172.21.15.87:0/634474941 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87700a89d0 con 0x7f87800cbf90 2024-05-27T06:30:04.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.200+0000 7f877f400640 1 -- 172.21.15.87:0/634474941 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87700a8da0 con 0x7f87800cbf90 2024-05-27T06:30:04.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.204+0000 7f8786a00640 1 -- 172.21.15.87:0/634474941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87800cbf90 msgr2=0x7f878006cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:04.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.204+0000 7f8786a00640 1 --2- 172.21.15.87:0/634474941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87800cbf90 0x7f878006cfc0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8780072550 tx=0x7f877001ed10 comp rx=0 tx=0).stop 2024-05-27T06:30:04.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.204+0000 7f8786a00640 1 -- 172.21.15.87:0/634474941 shutdown_connections 2024-05-27T06:30:04.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.204+0000 7f8786a00640 1 --2- 172.21.15.87:0/634474941 >> v2:172.21.15.149:3300/0 conn(0x7f878015d520 0x7f87800d1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:04.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.204+0000 7f8786a00640 1 --2- 172.21.15.87:0/634474941 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f878006d500 0x7f878015cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:04.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.204+0000 7f8786a00640 1 --2- 172.21.15.87:0/634474941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87800cbf90 0x7f878006cfc0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:04.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.204+0000 7f8786a00640 1 -- 172.21.15.87:0/634474941 >> 172.21.15.87:0/634474941 conn(0x7f87800b46b0 msgr2=0x7f87800b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:04.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.204+0000 7f8786a00640 1 -- 172.21.15.87:0/634474941 shutdown_connections 2024-05-27T06:30:04.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.204+0000 7f8786a00640 1 -- 172.21.15.87:0/634474941 wait complete. 2024-05-27T06:30:04.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.204+0000 7f8786a00640 1 Processor -- start 2024-05-27T06:30:04.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.204+0000 7f8786a00640 1 -- start start 2024-05-27T06:30:04.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.208+0000 7f8786a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f878006d500 0x7f87800c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:04.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.208+0000 7f8786a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87800cbf90 0x7f878009a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:04.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.208+0000 7f8786a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f878015d520 0x7f87800c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:04.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.208+0000 7f8786a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f878015e170 con 0x7f878015d520 2024-05-27T06:30:04.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.208+0000 7f8786a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f878006caa0 con 0x7f87800cbf90 2024-05-27T06:30:04.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.208+0000 7f8786a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f87800cc3a0 con 0x7f878006d500 2024-05-27T06:30:04.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.208+0000 7f8784a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f878015d520 0x7f87800c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:04.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.208+0000 7f8784a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f878015d520 0x7f87800c86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46984/0 (socket says 172.21.15.87:46984) 2024-05-27T06:30:04.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.208+0000 7f8784a00640 1 -- 172.21.15.87:0/2568705459 learned_addr learned my addr 172.21.15.87:0/2568705459 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:04.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.208+0000 7f877fe00640 1 --2- 172.21.15.87:0/2568705459 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f878006d500 0x7f87800c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:04.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.208+0000 7f8777400640 1 --2- 172.21.15.87:0/2568705459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87800cbf90 0x7f878009a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:04.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.208+0000 7f8784a00640 1 -- 172.21.15.87:0/2568705459 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f878006d500 msgr2=0x7f87800c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:04.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.208+0000 7f8784a00640 1 --2- 172.21.15.87:0/2568705459 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f878006d500 0x7f87800c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:04.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.208+0000 7f8784a00640 1 -- 172.21.15.87:0/2568705459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87800cbf90 msgr2=0x7f878009a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:04.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.208+0000 7f8784a00640 1 --2- 172.21.15.87:0/2568705459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87800cbf90 0x7f878009a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:04.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.208+0000 7f8784a00640 1 -- 172.21.15.87:0/2568705459 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87800c6830 con 0x7f878015d520 2024-05-27T06:30:04.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.208+0000 7f8784a00640 1 --2- 172.21.15.87:0/2568705459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f878015d520 0x7f87800c86b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8778007cf0 tx=0x7f877800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:04.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.208+0000 7f877cc00640 1 -- 172.21.15.87:0/2568705459 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8778014420 con 0x7f878015d520 2024-05-27T06:30:04.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.208+0000 7f877cc00640 1 -- 172.21.15.87:0/2568705459 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8778019070 con 0x7f878015d520 2024-05-27T06:30:04.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.208+0000 7f877cc00640 1 -- 172.21.15.87:0/2568705459 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8778014820 con 0x7f878015d520 2024-05-27T06:30:04.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.208+0000 7f8786a00640 1 -- 172.21.15.87:0/2568705459 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87800c6b10 con 0x7f878015d520 2024-05-27T06:30:04.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.208+0000 7f8786a00640 1 -- 172.21.15.87:0/2568705459 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87800c70d0 con 0x7f878015d520 2024-05-27T06:30:04.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.208+0000 7f8786a00640 1 -- 172.21.15.87:0/2568705459 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f878006aa30 con 0x7f878015d520 2024-05-27T06:30:04.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.208+0000 7f877cc00640 1 -- 172.21.15.87:0/2568705459 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f87780149c0 con 0x7f878015d520 2024-05-27T06:30:04.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.212+0000 7f877cc00640 1 --2- 172.21.15.87:0/2568705459 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f875c06f400 0x7f875c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:04.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.212+0000 7f877cc00640 1 -- 172.21.15.87:0/2568705459 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f877808fb40 con 0x7f878015d520 2024-05-27T06:30:04.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.212+0000 7f877fe00640 1 --2- 172.21.15.87:0/2568705459 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f875c06f400 0x7f875c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:04.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.212+0000 7f877fe00640 1 --2- 172.21.15.87:0/2568705459 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f875c06f400 0x7f875c071910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f87700b2000 tx=0x7f8770009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:04.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.216+0000 7f877cc00640 1 -- 172.21.15.87:0/2568705459 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f877805c1b0 con 0x7f878015d520 2024-05-27T06:30:04.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.412+0000 7f8786a00640 1 -- 172.21.15.87:0/2568705459 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87800c65c0 con 0x7f878015d520 2024-05-27T06:30:04.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.412+0000 7f877cc00640 1 -- 172.21.15.87:0/2568705459 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5187 (secure 0 0 0) 0x7f87780604b0 con 0x7f878015d520 2024-05-27T06:30:04.411 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:30:04.412 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5254,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/1883124200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1883124200},{"type":"v1","addr":"172.21.15.149:6834","nonce":1883124200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3525413342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":3525413342},{"type":"v1","addr":"172.21.15.149:6835","nonce":3525413342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5373,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1517601928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1517601928},{"type":"v1","addr":"172.21.15.87:6835","nonce":1517601928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T06:29:31.715627+0000","modified":"2024-05-27T06:29:34.730216+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5382":{"gid":5382,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/3958980223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":3958980223},{"type":"v1","addr":"172.21.15.87:6837","nonce":3958980223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5382,"qdb_cluster":[5382]},"id":3}]} 2024-05-27T06:30:04.412 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 27 2024-05-27T06:30:04.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.416+0000 7f8786a00640 1 -- 172.21.15.87:0/2568705459 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f875c06f400 msgr2=0x7f875c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:04.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.416+0000 7f8786a00640 1 --2- 172.21.15.87:0/2568705459 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f875c06f400 0x7f875c071910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f87700b2000 tx=0x7f8770009040 comp rx=0 tx=0).stop 2024-05-27T06:30:04.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.416+0000 7f8786a00640 1 -- 172.21.15.87:0/2568705459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f878015d520 msgr2=0x7f87800c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:04.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.416+0000 7f8786a00640 1 --2- 172.21.15.87:0/2568705459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f878015d520 0x7f87800c86b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8778007cf0 tx=0x7f877800e4b0 comp rx=0 tx=0).stop 2024-05-27T06:30:04.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.416+0000 7f8786a00640 1 -- 172.21.15.87:0/2568705459 shutdown_connections 2024-05-27T06:30:04.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.416+0000 7f8786a00640 1 --2- 172.21.15.87:0/2568705459 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f875c06f400 0x7f875c071910 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:04.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.416+0000 7f8786a00640 1 --2- 172.21.15.87:0/2568705459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f878015d520 0x7f87800c86b0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:04.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.416+0000 7f8786a00640 1 --2- 172.21.15.87:0/2568705459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87800cbf90 0x7f878009a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:04.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.416+0000 7f8786a00640 1 --2- 172.21.15.87:0/2568705459 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f878006d500 0x7f87800c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:04.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.416+0000 7f8786a00640 1 -- 172.21.15.87:0/2568705459 >> 172.21.15.87:0/2568705459 conn(0x7f87800b46b0 msgr2=0x7f87800cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:04.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.416+0000 7f8786a00640 1 -- 172.21.15.87:0/2568705459 shutdown_connections 2024-05-27T06:30:04.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.416+0000 7f8786a00640 1 -- 172.21.15.87:0/2568705459 wait complete. 2024-05-27T06:30:04.434 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T06:30:04.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.584+0000 7f7139e00640 1 Processor -- start 2024-05-27T06:30:04.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.584+0000 7f7139e00640 1 -- start start 2024-05-27T06:30:04.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.584+0000 7f7139e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71340cea40 0x7f7134158360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:04.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.584+0000 7f7139e00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71340b2cd0 con 0x7f71340b2fb0 2024-05-27T06:30:04.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.584+0000 7f7139e00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71340cdc80 con 0x7f71340d2010 2024-05-27T06:30:04.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.584+0000 7f7139e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f71340ce5b0 con 0x7f71340cea40 2024-05-27T06:30:04.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.584+0000 7f7133400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f71340b2fb0 0x7f71340b33c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:46804/0 (socket says 172.21.15.87:46804) 2024-05-27T06:30:04.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.584+0000 7f7133400640 1 -- 172.21.15.87:0/1562031157 learned_addr learned my addr 172.21.15.87:0/1562031157 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:30:04.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.584+0000 7f7132a00640 1 --2- 172.21.15.87:0/1562031157 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71340cea40 0x7f7134158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:04.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.584+0000 7f7132000640 1 -- 172.21.15.87:0/1562031157 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1301255125 0 0) 0x7f71340b2cd0 con 0x7f71340b2fb0 2024-05-27T06:30:04.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.584+0000 7f7132000640 1 -- 172.21.15.87:0/1562031157 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7118003530 con 0x7f71340b2fb0 2024-05-27T06:30:04.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.584+0000 7f7132000640 1 -- 172.21.15.87:0/1562031157 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2780443321 0 0) 0x7f7118003530 con 0x7f71340b2fb0 2024-05-27T06:30:04.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.584+0000 7f7132000640 1 -- 172.21.15.87:0/1562031157 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71340cea40 msgr2=0x7f7134158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:04.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.584+0000 7f7132000640 1 --2- 172.21.15.87:0/1562031157 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71340cea40 0x7f7134158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:04.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.584+0000 7f7132000640 1 -- 172.21.15.87:0/1562031157 >> v1:172.21.15.149:6789/0 conn(0x7f71340d2010 legacy=0x7f71340d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:04.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.584+0000 7f7132000640 1 -- 172.21.15.87:0/1562031157 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71340cdf60 con 0x7f71340b2fb0 2024-05-27T06:30:04.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.584+0000 7f7132000640 1 -- 172.21.15.87:0/1562031157 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7f712c001aa0 con 0x7f71340b2fb0 2024-05-27T06:30:04.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.584+0000 7f7132000640 1 -- 172.21.15.87:0/1562031157 >> v1:172.21.15.87:6789/0 conn(0x7f71340b2fb0 legacy=0x7f71340b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:04.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.584+0000 7f7132000640 1 --2- 172.21.15.87:0/1562031157 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71340cea40 0x7f7118003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:04.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.584+0000 7f7132000640 1 --2- 172.21.15.87:0/1562031157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7118004010 0x7f7118004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:04.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.584+0000 7f7132000640 1 --2- 172.21.15.87:0/1562031157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7118004d50 0x7f7118005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:04.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.584+0000 7f7132000640 1 -- 172.21.15.87:0/1562031157 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f71340ce5b0 con 0x7f7118004d50 2024-05-27T06:30:04.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.584+0000 7f7132000640 1 -- 172.21.15.87:0/1562031157 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f711800bc10 con 0x7f7118004010 2024-05-27T06:30:04.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.584+0000 7f7132000640 1 -- 172.21.15.87:0/1562031157 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f711800be10 con 0x7f71340cea40 2024-05-27T06:30:04.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.588+0000 7f7133400640 1 --2- 172.21.15.87:0/1562031157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7118004d50 0x7f7118005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:04.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.588+0000 7f7132a00640 1 --2- 172.21.15.87:0/1562031157 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71340cea40 0x7f7118003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:04.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.588+0000 7f712a000640 1 --2- 172.21.15.87:0/1562031157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7118004010 0x7f7118004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:04.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.588+0000 7f7133400640 1 -- 172.21.15.87:0/1562031157 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71340cea40 msgr2=0x7f7118003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:04.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.588+0000 7f7133400640 1 --2- 172.21.15.87:0/1562031157 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71340cea40 0x7f7118003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:04.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.588+0000 7f7133400640 1 -- 172.21.15.87:0/1562031157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7118004010 msgr2=0x7f7118004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:04.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.588+0000 7f7133400640 1 --2- 172.21.15.87:0/1562031157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7118004010 0x7f7118004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:04.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.588+0000 7f7133400640 1 -- 172.21.15.87:0/1562031157 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7118003530 con 0x7f7118004d50 2024-05-27T06:30:04.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.588+0000 7f712a000640 1 --2- 172.21.15.87:0/1562031157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7118004010 0x7f7118004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:30:04.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.588+0000 7f7133400640 1 --2- 172.21.15.87:0/1562031157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7118004d50 0x7f7118005200 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f712c00a8f0 tx=0x7f712c01fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2100e88f017b690 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:04.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.588+0000 7f7132000640 1 -- 172.21.15.87:0/1562031157 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712c00a540 con 0x7f7118004d50 2024-05-27T06:30:04.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.588+0000 7f7132000640 1 -- 172.21.15.87:0/1562031157 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f712c0aa710 con 0x7f7118004d50 2024-05-27T06:30:04.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.588+0000 7f7132000640 1 -- 172.21.15.87:0/1562031157 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712c0aab00 con 0x7f7118004d50 2024-05-27T06:30:04.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.592+0000 7f7139e00640 1 -- 172.21.15.87:0/1562031157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7118004d50 msgr2=0x7f7118005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:04.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.592+0000 7f7139e00640 1 --2- 172.21.15.87:0/1562031157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7118004d50 0x7f7118005200 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f712c00a8f0 tx=0x7f712c01fa20 comp rx=0 tx=0).stop 2024-05-27T06:30:04.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.592+0000 7f7133400640 1 -- 172.21.15.87:0/1562031157 reap_dead start 2024-05-27T06:30:04.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.592+0000 7f7139e00640 1 -- 172.21.15.87:0/1562031157 shutdown_connections 2024-05-27T06:30:04.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.592+0000 7f7139e00640 1 -- 172.21.15.87:0/1562031157 >> 172.21.15.87:0/1562031157 conn(0x7f71340d3590 msgr2=0x7f71340d39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:04.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.592+0000 7f7139e00640 1 -- 172.21.15.87:0/1562031157 shutdown_connections 2024-05-27T06:30:04.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.592+0000 7f7139e00640 1 -- 172.21.15.87:0/1562031157 wait complete. 2024-05-27T06:30:04.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.592+0000 7f7139e00640 1 Processor -- start 2024-05-27T06:30:04.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.592+0000 7f7139e00640 1 -- start start 2024-05-27T06:30:04.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.596+0000 7f7139e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7118004d50 0x7f7134070f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:04.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.596+0000 7f7139e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71340719a0 0x7f71341fa080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:04.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.596+0000 7f7139e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71341fa5c0 0x7f713406f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:04.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.596+0000 7f7139e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f71340d2d60 con 0x7f71340719a0 2024-05-27T06:30:04.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.596+0000 7f7139e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f713415f350 con 0x7f7118004d50 2024-05-27T06:30:04.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.596+0000 7f7139e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f71340d2ee0 con 0x7f71341fa5c0 2024-05-27T06:30:04.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.596+0000 7f712a000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71340719a0 0x7f71341fa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:04.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.596+0000 7f712a000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71340719a0 0x7f71341fa080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47000/0 (socket says 172.21.15.87:47000) 2024-05-27T06:30:04.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.596+0000 7f712a000640 1 -- 172.21.15.87:0/231095686 learned_addr learned my addr 172.21.15.87:0/231095686 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:04.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.596+0000 7f712a000640 1 -- 172.21.15.87:0/231095686 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71341fa5c0 msgr2=0x7f713406f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:04.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.596+0000 7f712a000640 1 --2- 172.21.15.87:0/231095686 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71341fa5c0 0x7f713406f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:04.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.596+0000 7f712a000640 1 -- 172.21.15.87:0/231095686 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7118004d50 msgr2=0x7f7134070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:04.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.596+0000 7f712a000640 1 --2- 172.21.15.87:0/231095686 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7118004d50 0x7f7134070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:04.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.596+0000 7f712a000640 1 -- 172.21.15.87:0/231095686 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71341fa9d0 con 0x7f71340719a0 2024-05-27T06:30:04.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.596+0000 7f712a000640 1 --2- 172.21.15.87:0/231095686 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71340719a0 0x7f71341fa080 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f711c00e7e0 tx=0x7f711c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:04.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.596+0000 7f712be00640 1 -- 172.21.15.87:0/231095686 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711c0050d0 con 0x7f71340719a0 2024-05-27T06:30:04.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.596+0000 7f712be00640 1 -- 172.21.15.87:0/231095686 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f711c018070 con 0x7f71340719a0 2024-05-27T06:30:04.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.596+0000 7f7139e00640 1 -- 172.21.15.87:0/231095686 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71341fae60 con 0x7f71340719a0 2024-05-27T06:30:04.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.596+0000 7f712be00640 1 -- 172.21.15.87:0/231095686 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711c005470 con 0x7f71340719a0 2024-05-27T06:30:04.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.596+0000 7f7139e00640 1 -- 172.21.15.87:0/231095686 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71341e7ef0 con 0x7f71340719a0 2024-05-27T06:30:04.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.596+0000 7f7139e00640 1 -- 172.21.15.87:0/231095686 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f713406aa30 con 0x7f71340719a0 2024-05-27T06:30:04.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.600+0000 7f712be00640 1 -- 172.21.15.87:0/231095686 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f711c00c640 con 0x7f71340719a0 2024-05-27T06:30:04.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.600+0000 7f712be00640 1 --2- 172.21.15.87:0/231095686 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f711006f5a0 0x7f7110071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:04.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.600+0000 7f712be00640 1 -- 172.21.15.87:0/231095686 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f711c08f1f0 con 0x7f71340719a0 2024-05-27T06:30:04.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.600+0000 7f7132a00640 1 --2- 172.21.15.87:0/231095686 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f711006f5a0 0x7f7110071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:04.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.600+0000 7f7132a00640 1 --2- 172.21.15.87:0/231095686 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f711006f5a0 0x7f7110071ab0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f71340d1610 tx=0x7f71240095f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:04.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.604+0000 7f712be00640 1 -- 172.21.15.87:0/231095686 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f71341fa9d0 con 0x7f71340719a0 2024-05-27T06:30:04.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.800+0000 7f7139e00640 1 -- 172.21.15.87:0/231095686 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71340d18e0 con 0x7f71340719a0 2024-05-27T06:30:04.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.800+0000 7f712be00640 1 -- 172.21.15.87:0/231095686 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5187 (secure 0 0 0) 0x7f711c05bfd0 con 0x7f71340719a0 2024-05-27T06:30:04.799 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:30:04.799 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5254,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/1883124200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1883124200},{"type":"v1","addr":"172.21.15.149:6834","nonce":1883124200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3525413342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":3525413342},{"type":"v1","addr":"172.21.15.149:6835","nonce":3525413342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5373,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1517601928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1517601928},{"type":"v1","addr":"172.21.15.87:6835","nonce":1517601928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T06:29:31.715627+0000","modified":"2024-05-27T06:29:34.730216+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5382":{"gid":5382,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/3958980223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":3958980223},{"type":"v1","addr":"172.21.15.87:6837","nonce":3958980223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5382,"qdb_cluster":[5382]},"id":3}]} 2024-05-27T06:30:04.799 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 27 2024-05-27T06:30:04.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.800+0000 7f7139e00640 1 -- 172.21.15.87:0/231095686 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f711006f5a0 msgr2=0x7f7110071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:04.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.800+0000 7f7139e00640 1 --2- 172.21.15.87:0/231095686 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f711006f5a0 0x7f7110071ab0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f71340d1610 tx=0x7f71240095f0 comp rx=0 tx=0).stop 2024-05-27T06:30:04.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.800+0000 7f7139e00640 1 -- 172.21.15.87:0/231095686 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71340719a0 msgr2=0x7f71341fa080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:04.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.800+0000 7f7139e00640 1 --2- 172.21.15.87:0/231095686 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71340719a0 0x7f71341fa080 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f711c00e7e0 tx=0x7f711c00eca0 comp rx=0 tx=0).stop 2024-05-27T06:30:04.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.800+0000 7f7139e00640 1 -- 172.21.15.87:0/231095686 shutdown_connections 2024-05-27T06:30:04.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.800+0000 7f7139e00640 1 --2- 172.21.15.87:0/231095686 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f711006f5a0 0x7f7110071ab0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:04.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.800+0000 7f7139e00640 1 --2- 172.21.15.87:0/231095686 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71341fa5c0 0x7f713406f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:04.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.800+0000 7f7139e00640 1 --2- 172.21.15.87:0/231095686 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71340719a0 0x7f71341fa080 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:04.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.800+0000 7f7139e00640 1 --2- 172.21.15.87:0/231095686 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7118004d50 0x7f7134070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:04.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.800+0000 7f7139e00640 1 -- 172.21.15.87:0/231095686 >> 172.21.15.87:0/231095686 conn(0x7f71340d3590 msgr2=0x7f71340b3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:04.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.800+0000 7f7139e00640 1 -- 172.21.15.87:0/231095686 shutdown_connections 2024-05-27T06:30:04.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.800+0000 7f7139e00640 1 -- 172.21.15.87:0/231095686 wait complete. 2024-05-27T06:30:04.820 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T06:30:04.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.968+0000 7f4921200640 1 Processor -- start 2024-05-27T06:30:04.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.968+0000 7f4921200640 1 -- start start 2024-05-27T06:30:04.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.968+0000 7f4921200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f491c0cea40 0x7f491c158360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:04.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.968+0000 7f4921200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f491c0b2cd0 con 0x7f491c0d2010 2024-05-27T06:30:04.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.968+0000 7f4921200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f491c0cdc80 con 0x7f491c0b2fb0 2024-05-27T06:30:04.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.968+0000 7f4921200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f491c0ce5b0 con 0x7f491c0cea40 2024-05-27T06:30:04.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.968+0000 7f4911400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f491c0d2010 0x7f491c0d2420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:42960/0 (socket says 172.21.15.87:42960) 2024-05-27T06:30:04.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.968+0000 7f4911400640 1 -- 172.21.15.87:0/2084514252 learned_addr learned my addr 172.21.15.87:0/2084514252 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:30:04.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.972+0000 7f4919e00640 1 --2- 172.21.15.87:0/2084514252 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f491c0cea40 0x7f491c158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:04.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.972+0000 7f4919400640 1 -- 172.21.15.87:0/2084514252 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4058410331 0 0) 0x7f491c0b2cd0 con 0x7f491c0d2010 2024-05-27T06:30:04.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.972+0000 7f4919400640 1 -- 172.21.15.87:0/2084514252 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4900003530 con 0x7f491c0d2010 2024-05-27T06:30:04.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.972+0000 7f4919e00640 1 -- 172.21.15.87:0/2084514252 >> v1:172.21.15.149:6789/0 conn(0x7f491c0b2fb0 legacy=0x7f491c0b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:04.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.972+0000 7f4919400640 1 -- 172.21.15.87:0/2084514252 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2337982016 0 0) 0x7f491c0cdc80 con 0x7f491c0b2fb0 2024-05-27T06:30:04.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.972+0000 7f4919e00640 1 -- 172.21.15.87:0/2084514252 >> v1:172.21.15.87:6789/0 conn(0x7f491c0d2010 legacy=0x7f491c0d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:04.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.972+0000 7f4919e00640 1 -- 172.21.15.87:0/2084514252 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f491c0cdf60 con 0x7f491c0cea40 2024-05-27T06:30:04.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.972+0000 7f4919e00640 1 --2- 172.21.15.87:0/2084514252 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f491c0cea40 0x7f491c158360 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f490c009dc0 tx=0x7f490c01c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=136291550adcd71b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:04.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.972+0000 7f4919400640 1 -- 172.21.15.87:0/2084514252 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490c0b2070 con 0x7f491c0cea40 2024-05-27T06:30:04.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.972+0000 7f4919400640 1 -- 172.21.15.87:0/2084514252 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f490c0a5940 con 0x7f491c0cea40 2024-05-27T06:30:04.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.972+0000 7f4919400640 1 -- 172.21.15.87:0/2084514252 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490c0a5cf0 con 0x7f491c0cea40 2024-05-27T06:30:04.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.976+0000 7f4921200640 1 -- 172.21.15.87:0/2084514252 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f491c0cea40 msgr2=0x7f491c158360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:04.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.976+0000 7f4921200640 1 --2- 172.21.15.87:0/2084514252 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f491c0cea40 0x7f491c158360 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f490c009dc0 tx=0x7f490c01c990 comp rx=0 tx=0).stop 2024-05-27T06:30:04.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.976+0000 7f4921200640 1 -- 172.21.15.87:0/2084514252 shutdown_connections 2024-05-27T06:30:04.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.976+0000 7f4921200640 1 --2- 172.21.15.87:0/2084514252 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f491c0cea40 0x7f491c158360 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:04.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.976+0000 7f4921200640 1 -- 172.21.15.87:0/2084514252 >> 172.21.15.87:0/2084514252 conn(0x7f491c0d3590 msgr2=0x7f491c0d39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:04.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.976+0000 7f4921200640 1 -- 172.21.15.87:0/2084514252 shutdown_connections 2024-05-27T06:30:04.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.976+0000 7f4921200640 1 -- 172.21.15.87:0/2084514252 wait complete. 2024-05-27T06:30:04.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.976+0000 7f4921200640 1 Processor -- start 2024-05-27T06:30:04.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.976+0000 7f4921200640 1 -- start start 2024-05-27T06:30:04.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.980+0000 7f4921200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f491c0b2fb0 0x7f491c0cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:04.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.980+0000 7f4921200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f491c0cea40 0x7f491c154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:04.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.980+0000 7f4921200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f491c0d2010 0x7f491c1566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:04.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.980+0000 7f4921200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f491c0d2ee0 con 0x7f491c0d2010 2024-05-27T06:30:04.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.980+0000 7f4921200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f491c0d2d60 con 0x7f491c0b2fb0 2024-05-27T06:30:04.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.980+0000 7f4921200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f491c0cee50 con 0x7f491c0cea40 2024-05-27T06:30:04.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.980+0000 7f491a800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f491c0d2010 0x7f491c1566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:04.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.980+0000 7f491a800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f491c0d2010 0x7f491c1566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41870/0 (socket says 172.21.15.87:41870) 2024-05-27T06:30:04.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.980+0000 7f491a800640 1 -- 172.21.15.87:0/843586946 learned_addr learned my addr 172.21.15.87:0/843586946 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:04.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.980+0000 7f4919e00640 1 --2- 172.21.15.87:0/843586946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f491c0b2fb0 0x7f491c0cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:04.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.980+0000 7f4911400640 1 --2- 172.21.15.87:0/843586946 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f491c0cea40 0x7f491c154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:04.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.980+0000 7f491a800640 1 -- 172.21.15.87:0/843586946 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f491c0cea40 msgr2=0x7f491c154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:04.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.980+0000 7f491a800640 1 --2- 172.21.15.87:0/843586946 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f491c0cea40 0x7f491c154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:04.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.980+0000 7f491a800640 1 -- 172.21.15.87:0/843586946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f491c0b2fb0 msgr2=0x7f491c0cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:04.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.980+0000 7f491a800640 1 --2- 172.21.15.87:0/843586946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f491c0b2fb0 0x7f491c0cd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:04.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.980+0000 7f491a800640 1 -- 172.21.15.87:0/843586946 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f491c06f470 con 0x7f491c0d2010 2024-05-27T06:30:04.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.980+0000 7f491a800640 1 --2- 172.21.15.87:0/843586946 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f491c0d2010 0x7f491c1566f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f491400c3c0 tx=0x7f491400c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:04.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.980+0000 7f4912a00640 1 -- 172.21.15.87:0/843586946 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4914017070 con 0x7f491c0d2010 2024-05-27T06:30:04.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.980+0000 7f4912a00640 1 -- 172.21.15.87:0/843586946 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4914003600 con 0x7f491c0d2010 2024-05-27T06:30:04.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.980+0000 7f4921200640 1 -- 172.21.15.87:0/843586946 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f491c154950 con 0x7f491c0d2010 2024-05-27T06:30:04.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.980+0000 7f4912a00640 1 -- 172.21.15.87:0/843586946 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49140039f0 con 0x7f491c0d2010 2024-05-27T06:30:04.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.980+0000 7f4921200640 1 -- 172.21.15.87:0/843586946 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f491c14f9f0 con 0x7f491c0d2010 2024-05-27T06:30:04.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.980+0000 7f4921200640 1 -- 172.21.15.87:0/843586946 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f491c06aa30 con 0x7f491c0d2010 2024-05-27T06:30:04.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.984+0000 7f4912a00640 1 -- 172.21.15.87:0/843586946 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f491401a070 con 0x7f491c0d2010 2024-05-27T06:30:04.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.984+0000 7f4912a00640 1 --2- 172.21.15.87:0/843586946 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f48f806f400 0x7f48f8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:04.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.984+0000 7f4912a00640 1 -- 172.21.15.87:0/843586946 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f491408e880 con 0x7f491c0d2010 2024-05-27T06:30:04.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.984+0000 7f4919e00640 1 --2- 172.21.15.87:0/843586946 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f48f806f400 0x7f48f8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:04.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.984+0000 7f4919e00640 1 --2- 172.21.15.87:0/843586946 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f48f806f400 0x7f48f8071910 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f490c0af000 tx=0x7f490c0a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:04.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:04.988+0000 7f4912a00640 1 -- 172.21.15.87:0/843586946 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f491405aef0 con 0x7f491c0d2010 2024-05-27T06:30:05.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.148+0000 7f4921200640 1 -- 172.21.15.87:0/843586946 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f491c0b75d0 con 0x7f491c0d2010 2024-05-27T06:30:05.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.148+0000 7f4912a00640 1 -- 172.21.15.87:0/843586946 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+16926 (secure 0 0 0) 0x7f491405f1f0 con 0x7f491c0d2010 2024-05-27T06:30:05.149 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:30:05.149 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":54,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:29:33.325293+0000","last_up_change":"2024-05-27T06:27:25.988592+0000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T06:27:26.590191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-27T06:29:29.402801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-27T06:29:30.674019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6801","nonce":3674824716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6803","nonce":3674824716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6807","nonce":3674824716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6805","nonce":3674824716}]},"public_addr":"172.21.15.87:6801/3674824716","cluster_addr":"172.21.15.87:6803/3674824716","heartbeat_back_addr":"172.21.15.87:6807/3674824716","heartbeat_front_addr":"172.21.15.87:6805/3674824716","state":["exists","up"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6809","nonce":2443981288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6811","nonce":2443981288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6815","nonce":2443981288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6813","nonce":2443981288}]},"public_addr":"172.21.15.87:6809/2443981288","cluster_addr":"172.21.15.87:6811/2443981288","heartbeat_back_addr":"172.21.15.87:6815/2443981288","heartbeat_front_addr":"172.21.15.87:6813/2443981288","state":["exists","up"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6819","nonce":1441249238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6823","nonce":1441249238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6831","nonce":1441249238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6825","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6827","nonce":1441249238}]},"public_addr":"172.21.15.87:6819/1441249238","cluster_addr":"172.21.15.87:6823/1441249238","heartbeat_back_addr":"172.21.15.87:6831/1441249238","heartbeat_front_addr":"172.21.15.87:6827/1441249238","state":["exists","up"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6818","nonce":1173805234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6822","nonce":1173805234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6829","nonce":1173805234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6826","nonce":1173805234}]},"public_addr":"172.21.15.87:6818/1173805234","cluster_addr":"172.21.15.87:6822/1173805234","heartbeat_back_addr":"172.21.15.87:6829/1173805234","heartbeat_front_addr":"172.21.15.87:6826/1173805234","state":["exists","up"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6819","nonce":1551871079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6823","nonce":1551871079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6831","nonce":1551871079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6827","nonce":1551871079}]},"public_addr":"172.21.15.149:6819/1551871079","cluster_addr":"172.21.15.149:6823/1551871079","heartbeat_back_addr":"172.21.15.149:6831/1551871079","heartbeat_front_addr":"172.21.15.149:6827/1551871079","state":["exists","up"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6818","nonce":582864816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6822","nonce":582864816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6830","nonce":582864816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6826","nonce":582864816}]},"public_addr":"172.21.15.149:6818/582864816","cluster_addr":"172.21.15.149:6822/582864816","heartbeat_back_addr":"172.21.15.149:6830/582864816","heartbeat_front_addr":"172.21.15.149:6826/582864816","state":["exists","up"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6801","nonce":531351314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6803","nonce":531351314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6807","nonce":531351314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6805","nonce":531351314}]},"public_addr":"172.21.15.149:6801/531351314","cluster_addr":"172.21.15.149:6803/531351314","heartbeat_back_addr":"172.21.15.149:6807/531351314","heartbeat_front_addr":"172.21.15.149:6805/531351314","state":["exists","up"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6809","nonce":1171039913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6811","nonce":1171039913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6815","nonce":1171039913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6813","nonce":1171039913}]},"public_addr":"172.21.15.149:6809/1171039913","cluster_addr":"172.21.15.149:6811/1171039913","heartbeat_back_addr":"172.21.15.149:6815/1171039913","heartbeat_front_addr":"172.21.15.149:6813/1171039913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.589776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.819787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.767566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.683842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.038885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.120319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.687007+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.812832+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:30:05.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.152+0000 7f4921200640 1 -- 172.21.15.87:0/843586946 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f48f806f400 msgr2=0x7f48f8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:05.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.152+0000 7f4921200640 1 --2- 172.21.15.87:0/843586946 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f48f806f400 0x7f48f8071910 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f490c0af000 tx=0x7f490c0a7070 comp rx=0 tx=0).stop 2024-05-27T06:30:05.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.152+0000 7f4921200640 1 -- 172.21.15.87:0/843586946 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f491c0d2010 msgr2=0x7f491c1566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:05.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.152+0000 7f4921200640 1 --2- 172.21.15.87:0/843586946 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f491c0d2010 0x7f491c1566f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f491400c3c0 tx=0x7f491400c7c0 comp rx=0 tx=0).stop 2024-05-27T06:30:05.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.152+0000 7f4921200640 1 -- 172.21.15.87:0/843586946 shutdown_connections 2024-05-27T06:30:05.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.152+0000 7f4921200640 1 --2- 172.21.15.87:0/843586946 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f48f806f400 0x7f48f8071910 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:05.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.152+0000 7f4921200640 1 --2- 172.21.15.87:0/843586946 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f491c0d2010 0x7f491c1566f0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:05.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.152+0000 7f4921200640 1 --2- 172.21.15.87:0/843586946 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f491c0cea40 0x7f491c154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:05.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.152+0000 7f4921200640 1 --2- 172.21.15.87:0/843586946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f491c0b2fb0 0x7f491c0cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:05.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.152+0000 7f4921200640 1 -- 172.21.15.87:0/843586946 >> 172.21.15.87:0/843586946 conn(0x7f491c0d3590 msgr2=0x7f491c0b7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:05.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.152+0000 7f4921200640 1 -- 172.21.15.87:0/843586946 shutdown_connections 2024-05-27T06:30:05.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.152+0000 7f4921200640 1 -- 172.21.15.87:0/843586946 wait complete. 2024-05-27T06:30:05.171 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-27T06:30:05.171 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T06:30:05.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.320+0000 7f8d84a00640 1 Processor -- start 2024-05-27T06:30:05.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.320+0000 7f8d84a00640 1 -- start start 2024-05-27T06:30:05.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.320+0000 7f8d84a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8d8015fbf0 0x7f8d80163660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:05.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.320+0000 7f8d84a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8d800af4c0 0x7f8d800af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:05.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.320+0000 7f8d84a00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d80163ea0 con 0x7f8d800d1000 2024-05-27T06:30:05.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.320+0000 7f8d84a00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f8d80164180 con 0x7f8d8015fbf0 2024-05-27T06:30:05.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.320+0000 7f8d84a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f8d80164460 con 0x7f8d800af4c0 2024-05-27T06:30:05.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.320+0000 7f8d7f200640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8d800d1000 0x7f8d800d1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:42966/0 (socket says 172.21.15.87:42966) 2024-05-27T06:30:05.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.320+0000 7f8d7e800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8d8015fbf0 0x7f8d80163660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:05.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.320+0000 7f8d7f200640 1 -- 172.21.15.87:0/2748051627 learned_addr learned my addr 172.21.15.87:0/2748051627 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:30:05.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.320+0000 7f8d7de00640 1 --2- 172.21.15.87:0/2748051627 >> v2:172.21.15.149:3300/0 conn(0x7f8d800af4c0 0x7f8d800af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:05.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.320+0000 7f8d7e800640 1 -- 172.21.15.87:0/2748051627 >> v2:172.21.15.149:3300/0 conn(0x7f8d800af4c0 msgr2=0x7f8d800af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:05.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.320+0000 7f8d7e800640 1 --2- 172.21.15.87:0/2748051627 >> v2:172.21.15.149:3300/0 conn(0x7f8d800af4c0 0x7f8d800af8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:05.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.320+0000 7f8d7e800640 1 -- 172.21.15.87:0/2748051627 >> v1:172.21.15.87:6789/0 conn(0x7f8d800d1000 legacy=0x7f8d800d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:05.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.320+0000 7f8d7e800640 1 -- 172.21.15.87:0/2748051627 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d800cf1c0 con 0x7f8d8015fbf0 2024-05-27T06:30:05.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.320+0000 7f8d7d400640 1 -- 172.21.15.87:0/2748051627 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3658573261 0 0) 0x7f8d80163ea0 con 0x7f8d800d1000 2024-05-27T06:30:05.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.324+0000 7f8d7e800640 1 --2- 172.21.15.87:0/2748051627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d8015fbf0 0x7f8d80163660 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8d800b63f0 tx=0x7f8d7001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c96501dce73b71 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:05.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.324+0000 7f8d7d400640 1 -- 172.21.15.87:0/2748051627 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d700b1070 con 0x7f8d8015fbf0 2024-05-27T06:30:05.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.324+0000 7f8d7d400640 1 -- 172.21.15.87:0/2748051627 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d700ac440 con 0x7f8d8015fbf0 2024-05-27T06:30:05.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.324+0000 7f8d7d400640 1 -- 172.21.15.87:0/2748051627 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d700a4e60 con 0x7f8d8015fbf0 2024-05-27T06:30:05.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.324+0000 7f8d84a00640 1 -- 172.21.15.87:0/2748051627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d8015fbf0 msgr2=0x7f8d80163660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:05.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.324+0000 7f8d84a00640 1 --2- 172.21.15.87:0/2748051627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d8015fbf0 0x7f8d80163660 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8d800b63f0 tx=0x7f8d7001c480 comp rx=0 tx=0).stop 2024-05-27T06:30:05.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.324+0000 7f8d84a00640 1 -- 172.21.15.87:0/2748051627 shutdown_connections 2024-05-27T06:30:05.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.324+0000 7f8d84a00640 1 --2- 172.21.15.87:0/2748051627 >> v2:172.21.15.149:3300/0 conn(0x7f8d800af4c0 0x7f8d800af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:05.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.324+0000 7f8d84a00640 1 --2- 172.21.15.87:0/2748051627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d8015fbf0 0x7f8d80163660 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:05.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.324+0000 7f8d84a00640 1 -- 172.21.15.87:0/2748051627 >> 172.21.15.87:0/2748051627 conn(0x7f8d800d2e90 msgr2=0x7f8d800711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:05.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.324+0000 7f8d84a00640 1 -- 172.21.15.87:0/2748051627 shutdown_connections 2024-05-27T06:30:05.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.324+0000 7f8d84a00640 1 -- 172.21.15.87:0/2748051627 wait complete. 2024-05-27T06:30:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.328+0000 7f8d84a00640 1 Processor -- start 2024-05-27T06:30:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.328+0000 7f8d84a00640 1 -- start start 2024-05-27T06:30:05.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.328+0000 7f8d84a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d800af4c0 0x7f8d801617b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:05.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.328+0000 7f8d84a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d800d1000 0x7f8d80158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:05.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.328+0000 7f8d84a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d8015fbf0 0x7f8d80149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:05.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.328+0000 7f8d84a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8016d600 con 0x7f8d800d1000 2024-05-27T06:30:05.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.328+0000 7f8d84a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8016d480 con 0x7f8d8015fbf0 2024-05-27T06:30:05.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.328+0000 7f8d84a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8d8016d780 con 0x7f8d800af4c0 2024-05-27T06:30:05.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.328+0000 7f8d7de00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d800d1000 0x7f8d80158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:05.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.328+0000 7f8d7de00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d800d1000 0x7f8d80158a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41900/0 (socket says 172.21.15.87:41900) 2024-05-27T06:30:05.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.328+0000 7f8d7de00640 1 -- 172.21.15.87:0/3733793356 learned_addr learned my addr 172.21.15.87:0/3733793356 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:05.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.328+0000 7f8d7f200640 1 --2- 172.21.15.87:0/3733793356 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d8015fbf0 0x7f8d80149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.328+0000 7f8d7e800640 1 --2- 172.21.15.87:0/3733793356 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d800af4c0 0x7f8d801617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.328+0000 7f8d7de00640 1 -- 172.21.15.87:0/3733793356 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d800af4c0 msgr2=0x7f8d801617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.328+0000 7f8d7de00640 1 --2- 172.21.15.87:0/3733793356 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d800af4c0 0x7f8d801617b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.328+0000 7f8d7de00640 1 -- 172.21.15.87:0/3733793356 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d8015fbf0 msgr2=0x7f8d80149a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.328+0000 7f8d7de00640 1 --2- 172.21.15.87:0/3733793356 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d8015fbf0 0x7f8d80149a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.328+0000 7f8d7de00640 1 -- 172.21.15.87:0/3733793356 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d801620b0 con 0x7f8d800d1000 2024-05-27T06:30:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.328+0000 7f8d7e800640 1 --2- 172.21.15.87:0/3733793356 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d800af4c0 0x7f8d801617b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:30:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.328+0000 7f8d7f200640 1 --2- 172.21.15.87:0/3733793356 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d8015fbf0 0x7f8d80149a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:30:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.328+0000 7f8d7de00640 1 --2- 172.21.15.87:0/3733793356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d800d1000 0x7f8d80158a80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00d5f0 tx=0x7f8d6c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.332+0000 7f8d76a00640 1 -- 172.21.15.87:0/3733793356 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c0125f0 con 0x7f8d800d1000 2024-05-27T06:30:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.332+0000 7f8d76a00640 1 -- 172.21.15.87:0/3733793356 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d6c019070 con 0x7f8d800d1000 2024-05-27T06:30:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.332+0000 7f8d76a00640 1 -- 172.21.15.87:0/3733793356 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c0129d0 con 0x7f8d800d1000 2024-05-27T06:30:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.332+0000 7f8d84a00640 1 -- 172.21.15.87:0/3733793356 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d80157fa0 con 0x7f8d800d1000 2024-05-27T06:30:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.332+0000 7f8d84a00640 1 -- 172.21.15.87:0/3733793356 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d80158560 con 0x7f8d800d1000 2024-05-27T06:30:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.332+0000 7f8d84a00640 1 -- 172.21.15.87:0/3733793356 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d8006aa30 con 0x7f8d800d1000 2024-05-27T06:30:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.332+0000 7f8d76a00640 1 -- 172.21.15.87:0/3733793356 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8d6c012b70 con 0x7f8d800d1000 2024-05-27T06:30:05.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.332+0000 7f8d76a00640 1 --2- 172.21.15.87:0/3733793356 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f8d6006f400 0x7f8d60071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:05.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.332+0000 7f8d76a00640 1 -- 172.21.15.87:0/3733793356 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f8d6c08f980 con 0x7f8d800d1000 2024-05-27T06:30:05.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.332+0000 7f8d7e800640 1 --2- 172.21.15.87:0/3733793356 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f8d6006f400 0x7f8d60071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:05.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.336+0000 7f8d7e800640 1 --2- 172.21.15.87:0/3733793356 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f8d6006f400 0x7f8d60071910 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8d700ae000 tx=0x7f8d700a6070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:05.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.336+0000 7f8d76a00640 1 -- 172.21.15.87:0/3733793356 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f8d6c05c640 con 0x7f8d800d1000 2024-05-27T06:30:05.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.532+0000 7f8d84a00640 1 -- 172.21.15.87:0/3733793356 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d80161e00 con 0x7f8d800d1000 2024-05-27T06:30:05.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.532+0000 7f8d76a00640 1 -- 172.21.15.87:0/3733793356 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5187 (secure 0 0 0) 0x7f8d6c05bf40 con 0x7f8d800d1000 2024-05-27T06:30:05.531 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:30:05.531 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5254,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/1883124200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1883124200},{"type":"v1","addr":"172.21.15.149:6834","nonce":1883124200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3525413342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":3525413342},{"type":"v1","addr":"172.21.15.149:6835","nonce":3525413342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5373,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1517601928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1517601928},{"type":"v1","addr":"172.21.15.87:6835","nonce":1517601928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T06:29:31.715627+0000","modified":"2024-05-27T06:29:34.730216+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5382":{"gid":5382,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/3958980223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":3958980223},{"type":"v1","addr":"172.21.15.87:6837","nonce":3958980223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5382,"qdb_cluster":[5382]},"id":3}]} 2024-05-27T06:30:05.531 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 27 2024-05-27T06:30:05.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.532+0000 7f8d84a00640 1 -- 172.21.15.87:0/3733793356 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f8d6006f400 msgr2=0x7f8d60071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:05.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.532+0000 7f8d84a00640 1 --2- 172.21.15.87:0/3733793356 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f8d6006f400 0x7f8d60071910 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8d700ae000 tx=0x7f8d700a6070 comp rx=0 tx=0).stop 2024-05-27T06:30:05.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.532+0000 7f8d84a00640 1 -- 172.21.15.87:0/3733793356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d800d1000 msgr2=0x7f8d80158a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:05.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.532+0000 7f8d84a00640 1 --2- 172.21.15.87:0/3733793356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d800d1000 0x7f8d80158a80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00d5f0 tx=0x7f8d6c00dab0 comp rx=0 tx=0).stop 2024-05-27T06:30:05.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.532+0000 7f8d84a00640 1 -- 172.21.15.87:0/3733793356 shutdown_connections 2024-05-27T06:30:05.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.532+0000 7f8d84a00640 1 --2- 172.21.15.87:0/3733793356 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f8d6006f400 0x7f8d60071910 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:05.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.532+0000 7f8d84a00640 1 --2- 172.21.15.87:0/3733793356 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d8015fbf0 0x7f8d80149a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:05.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.532+0000 7f8d84a00640 1 --2- 172.21.15.87:0/3733793356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d800d1000 0x7f8d80158a80 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:05.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.532+0000 7f8d84a00640 1 --2- 172.21.15.87:0/3733793356 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d800af4c0 0x7f8d801617b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:05.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.532+0000 7f8d84a00640 1 -- 172.21.15.87:0/3733793356 >> 172.21.15.87:0/3733793356 conn(0x7f8d800d2e90 msgr2=0x7f8d800b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:05.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.536+0000 7f8d84a00640 1 -- 172.21.15.87:0/3733793356 shutdown_connections 2024-05-27T06:30:05.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.536+0000 7f8d84a00640 1 -- 172.21.15.87:0/3733793356 wait complete. 2024-05-27T06:30:05.552 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T06:30:05.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.700+0000 7f8681e00640 1 Processor -- start 2024-05-27T06:30:05.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.700+0000 7f8681e00640 1 -- start start 2024-05-27T06:30:05.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.704+0000 7f8681e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f867c06d430 0x7f867c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:05.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.704+0000 7f8681e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f867c0b5e10 0x7f867c0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:05.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.704+0000 7f8681e00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f867c06f240 con 0x7f867c0aef40 2024-05-27T06:30:05.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.704+0000 7f8681e00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f867c06fe30 con 0x7f867c06d430 2024-05-27T06:30:05.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.704+0000 7f8681e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f867c06d1e0 con 0x7f867c0b5e10 2024-05-27T06:30:05.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.704+0000 7f867aa00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f867c06d430 0x7f867c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:05.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.704+0000 7f8672000640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f867c0aef40 0x7f867c0b5700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:42982/0 (socket says 172.21.15.87:42982) 2024-05-27T06:30:05.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.704+0000 7f8672000640 1 -- 172.21.15.87:0/3703742567 learned_addr learned my addr 172.21.15.87:0/3703742567 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:30:05.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.704+0000 7f867b400640 1 --2- 172.21.15.87:0/3703742567 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f867c0b5e10 0x7f867c0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:05.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.704+0000 7f867aa00640 1 -- 172.21.15.87:0/3703742567 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f867c0b5e10 msgr2=0x7f867c0702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:05.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.704+0000 7f867aa00640 1 --2- 172.21.15.87:0/3703742567 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f867c0b5e10 0x7f867c0702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:05.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.704+0000 7f867aa00640 1 -- 172.21.15.87:0/3703742567 >> v1:172.21.15.87:6789/0 conn(0x7f867c0aef40 legacy=0x7f867c0b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:05.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.704+0000 7f867a000640 1 -- 172.21.15.87:0/3703742567 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1111160353 0 0) 0x7f867c06f240 con 0x7f867c0aef40 2024-05-27T06:30:05.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.704+0000 7f867aa00640 1 -- 172.21.15.87:0/3703742567 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f867c06f500 con 0x7f867c06d430 2024-05-27T06:30:05.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.708+0000 7f867aa00640 1 --2- 172.21.15.87:0/3703742567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f867c06d430 0x7f867c06e320 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f866c0097c0 tx=0x7f866c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a5e62b46bd3358 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:05.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.708+0000 7f867a000640 1 -- 172.21.15.87:0/3703742567 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c0b2070 con 0x7f867c06d430 2024-05-27T06:30:05.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.708+0000 7f867a000640 1 -- 172.21.15.87:0/3703742567 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f866c0ad640 con 0x7f867c06d430 2024-05-27T06:30:05.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.708+0000 7f867a000640 1 -- 172.21.15.87:0/3703742567 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c0ada10 con 0x7f867c06d430 2024-05-27T06:30:05.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.708+0000 7f8681e00640 1 -- 172.21.15.87:0/3703742567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f867c06d430 msgr2=0x7f867c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:05.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.708+0000 7f8681e00640 1 --2- 172.21.15.87:0/3703742567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f867c06d430 0x7f867c06e320 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f866c0097c0 tx=0x7f866c01c4a0 comp rx=0 tx=0).stop 2024-05-27T06:30:05.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.708+0000 7f8681e00640 1 -- 172.21.15.87:0/3703742567 shutdown_connections 2024-05-27T06:30:05.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.708+0000 7f8681e00640 1 --2- 172.21.15.87:0/3703742567 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f867c0b5e10 0x7f867c0702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:05.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.708+0000 7f8681e00640 1 --2- 172.21.15.87:0/3703742567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f867c06d430 0x7f867c06e320 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:05.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.708+0000 7f8681e00640 1 -- 172.21.15.87:0/3703742567 >> 172.21.15.87:0/3703742567 conn(0x7f867c0d1e70 msgr2=0x7f867c0d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:05.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.708+0000 7f8681e00640 1 -- 172.21.15.87:0/3703742567 shutdown_connections 2024-05-27T06:30:05.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.708+0000 7f8681e00640 1 -- 172.21.15.87:0/3703742567 wait complete. 2024-05-27T06:30:05.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.708+0000 7f8681e00640 1 Processor -- start 2024-05-27T06:30:05.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.708+0000 7f8681e00640 1 -- start start 2024-05-27T06:30:05.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.712+0000 7f8681e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f867c06d430 0x7f867c1618f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:05.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.712+0000 7f8681e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f867c0aef40 0x7f867c157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:05.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.712+0000 7f8681e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f867c157aa0 0x7f867c160a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:05.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.712+0000 7f8681e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f867c16cfc0 con 0x7f867c0aef40 2024-05-27T06:30:05.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.712+0000 7f8681e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f867c16ce40 con 0x7f867c06d430 2024-05-27T06:30:05.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.712+0000 7f8681e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f867c16d140 con 0x7f867c157aa0 2024-05-27T06:30:05.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.712+0000 7f8672000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f867c0aef40 0x7f867c157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:05.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.712+0000 7f8672000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f867c0aef40 0x7f867c157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41914/0 (socket says 172.21.15.87:41914) 2024-05-27T06:30:05.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.712+0000 7f8672000640 1 -- 172.21.15.87:0/3003639155 learned_addr learned my addr 172.21.15.87:0/3003639155 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:05.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.712+0000 7f8672000640 1 -- 172.21.15.87:0/3003639155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f867c157aa0 msgr2=0x7f867c160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:05.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.712+0000 7f8672000640 1 --2- 172.21.15.87:0/3003639155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f867c157aa0 0x7f867c160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:05.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.712+0000 7f8672000640 1 -- 172.21.15.87:0/3003639155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f867c06d430 msgr2=0x7f867c1618f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:05.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.712+0000 7f8672000640 1 --2- 172.21.15.87:0/3003639155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f867c06d430 0x7f867c1618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:05.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.712+0000 7f8672000640 1 -- 172.21.15.87:0/3003639155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f867c0ceae0 con 0x7f867c0aef40 2024-05-27T06:30:05.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.712+0000 7f8672000640 1 --2- 172.21.15.87:0/3003639155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f867c0aef40 0x7f867c157560 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8664005890 tx=0x7f866400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:05.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.712+0000 7f8673e00640 1 -- 172.21.15.87:0/3003639155 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8664017070 con 0x7f867c0aef40 2024-05-27T06:30:05.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.712+0000 7f8673e00640 1 -- 172.21.15.87:0/3003639155 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8664005d10 con 0x7f867c0aef40 2024-05-27T06:30:05.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.712+0000 7f8681e00640 1 -- 172.21.15.87:0/3003639155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f867c0cedc0 con 0x7f867c0aef40 2024-05-27T06:30:05.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.712+0000 7f8673e00640 1 -- 172.21.15.87:0/3003639155 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8664007310 con 0x7f867c0aef40 2024-05-27T06:30:05.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.712+0000 7f8681e00640 1 -- 172.21.15.87:0/3003639155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f867c0ce590 con 0x7f867c0aef40 2024-05-27T06:30:05.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.712+0000 7f8681e00640 1 -- 172.21.15.87:0/3003639155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f867c0ce820 con 0x7f867c0aef40 2024-05-27T06:30:05.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.716+0000 7f8673e00640 1 -- 172.21.15.87:0/3003639155 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f866401a070 con 0x7f867c0aef40 2024-05-27T06:30:05.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.716+0000 7f8673e00640 1 --2- 172.21.15.87:0/3003639155 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f865806f430 0x7f8658071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:05.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.716+0000 7f8673e00640 1 -- 172.21.15.87:0/3003639155 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f866408e7b0 con 0x7f867c0aef40 2024-05-27T06:30:05.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.716+0000 7f867aa00640 1 --2- 172.21.15.87:0/3003639155 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f865806f430 0x7f8658071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:05.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.716+0000 7f867aa00640 1 --2- 172.21.15.87:0/3003639155 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f865806f430 0x7f8658071940 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f866c0af000 tx=0x7f866c004740 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:05.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.720+0000 7f8673e00640 1 -- 172.21.15.87:0/3003639155 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f866405b500 con 0x7f867c0aef40 2024-05-27T06:30:05.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.912+0000 7f8681e00640 1 -- 172.21.15.87:0/3003639155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f867c06aa30 con 0x7f867c0aef40 2024-05-27T06:30:05.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.912+0000 7f8673e00640 1 -- 172.21.15.87:0/3003639155 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5187 (secure 0 0 0) 0x7f866405ae00 con 0x7f867c0aef40 2024-05-27T06:30:05.912 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:30:05.912 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5254,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/1883124200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1883124200},{"type":"v1","addr":"172.21.15.149:6834","nonce":1883124200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3525413342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":3525413342},{"type":"v1","addr":"172.21.15.149:6835","nonce":3525413342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5373,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1517601928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1517601928},{"type":"v1","addr":"172.21.15.87:6835","nonce":1517601928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T06:29:31.715627+0000","modified":"2024-05-27T06:29:34.730216+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5382":{"gid":5382,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/3958980223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":3958980223},{"type":"v1","addr":"172.21.15.87:6837","nonce":3958980223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5382,"qdb_cluster":[5382]},"id":3}]} 2024-05-27T06:30:05.913 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 27 2024-05-27T06:30:05.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.916+0000 7f8681e00640 1 -- 172.21.15.87:0/3003639155 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f865806f430 msgr2=0x7f8658071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:05.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.916+0000 7f8681e00640 1 --2- 172.21.15.87:0/3003639155 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f865806f430 0x7f8658071940 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f866c0af000 tx=0x7f866c004740 comp rx=0 tx=0).stop 2024-05-27T06:30:05.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.916+0000 7f8681e00640 1 -- 172.21.15.87:0/3003639155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f867c0aef40 msgr2=0x7f867c157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:05.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.916+0000 7f8681e00640 1 --2- 172.21.15.87:0/3003639155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f867c0aef40 0x7f867c157560 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8664005890 tx=0x7f866400c890 comp rx=0 tx=0).stop 2024-05-27T06:30:05.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.916+0000 7f8681e00640 1 -- 172.21.15.87:0/3003639155 shutdown_connections 2024-05-27T06:30:05.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.916+0000 7f8681e00640 1 --2- 172.21.15.87:0/3003639155 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f865806f430 0x7f8658071940 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:05.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.916+0000 7f8681e00640 1 --2- 172.21.15.87:0/3003639155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f867c157aa0 0x7f867c160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:05.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.916+0000 7f8681e00640 1 --2- 172.21.15.87:0/3003639155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f867c0aef40 0x7f867c157560 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:05.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.916+0000 7f8681e00640 1 --2- 172.21.15.87:0/3003639155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f867c06d430 0x7f867c1618f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:05.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.916+0000 7f8681e00640 1 -- 172.21.15.87:0/3003639155 >> 172.21.15.87:0/3003639155 conn(0x7f867c0d1e70 msgr2=0x7f867c0b1980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:05.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.916+0000 7f8681e00640 1 -- 172.21.15.87:0/3003639155 shutdown_connections 2024-05-27T06:30:05.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:05.916+0000 7f8681e00640 1 -- 172.21.15.87:0/3003639155 wait complete. 2024-05-27T06:30:05.934 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T06:30:06.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.080+0000 7efcb0c00640 1 Processor -- start 2024-05-27T06:30:06.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.084+0000 7efcb0c00640 1 -- start start 2024-05-27T06:30:06.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.084+0000 7efcb0c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efcac0d1120 0x7efcac0d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:06.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.084+0000 7efcb0c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efcac1444e0 0x7efcac1448f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:06.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.084+0000 7efcb0c00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcac06d200 con 0x7efcac06ff20 2024-05-27T06:30:06.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.084+0000 7efcb0c00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7efcac06cfb0 con 0x7efcac0d1120 2024-05-27T06:30:06.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.084+0000 7efcb0c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7efcac06d4e0 con 0x7efcac1444e0 2024-05-27T06:30:06.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.084+0000 7efca3e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7efcac06ff20 0x7efcac070330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:42990/0 (socket says 172.21.15.87:42990) 2024-05-27T06:30:06.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.084+0000 7efca3e00640 1 -- 172.21.15.87:0/3173649748 learned_addr learned my addr 172.21.15.87:0/3173649748 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:30:06.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.084+0000 7efcab400640 1 --2- 172.21.15.87:0/3173649748 >> v2:172.21.15.87:3300/0 conn(0x7efcac0d1120 0x7efcac0d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:06.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.084+0000 7efcabe00640 1 --2- 172.21.15.87:0/3173649748 >> v2:172.21.15.149:3300/0 conn(0x7efcac1444e0 0x7efcac1448f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:06.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.084+0000 7efcaaa00640 1 -- 172.21.15.87:0/3173649748 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2876683420 0 0) 0x7efcac06d200 con 0x7efcac06ff20 2024-05-27T06:30:06.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.084+0000 7efcaaa00640 1 -- 172.21.15.87:0/3173649748 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc90003530 con 0x7efcac06ff20 2024-05-27T06:30:06.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.084+0000 7efcab400640 1 -- 172.21.15.87:0/3173649748 >> v2:172.21.15.149:3300/0 conn(0x7efcac1444e0 msgr2=0x7efcac1448f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:06.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.084+0000 7efcab400640 1 --2- 172.21.15.87:0/3173649748 >> v2:172.21.15.149:3300/0 conn(0x7efcac1444e0 0x7efcac1448f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:06.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.084+0000 7efcab400640 1 -- 172.21.15.87:0/3173649748 >> v1:172.21.15.87:6789/0 conn(0x7efcac06ff20 legacy=0x7efcac070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:06.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.084+0000 7efcab400640 1 -- 172.21.15.87:0/3173649748 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcac06d7c0 con 0x7efcac0d1120 2024-05-27T06:30:06.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.088+0000 7efcab400640 1 --2- 172.21.15.87:0/3173649748 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcac0d1120 0x7efcac0d1530 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7efcac073910 tx=0x7efc9c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4856be6b4c851cba server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:06.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.088+0000 7efcaaa00640 1 -- 172.21.15.87:0/3173649748 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c0b0070 con 0x7efcac0d1120 2024-05-27T06:30:06.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.088+0000 7efcaaa00640 1 -- 172.21.15.87:0/3173649748 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc9c0ab600 con 0x7efcac0d1120 2024-05-27T06:30:06.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.088+0000 7efcaaa00640 1 -- 172.21.15.87:0/3173649748 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c0ab9d0 con 0x7efcac0d1120 2024-05-27T06:30:06.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.088+0000 7efcb0c00640 1 -- 172.21.15.87:0/3173649748 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcac0d1120 msgr2=0x7efcac0d1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:06.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.088+0000 7efcb0c00640 1 --2- 172.21.15.87:0/3173649748 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcac0d1120 0x7efcac0d1530 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7efcac073910 tx=0x7efc9c01c360 comp rx=0 tx=0).stop 2024-05-27T06:30:06.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.088+0000 7efcb0c00640 1 -- 172.21.15.87:0/3173649748 shutdown_connections 2024-05-27T06:30:06.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.088+0000 7efcb0c00640 1 --2- 172.21.15.87:0/3173649748 >> v2:172.21.15.149:3300/0 conn(0x7efcac1444e0 0x7efcac1448f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:06.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.088+0000 7efcb0c00640 1 --2- 172.21.15.87:0/3173649748 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcac0d1120 0x7efcac0d1530 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:06.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.088+0000 7efcb0c00640 1 -- 172.21.15.87:0/3173649748 >> 172.21.15.87:0/3173649748 conn(0x7efcac071060 msgr2=0x7efcac071470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:06.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.088+0000 7efcb0c00640 1 -- 172.21.15.87:0/3173649748 shutdown_connections 2024-05-27T06:30:06.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.088+0000 7efcb0c00640 1 -- 172.21.15.87:0/3173649748 wait complete. 2024-05-27T06:30:06.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.092+0000 7efcb0c00640 1 Processor -- start 2024-05-27T06:30:06.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.092+0000 7efcb0c00640 1 -- start start 2024-05-27T06:30:06.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.092+0000 7efcb0c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcac06ff20 0x7efcac0b67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:06.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.092+0000 7efcb0c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcac0d1120 0x7efcac1fa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:06.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.092+0000 7efcb0c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcac1444e0 0x7efcac13fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:06.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.092+0000 7efcb0c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efcac16ab90 con 0x7efcac06ff20 2024-05-27T06:30:06.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.092+0000 7efcb0c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efcac16aa10 con 0x7efcac1444e0 2024-05-27T06:30:06.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.092+0000 7efcb0c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efcac16ad10 con 0x7efcac0d1120 2024-05-27T06:30:06.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.092+0000 7efcab400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcac06ff20 0x7efcac0b67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:06.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.092+0000 7efcab400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcac06ff20 0x7efcac0b67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41928/0 (socket says 172.21.15.87:41928) 2024-05-27T06:30:06.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.092+0000 7efcab400640 1 -- 172.21.15.87:0/177143254 learned_addr learned my addr 172.21.15.87:0/177143254 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:06.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.092+0000 7efcabe00640 1 --2- 172.21.15.87:0/177143254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcac1444e0 0x7efcac13fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:06.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.092+0000 7efca3e00640 1 --2- 172.21.15.87:0/177143254 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcac0d1120 0x7efcac1fa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:06.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.092+0000 7efcab400640 1 -- 172.21.15.87:0/177143254 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcac0d1120 msgr2=0x7efcac1fa0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:06.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.092+0000 7efcab400640 1 --2- 172.21.15.87:0/177143254 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcac0d1120 0x7efcac1fa0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:06.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.092+0000 7efcab400640 1 -- 172.21.15.87:0/177143254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcac1444e0 msgr2=0x7efcac13fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:06.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.092+0000 7efcab400640 1 --2- 172.21.15.87:0/177143254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcac1444e0 0x7efcac13fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:06.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.092+0000 7efcab400640 1 -- 172.21.15.87:0/177143254 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcac1fa600 con 0x7efcac06ff20 2024-05-27T06:30:06.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.092+0000 7efcabe00640 1 --2- 172.21.15.87:0/177143254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcac1444e0 0x7efcac13fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:30:06.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.092+0000 7efca3e00640 1 --2- 172.21.15.87:0/177143254 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcac0d1120 0x7efcac1fa0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:30:06.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.092+0000 7efcab400640 1 --2- 172.21.15.87:0/177143254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcac06ff20 0x7efcac0b67c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7efc9c0ae040 tx=0x7efc9c019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:06.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.092+0000 7efca3400640 1 -- 172.21.15.87:0/177143254 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c0b8020 con 0x7efcac06ff20 2024-05-27T06:30:06.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.092+0000 7efca3400640 1 -- 172.21.15.87:0/177143254 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc9c0b4410 con 0x7efcac06ff20 2024-05-27T06:30:06.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.092+0000 7efca3400640 1 -- 172.21.15.87:0/177143254 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c0b0040 con 0x7efcac06ff20 2024-05-27T06:30:06.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.092+0000 7efcb0c00640 1 -- 172.21.15.87:0/177143254 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcac0b5720 con 0x7efcac06ff20 2024-05-27T06:30:06.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.092+0000 7efcb0c00640 1 -- 172.21.15.87:0/177143254 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcac0b5ce0 con 0x7efcac06ff20 2024-05-27T06:30:06.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.096+0000 7efcb0c00640 1 -- 172.21.15.87:0/177143254 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcac06aa30 con 0x7efcac06ff20 2024-05-27T06:30:06.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.096+0000 7efca3400640 1 -- 172.21.15.87:0/177143254 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7efc9c0bb020 con 0x7efcac06ff20 2024-05-27T06:30:06.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.096+0000 7efca3400640 1 --2- 172.21.15.87:0/177143254 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efc8806f400 0x7efc88071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:06.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.096+0000 7efca3400640 1 -- 172.21.15.87:0/177143254 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7efc9c128f80 con 0x7efcac06ff20 2024-05-27T06:30:06.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.096+0000 7efca3e00640 1 --2- 172.21.15.87:0/177143254 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efc8806f400 0x7efc88071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:06.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.096+0000 7efca3e00640 1 --2- 172.21.15.87:0/177143254 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efc8806f400 0x7efc88071910 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efcac0b3630 tx=0x7efc94009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:06.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.100+0000 7efca3400640 1 -- 172.21.15.87:0/177143254 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7efc9c0c2030 con 0x7efcac06ff20 2024-05-27T06:30:06.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.260+0000 7efcb0c00640 1 -- 172.21.15.87:0/177143254 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efcac070820 con 0x7efcac06ff20 2024-05-27T06:30:06.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.260+0000 7efca3400640 1 -- 172.21.15.87:0/177143254 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+16926 (secure 0 0 0) 0x7efcac1fa600 con 0x7efcac06ff20 2024-05-27T06:30:06.260 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:30:06.260 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":54,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:29:33.325293+0000","last_up_change":"2024-05-27T06:27:25.988592+0000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T06:27:26.590191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-27T06:29:29.402801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-27T06:29:30.674019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6801","nonce":3674824716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6803","nonce":3674824716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6807","nonce":3674824716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6805","nonce":3674824716}]},"public_addr":"172.21.15.87:6801/3674824716","cluster_addr":"172.21.15.87:6803/3674824716","heartbeat_back_addr":"172.21.15.87:6807/3674824716","heartbeat_front_addr":"172.21.15.87:6805/3674824716","state":["exists","up"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6809","nonce":2443981288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6811","nonce":2443981288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6815","nonce":2443981288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6813","nonce":2443981288}]},"public_addr":"172.21.15.87:6809/2443981288","cluster_addr":"172.21.15.87:6811/2443981288","heartbeat_back_addr":"172.21.15.87:6815/2443981288","heartbeat_front_addr":"172.21.15.87:6813/2443981288","state":["exists","up"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6819","nonce":1441249238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6823","nonce":1441249238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6831","nonce":1441249238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6825","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6827","nonce":1441249238}]},"public_addr":"172.21.15.87:6819/1441249238","cluster_addr":"172.21.15.87:6823/1441249238","heartbeat_back_addr":"172.21.15.87:6831/1441249238","heartbeat_front_addr":"172.21.15.87:6827/1441249238","state":["exists","up"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6818","nonce":1173805234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6822","nonce":1173805234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6829","nonce":1173805234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6826","nonce":1173805234}]},"public_addr":"172.21.15.87:6818/1173805234","cluster_addr":"172.21.15.87:6822/1173805234","heartbeat_back_addr":"172.21.15.87:6829/1173805234","heartbeat_front_addr":"172.21.15.87:6826/1173805234","state":["exists","up"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6819","nonce":1551871079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6823","nonce":1551871079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6831","nonce":1551871079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6827","nonce":1551871079}]},"public_addr":"172.21.15.149:6819/1551871079","cluster_addr":"172.21.15.149:6823/1551871079","heartbeat_back_addr":"172.21.15.149:6831/1551871079","heartbeat_front_addr":"172.21.15.149:6827/1551871079","state":["exists","up"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6818","nonce":582864816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6822","nonce":582864816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6830","nonce":582864816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6826","nonce":582864816}]},"public_addr":"172.21.15.149:6818/582864816","cluster_addr":"172.21.15.149:6822/582864816","heartbeat_back_addr":"172.21.15.149:6830/582864816","heartbeat_front_addr":"172.21.15.149:6826/582864816","state":["exists","up"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6801","nonce":531351314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6803","nonce":531351314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6807","nonce":531351314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6805","nonce":531351314}]},"public_addr":"172.21.15.149:6801/531351314","cluster_addr":"172.21.15.149:6803/531351314","heartbeat_back_addr":"172.21.15.149:6807/531351314","heartbeat_front_addr":"172.21.15.149:6805/531351314","state":["exists","up"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6809","nonce":1171039913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6811","nonce":1171039913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6815","nonce":1171039913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6813","nonce":1171039913}]},"public_addr":"172.21.15.149:6809/1171039913","cluster_addr":"172.21.15.149:6811/1171039913","heartbeat_back_addr":"172.21.15.149:6815/1171039913","heartbeat_front_addr":"172.21.15.149:6813/1171039913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.589776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.819787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.767566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.683842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.038885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.120319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.687007+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.812832+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:30:06.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.264+0000 7efcb0c00640 1 -- 172.21.15.87:0/177143254 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efc8806f400 msgr2=0x7efc88071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:06.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.264+0000 7efcb0c00640 1 --2- 172.21.15.87:0/177143254 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efc8806f400 0x7efc88071910 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efcac0b3630 tx=0x7efc94009040 comp rx=0 tx=0).stop 2024-05-27T06:30:06.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.264+0000 7efcb0c00640 1 -- 172.21.15.87:0/177143254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcac06ff20 msgr2=0x7efcac0b67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:06.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.264+0000 7efcb0c00640 1 --2- 172.21.15.87:0/177143254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcac06ff20 0x7efcac0b67c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7efc9c0ae040 tx=0x7efc9c019100 comp rx=0 tx=0).stop 2024-05-27T06:30:06.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.264+0000 7efcb0c00640 1 -- 172.21.15.87:0/177143254 shutdown_connections 2024-05-27T06:30:06.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.264+0000 7efcb0c00640 1 --2- 172.21.15.87:0/177143254 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7efc8806f400 0x7efc88071910 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:06.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.264+0000 7efcb0c00640 1 --2- 172.21.15.87:0/177143254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcac1444e0 0x7efcac13fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:06.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.264+0000 7efcb0c00640 1 --2- 172.21.15.87:0/177143254 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcac0d1120 0x7efcac1fa0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:06.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.264+0000 7efcb0c00640 1 --2- 172.21.15.87:0/177143254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcac06ff20 0x7efcac0b67c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:06.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.264+0000 7efcb0c00640 1 -- 172.21.15.87:0/177143254 >> 172.21.15.87:0/177143254 conn(0x7efcac071060 msgr2=0x7efcac071470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:06.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.264+0000 7efcb0c00640 1 -- 172.21.15.87:0/177143254 shutdown_connections 2024-05-27T06:30:06.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.264+0000 7efcb0c00640 1 -- 172.21.15.87:0/177143254 wait complete. 2024-05-27T06:30:06.282 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-27T06:30:06.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.432+0000 7f65fe800640 1 Processor -- start 2024-05-27T06:30:06.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.432+0000 7f65fe800640 1 -- start start 2024-05-27T06:30:06.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.432+0000 7f65fe800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f65f815cbc0 0x7f65f80af540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:06.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.432+0000 7f65fe800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f65f806ebd0 0x7f65f806efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:06.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.432+0000 7f65fe800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65f80afa80 con 0x7f65f8074330 2024-05-27T06:30:06.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.432+0000 7f65fe800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f65f815cfd0 con 0x7f65f806ebd0 2024-05-27T06:30:06.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.432+0000 7f65fe800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f65f806c9b0 con 0x7f65f815cbc0 2024-05-27T06:30:06.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.432+0000 7f65f7e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f65f806ebd0 0x7f65f806efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:06.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.432+0000 7f65f6a00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f65f8074330 0x7f65f8074740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43006/0 (socket says 172.21.15.87:43006) 2024-05-27T06:30:06.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.432+0000 7f65f6a00640 1 -- 172.21.15.87:0/410462052 learned_addr learned my addr 172.21.15.87:0/410462052 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:30:06.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.432+0000 7f65f7400640 1 --2- 172.21.15.87:0/410462052 >> v2:172.21.15.149:3300/0 conn(0x7f65f815cbc0 0x7f65f80af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:06.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.432+0000 7f65f7e00640 1 -- 172.21.15.87:0/410462052 >> v2:172.21.15.149:3300/0 conn(0x7f65f815cbc0 msgr2=0x7f65f80af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:06.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.432+0000 7f65f7e00640 1 --2- 172.21.15.87:0/410462052 >> v2:172.21.15.149:3300/0 conn(0x7f65f815cbc0 0x7f65f80af540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:06.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.432+0000 7f65f7e00640 1 -- 172.21.15.87:0/410462052 >> v1:172.21.15.87:6789/0 conn(0x7f65f8074330 legacy=0x7f65f8074740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:06.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.432+0000 7f65f7e00640 1 -- 172.21.15.87:0/410462052 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f80afd40 con 0x7f65f806ebd0 2024-05-27T06:30:06.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.436+0000 7f65f7e00640 1 --2- 172.21.15.87:0/410462052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f806ebd0 0x7f65f806efe0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f65f806e5b0 tx=0x7f65f001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90511a24b7d49ba0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:06.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.440+0000 7f65f6000640 1 -- 172.21.15.87:0/410462052 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f00b2070 con 0x7f65f806ebd0 2024-05-27T06:30:06.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.440+0000 7f65f6000640 1 -- 172.21.15.87:0/410462052 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f00a5850 con 0x7f65f806ebd0 2024-05-27T06:30:06.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.440+0000 7f65f6000640 1 -- 172.21.15.87:0/410462052 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f00a5c20 con 0x7f65f806ebd0 2024-05-27T06:30:06.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.440+0000 7f65fe800640 1 -- 172.21.15.87:0/410462052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f806ebd0 msgr2=0x7f65f806efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:06.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.440+0000 7f65fe800640 1 --2- 172.21.15.87:0/410462052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f806ebd0 0x7f65f806efe0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f65f806e5b0 tx=0x7f65f001c8a0 comp rx=0 tx=0).stop 2024-05-27T06:30:06.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.440+0000 7f65fe800640 1 -- 172.21.15.87:0/410462052 shutdown_connections 2024-05-27T06:30:06.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.440+0000 7f65fe800640 1 --2- 172.21.15.87:0/410462052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f806ebd0 0x7f65f806efe0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:06.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.440+0000 7f65fe800640 1 --2- 172.21.15.87:0/410462052 >> v2:172.21.15.149:3300/0 conn(0x7f65f815cbc0 0x7f65f80af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:06.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.440+0000 7f65fe800640 1 -- 172.21.15.87:0/410462052 >> 172.21.15.87:0/410462052 conn(0x7f65f80b2fb0 msgr2=0x7f65f80b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:06.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.440+0000 7f65fe800640 1 -- 172.21.15.87:0/410462052 shutdown_connections 2024-05-27T06:30:06.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.440+0000 7f65fe800640 1 -- 172.21.15.87:0/410462052 wait complete. 2024-05-27T06:30:06.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.444+0000 7f65fe800640 1 Processor -- start 2024-05-27T06:30:06.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.444+0000 7f65fe800640 1 -- start start 2024-05-27T06:30:06.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.444+0000 7f65fe800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65f806ebd0 0x7f65f814e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:06.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.444+0000 7f65fe800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f65f8074330 0x7f65f8151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:06.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.444+0000 7f65fe800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f815cbc0 0x7f65f809e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:06.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.444+0000 7f65fe800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f65f8169c00 con 0x7f65f815cbc0 2024-05-27T06:30:06.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.444+0000 7f65fe800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f65f8169a80 con 0x7f65f806ebd0 2024-05-27T06:30:06.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.444+0000 7f65fe800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f65f8169d80 con 0x7f65f8074330 2024-05-27T06:30:06.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.444+0000 7f65f7e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f815cbc0 0x7f65f809e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:06.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.444+0000 7f65f7e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f815cbc0 0x7f65f809e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41948/0 (socket says 172.21.15.87:41948) 2024-05-27T06:30:06.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.444+0000 7f65f7e00640 1 -- 172.21.15.87:0/2732174463 learned_addr learned my addr 172.21.15.87:0/2732174463 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:06.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.444+0000 7f65f6a00640 1 --2- 172.21.15.87:0/2732174463 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f65f8074330 0x7f65f8151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:06.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.444+0000 7f65f7400640 1 --2- 172.21.15.87:0/2732174463 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65f806ebd0 0x7f65f814e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:06.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.444+0000 7f65f7e00640 1 -- 172.21.15.87:0/2732174463 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f65f8074330 msgr2=0x7f65f8151430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:06.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.444+0000 7f65f7e00640 1 --2- 172.21.15.87:0/2732174463 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f65f8074330 0x7f65f8151430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:06.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.444+0000 7f65f7e00640 1 -- 172.21.15.87:0/2732174463 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65f806ebd0 msgr2=0x7f65f814e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:06.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.444+0000 7f65f7e00640 1 --2- 172.21.15.87:0/2732174463 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65f806ebd0 0x7f65f814e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:06.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.444+0000 7f65f7e00640 1 -- 172.21.15.87:0/2732174463 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f8150390 con 0x7f65f815cbc0 2024-05-27T06:30:06.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.448+0000 7f65f7e00640 1 --2- 172.21.15.87:0/2732174463 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f815cbc0 0x7f65f809e260 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f65f001a4d0 tx=0x7f65f0019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:06.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.448+0000 7f65ef400640 1 -- 172.21.15.87:0/2732174463 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f00b2050 con 0x7f65f815cbc0 2024-05-27T06:30:06.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.448+0000 7f65ef400640 1 -- 172.21.15.87:0/2732174463 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f00be070 con 0x7f65f815cbc0 2024-05-27T06:30:06.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.448+0000 7f65ef400640 1 -- 172.21.15.87:0/2732174463 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f00ada90 con 0x7f65f815cbc0 2024-05-27T06:30:06.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.448+0000 7f65fe800640 1 -- 172.21.15.87:0/2732174463 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65f8150670 con 0x7f65f815cbc0 2024-05-27T06:30:06.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.448+0000 7f65fe800640 1 -- 172.21.15.87:0/2732174463 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65f8150c30 con 0x7f65f815cbc0 2024-05-27T06:30:06.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.448+0000 7f65fe800640 1 -- 172.21.15.87:0/2732174463 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65f806aa30 con 0x7f65f815cbc0 2024-05-27T06:30:06.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.448+0000 7f65ef400640 1 -- 172.21.15.87:0/2732174463 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f65f00a56d0 con 0x7f65f815cbc0 2024-05-27T06:30:06.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.452+0000 7f65ef400640 1 --2- 172.21.15.87:0/2732174463 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f65d806f430 0x7f65d8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:06.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.452+0000 7f65ef400640 1 -- 172.21.15.87:0/2732174463 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f65f012a430 con 0x7f65f815cbc0 2024-05-27T06:30:06.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.452+0000 7f65f7400640 1 --2- 172.21.15.87:0/2732174463 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f65d806f430 0x7f65d8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:06.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.452+0000 7f65f7400640 1 --2- 172.21.15.87:0/2732174463 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f65d806f430 0x7f65d8071940 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f65f8161800 tx=0x7f65e8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:06.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.456+0000 7f65ef400640 1 -- 172.21.15.87:0/2732174463 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f65f0016520 con 0x7f65f815cbc0 2024-05-27T06:30:06.611 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T06:30:06.614 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T06:30:06.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.648+0000 7f65fe800640 1 -- 172.21.15.87:0/2732174463 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f65f8150120 con 0x7f65f815cbc0 2024-05-27T06:30:06.649 INFO:tasks.ceph.mon.a.smithi087.stderr:2024-05-27T06:30:06.652+0000 7f7cc0e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-27T06:30:06.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.652+0000 7f65ef400640 1 -- 172.21.15.87:0/2732174463 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) ==== 161+0+0 (secure 0 0 0) 0x7f65f00f6b40 con 0x7f65f815cbc0 2024-05-27T06:30:06.651 INFO:teuthology.orchestra.run.smithi087.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-27T06:30:06.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.656+0000 7f65fe800640 1 -- 172.21.15.87:0/2732174463 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f65d806f430 msgr2=0x7f65d8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:06.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.656+0000 7f65fe800640 1 --2- 172.21.15.87:0/2732174463 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f65d806f430 0x7f65d8071940 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f65f8161800 tx=0x7f65e8008040 comp rx=0 tx=0).stop 2024-05-27T06:30:06.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.656+0000 7f65fe800640 1 -- 172.21.15.87:0/2732174463 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f815cbc0 msgr2=0x7f65f809e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:06.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.656+0000 7f65fe800640 1 --2- 172.21.15.87:0/2732174463 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f815cbc0 0x7f65f809e260 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f65f001a4d0 tx=0x7f65f0019640 comp rx=0 tx=0).stop 2024-05-27T06:30:06.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.656+0000 7f65fe800640 1 -- 172.21.15.87:0/2732174463 shutdown_connections 2024-05-27T06:30:06.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.656+0000 7f65fe800640 1 --2- 172.21.15.87:0/2732174463 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f65d806f430 0x7f65d8071940 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:06.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.656+0000 7f65fe800640 1 --2- 172.21.15.87:0/2732174463 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f815cbc0 0x7f65f809e260 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:06.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.656+0000 7f65fe800640 1 --2- 172.21.15.87:0/2732174463 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f65f8074330 0x7f65f8151430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:06.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.656+0000 7f65fe800640 1 --2- 172.21.15.87:0/2732174463 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65f806ebd0 0x7f65f814e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:06.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.656+0000 7f65fe800640 1 -- 172.21.15.87:0/2732174463 >> 172.21.15.87:0/2732174463 conn(0x7f65f80b2fb0 msgr2=0x7f65f8156e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:06.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.656+0000 7f65fe800640 1 -- 172.21.15.87:0/2732174463 shutdown_connections 2024-05-27T06:30:06.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.656+0000 7f65fe800640 1 -- 172.21.15.87:0/2732174463 wait complete. 2024-05-27T06:30:06.663 INFO:tasks.ceph.mds.a.smithi087.stderr: -2939> 2024-05-27T06:29:34.292+0000 7f3e3b600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-27T06:30:06.677 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-27T06:30:06.781 INFO:tasks.ceph.mds.a.smithi087.stdout:starting mds.a at 2024-05-27T06:30:06.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.876+0000 7fe0c4a00640 1 Processor -- start 2024-05-27T06:30:06.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.876+0000 7fe0c4a00640 1 -- start start 2024-05-27T06:30:06.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.876+0000 7fe0c4a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0c00d1700 0x7fe0c00d1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:06.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.876+0000 7fe0c4a00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe0c006c940 0x7fe0c006cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:06.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.876+0000 7fe0c4a00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c00d2050 con 0x7fe0c0157310 2024-05-27T06:30:06.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.876+0000 7fe0c4a00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fe0c00d0140 con 0x7fe0c006c940 2024-05-27T06:30:06.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.876+0000 7fe0c4a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe0c00cf530 con 0x7fe0c00d1700 2024-05-27T06:30:06.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.876+0000 7fe0be800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe0c006c940 0x7fe0c006cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:06.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.876+0000 7fe0b5400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0c00d1700 0x7fe0c00d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:06.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.876+0000 7fe0be800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe0c006c940 0x7fe0c006cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:60600/0 (socket says 172.21.15.87:60600) 2024-05-27T06:30:06.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.876+0000 7fe0be800640 1 -- 172.21.15.87:0/2002539871 learned_addr learned my addr 172.21.15.87:0/2002539871 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:06.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.876+0000 7fe0bde00640 1 --1- 172.21.15.87:0/2002539871 >> v1:172.21.15.149:6789/0 conn(0x7fe0c0157310 0x7fe0c015dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.87:35270/0 (socket says 172.21.15.87:35270) 2024-05-27T06:30:06.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.880+0000 7fe0be800640 1 -- 172.21.15.87:0/2002539871 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0c00d1700 msgr2=0x7fe0c00d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:06.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.880+0000 7fe0be800640 1 --2- 172.21.15.87:0/2002539871 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0c00d1700 0x7fe0c00d1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:06.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.880+0000 7fe0be800640 1 -- 172.21.15.87:0/2002539871 >> v1:172.21.15.149:6789/0 conn(0x7fe0c0157310 legacy=0x7fe0c015dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:06.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.880+0000 7fe0be800640 1 -- 172.21.15.87:0/2002539871 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c00cf810 con 0x7fe0c006c940 2024-05-27T06:30:06.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.880+0000 7fe0be800640 1 --2- 172.21.15.87:0/2002539871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0c006c940 0x7fe0c006cd50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8009e50 tx=0x7fe0b801ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49ee1e93b87ba391 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:06.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.880+0000 7fe0bd400640 1 -- 172.21.15.87:0/2002539871 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b80a58d0 con 0x7fe0c006c940 2024-05-27T06:30:06.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.880+0000 7fe0bd400640 1 -- 172.21.15.87:0/2002539871 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0b80a5a70 con 0x7fe0c006c940 2024-05-27T06:30:06.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.880+0000 7fe0bd400640 1 -- 172.21.15.87:0/2002539871 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b80a5e40 con 0x7fe0c006c940 2024-05-27T06:30:06.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.884+0000 7fe0c4a00640 1 -- 172.21.15.87:0/2002539871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0c006c940 msgr2=0x7fe0c006cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:06.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.884+0000 7fe0c4a00640 1 --2- 172.21.15.87:0/2002539871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0c006c940 0x7fe0c006cd50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8009e50 tx=0x7fe0b801ca00 comp rx=0 tx=0).stop 2024-05-27T06:30:06.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.884+0000 7fe0c4a00640 1 -- 172.21.15.87:0/2002539871 shutdown_connections 2024-05-27T06:30:06.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.884+0000 7fe0c4a00640 1 --2- 172.21.15.87:0/2002539871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0c006c940 0x7fe0c006cd50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:06.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.884+0000 7fe0c4a00640 1 --2- 172.21.15.87:0/2002539871 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0c00d1700 0x7fe0c00d1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:06.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.884+0000 7fe0c4a00640 1 -- 172.21.15.87:0/2002539871 >> 172.21.15.87:0/2002539871 conn(0x7fe0c00b46b0 msgr2=0x7fe0c00b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:06.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.884+0000 7fe0c4a00640 1 -- 172.21.15.87:0/2002539871 shutdown_connections 2024-05-27T06:30:06.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.884+0000 7fe0c4a00640 1 -- 172.21.15.87:0/2002539871 wait complete. 2024-05-27T06:30:06.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.884+0000 7fe0c4a00640 1 Processor -- start 2024-05-27T06:30:06.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.884+0000 7fe0c4a00640 1 -- start start 2024-05-27T06:30:06.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.888+0000 7fe0c4a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0c006c940 0x7fe0c0168960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:06.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.888+0000 7fe0c4a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0c00d1700 0x7fe0c009a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:06.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.888+0000 7fe0c4a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0c0157310 0x7fe0c015bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:06.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.888+0000 7fe0c4a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c0070640 con 0x7fe0c0157310 2024-05-27T06:30:06.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.888+0000 7fe0c4a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c006d6a0 con 0x7fe0c00d1700 2024-05-27T06:30:06.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.888+0000 7fe0c4a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe0c00707c0 con 0x7fe0c006c940 2024-05-27T06:30:06.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.888+0000 7fe0be800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0c0157310 0x7fe0c015bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:06.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.888+0000 7fe0be800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0c0157310 0x7fe0c015bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41980/0 (socket says 172.21.15.87:41980) 2024-05-27T06:30:06.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.888+0000 7fe0be800640 1 -- 172.21.15.87:0/1888286788 learned_addr learned my addr 172.21.15.87:0/1888286788 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:06.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.888+0000 7fe0bde00640 1 --2- 172.21.15.87:0/1888286788 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0c006c940 0x7fe0c0168960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:06.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.888+0000 7fe0b5400640 1 --2- 172.21.15.87:0/1888286788 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0c00d1700 0x7fe0c009a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:06.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.888+0000 7fe0be800640 1 -- 172.21.15.87:0/1888286788 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0c006c940 msgr2=0x7fe0c0168960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:06.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.888+0000 7fe0be800640 1 --2- 172.21.15.87:0/1888286788 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0c006c940 0x7fe0c0168960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:06.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.888+0000 7fe0be800640 1 -- 172.21.15.87:0/1888286788 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0c00d1700 msgr2=0x7fe0c009a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:06.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.888+0000 7fe0be800640 1 --2- 172.21.15.87:0/1888286788 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0c00d1700 0x7fe0c009a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:06.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.888+0000 7fe0be800640 1 -- 172.21.15.87:0/1888286788 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c015ff20 con 0x7fe0c0157310 2024-05-27T06:30:06.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.888+0000 7fe0be800640 1 --2- 172.21.15.87:0/1888286788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0c0157310 0x7fe0c015bbc0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe0b80af040 tx=0x7fe0b80197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:06.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.888+0000 7fe0b6a00640 1 -- 172.21.15.87:0/1888286788 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b80a58d0 con 0x7fe0c0157310 2024-05-27T06:30:06.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.888+0000 7fe0b6a00640 1 -- 172.21.15.87:0/1888286788 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0b80be070 con 0x7fe0c0157310 2024-05-27T06:30:06.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.888+0000 7fe0b6a00640 1 -- 172.21.15.87:0/1888286788 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b8009510 con 0x7fe0c0157310 2024-05-27T06:30:06.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.888+0000 7fe0c4a00640 1 -- 172.21.15.87:0/1888286788 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0c015fc40 con 0x7fe0c0157310 2024-05-27T06:30:06.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.888+0000 7fe0c4a00640 1 -- 172.21.15.87:0/1888286788 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0c0169560 con 0x7fe0c0157310 2024-05-27T06:30:06.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.888+0000 7fe0c4a00640 1 -- 172.21.15.87:0/1888286788 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0c006aa30 con 0x7fe0c0157310 2024-05-27T06:30:06.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.892+0000 7fe0b6a00640 1 -- 172.21.15.87:0/1888286788 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe0b80b86b0 con 0x7fe0c0157310 2024-05-27T06:30:06.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.892+0000 7fe0b6a00640 1 --2- 172.21.15.87:0/1888286788 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe09c06f400 0x7fe09c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:06.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.892+0000 7fe0b6a00640 1 -- 172.21.15.87:0/1888286788 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6187+0+0 (secure 0 0 0) 0x7fe0b812a9a0 con 0x7fe0c0157310 2024-05-27T06:30:06.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.892+0000 7fe0bde00640 1 --2- 172.21.15.87:0/1888286788 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe09c06f400 0x7fe09c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:06.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.892+0000 7fe0bde00640 1 --2- 172.21.15.87:0/1888286788 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe09c06f400 0x7fe09c071910 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0000f70 tx=0x7fe0b0007e50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:06.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:06.896+0000 7fe0b6a00640 1 -- 172.21.15.87:0/1888286788 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe0b8016620 con 0x7fe0c0157310 2024-05-27T06:30:07.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.088+0000 7fe0c4a00640 1 -- 172.21.15.87:0/1888286788 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe0c00cdd40 con 0x7fe0c0157310 2024-05-27T06:30:07.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.656+0000 7fe0b6a00640 1 -- 172.21.15.87:0/1888286788 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) ==== 104+0+0 (secure 0 0 0) 0x7fe0b80f7110 con 0x7fe0c0157310 2024-05-27T06:30:07.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.656+0000 7fe0c4a00640 1 -- 172.21.15.87:0/1888286788 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe09c06f400 msgr2=0x7fe09c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:07.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.656+0000 7fe0c4a00640 1 --2- 172.21.15.87:0/1888286788 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe09c06f400 0x7fe09c071910 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0000f70 tx=0x7fe0b0007e50 comp rx=0 tx=0).stop 2024-05-27T06:30:07.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.656+0000 7fe0c4a00640 1 -- 172.21.15.87:0/1888286788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0c0157310 msgr2=0x7fe0c015bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:07.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.656+0000 7fe0c4a00640 1 --2- 172.21.15.87:0/1888286788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0c0157310 0x7fe0c015bbc0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe0b80af040 tx=0x7fe0b80197a0 comp rx=0 tx=0).stop 2024-05-27T06:30:07.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.656+0000 7fe0c4a00640 1 -- 172.21.15.87:0/1888286788 shutdown_connections 2024-05-27T06:30:07.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.656+0000 7fe0c4a00640 1 --2- 172.21.15.87:0/1888286788 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe09c06f400 0x7fe09c071910 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:07.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.656+0000 7fe0c4a00640 1 --2- 172.21.15.87:0/1888286788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0c0157310 0x7fe0c015bbc0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:07.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.656+0000 7fe0c4a00640 1 --2- 172.21.15.87:0/1888286788 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0c00d1700 0x7fe0c009a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:07.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.656+0000 7fe0c4a00640 1 --2- 172.21.15.87:0/1888286788 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0c006c940 0x7fe0c0168960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:07.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.656+0000 7fe0c4a00640 1 -- 172.21.15.87:0/1888286788 >> 172.21.15.87:0/1888286788 conn(0x7fe0c00b46b0 msgr2=0x7fe0c006f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:07.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.656+0000 7fe0c4a00640 1 -- 172.21.15.87:0/1888286788 shutdown_connections 2024-05-27T06:30:07.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.656+0000 7fe0c4a00640 1 -- 172.21.15.87:0/1888286788 wait complete. 2024-05-27T06:30:07.678 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-27T06:30:07.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.828+0000 7f0a1ce00640 1 Processor -- start 2024-05-27T06:30:07.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.828+0000 7f0a1ce00640 1 -- start start 2024-05-27T06:30:07.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a1ce00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0a1806eb20 0x7f0a1806ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:07.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a1ce00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a180d1130 con 0x7f0a181610c0 2024-05-27T06:30:07.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a1ce00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a180d0e50 con 0x7f0a180d1700 2024-05-27T06:30:07.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a1ce00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0a18161a00 con 0x7f0a1806eb20 2024-05-27T06:30:07.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a15e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f0a181610c0 0x7f0a180d02d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43026/0 (socket says 172.21.15.87:43026) 2024-05-27T06:30:07.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a15e00640 1 -- 172.21.15.87:0/1436815407 learned_addr learned my addr 172.21.15.87:0/1436815407 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:30:07.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a16800640 1 --2- 172.21.15.87:0/1436815407 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0a1806eb20 0x7f0a1806ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:07.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a14a00640 1 -- 172.21.15.87:0/1436815407 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3970659199 0 0) 0x7f0a180d1130 con 0x7f0a181610c0 2024-05-27T06:30:07.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a14a00640 1 -- 172.21.15.87:0/1436815407 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09fc003530 con 0x7f0a181610c0 2024-05-27T06:30:07.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a14a00640 1 -- 172.21.15.87:0/1436815407 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2410260073 0 0) 0x7f09fc003530 con 0x7f0a181610c0 2024-05-27T06:30:07.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a14a00640 1 -- 172.21.15.87:0/1436815407 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0a1806eb20 msgr2=0x7f0a1806ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:07.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a14a00640 1 --2- 172.21.15.87:0/1436815407 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0a1806eb20 0x7f0a1806ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:07.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a14a00640 1 -- 172.21.15.87:0/1436815407 >> v1:172.21.15.149:6789/0 conn(0x7f0a180d1700 legacy=0x7f0a180d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:07.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a14a00640 1 -- 172.21.15.87:0/1436815407 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a18161ce0 con 0x7f0a181610c0 2024-05-27T06:30:07.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a14a00640 1 -- 172.21.15.87:0/1436815407 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7f0a08001a80 con 0x7f0a181610c0 2024-05-27T06:30:07.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a14a00640 1 -- 172.21.15.87:0/1436815407 >> v1:172.21.15.87:6789/0 conn(0x7f0a181610c0 legacy=0x7f0a180d02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:07.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a14a00640 1 --2- 172.21.15.87:0/1436815407 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09fc0039f0 0x7f09fc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:07.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a14a00640 1 --2- 172.21.15.87:0/1436815407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09fc004810 0x7f09fc004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:07.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a14a00640 1 --2- 172.21.15.87:0/1436815407 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0a1806eb20 0x7f09fc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:07.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a14a00640 1 -- 172.21.15.87:0/1436815407 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0a18161a00 con 0x7f09fc004810 2024-05-27T06:30:07.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a14a00640 1 -- 172.21.15.87:0/1436815407 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f09fc00bb00 con 0x7f09fc0039f0 2024-05-27T06:30:07.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a14a00640 1 -- 172.21.15.87:0/1436815407 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f09fc00bd00 con 0x7f0a1806eb20 2024-05-27T06:30:07.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a15400640 1 --2- 172.21.15.87:0/1436815407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09fc004810 0x7f09fc004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:07.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a15e00640 1 --2- 172.21.15.87:0/1436815407 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09fc0039f0 0x7f09fc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:07.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a16800640 1 --2- 172.21.15.87:0/1436815407 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0a1806eb20 0x7f09fc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:07.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a15400640 1 -- 172.21.15.87:0/1436815407 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0a1806eb20 msgr2=0x7f09fc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:07.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a15400640 1 --2- 172.21.15.87:0/1436815407 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0a1806eb20 0x7f09fc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:07.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a15400640 1 -- 172.21.15.87:0/1436815407 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09fc0039f0 msgr2=0x7f09fc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:07.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a15400640 1 --2- 172.21.15.87:0/1436815407 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09fc0039f0 0x7f09fc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:07.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.832+0000 7f0a15400640 1 -- 172.21.15.87:0/1436815407 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09fc003530 con 0x7f09fc004810 2024-05-27T06:30:07.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.836+0000 7f0a15400640 1 --2- 172.21.15.87:0/1436815407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09fc004810 0x7f09fc004c20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0a04001840 tx=0x7f0a0401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d8df3c4ced8682 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:07.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.836+0000 7f0a14a00640 1 -- 172.21.15.87:0/1436815407 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a040b5070 con 0x7f09fc004810 2024-05-27T06:30:07.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.836+0000 7f0a14a00640 1 -- 172.21.15.87:0/1436815407 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a040a8930 con 0x7f09fc004810 2024-05-27T06:30:07.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.836+0000 7f0a14a00640 1 -- 172.21.15.87:0/1436815407 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a04001460 con 0x7f09fc004810 2024-05-27T06:30:07.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.836+0000 7f0a1ce00640 1 -- 172.21.15.87:0/1436815407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09fc004810 msgr2=0x7f09fc004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:07.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.836+0000 7f0a1ce00640 1 --2- 172.21.15.87:0/1436815407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09fc004810 0x7f09fc004c20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0a04001840 tx=0x7f0a0401ec50 comp rx=0 tx=0).stop 2024-05-27T06:30:07.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.836+0000 7f0a16800640 1 -- 172.21.15.87:0/1436815407 reap_dead start 2024-05-27T06:30:07.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.836+0000 7f0a1ce00640 1 -- 172.21.15.87:0/1436815407 shutdown_connections 2024-05-27T06:30:07.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.836+0000 7f0a1ce00640 1 -- 172.21.15.87:0/1436815407 >> 172.21.15.87:0/1436815407 conn(0x7f0a180b46b0 msgr2=0x7f0a180b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:07.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.836+0000 7f0a1ce00640 1 -- 172.21.15.87:0/1436815407 shutdown_connections 2024-05-27T06:30:07.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.836+0000 7f0a1ce00640 1 -- 172.21.15.87:0/1436815407 wait complete. 2024-05-27T06:30:07.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.840+0000 7f0a1ce00640 1 Processor -- start 2024-05-27T06:30:07.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.840+0000 7f0a1ce00640 1 -- start start 2024-05-27T06:30:07.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.840+0000 7f0a1ce00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f09fc004810 0x7f0a181f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:07.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.840+0000 7f0a1ce00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a180b2d80 0x7f0a180b3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:07.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.840+0000 7f0a1ce00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a180cc540 0x7f0a180cc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:07.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.840+0000 7f0a1ce00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0a181614d0 con 0x7f0a180cc540 2024-05-27T06:30:07.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.840+0000 7f0a1ce00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0a18147a30 con 0x7f0a180b2d80 2024-05-27T06:30:07.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.840+0000 7f0a1ce00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0a18161650 con 0x7f09fc004810 2024-05-27T06:30:07.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.840+0000 7f0a16800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a180cc540 0x7f0a180cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:07.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.840+0000 7f0a16800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a180cc540 0x7f0a180cc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42004/0 (socket says 172.21.15.87:42004) 2024-05-27T06:30:07.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.840+0000 7f0a16800640 1 -- 172.21.15.87:0/2591890298 learned_addr learned my addr 172.21.15.87:0/2591890298 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:07.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.840+0000 7f0a15e00640 1 --2- 172.21.15.87:0/2591890298 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f09fc004810 0x7f0a181f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:07.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.840+0000 7f0a15400640 1 --2- 172.21.15.87:0/2591890298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a180b2d80 0x7f0a180b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:07.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.840+0000 7f0a16800640 1 -- 172.21.15.87:0/2591890298 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f09fc004810 msgr2=0x7f0a181f5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:07.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.840+0000 7f0a16800640 1 --2- 172.21.15.87:0/2591890298 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f09fc004810 0x7f0a181f5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:07.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.840+0000 7f0a16800640 1 -- 172.21.15.87:0/2591890298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a180b2d80 msgr2=0x7f0a180b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:07.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.840+0000 7f0a16800640 1 --2- 172.21.15.87:0/2591890298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a180b2d80 0x7f0a180b3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:07.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.840+0000 7f0a16800640 1 -- 172.21.15.87:0/2591890298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a181475f0 con 0x7f0a180cc540 2024-05-27T06:30:07.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.840+0000 7f0a15400640 1 --2- 172.21.15.87:0/2591890298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a180b2d80 0x7f0a180b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:30:07.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.844+0000 7f0a16800640 1 --2- 172.21.15.87:0/2591890298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a180cc540 0x7f0a180cc950 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0a180b4260 tx=0x7f0a10011860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:07.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.844+0000 7f0a0e000640 1 -- 172.21.15.87:0/2591890298 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a10019020 con 0x7f0a180cc540 2024-05-27T06:30:07.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.844+0000 7f0a0e000640 1 -- 172.21.15.87:0/2591890298 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a10003620 con 0x7f0a180cc540 2024-05-27T06:30:07.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.844+0000 7f0a0e000640 1 -- 172.21.15.87:0/2591890298 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a10003a50 con 0x7f0a180cc540 2024-05-27T06:30:07.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.844+0000 7f0a1ce00640 1 -- 172.21.15.87:0/2591890298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a18147020 con 0x7f0a180cc540 2024-05-27T06:30:07.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.844+0000 7f0a1ce00640 1 -- 172.21.15.87:0/2591890298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a180cce90 con 0x7f0a180cc540 2024-05-27T06:30:07.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.844+0000 7f0a1ce00640 1 -- 172.21.15.87:0/2591890298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a181faa80 con 0x7f0a180cc540 2024-05-27T06:30:07.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.844+0000 7f0a0e000640 1 -- 172.21.15.87:0/2591890298 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0a1001c020 con 0x7f0a180cc540 2024-05-27T06:30:07.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.844+0000 7f0a0e000640 1 --2- 172.21.15.87:0/2591890298 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f09f806f430 0x7f09f8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:07.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.844+0000 7f0a0e000640 1 -- 172.21.15.87:0/2591890298 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6187+0+0 (secure 0 0 0) 0x7f0a1008f630 con 0x7f0a180cc540 2024-05-27T06:30:07.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.848+0000 7f0a15e00640 1 --2- 172.21.15.87:0/2591890298 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f09f806f430 0x7f09f8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:07.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.848+0000 7f0a15e00640 1 --2- 172.21.15.87:0/2591890298 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f09f806f430 0x7f09f8071940 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0a08002240 tx=0x7f0a08006040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:07.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:07.852+0000 7f0a0e000640 1 -- 172.21.15.87:0/2591890298 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f0a181faa80 con 0x7f0a180cc540 2024-05-27T06:30:08.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.008+0000 7f0a1ce00640 1 -- 172.21.15.87:0/2591890298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0a1806aa30 con 0x7f0a180cc540 2024-05-27T06:30:08.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.656+0000 7f0a0e000640 1 -- 172.21.15.87:0/2591890298 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v56) ==== 181+0+0 (secure 0 0 0) 0x7f0a180cce90 con 0x7f0a180cc540 2024-05-27T06:30:08.655 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_metadata' removed 2024-05-27T06:30:08.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.660+0000 7f0a1ce00640 1 -- 172.21.15.87:0/2591890298 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f09f806f430 msgr2=0x7f09f8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:08.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.660+0000 7f0a1ce00640 1 --2- 172.21.15.87:0/2591890298 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f09f806f430 0x7f09f8071940 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0a08002240 tx=0x7f0a08006040 comp rx=0 tx=0).stop 2024-05-27T06:30:08.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.660+0000 7f0a1ce00640 1 -- 172.21.15.87:0/2591890298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a180cc540 msgr2=0x7f0a180cc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:08.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.660+0000 7f0a1ce00640 1 --2- 172.21.15.87:0/2591890298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a180cc540 0x7f0a180cc950 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0a180b4260 tx=0x7f0a10011860 comp rx=0 tx=0).stop 2024-05-27T06:30:08.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.660+0000 7f0a1ce00640 1 -- 172.21.15.87:0/2591890298 shutdown_connections 2024-05-27T06:30:08.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.660+0000 7f0a1ce00640 1 --2- 172.21.15.87:0/2591890298 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f09f806f430 0x7f09f8071940 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:08.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.660+0000 7f0a1ce00640 1 --2- 172.21.15.87:0/2591890298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a180cc540 0x7f0a180cc950 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:08.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.660+0000 7f0a1ce00640 1 --2- 172.21.15.87:0/2591890298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a180b2d80 0x7f0a180b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:08.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.660+0000 7f0a1ce00640 1 --2- 172.21.15.87:0/2591890298 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f09fc004810 0x7f0a181f5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:08.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.660+0000 7f0a1ce00640 1 -- 172.21.15.87:0/2591890298 >> 172.21.15.87:0/2591890298 conn(0x7f0a180b46b0 msgr2=0x7f0a180aff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:08.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.660+0000 7f0a1ce00640 1 -- 172.21.15.87:0/2591890298 shutdown_connections 2024-05-27T06:30:08.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.660+0000 7f0a1ce00640 1 -- 172.21.15.87:0/2591890298 wait complete. 2024-05-27T06:30:08.683 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-27T06:30:08.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.836+0000 7fc606400640 1 Processor -- start 2024-05-27T06:30:08.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.836+0000 7fc606400640 1 -- start start 2024-05-27T06:30:08.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.840+0000 7fc606400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc600157310 0x7fc60015dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:08.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.840+0000 7fc606400640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc60015e110 con 0x7fc60006c940 2024-05-27T06:30:08.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.840+0000 7fc606400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6000cf530 con 0x7fc6000d1700 2024-05-27T06:30:08.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.840+0000 7fc606400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fc6000d0140 con 0x7fc600157310 2024-05-27T06:30:08.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.840+0000 7fc5ffe00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fc60006c940 0x7fc60006cd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43040/0 (socket says 172.21.15.87:43040) 2024-05-27T06:30:08.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.840+0000 7fc5ffe00640 1 -- 172.21.15.87:0/3042126227 learned_addr learned my addr 172.21.15.87:0/3042126227 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:30:08.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.840+0000 7fc5ff400640 1 --2- 172.21.15.87:0/3042126227 >> v2:172.21.15.149:3300/0 conn(0x7fc600157310 0x7fc60015dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:08.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.840+0000 7fc5fea00640 1 -- 172.21.15.87:0/3042126227 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 68185345 0 0) 0x7fc5f80014a0 con 0x7fc60006c940 2024-05-27T06:30:08.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.840+0000 7fc5fea00640 1 -- 172.21.15.87:0/3042126227 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5e4003530 con 0x7fc60006c940 2024-05-27T06:30:08.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.840+0000 7fc5ff400640 1 -- 172.21.15.87:0/3042126227 >> v1:172.21.15.149:6789/0 conn(0x7fc6000d1700 legacy=0x7fc6000d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:08.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.840+0000 7fc5fea00640 1 -- 172.21.15.87:0/3042126227 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 963001616 0 0) 0x7fc6000cf530 con 0x7fc6000d1700 2024-05-27T06:30:08.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.840+0000 7fc5ff400640 1 -- 172.21.15.87:0/3042126227 >> v1:172.21.15.87:6789/0 conn(0x7fc60006c940 legacy=0x7fc60006cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:08.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.840+0000 7fc5ff400640 1 -- 172.21.15.87:0/3042126227 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6000cf810 con 0x7fc600157310 2024-05-27T06:30:08.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.844+0000 7fc5ff400640 1 --2- 172.21.15.87:0/3042126227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc600157310 0x7fc60015dbd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00097f0 tx=0x7fc5f001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11403b9bdb126271 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:08.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.844+0000 7fc5fea00640 1 -- 172.21.15.87:0/3042126227 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f00b0070 con 0x7fc600157310 2024-05-27T06:30:08.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.844+0000 7fc5fea00640 1 -- 172.21.15.87:0/3042126227 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5f00ab600 con 0x7fc600157310 2024-05-27T06:30:08.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.844+0000 7fc5fea00640 1 -- 172.21.15.87:0/3042126227 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f00ab9b0 con 0x7fc600157310 2024-05-27T06:30:08.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.844+0000 7fc606400640 1 -- 172.21.15.87:0/3042126227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc600157310 msgr2=0x7fc60015dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:08.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.844+0000 7fc606400640 1 --2- 172.21.15.87:0/3042126227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc600157310 0x7fc60015dbd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00097f0 tx=0x7fc5f001c410 comp rx=0 tx=0).stop 2024-05-27T06:30:08.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.844+0000 7fc606400640 1 -- 172.21.15.87:0/3042126227 shutdown_connections 2024-05-27T06:30:08.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.844+0000 7fc606400640 1 --2- 172.21.15.87:0/3042126227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc600157310 0x7fc60015dbd0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:08.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.844+0000 7fc606400640 1 -- 172.21.15.87:0/3042126227 >> 172.21.15.87:0/3042126227 conn(0x7fc6000b46b0 msgr2=0x7fc6000b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:08.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.844+0000 7fc606400640 1 -- 172.21.15.87:0/3042126227 shutdown_connections 2024-05-27T06:30:08.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.844+0000 7fc606400640 1 -- 172.21.15.87:0/3042126227 wait complete. 2024-05-27T06:30:08.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.844+0000 7fc606400640 1 Processor -- start 2024-05-27T06:30:08.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.844+0000 7fc606400640 1 -- start start 2024-05-27T06:30:08.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.848+0000 7fc606400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc60006c940 0x7fc600150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:08.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.848+0000 7fc606400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6000d1700 0x7fc600152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:08.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.848+0000 7fc606400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc600157310 0x7fc600152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:08.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.848+0000 7fc606400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc6000707e0 con 0x7fc6000d1700 2024-05-27T06:30:08.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.848+0000 7fc606400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc600070660 con 0x7fc600157310 2024-05-27T06:30:08.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.848+0000 7fc606400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc60016b4e0 con 0x7fc60006c940 2024-05-27T06:30:08.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.848+0000 7fc5f6a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6000d1700 0x7fc600152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:08.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.848+0000 7fc5f6a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6000d1700 0x7fc600152710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42020/0 (socket says 172.21.15.87:42020) 2024-05-27T06:30:08.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.848+0000 7fc5f6a00640 1 -- 172.21.15.87:0/1906695977 learned_addr learned my addr 172.21.15.87:0/1906695977 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:08.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.848+0000 7fc5ff400640 1 --2- 172.21.15.87:0/1906695977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc60006c940 0x7fc600150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:08.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.848+0000 7fc5ffe00640 1 --2- 172.21.15.87:0/1906695977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc600157310 0x7fc600152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:08.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.848+0000 7fc5f6a00640 1 -- 172.21.15.87:0/1906695977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc60006c940 msgr2=0x7fc600150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:08.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.848+0000 7fc5f6a00640 1 --2- 172.21.15.87:0/1906695977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc60006c940 0x7fc600150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:08.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.848+0000 7fc5f6a00640 1 -- 172.21.15.87:0/1906695977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc600157310 msgr2=0x7fc600152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:08.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.848+0000 7fc5f6a00640 1 --2- 172.21.15.87:0/1906695977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc600157310 0x7fc600152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:08.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.848+0000 7fc5f6a00640 1 -- 172.21.15.87:0/1906695977 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6001546b0 con 0x7fc6000d1700 2024-05-27T06:30:08.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.848+0000 7fc5f6a00640 1 --2- 172.21.15.87:0/1906695977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6000d1700 0x7fc600152710 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc5e800c370 tx=0x7fc5e800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:08.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.848+0000 7fc5f7e00640 1 -- 172.21.15.87:0/1906695977 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8017070 con 0x7fc6000d1700 2024-05-27T06:30:08.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.848+0000 7fc5f7e00640 1 -- 172.21.15.87:0/1906695977 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e8003600 con 0x7fc6000d1700 2024-05-27T06:30:08.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.848+0000 7fc606400640 1 -- 172.21.15.87:0/1906695977 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc600154990 con 0x7fc6000d1700 2024-05-27T06:30:08.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.848+0000 7fc5f7e00640 1 -- 172.21.15.87:0/1906695977 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8003a50 con 0x7fc6000d1700 2024-05-27T06:30:08.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.848+0000 7fc606400640 1 -- 172.21.15.87:0/1906695977 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc600152090 con 0x7fc6000d1700 2024-05-27T06:30:08.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.848+0000 7fc606400640 1 -- 172.21.15.87:0/1906695977 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc60006aa30 con 0x7fc6000d1700 2024-05-27T06:30:08.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.852+0000 7fc5f7e00640 1 -- 172.21.15.87:0/1906695977 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc5e801a070 con 0x7fc6000d1700 2024-05-27T06:30:08.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.852+0000 7fc5f7e00640 1 --2- 172.21.15.87:0/1906695977 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc5dc06f400 0x7fc5dc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:08.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.852+0000 7fc5f7e00640 1 -- 172.21.15.87:0/1906695977 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5749+0+0 (secure 0 0 0) 0x7fc5e808e6a0 con 0x7fc6000d1700 2024-05-27T06:30:08.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.852+0000 7fc5ff400640 1 --2- 172.21.15.87:0/1906695977 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc5dc06f400 0x7fc5dc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:08.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.852+0000 7fc5ff400640 1 --2- 172.21.15.87:0/1906695977 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc5dc06f400 0x7fc5dc071910 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00ad000 tx=0x7fc5f00a4f90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:08.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:08.856+0000 7fc5f7e00640 1 -- 172.21.15.87:0/1906695977 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fc5e805ae70 con 0x7fc6000d1700 2024-05-27T06:30:09.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.012+0000 7fc606400640 1 -- 172.21.15.87:0/1906695977 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc60015f230 con 0x7fc6000d1700 2024-05-27T06:30:09.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.664+0000 7fc5f7e00640 1 -- 172.21.15.87:0/1906695977 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v57) ==== 169+0+0 (secure 0 0 0) 0x7fc5e805f170 con 0x7fc6000d1700 2024-05-27T06:30:09.661 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_data' removed 2024-05-27T06:30:09.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.664+0000 7fc606400640 1 -- 172.21.15.87:0/1906695977 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc5dc06f400 msgr2=0x7fc5dc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:09.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.664+0000 7fc606400640 1 --2- 172.21.15.87:0/1906695977 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc5dc06f400 0x7fc5dc071910 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00ad000 tx=0x7fc5f00a4f90 comp rx=0 tx=0).stop 2024-05-27T06:30:09.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.664+0000 7fc606400640 1 -- 172.21.15.87:0/1906695977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6000d1700 msgr2=0x7fc600152710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:09.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.664+0000 7fc606400640 1 --2- 172.21.15.87:0/1906695977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6000d1700 0x7fc600152710 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc5e800c370 tx=0x7fc5e800c830 comp rx=0 tx=0).stop 2024-05-27T06:30:09.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.668+0000 7fc606400640 1 -- 172.21.15.87:0/1906695977 shutdown_connections 2024-05-27T06:30:09.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.668+0000 7fc606400640 1 --2- 172.21.15.87:0/1906695977 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fc5dc06f400 0x7fc5dc071910 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:09.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.668+0000 7fc606400640 1 --2- 172.21.15.87:0/1906695977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc600157310 0x7fc600152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:09.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.668+0000 7fc606400640 1 --2- 172.21.15.87:0/1906695977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6000d1700 0x7fc600152710 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:09.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.668+0000 7fc606400640 1 --2- 172.21.15.87:0/1906695977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc60006c940 0x7fc600150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:09.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.668+0000 7fc606400640 1 -- 172.21.15.87:0/1906695977 >> 172.21.15.87:0/1906695977 conn(0x7fc6000b46b0 msgr2=0x7fc6000686b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:09.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.668+0000 7fc606400640 1 -- 172.21.15.87:0/1906695977 shutdown_connections 2024-05-27T06:30:09.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.668+0000 7fc606400640 1 -- 172.21.15.87:0/1906695977 wait complete. 2024-05-27T06:30:09.689 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-27T06:30:09.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.840+0000 7fbaff000640 1 Processor -- start 2024-05-27T06:30:09.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.840+0000 7fbaff000640 1 -- start start 2024-05-27T06:30:09.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.840+0000 7fbaff000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbaf8157310 0x7fbaf815dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:09.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.840+0000 7fbaff000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbaf80d1700 0x7fbaf80d1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:09.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.840+0000 7fbaff000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbaf806c940 0x7fbaf806cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:09.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.840+0000 7fbaff000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fbaf80d0140 con 0x7fbaf806c940 2024-05-27T06:30:09.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.840+0000 7fbaff000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fbaf815e110 con 0x7fbaf80d1700 2024-05-27T06:30:09.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.840+0000 7fbaff000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbaf80d2050 con 0x7fbaf8157310 2024-05-27T06:30:09.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.840+0000 7fbafd000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbaf806c940 0x7fbaf806cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:09.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.840+0000 7fbafd000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbaf806c940 0x7fbaf806cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42034/0 (socket says 172.21.15.87:42034) 2024-05-27T06:30:09.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.840+0000 7fbafd000640 1 -- 172.21.15.87:0/1247672387 learned_addr learned my addr 172.21.15.87:0/1247672387 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:09.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.840+0000 7fbaf7e00640 1 --2- 172.21.15.87:0/1247672387 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbaf8157310 0x7fbaf815dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:09.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.840+0000 7fbaf7400640 1 --2- 172.21.15.87:0/1247672387 >> v2:172.21.15.149:3300/0 conn(0x7fbaf80d1700 0x7fbaf80d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:09.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.840+0000 7fbafd000640 1 -- 172.21.15.87:0/1247672387 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbaf8157310 msgr2=0x7fbaf815dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:09.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.840+0000 7fbafd000640 1 --2- 172.21.15.87:0/1247672387 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbaf8157310 0x7fbaf815dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:09.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.840+0000 7fbafd000640 1 -- 172.21.15.87:0/1247672387 >> v2:172.21.15.149:3300/0 conn(0x7fbaf80d1700 msgr2=0x7fbaf80d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:09.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.840+0000 7fbafd000640 1 --2- 172.21.15.87:0/1247672387 >> v2:172.21.15.149:3300/0 conn(0x7fbaf80d1700 0x7fbaf80d1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:09.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.840+0000 7fbafd000640 1 -- 172.21.15.87:0/1247672387 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf80cf530 con 0x7fbaf806c940 2024-05-27T06:30:09.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.844+0000 7fbafd000640 1 --2- 172.21.15.87:0/1247672387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbaf806c940 0x7fbaf806cd50 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbaf80d2400 tx=0x7fbaf001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569012be3f3e45f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:09.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.844+0000 7fbaf6a00640 1 -- 172.21.15.87:0/1247672387 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf00a5840 con 0x7fbaf806c940 2024-05-27T06:30:09.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.844+0000 7fbaf6a00640 1 -- 172.21.15.87:0/1247672387 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaf00a59e0 con 0x7fbaf806c940 2024-05-27T06:30:09.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.844+0000 7fbaf6a00640 1 -- 172.21.15.87:0/1247672387 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf00a5db0 con 0x7fbaf806c940 2024-05-27T06:30:09.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.844+0000 7fbaff000640 1 -- 172.21.15.87:0/1247672387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbaf806c940 msgr2=0x7fbaf806cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:09.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.844+0000 7fbaff000640 1 --2- 172.21.15.87:0/1247672387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbaf806c940 0x7fbaf806cd50 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbaf80d2400 tx=0x7fbaf001c9c0 comp rx=0 tx=0).stop 2024-05-27T06:30:09.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.844+0000 7fbaff000640 1 -- 172.21.15.87:0/1247672387 shutdown_connections 2024-05-27T06:30:09.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.844+0000 7fbaff000640 1 --2- 172.21.15.87:0/1247672387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbaf806c940 0x7fbaf806cd50 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:09.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.844+0000 7fbaff000640 1 --2- 172.21.15.87:0/1247672387 >> v2:172.21.15.149:3300/0 conn(0x7fbaf80d1700 0x7fbaf80d1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:09.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.848+0000 7fbaff000640 1 --2- 172.21.15.87:0/1247672387 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbaf8157310 0x7fbaf815dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:09.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.848+0000 7fbaff000640 1 -- 172.21.15.87:0/1247672387 >> 172.21.15.87:0/1247672387 conn(0x7fbaf80b46b0 msgr2=0x7fbaf80b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:09.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.848+0000 7fbaff000640 1 -- 172.21.15.87:0/1247672387 shutdown_connections 2024-05-27T06:30:09.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.848+0000 7fbaff000640 1 -- 172.21.15.87:0/1247672387 wait complete. 2024-05-27T06:30:09.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.848+0000 7fbaff000640 1 Processor -- start 2024-05-27T06:30:09.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.848+0000 7fbaff000640 1 -- start start 2024-05-27T06:30:09.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.848+0000 7fbaff000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbaf806c940 0x7fbaf814e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:09.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.848+0000 7fbaff000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbaf80d1700 0x7fbaf814a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:09.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.848+0000 7fbaff000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbaf8157310 0x7fbaf80ae190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:09.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.848+0000 7fbaff000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf806d6a0 con 0x7fbaf806c940 2024-05-27T06:30:09.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.848+0000 7fbaff000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf80cf200 con 0x7fbaf8157310 2024-05-27T06:30:09.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.848+0000 7fbaff000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbaf8070640 con 0x7fbaf80d1700 2024-05-27T06:30:09.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.848+0000 7fbaf7e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbaf806c940 0x7fbaf814e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:09.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.852+0000 7fbaf7e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbaf806c940 0x7fbaf814e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42048/0 (socket says 172.21.15.87:42048) 2024-05-27T06:30:09.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.852+0000 7fbaf7e00640 1 -- 172.21.15.87:0/991644688 learned_addr learned my addr 172.21.15.87:0/991644688 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:09.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.852+0000 7fbaf7400640 1 --2- 172.21.15.87:0/991644688 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbaf80d1700 0x7fbaf814a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:09.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.852+0000 7fbafd000640 1 --2- 172.21.15.87:0/991644688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbaf8157310 0x7fbaf80ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:09.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.852+0000 7fbaf7e00640 1 -- 172.21.15.87:0/991644688 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbaf80d1700 msgr2=0x7fbaf814a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:09.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.852+0000 7fbaf7e00640 1 --2- 172.21.15.87:0/991644688 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbaf80d1700 0x7fbaf814a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:09.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.852+0000 7fbaf7e00640 1 -- 172.21.15.87:0/991644688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbaf8157310 msgr2=0x7fbaf80ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:09.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.852+0000 7fbaf7e00640 1 --2- 172.21.15.87:0/991644688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbaf8157310 0x7fbaf80ae190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:09.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.852+0000 7fbaf7e00640 1 -- 172.21.15.87:0/991644688 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf81fd3a0 con 0x7fbaf806c940 2024-05-27T06:30:09.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.852+0000 7fbaf7e00640 1 --2- 172.21.15.87:0/991644688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbaf806c940 0x7fbaf814e790 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fbae800e870 tx=0x7fbae800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:09.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.852+0000 7fbaefe00640 1 -- 172.21.15.87:0/991644688 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae8017070 con 0x7fbaf806c940 2024-05-27T06:30:09.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.852+0000 7fbaefe00640 1 -- 172.21.15.87:0/991644688 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbae800ee60 con 0x7fbaf806c940 2024-05-27T06:30:09.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.852+0000 7fbaff000640 1 -- 172.21.15.87:0/991644688 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf81fd640 con 0x7fbaf806c940 2024-05-27T06:30:09.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.852+0000 7fbaefe00640 1 -- 172.21.15.87:0/991644688 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae800cb40 con 0x7fbaf806c940 2024-05-27T06:30:09.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.852+0000 7fbaff000640 1 -- 172.21.15.87:0/991644688 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf8153e60 con 0x7fbaf806c940 2024-05-27T06:30:09.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.852+0000 7fbaff000640 1 -- 172.21.15.87:0/991644688 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaf806aa30 con 0x7fbaf806c940 2024-05-27T06:30:09.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.852+0000 7fbaefe00640 1 -- 172.21.15.87:0/991644688 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbae801a070 con 0x7fbaf806c940 2024-05-27T06:30:09.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.856+0000 7fbaefe00640 1 --2- 172.21.15.87:0/991644688 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbad806f430 0x7fbad8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:09.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.856+0000 7fbaefe00640 1 -- 172.21.15.87:0/991644688 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7fbae808ef40 con 0x7fbaf806c940 2024-05-27T06:30:09.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.856+0000 7fbaf7400640 1 --2- 172.21.15.87:0/991644688 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbad806f430 0x7fbad8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:09.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.856+0000 7fbaf7400640 1 --2- 172.21.15.87:0/991644688 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbad806f430 0x7fbad8071940 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbaf815df50 tx=0x7fbae4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:09.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:09.860+0000 7fbaefe00640 1 -- 172.21.15.87:0/991644688 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fbae805c030 con 0x7fbaf806c940 2024-05-27T06:30:10.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.016+0000 7fbaff000640 1 -- 172.21.15.87:0/991644688 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fbaf81fd810 con 0x7fbaf806c940 2024-05-27T06:30:10.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.020+0000 7fbaefe00640 1 -- 172.21.15.87:0/991644688 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7fbae805b930 con 0x7fbaf806c940 2024-05-27T06:30:10.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.024+0000 7fbaff000640 1 -- 172.21.15.87:0/991644688 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbad806f430 msgr2=0x7fbad8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:10.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.024+0000 7fbaff000640 1 --2- 172.21.15.87:0/991644688 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbad806f430 0x7fbad8071940 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbaf815df50 tx=0x7fbae4008040 comp rx=0 tx=0).stop 2024-05-27T06:30:10.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.024+0000 7fbaff000640 1 -- 172.21.15.87:0/991644688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbaf806c940 msgr2=0x7fbaf814e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:10.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.024+0000 7fbaff000640 1 --2- 172.21.15.87:0/991644688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbaf806c940 0x7fbaf814e790 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fbae800e870 tx=0x7fbae800ed30 comp rx=0 tx=0).stop 2024-05-27T06:30:10.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.024+0000 7fbaff000640 1 -- 172.21.15.87:0/991644688 shutdown_connections 2024-05-27T06:30:10.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.024+0000 7fbaff000640 1 --2- 172.21.15.87:0/991644688 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fbad806f430 0x7fbad8071940 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:10.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.024+0000 7fbaff000640 1 --2- 172.21.15.87:0/991644688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbaf8157310 0x7fbaf80ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:10.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.024+0000 7fbaff000640 1 --2- 172.21.15.87:0/991644688 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbaf80d1700 0x7fbaf814a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:10.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.024+0000 7fbaff000640 1 --2- 172.21.15.87:0/991644688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbaf806c940 0x7fbaf814e790 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:10.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.024+0000 7fbaff000640 1 -- 172.21.15.87:0/991644688 >> 172.21.15.87:0/991644688 conn(0x7fbaf80b46b0 msgr2=0x7fbaf815cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:10.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.024+0000 7fbaff000640 1 -- 172.21.15.87:0/991644688 shutdown_connections 2024-05-27T06:30:10.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.024+0000 7fbaff000640 1 -- 172.21.15.87:0/991644688 wait complete. 2024-05-27T06:30:10.041 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2024-05-27T06:30:10.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.196+0000 7f3cec000640 1 Processor -- start 2024-05-27T06:30:10.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.200+0000 7f3cec000640 1 -- start start 2024-05-27T06:30:10.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.200+0000 7f3cec000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3ce4072eb0 0x7f3ce40d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:10.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.200+0000 7f3cec000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ce40d2090 con 0x7f3ce4072aa0 2024-05-27T06:30:10.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.200+0000 7f3cec000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ce40cd120 con 0x7f3ce40d1c80 2024-05-27T06:30:10.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.200+0000 7f3cec000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f3ce40cdd30 con 0x7f3ce4072eb0 2024-05-27T06:30:10.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.200+0000 7f3ce8c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3ce4072eb0 0x7f3ce40d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:10.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.200+0000 7f3ce8c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3ce4072eb0 0x7f3ce40d1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42058/0 (socket says 172.21.15.87:42058) 2024-05-27T06:30:10.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.200+0000 7f3ce8c00640 1 -- 172.21.15.87:0/3467437203 learned_addr learned my addr 172.21.15.87:0/3467437203 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:10.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.200+0000 7f3ce9600640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f3ce4072aa0 0x7f3ce406d820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43042/0 (socket says 172.21.15.87:43042) 2024-05-27T06:30:10.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.200+0000 7f3ce8c00640 1 -- 172.21.15.87:0/3467437203 >> v1:172.21.15.149:6789/0 conn(0x7f3ce40d1c80 legacy=0x7f3ce40ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:10.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.200+0000 7f3ce8c00640 1 -- 172.21.15.87:0/3467437203 >> v1:172.21.15.87:6789/0 conn(0x7f3ce4072aa0 legacy=0x7f3ce406d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:10.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.200+0000 7f3ce8c00640 1 -- 172.21.15.87:0/3467437203 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce40cd400 con 0x7f3ce4072eb0 2024-05-27T06:30:10.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.200+0000 7f3ce3e00640 1 -- 172.21.15.87:0/3467437203 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1275802869 0 0) 0x7f3ce40d2090 con 0x7f3ce4072aa0 2024-05-27T06:30:10.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.204+0000 7f3ce8c00640 1 --2- 172.21.15.87:0/3467437203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ce4072eb0 0x7f3ce40d1740 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009870 tx=0x7f3cd001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943de0e703fb9b60 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:10.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.204+0000 7f3ce3e00640 1 -- 172.21.15.87:0/3467437203 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd00a95f0 con 0x7f3ce4072eb0 2024-05-27T06:30:10.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.204+0000 7f3ce3e00640 1 -- 172.21.15.87:0/3467437203 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cd00a9790 con 0x7f3ce4072eb0 2024-05-27T06:30:10.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.204+0000 7f3ce3e00640 1 -- 172.21.15.87:0/3467437203 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd00a9b60 con 0x7f3ce4072eb0 2024-05-27T06:30:10.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.204+0000 7f3cec000640 1 -- 172.21.15.87:0/3467437203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ce4072eb0 msgr2=0x7f3ce40d1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:10.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.204+0000 7f3cec000640 1 --2- 172.21.15.87:0/3467437203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ce4072eb0 0x7f3ce40d1740 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009870 tx=0x7f3cd001c530 comp rx=0 tx=0).stop 2024-05-27T06:30:10.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.204+0000 7f3cec000640 1 -- 172.21.15.87:0/3467437203 shutdown_connections 2024-05-27T06:30:10.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.204+0000 7f3cec000640 1 --2- 172.21.15.87:0/3467437203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ce4072eb0 0x7f3ce40d1740 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:10.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.204+0000 7f3cec000640 1 -- 172.21.15.87:0/3467437203 >> 172.21.15.87:0/3467437203 conn(0x7f3ce40b46b0 msgr2=0x7f3ce40b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:10.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.204+0000 7f3cec000640 1 -- 172.21.15.87:0/3467437203 shutdown_connections 2024-05-27T06:30:10.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.204+0000 7f3cec000640 1 -- 172.21.15.87:0/3467437203 wait complete. 2024-05-27T06:30:10.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.208+0000 7f3cec000640 1 Processor -- start 2024-05-27T06:30:10.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.208+0000 7f3cec000640 1 -- start start 2024-05-27T06:30:10.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.208+0000 7f3cec000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ce4072aa0 0x7f3ce41fd930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:10.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.208+0000 7f3cec000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3ce4072eb0 0x7f3ce4158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:10.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.208+0000 7f3cec000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ce40d1c80 0x7f3ce4167b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:10.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.208+0000 7f3cec000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce40cce30 con 0x7f3ce40d1c80 2024-05-27T06:30:10.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.208+0000 7f3cec000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce40cccb0 con 0x7f3ce4072aa0 2024-05-27T06:30:10.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.208+0000 7f3cec000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3ce416c4d0 con 0x7f3ce4072eb0 2024-05-27T06:30:10.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.208+0000 7f3cea000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ce40d1c80 0x7f3ce4167b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:10.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.208+0000 7f3cea000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ce40d1c80 0x7f3ce4167b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42068/0 (socket says 172.21.15.87:42068) 2024-05-27T06:30:10.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.208+0000 7f3cea000640 1 -- 172.21.15.87:0/2021723894 learned_addr learned my addr 172.21.15.87:0/2021723894 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:10.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.208+0000 7f3ce9600640 1 --2- 172.21.15.87:0/2021723894 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ce4072aa0 0x7f3ce41fd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:10.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.208+0000 7f3ce8c00640 1 --2- 172.21.15.87:0/2021723894 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3ce4072eb0 0x7f3ce4158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:10.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.212+0000 7f3cea000640 1 -- 172.21.15.87:0/2021723894 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3ce4072eb0 msgr2=0x7f3ce4158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:10.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.212+0000 7f3cea000640 1 --2- 172.21.15.87:0/2021723894 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3ce4072eb0 0x7f3ce4158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:10.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.212+0000 7f3cea000640 1 -- 172.21.15.87:0/2021723894 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ce4072aa0 msgr2=0x7f3ce41fd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:10.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.212+0000 7f3cea000640 1 --2- 172.21.15.87:0/2021723894 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ce4072aa0 0x7f3ce41fd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:10.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.212+0000 7f3cea000640 1 -- 172.21.15.87:0/2021723894 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce40c8a80 con 0x7f3ce40d1c80 2024-05-27T06:30:10.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.212+0000 7f3cea000640 1 --2- 172.21.15.87:0/2021723894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ce40d1c80 0x7f3ce4167b00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00c760 tx=0x7f3cdc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:10.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.212+0000 7f3ce1600640 1 -- 172.21.15.87:0/2021723894 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc003b80 con 0x7f3ce40d1c80 2024-05-27T06:30:10.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.212+0000 7f3ce1600640 1 -- 172.21.15.87:0/2021723894 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cdc003d20 con 0x7f3ce40d1c80 2024-05-27T06:30:10.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.212+0000 7f3cec000640 1 -- 172.21.15.87:0/2021723894 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce40c8d60 con 0x7f3ce40d1c80 2024-05-27T06:30:10.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.212+0000 7f3ce1600640 1 -- 172.21.15.87:0/2021723894 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc00aa70 con 0x7f3ce40d1c80 2024-05-27T06:30:10.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.212+0000 7f3cec000640 1 -- 172.21.15.87:0/2021723894 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ce4167330 con 0x7f3ce40d1c80 2024-05-27T06:30:10.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.212+0000 7f3cec000640 1 -- 172.21.15.87:0/2021723894 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ce40c9280 con 0x7f3ce40d1c80 2024-05-27T06:30:10.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.212+0000 7f3ce1600640 1 -- 172.21.15.87:0/2021723894 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3cdc00ac10 con 0x7f3ce40d1c80 2024-05-27T06:30:10.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.212+0000 7f3ce1600640 1 --2- 172.21.15.87:0/2021723894 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3cc406f430 0x7f3cc4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:10.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.216+0000 7f3ce1600640 1 -- 172.21.15.87:0/2021723894 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f3cdc08ef60 con 0x7f3ce40d1c80 2024-05-27T06:30:10.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.216+0000 7f3ce9600640 1 --2- 172.21.15.87:0/2021723894 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3cc406f430 0x7f3cc4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:10.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.216+0000 7f3ce9600640 1 --2- 172.21.15.87:0/2021723894 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3cc406f430 0x7f3cc4071940 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8000f70 tx=0x7f3cd8007240 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:10.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.220+0000 7f3ce1600640 1 -- 172.21.15.87:0/2021723894 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f3ce40c9280 con 0x7f3ce40d1c80 2024-05-27T06:30:10.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.432+0000 7f3cec000640 1 -- 172.21.15.87:0/2021723894 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) -- 0x7f3ce406aa30 con 0x7f3ce40d1c80 2024-05-27T06:30:10.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.664+0000 7f3ce1600640 1 -- 172.21.15.87:0/2021723894 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v148) ==== 134+0+0 (secure 0 0 0) 0x7f3cdc05b8e0 con 0x7f3ce40d1c80 2024-05-27T06:30:10.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.668+0000 7f3cec000640 1 -- 172.21.15.87:0/2021723894 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3cc406f430 msgr2=0x7f3cc4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:10.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.668+0000 7f3cec000640 1 --2- 172.21.15.87:0/2021723894 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3cc406f430 0x7f3cc4071940 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8000f70 tx=0x7f3cd8007240 comp rx=0 tx=0).stop 2024-05-27T06:30:10.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.668+0000 7f3cec000640 1 -- 172.21.15.87:0/2021723894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ce40d1c80 msgr2=0x7f3ce4167b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:10.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.668+0000 7f3cec000640 1 --2- 172.21.15.87:0/2021723894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ce40d1c80 0x7f3ce4167b00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00c760 tx=0x7f3cdc00cc20 comp rx=0 tx=0).stop 2024-05-27T06:30:10.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.668+0000 7f3cec000640 1 -- 172.21.15.87:0/2021723894 shutdown_connections 2024-05-27T06:30:10.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.668+0000 7f3cec000640 1 --2- 172.21.15.87:0/2021723894 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3cc406f430 0x7f3cc4071940 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:10.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.668+0000 7f3cec000640 1 --2- 172.21.15.87:0/2021723894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ce40d1c80 0x7f3ce4167b00 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:10.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.668+0000 7f3cec000640 1 --2- 172.21.15.87:0/2021723894 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3ce4072eb0 0x7f3ce4158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:10.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.668+0000 7f3cec000640 1 --2- 172.21.15.87:0/2021723894 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ce4072aa0 0x7f3ce41fd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:10.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.668+0000 7f3cec000640 1 -- 172.21.15.87:0/2021723894 >> 172.21.15.87:0/2021723894 conn(0x7f3ce40b46b0 msgr2=0x7f3ce40ae450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:10.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.668+0000 7f3cec000640 1 -- 172.21.15.87:0/2021723894 shutdown_connections 2024-05-27T06:30:10.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:10.668+0000 7f3cec000640 1 -- 172.21.15.87:0/2021723894 wait complete. 2024-05-27T06:30:10.687 INFO:tasks.cephfs_test_runner:test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) ... ERROR 2024-05-27T06:30:10.688 INFO:tasks.cephfs_test_runner: 2024-05-27T06:30:10.688 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-27T06:30:10.688 INFO:tasks.cephfs_test_runner:ERROR: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-05-27T06:30:10.688 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-27T06:30:10.688 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-27T06:30:10.688 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_38f9d900c83c63799fbdbe61acc9a11b0d3554a6/qa/tasks/cephfs/test_pool_perm.py", line 52, in test_pool_perm 2024-05-27T06:30:10.688 INFO:tasks.cephfs_test_runner: self.mount_a.run_python(remote_script.format(path=file_path, check_read=str(True))) 2024-05-27T06:30:10.688 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_38f9d900c83c63799fbdbe61acc9a11b0d3554a6/qa/tasks/cephfs/mount.py", line 766, in run_python 2024-05-27T06:30:10.688 INFO:tasks.cephfs_test_runner: p.wait() 2024-05-27T06:30:10.688 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/orchestra/run.py", line 161, in wait 2024-05-27T06:30:10.688 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-05-27T06:30:10.688 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-05-27T06:30:10.689 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-05-27T06:30:10.689 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi087 with status 1: 'stdin-killer -- python3 -c \'\nimport os\nimport errno\n\nfd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR)\ntry:\n if True:\n ret = os.read(fd, 1024)\n else:\n os.write(fd, b\'"\'"\'content\'"\'"\')\nexcept OSError as e:\n if e.errno != errno.EPERM:\n raise\nelse:\n raise RuntimeError("client does not check permission of data pool")\n\'' 2024-05-27T06:30:10.689 INFO:tasks.cephfs_test_runner: 2024-05-27T06:30:10.689 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-27T06:30:10.689 INFO:tasks.cephfs_test_runner:Ran 2 tests in 109.605s 2024-05-27T06:30:10.689 INFO:tasks.cephfs_test_runner: 2024-05-27T06:30:10.689 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-05-27T06:30:10.689 INFO:tasks.cephfs_test_runner: 2024-05-27T06:30:10.689 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-27T06:30:10.689 INFO:tasks.cephfs_test_runner:ERROR: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-05-27T06:30:10.689 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-27T06:30:10.689 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-27T06:30:10.689 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_38f9d900c83c63799fbdbe61acc9a11b0d3554a6/qa/tasks/cephfs/test_pool_perm.py", line 52, in test_pool_perm 2024-05-27T06:30:10.689 INFO:tasks.cephfs_test_runner: self.mount_a.run_python(remote_script.format(path=file_path, check_read=str(True))) 2024-05-27T06:30:10.690 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_38f9d900c83c63799fbdbe61acc9a11b0d3554a6/qa/tasks/cephfs/mount.py", line 766, in run_python 2024-05-27T06:30:10.690 INFO:tasks.cephfs_test_runner: p.wait() 2024-05-27T06:30:10.690 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/orchestra/run.py", line 161, in wait 2024-05-27T06:30:10.690 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-05-27T06:30:10.690 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-05-27T06:30:10.690 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-05-27T06:30:10.690 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi087 with status 1: 'stdin-killer -- python3 -c \'\nimport os\nimport errno\n\nfd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR)\ntry:\n if True:\n ret = os.read(fd, 1024)\n else:\n os.write(fd, b\'"\'"\'content\'"\'"\')\nexcept OSError as e:\n if e.errno != errno.EPERM:\n raise\nelse:\n raise RuntimeError("client does not check permission of data pool")\n\'' 2024-05-27T06:30:10.690 INFO:tasks.cephfs_test_runner: 2024-05-27T06:30:10.690 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_38f9d900c83c63799fbdbe61acc9a11b0d3554a6/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-05-27T06:30:10.909 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=1ac8abedd9f84009a7d211f00e293f94 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_38f9d900c83c63799fbdbe61acc9a11b0d3554a6/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-05-27T06:30:10.910 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-05-27T06:30:10.919 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-27T06:30:10.977 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-27T06:30:10.977 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:30:10.978 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:30:10.990 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8583 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274976k,nr_inodes=818744,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-27T06:30:10.991 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-27T06:30:10.991 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:30:11.041 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350232k,nr_inodes=4087558,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8583 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274976k,nr_inodes=818744,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274980k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-27T06:30:11.041 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:30:11.041 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:30:11.050 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105064k,nr_inodes=2026266,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625948k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6550 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625944k,nr_inodes=406486,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625948k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-27T06:30:11.050 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-05-27T06:30:11.051 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T06:30:11.100 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105064k,nr_inodes=2026266,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625948k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6550 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625944k,nr_inodes=406486,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625948k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-27T06:30:11.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:30:11.100 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-05-27T06:30:11.151 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-27T06:30:11.152 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-27T06:30:11.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:30:11.153 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-27T06:30:11.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:30:11.219 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-27T06:30:11.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:30:11.286 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2024-05-27T06:30:11.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:30:11.427 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-05-27T06:30:11.436 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-27T06:30:11.436 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-27T06:30:11.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:30:11.438 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T06:30:11.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:30:11.503 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T06:30:11.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T06:30:11.570 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2024-05-27T06:30:11.707 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-27T06:30:11.719 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-27T06:30:11.720 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T06:30:11.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.868+0000 7faf11800640 1 Processor -- start 2024-05-27T06:30:11.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.868+0000 7faf11800640 1 -- start start 2024-05-27T06:30:11.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.868+0000 7faf11800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf0c1617b0 0x7faf0c06d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:11.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.868+0000 7faf11800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7faf0c06db40 0x7faf0c0d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:11.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.868+0000 7faf11800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf0c161bc0 con 0x7faf0c0cffa0 2024-05-27T06:30:11.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.868+0000 7faf11800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7faf0c0d03b0 con 0x7faf0c06db40 2024-05-27T06:30:11.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.868+0000 7faf11800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7faf0c1626e0 con 0x7faf0c1617b0 2024-05-27T06:30:11.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.868+0000 7faf0b400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7faf0c06db40 0x7faf0c0d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:11.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.868+0000 7faf0aa00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7faf0c0cffa0 0x7faf0c144800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43044/0 (socket says 172.21.15.87:43044) 2024-05-27T06:30:11.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.868+0000 7faf0aa00640 1 -- 172.21.15.87:0/701535131 learned_addr learned my addr 172.21.15.87:0/701535131 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:30:11.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.868+0000 7faf02000640 1 --2- 172.21.15.87:0/701535131 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf0c1617b0 0x7faf0c06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:11.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.868+0000 7faf0b400640 1 -- 172.21.15.87:0/701535131 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf0c1617b0 msgr2=0x7faf0c06d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:11.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.868+0000 7faf0b400640 1 --2- 172.21.15.87:0/701535131 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf0c1617b0 0x7faf0c06d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:11.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.868+0000 7faf0b400640 1 -- 172.21.15.87:0/701535131 >> v1:172.21.15.87:6789/0 conn(0x7faf0c0cffa0 legacy=0x7faf0c144800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:11.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.868+0000 7faf0b400640 1 -- 172.21.15.87:0/701535131 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0c06df50 con 0x7faf0c06db40 2024-05-27T06:30:11.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.868+0000 7faf0a000640 1 -- 172.21.15.87:0/701535131 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 567937586 0 0) 0x7faefc001120 con 0x7faf0c0cffa0 2024-05-27T06:30:11.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.872+0000 7faf0b400640 1 --2- 172.21.15.87:0/701535131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf0c06db40 0x7faf0c0d17c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7faf04009d90 tx=0x7faf0401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2044894c6613c25 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:11.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.872+0000 7faf0a000640 1 -- 172.21.15.87:0/701535131 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf040b2070 con 0x7faf0c06db40 2024-05-27T06:30:11.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.872+0000 7faf0a000640 1 -- 172.21.15.87:0/701535131 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf040a5890 con 0x7faf0c06db40 2024-05-27T06:30:11.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.872+0000 7faf0a000640 1 -- 172.21.15.87:0/701535131 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf040a5c60 con 0x7faf0c06db40 2024-05-27T06:30:11.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.872+0000 7faf11800640 1 -- 172.21.15.87:0/701535131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf0c06db40 msgr2=0x7faf0c0d17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:11.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.872+0000 7faf11800640 1 --2- 172.21.15.87:0/701535131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf0c06db40 0x7faf0c0d17c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7faf04009d90 tx=0x7faf0401c8e0 comp rx=0 tx=0).stop 2024-05-27T06:30:11.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.872+0000 7faf11800640 1 -- 172.21.15.87:0/701535131 shutdown_connections 2024-05-27T06:30:11.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.872+0000 7faf11800640 1 --2- 172.21.15.87:0/701535131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf0c06db40 0x7faf0c0d17c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:11.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.872+0000 7faf11800640 1 --2- 172.21.15.87:0/701535131 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf0c1617b0 0x7faf0c06d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:11.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.872+0000 7faf11800640 1 -- 172.21.15.87:0/701535131 >> 172.21.15.87:0/701535131 conn(0x7faf0c0700d0 msgr2=0x7faf0c0704e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:11.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.872+0000 7faf11800640 1 -- 172.21.15.87:0/701535131 shutdown_connections 2024-05-27T06:30:11.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.872+0000 7faf11800640 1 -- 172.21.15.87:0/701535131 wait complete. 2024-05-27T06:30:11.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.876+0000 7faf11800640 1 Processor -- start 2024-05-27T06:30:11.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.876+0000 7faf11800640 1 -- start start 2024-05-27T06:30:11.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.876+0000 7faf11800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf0c06db40 0x7faf0c1fdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:11.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.876+0000 7faf11800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf0c0cffa0 0x7faf0c15d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:11.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.876+0000 7faf11800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf0c1617b0 0x7faf0c13cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:11.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.876+0000 7faf11800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c147620 con 0x7faf0c0cffa0 2024-05-27T06:30:11.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.876+0000 7faf11800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c144f10 con 0x7faf0c06db40 2024-05-27T06:30:11.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.876+0000 7faf11800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7faf0c0d2110 con 0x7faf0c1617b0 2024-05-27T06:30:11.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.880+0000 7faf02000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf0c0cffa0 0x7faf0c15d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:11.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.880+0000 7faf02000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf0c0cffa0 0x7faf0c15d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42084/0 (socket says 172.21.15.87:42084) 2024-05-27T06:30:11.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.880+0000 7faf02000640 1 -- 172.21.15.87:0/240336350 learned_addr learned my addr 172.21.15.87:0/240336350 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:11.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.880+0000 7faf0aa00640 1 --2- 172.21.15.87:0/240336350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf0c06db40 0x7faf0c1fdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:11.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.880+0000 7faf0b400640 1 --2- 172.21.15.87:0/240336350 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf0c1617b0 0x7faf0c13cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:11.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.880+0000 7faf02000640 1 -- 172.21.15.87:0/240336350 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf0c1617b0 msgr2=0x7faf0c13cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:11.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.880+0000 7faf02000640 1 --2- 172.21.15.87:0/240336350 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf0c1617b0 0x7faf0c13cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:11.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.880+0000 7faf02000640 1 -- 172.21.15.87:0/240336350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf0c06db40 msgr2=0x7faf0c1fdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:11.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.880+0000 7faf02000640 1 --2- 172.21.15.87:0/240336350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf0c06db40 0x7faf0c1fdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:11.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.880+0000 7faf02000640 1 -- 172.21.15.87:0/240336350 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0c0b6050 con 0x7faf0c0cffa0 2024-05-27T06:30:11.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.880+0000 7faf0aa00640 1 --2- 172.21.15.87:0/240336350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf0c06db40 0x7faf0c1fdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:30:11.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.880+0000 7faf02000640 1 --2- 172.21.15.87:0/240336350 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf0c0cffa0 0x7faf0c15d260 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7faef400e8a0 tx=0x7faef400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:11.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.880+0000 7faf03400640 1 -- 172.21.15.87:0/240336350 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef4017070 con 0x7faf0c0cffa0 2024-05-27T06:30:11.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.880+0000 7faf03400640 1 -- 172.21.15.87:0/240336350 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef400c940 con 0x7faf0c0cffa0 2024-05-27T06:30:11.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.880+0000 7faf11800640 1 -- 172.21.15.87:0/240336350 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf0c1613d0 con 0x7faf0c0cffa0 2024-05-27T06:30:11.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.880+0000 7faf03400640 1 -- 172.21.15.87:0/240336350 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef400ccf0 con 0x7faf0c0cffa0 2024-05-27T06:30:11.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.880+0000 7faf11800640 1 -- 172.21.15.87:0/240336350 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf0c0b65f0 con 0x7faf0c0cffa0 2024-05-27T06:30:11.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.880+0000 7faf11800640 1 -- 172.21.15.87:0/240336350 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf0c161140 con 0x7faf0c0cffa0 2024-05-27T06:30:11.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.880+0000 7faf03400640 1 -- 172.21.15.87:0/240336350 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7faef401a070 con 0x7faf0c0cffa0 2024-05-27T06:30:11.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.884+0000 7faf03400640 1 --2- 172.21.15.87:0/240336350 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7faee806f430 0x7faee8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:11.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.884+0000 7faf03400640 1 -- 172.21.15.87:0/240336350 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7faef408ee50 con 0x7faf0c0cffa0 2024-05-27T06:30:11.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.884+0000 7faf0aa00640 1 --2- 172.21.15.87:0/240336350 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7faee806f430 0x7faee8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:11.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.884+0000 7faf0aa00640 1 --2- 172.21.15.87:0/240336350 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7faee806f430 0x7faee8071940 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7faefc000f70 tx=0x7faefc007cb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:11.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:11.888+0000 7faf03400640 1 -- 172.21.15.87:0/240336350 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7faef405b960 con 0x7faf0c0cffa0 2024-05-27T06:30:12.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.044+0000 7faf11800640 1 -- 172.21.15.87:0/240336350 --> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faf0c06aa30 con 0x7faee806f430 2024-05-27T06:30:12.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.044+0000 7faf03400640 1 -- 172.21.15.87:0/240336350 <== mgr.4111 v2:172.21.15.87:6832/2724754260 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13390 (secure 0 0 0) 0x7faf0c06aa30 con 0x7faee806f430 2024-05-27T06:30:12.043 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:30:12.043 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-27T06:30:12.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.044+0000 7faf11800640 1 -- 172.21.15.87:0/240336350 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7faee806f430 msgr2=0x7faee8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:12.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.044+0000 7faf11800640 1 --2- 172.21.15.87:0/240336350 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7faee806f430 0x7faee8071940 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7faefc000f70 tx=0x7faefc007cb0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.044+0000 7faf11800640 1 -- 172.21.15.87:0/240336350 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf0c0cffa0 msgr2=0x7faf0c15d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:12.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.044+0000 7faf11800640 1 --2- 172.21.15.87:0/240336350 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf0c0cffa0 0x7faf0c15d260 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7faef400e8a0 tx=0x7faef400eca0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.044+0000 7faf11800640 1 -- 172.21.15.87:0/240336350 shutdown_connections 2024-05-27T06:30:12.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.044+0000 7faf11800640 1 --2- 172.21.15.87:0/240336350 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7faee806f430 0x7faee8071940 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.044+0000 7faf11800640 1 --2- 172.21.15.87:0/240336350 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf0c1617b0 0x7faf0c13cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.044+0000 7faf11800640 1 --2- 172.21.15.87:0/240336350 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf0c0cffa0 0x7faf0c15d260 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.044+0000 7faf11800640 1 --2- 172.21.15.87:0/240336350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf0c06db40 0x7faf0c1fdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.048+0000 7faf11800640 1 -- 172.21.15.87:0/240336350 >> 172.21.15.87:0/240336350 conn(0x7faf0c0700d0 msgr2=0x7faf0c0b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:12.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.048+0000 7faf11800640 1 -- 172.21.15.87:0/240336350 shutdown_connections 2024-05-27T06:30:12.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.048+0000 7faf11800640 1 -- 172.21.15.87:0/240336350 wait complete. 2024-05-27T06:30:12.064 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2024-05-27T06:30:10.601320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226612,"kb_used_data":6304,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748108,"statfs":{"total":773094113280,"available":772862062592,"internally_reserved":0,"allocated":6455296,"data_stored":3554546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12150,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-62,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001235"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":173,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426212+0000","last_change":"2024-05-27T06:27:28.692457+0000","last_active":"2024-05-27T06:29:34.426212+0000","last_peered":"2024-05-27T06:29:34.426212+0000","last_clean":"2024-05-27T06:29:34.426212+0000","last_became_active":"2024-05-27T06:27:28.691290+0000","last_became_peered":"2024-05-27T06:27:28.691290+0000","last_unstale":"2024-05-27T06:29:34.426212+0000","last_undegraded":"2024-05-27T06:29:34.426212+0000","last_fullsized":"2024-05-27T06:29:34.426212+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_clean_scrub_stamp":"2024-05-27T06:27:26.991915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:45.563728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28240,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343600,"statfs":{"total":96636764160,"available":96607846400,"internally_reserved":0,"allocated":1249280,"data_stored":883521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":647168,"data_stored":292993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":293645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":671744,"data_stored":307128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":293049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":293049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":293083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1269760,"data_stored":898078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T06:30:12.065 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T06:30:12.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.212+0000 7fe161c00640 1 Processor -- start 2024-05-27T06:30:12.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.212+0000 7fe161c00640 1 -- start start 2024-05-27T06:30:12.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.216+0000 7fe161c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe15c0cbf90 0x7fe15c06cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:12.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.216+0000 7fe161c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe15c06d500 0x7fe15c15cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:12.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.216+0000 7fe161c00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe15c15d930 con 0x7fe15c15d520 2024-05-27T06:30:12.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.216+0000 7fe161c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fe15c06d910 con 0x7fe15c0cbf90 2024-05-27T06:30:12.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.216+0000 7fe161c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe15c15dbb0 con 0x7fe15c06d500 2024-05-27T06:30:12.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.216+0000 7fe15b400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe15c15d520 0x7fe15c0d1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43046/0 (socket says 172.21.15.87:43046) 2024-05-27T06:30:12.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.216+0000 7fe15b400640 1 -- 172.21.15.87:0/2012278168 learned_addr learned my addr 172.21.15.87:0/2012278168 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:30:12.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.216+0000 7fe15aa00640 1 --2- 172.21.15.87:0/2012278168 >> v2:172.21.15.149:3300/0 conn(0x7fe15c0cbf90 0x7fe15c06cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:12.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.216+0000 7fe152000640 1 --2- 172.21.15.87:0/2012278168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe15c06d500 0x7fe15c15cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:12.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.216+0000 7fe15a000640 1 -- 172.21.15.87:0/2012278168 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2214652488 0 0) 0x7fe1540014a0 con 0x7fe15c15d520 2024-05-27T06:30:12.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.216+0000 7fe15a000640 1 -- 172.21.15.87:0/2012278168 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe140003530 con 0x7fe15c15d520 2024-05-27T06:30:12.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.216+0000 7fe15aa00640 1 -- 172.21.15.87:0/2012278168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe15c06d500 msgr2=0x7fe15c15cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:12.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.216+0000 7fe15aa00640 1 --2- 172.21.15.87:0/2012278168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe15c06d500 0x7fe15c15cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.216+0000 7fe15aa00640 1 -- 172.21.15.87:0/2012278168 >> v1:172.21.15.87:6789/0 conn(0x7fe15c15d520 legacy=0x7fe15c0d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:12.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.216+0000 7fe15aa00640 1 -- 172.21.15.87:0/2012278168 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe15c15de90 con 0x7fe15c0cbf90 2024-05-27T06:30:12.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.220+0000 7fe15aa00640 1 --2- 172.21.15.87:0/2012278168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe15c0cbf90 0x7fe15c06cfc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe14c0097c0 tx=0x7fe14c01ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=108515f860b6d5ee server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:12.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.220+0000 7fe15a000640 1 -- 172.21.15.87:0/2012278168 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0b5070 con 0x7fe15c0cbf90 2024-05-27T06:30:12.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.220+0000 7fe15a000640 1 -- 172.21.15.87:0/2012278168 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe14c0a8990 con 0x7fe15c0cbf90 2024-05-27T06:30:12.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.220+0000 7fe15a000640 1 -- 172.21.15.87:0/2012278168 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0a8d60 con 0x7fe15c0cbf90 2024-05-27T06:30:12.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.220+0000 7fe161c00640 1 -- 172.21.15.87:0/2012278168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe15c0cbf90 msgr2=0x7fe15c06cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:12.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.220+0000 7fe161c00640 1 --2- 172.21.15.87:0/2012278168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe15c0cbf90 0x7fe15c06cfc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe14c0097c0 tx=0x7fe14c01ec90 comp rx=0 tx=0).stop 2024-05-27T06:30:12.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.220+0000 7fe161c00640 1 -- 172.21.15.87:0/2012278168 shutdown_connections 2024-05-27T06:30:12.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.220+0000 7fe161c00640 1 --2- 172.21.15.87:0/2012278168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe15c06d500 0x7fe15c15cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.220+0000 7fe161c00640 1 --2- 172.21.15.87:0/2012278168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe15c0cbf90 0x7fe15c06cfc0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.220+0000 7fe161c00640 1 -- 172.21.15.87:0/2012278168 >> 172.21.15.87:0/2012278168 conn(0x7fe15c0b46b0 msgr2=0x7fe15c0b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:12.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.220+0000 7fe161c00640 1 -- 172.21.15.87:0/2012278168 shutdown_connections 2024-05-27T06:30:12.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.220+0000 7fe161c00640 1 -- 172.21.15.87:0/2012278168 wait complete. 2024-05-27T06:30:12.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.220+0000 7fe161c00640 1 Processor -- start 2024-05-27T06:30:12.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.224+0000 7fe161c00640 1 -- start start 2024-05-27T06:30:12.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.224+0000 7fe161c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe15c06d500 0x7fe15c09a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:12.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.224+0000 7fe161c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe15c0cbf90 0x7fe15c0c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:12.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.224+0000 7fe161c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe15c15d520 0x7fe15c0ca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:12.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.224+0000 7fe161c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe15c15e170 con 0x7fe15c0cbf90 2024-05-27T06:30:12.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.224+0000 7fe161c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe15c06caa0 con 0x7fe15c06d500 2024-05-27T06:30:12.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.224+0000 7fe161c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe15c0cc3a0 con 0x7fe15c15d520 2024-05-27T06:30:12.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.224+0000 7fe152000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe15c0cbf90 0x7fe15c0c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:12.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.224+0000 7fe152000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe15c0cbf90 0x7fe15c0c5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42096/0 (socket says 172.21.15.87:42096) 2024-05-27T06:30:12.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.224+0000 7fe152000640 1 -- 172.21.15.87:0/2027308901 learned_addr learned my addr 172.21.15.87:0/2027308901 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:12.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.224+0000 7fe15aa00640 1 --2- 172.21.15.87:0/2027308901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe15c06d500 0x7fe15c09a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:12.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.224+0000 7fe15b400640 1 --2- 172.21.15.87:0/2027308901 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe15c15d520 0x7fe15c0ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:12.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.224+0000 7fe152000640 1 -- 172.21.15.87:0/2027308901 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe15c15d520 msgr2=0x7fe15c0ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:12.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.224+0000 7fe152000640 1 --2- 172.21.15.87:0/2027308901 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe15c15d520 0x7fe15c0ca680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.224+0000 7fe152000640 1 -- 172.21.15.87:0/2027308901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe15c06d500 msgr2=0x7fe15c09a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:12.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.224+0000 7fe152000640 1 --2- 172.21.15.87:0/2027308901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe15c06d500 0x7fe15c09a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.224+0000 7fe152000640 1 -- 172.21.15.87:0/2027308901 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe15c0c6210 con 0x7fe15c0cbf90 2024-05-27T06:30:12.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.224+0000 7fe15aa00640 1 --2- 172.21.15.87:0/2027308901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe15c06d500 0x7fe15c09a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:30:12.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.224+0000 7fe152000640 1 --2- 172.21.15.87:0/2027308901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe15c0cbf90 0x7fe15c0c5850 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe14400e8a0 tx=0x7fe14400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:12.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.224+0000 7fe153400640 1 -- 172.21.15.87:0/2027308901 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe144017070 con 0x7fe15c0cbf90 2024-05-27T06:30:12.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.224+0000 7fe153400640 1 -- 172.21.15.87:0/2027308901 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe14400c940 con 0x7fe15c0cbf90 2024-05-27T06:30:12.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.224+0000 7fe153400640 1 -- 172.21.15.87:0/2027308901 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14400ccf0 con 0x7fe15c0cbf90 2024-05-27T06:30:12.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.224+0000 7fe161c00640 1 -- 172.21.15.87:0/2027308901 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe15c09ae80 con 0x7fe15c0cbf90 2024-05-27T06:30:12.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.224+0000 7fe161c00640 1 -- 172.21.15.87:0/2027308901 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe15c0c98c0 con 0x7fe15c0cbf90 2024-05-27T06:30:12.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.224+0000 7fe161c00640 1 -- 172.21.15.87:0/2027308901 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe15c06aa30 con 0x7fe15c0cbf90 2024-05-27T06:30:12.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.228+0000 7fe153400640 1 -- 172.21.15.87:0/2027308901 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe14401a070 con 0x7fe15c0cbf90 2024-05-27T06:30:12.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.228+0000 7fe153400640 1 --2- 172.21.15.87:0/2027308901 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe13806f430 0x7fe138071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:12.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.228+0000 7fe153400640 1 -- 172.21.15.87:0/2027308901 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7fe14408f090 con 0x7fe15c0cbf90 2024-05-27T06:30:12.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.228+0000 7fe15aa00640 1 --2- 172.21.15.87:0/2027308901 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe13806f430 0x7fe138071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:12.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.228+0000 7fe15aa00640 1 --2- 172.21.15.87:0/2027308901 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe13806f430 0x7fe138071940 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe14c0b2000 tx=0x7fe14c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:12.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.232+0000 7fe153400640 1 -- 172.21.15.87:0/2027308901 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe14405ba00 con 0x7fe15c0cbf90 2024-05-27T06:30:12.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.388+0000 7fe161c00640 1 -- 172.21.15.87:0/2027308901 --> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe15c15d250 con 0x7fe13806f430 2024-05-27T06:30:12.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.388+0000 7fe153400640 1 -- 172.21.15.87:0/2027308901 <== mgr.4111 v2:172.21.15.87:6832/2724754260 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13390 (secure 0 0 0) 0x7fe14c0a8790 con 0x7fe13806f430 2024-05-27T06:30:12.388 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:30:12.388 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-27T06:30:12.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.392+0000 7fe161c00640 1 -- 172.21.15.87:0/2027308901 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe13806f430 msgr2=0x7fe138071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:12.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.392+0000 7fe161c00640 1 --2- 172.21.15.87:0/2027308901 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe13806f430 0x7fe138071940 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe14c0b2000 tx=0x7fe14c008040 comp rx=0 tx=0).stop 2024-05-27T06:30:12.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.392+0000 7fe161c00640 1 -- 172.21.15.87:0/2027308901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe15c0cbf90 msgr2=0x7fe15c0c5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:12.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.392+0000 7fe161c00640 1 --2- 172.21.15.87:0/2027308901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe15c0cbf90 0x7fe15c0c5850 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe14400e8a0 tx=0x7fe14400eca0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.392+0000 7fe161c00640 1 -- 172.21.15.87:0/2027308901 shutdown_connections 2024-05-27T06:30:12.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.392+0000 7fe161c00640 1 --2- 172.21.15.87:0/2027308901 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe13806f430 0x7fe138071940 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.392+0000 7fe161c00640 1 --2- 172.21.15.87:0/2027308901 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe15c15d520 0x7fe15c0ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.392+0000 7fe161c00640 1 --2- 172.21.15.87:0/2027308901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe15c0cbf90 0x7fe15c0c5850 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.392+0000 7fe161c00640 1 --2- 172.21.15.87:0/2027308901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe15c06d500 0x7fe15c09a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.392+0000 7fe161c00640 1 -- 172.21.15.87:0/2027308901 >> 172.21.15.87:0/2027308901 conn(0x7fe15c0b46b0 msgr2=0x7fe15c0b0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:12.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.392+0000 7fe161c00640 1 -- 172.21.15.87:0/2027308901 shutdown_connections 2024-05-27T06:30:12.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.392+0000 7fe161c00640 1 -- 172.21.15.87:0/2027308901 wait complete. 2024-05-27T06:30:12.410 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2024-05-27T06:30:10.601320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226612,"kb_used_data":6304,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748108,"statfs":{"total":773094113280,"available":772862062592,"internally_reserved":0,"allocated":6455296,"data_stored":3554546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12150,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-62,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001235"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":173,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-27T06:29:34.426212+0000","last_change":"2024-05-27T06:27:28.692457+0000","last_active":"2024-05-27T06:29:34.426212+0000","last_peered":"2024-05-27T06:29:34.426212+0000","last_clean":"2024-05-27T06:29:34.426212+0000","last_became_active":"2024-05-27T06:27:28.691290+0000","last_became_peered":"2024-05-27T06:27:28.691290+0000","last_unstale":"2024-05-27T06:29:34.426212+0000","last_undegraded":"2024-05-27T06:29:34.426212+0000","last_fullsized":"2024-05-27T06:29:34.426212+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_clean_scrub_stamp":"2024-05-27T06:27:26.991915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:45.563728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28240,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343600,"statfs":{"total":96636764160,"available":96607846400,"internally_reserved":0,"allocated":1249280,"data_stored":883521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":647168,"data_stored":292993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":293645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":671744,"data_stored":307128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":293049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":293049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":293083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1269760,"data_stored":898078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T06:30:12.410 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-27T06:30:12.410 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T06:30:12.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.560+0000 7f80af800640 1 Processor -- start 2024-05-27T06:30:12.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.560+0000 7f80af800640 1 -- start start 2024-05-27T06:30:12.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.560+0000 7f80af800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f80a8072eb0 0x7f80a80d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:12.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.560+0000 7f80af800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f80a80d1c80 0x7f80a80ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:12.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.560+0000 7f80af800640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80a80d2090 con 0x7f80a8072aa0 2024-05-27T06:30:12.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.560+0000 7f80af800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f80a80cdd30 con 0x7f80a80d1c80 2024-05-27T06:30:12.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.560+0000 7f80af800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f80a80cd120 con 0x7f80a8072eb0 2024-05-27T06:30:12.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.560+0000 7f80ad800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f80a80d1c80 0x7f80a80ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:12.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.560+0000 7f80ad800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f80a80d1c80 0x7f80a80ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42110/0 (socket says 172.21.15.87:42110) 2024-05-27T06:30:12.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.560+0000 7f80ad800640 1 -- 172.21.15.87:0/2354178644 learned_addr learned my addr 172.21.15.87:0/2354178644 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:12.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.560+0000 7f809fe00640 1 --2- 172.21.15.87:0/2354178644 >> v2:172.21.15.149:3300/0 conn(0x7f80a8072eb0 0x7f80a80d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:12.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.560+0000 7f80ad800640 1 -- 172.21.15.87:0/2354178644 >> v2:172.21.15.149:3300/0 conn(0x7f80a8072eb0 msgr2=0x7f80a80d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:12.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.560+0000 7f80ad800640 1 --2- 172.21.15.87:0/2354178644 >> v2:172.21.15.149:3300/0 conn(0x7f80a8072eb0 0x7f80a80d1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.560+0000 7f80ad800640 1 -- 172.21.15.87:0/2354178644 >> v1:172.21.15.149:6789/0 conn(0x7f80a8072aa0 legacy=0x7f80a806d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:12.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.560+0000 7f80ad800640 1 -- 172.21.15.87:0/2354178644 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a80cd400 con 0x7f80a80d1c80 2024-05-27T06:30:12.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.564+0000 7f80ad800640 1 --2- 172.21.15.87:0/2354178644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a80d1c80 0x7f80a80ce1c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f80a8071f90 tx=0x7f80a001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e0c88e779b066ab server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:12.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.564+0000 7f80a7e00640 1 -- 172.21.15.87:0/2354178644 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a00a5880 con 0x7f80a80d1c80 2024-05-27T06:30:12.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.564+0000 7f80a7e00640 1 -- 172.21.15.87:0/2354178644 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80a00a5a20 con 0x7f80a80d1c80 2024-05-27T06:30:12.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.564+0000 7f80a7e00640 1 -- 172.21.15.87:0/2354178644 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a00a5df0 con 0x7f80a80d1c80 2024-05-27T06:30:12.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.564+0000 7f80af800640 1 -- 172.21.15.87:0/2354178644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a80d1c80 msgr2=0x7f80a80ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:12.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.564+0000 7f80af800640 1 --2- 172.21.15.87:0/2354178644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a80d1c80 0x7f80a80ce1c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f80a8071f90 tx=0x7f80a001c9c0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.564+0000 7f80af800640 1 -- 172.21.15.87:0/2354178644 shutdown_connections 2024-05-27T06:30:12.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.564+0000 7f80af800640 1 --2- 172.21.15.87:0/2354178644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a80d1c80 0x7f80a80ce1c0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.564+0000 7f80af800640 1 --2- 172.21.15.87:0/2354178644 >> v2:172.21.15.149:3300/0 conn(0x7f80a8072eb0 0x7f80a80d1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.564+0000 7f80af800640 1 -- 172.21.15.87:0/2354178644 >> 172.21.15.87:0/2354178644 conn(0x7f80a80b46b0 msgr2=0x7f80a80b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:12.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.564+0000 7f80af800640 1 -- 172.21.15.87:0/2354178644 shutdown_connections 2024-05-27T06:30:12.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.564+0000 7f80af800640 1 -- 172.21.15.87:0/2354178644 wait complete. 2024-05-27T06:30:12.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.568+0000 7f80af800640 1 Processor -- start 2024-05-27T06:30:12.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.568+0000 7f80af800640 1 -- start start 2024-05-27T06:30:12.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.568+0000 7f80af800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a8072aa0 0x7f80a80c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:12.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.568+0000 7f80af800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80a8072eb0 0x7f80a815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:12.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.568+0000 7f80af800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80a80d1c80 0x7f80a815cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:12.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.568+0000 7f80af800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f80a80cccb0 con 0x7f80a8072aa0 2024-05-27T06:30:12.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.568+0000 7f80af800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f80a806df30 con 0x7f80a80d1c80 2024-05-27T06:30:12.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.568+0000 7f80af800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f80a80cce30 con 0x7f80a8072eb0 2024-05-27T06:30:12.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.568+0000 7f80ace00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a8072aa0 0x7f80a80c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:12.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.568+0000 7f80ace00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a8072aa0 0x7f80a80c6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42126/0 (socket says 172.21.15.87:42126) 2024-05-27T06:30:12.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.568+0000 7f80ace00640 1 -- 172.21.15.87:0/484927409 learned_addr learned my addr 172.21.15.87:0/484927409 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:12.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.568+0000 7f809fe00640 1 --2- 172.21.15.87:0/484927409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80a8072eb0 0x7f80a815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:12.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.568+0000 7f80ad800640 1 --2- 172.21.15.87:0/484927409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80a80d1c80 0x7f80a815cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:12.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.568+0000 7f80ace00640 1 -- 172.21.15.87:0/484927409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80a8072eb0 msgr2=0x7f80a815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:12.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.568+0000 7f80ace00640 1 --2- 172.21.15.87:0/484927409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80a8072eb0 0x7f80a815ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.568+0000 7f80ace00640 1 -- 172.21.15.87:0/484927409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80a80d1c80 msgr2=0x7f80a815cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:12.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.568+0000 7f80ace00640 1 --2- 172.21.15.87:0/484927409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80a80d1c80 0x7f80a815cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.568+0000 7f80ace00640 1 -- 172.21.15.87:0/484927409 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a815bfd0 con 0x7f80a8072aa0 2024-05-27T06:30:12.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.568+0000 7f80ace00640 1 --2- 172.21.15.87:0/484927409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a8072aa0 0x7f80a80c6b60 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f809800c3f0 tx=0x7f809800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:12.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.568+0000 7f80a5600640 1 -- 172.21.15.87:0/484927409 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8098017070 con 0x7f80a8072aa0 2024-05-27T06:30:12.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.568+0000 7f80a5600640 1 -- 172.21.15.87:0/484927409 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80980052d0 con 0x7f80a8072aa0 2024-05-27T06:30:12.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.568+0000 7f80a5600640 1 -- 172.21.15.87:0/484927409 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8098003820 con 0x7f80a8072aa0 2024-05-27T06:30:12.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.568+0000 7f80af800640 1 -- 172.21.15.87:0/484927409 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80a80cb090 con 0x7f80a8072aa0 2024-05-27T06:30:12.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.568+0000 7f80af800640 1 -- 172.21.15.87:0/484927409 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80a815c570 con 0x7f80a8072aa0 2024-05-27T06:30:12.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.572+0000 7f80af800640 1 -- 172.21.15.87:0/484927409 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80a815be00 con 0x7f80a8072aa0 2024-05-27T06:30:12.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.572+0000 7f80a5600640 1 -- 172.21.15.87:0/484927409 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f809801a070 con 0x7f80a8072aa0 2024-05-27T06:30:12.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.572+0000 7f80a5600640 1 --2- 172.21.15.87:0/484927409 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f808406f400 0x7f8084071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:12.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.572+0000 7f80a5600640 1 -- 172.21.15.87:0/484927409 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f809808e450 con 0x7f80a8072aa0 2024-05-27T06:30:12.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.572+0000 7f809fe00640 1 --2- 172.21.15.87:0/484927409 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f808406f400 0x7f8084071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:12.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.572+0000 7f809fe00640 1 --2- 172.21.15.87:0/484927409 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f808406f400 0x7f8084071910 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f80a8158430 tx=0x7f8090008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:12.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.576+0000 7f80a5600640 1 -- 172.21.15.87:0/484927409 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f8098005480 con 0x7f80a8072aa0 2024-05-27T06:30:12.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.736+0000 7f80af800640 1 -- 172.21.15.87:0/484927409 --> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f80a806aa30 con 0x7f808406f400 2024-05-27T06:30:12.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.736+0000 7f80a5600640 1 -- 172.21.15.87:0/484927409 <== mgr.4111 v2:172.21.15.87:6832/2724754260 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13474 (secure 0 0 0) 0x7f80a806aa30 con 0x7f808406f400 2024-05-27T06:30:12.738 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:30:12.739 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-27T06:30:12.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.736+0000 7f80af800640 1 -- 172.21.15.87:0/484927409 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f808406f400 msgr2=0x7f8084071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:12.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.736+0000 7f80af800640 1 --2- 172.21.15.87:0/484927409 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f808406f400 0x7f8084071910 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f80a8158430 tx=0x7f8090008040 comp rx=0 tx=0).stop 2024-05-27T06:30:12.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.740+0000 7f80af800640 1 -- 172.21.15.87:0/484927409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a8072aa0 msgr2=0x7f80a80c6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:12.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.740+0000 7f80af800640 1 --2- 172.21.15.87:0/484927409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a8072aa0 0x7f80a80c6b60 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f809800c3f0 tx=0x7f809800c8b0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.740+0000 7f80af800640 1 -- 172.21.15.87:0/484927409 shutdown_connections 2024-05-27T06:30:12.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.740+0000 7f80af800640 1 --2- 172.21.15.87:0/484927409 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f808406f400 0x7f8084071910 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.740+0000 7f80af800640 1 --2- 172.21.15.87:0/484927409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80a80d1c80 0x7f80a815cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.740+0000 7f80af800640 1 --2- 172.21.15.87:0/484927409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80a8072eb0 0x7f80a815ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.740+0000 7f80af800640 1 --2- 172.21.15.87:0/484927409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a8072aa0 0x7f80a80c6b60 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.740+0000 7f80af800640 1 -- 172.21.15.87:0/484927409 >> 172.21.15.87:0/484927409 conn(0x7f80a80b46b0 msgr2=0x7f80a8167f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:12.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.740+0000 7f80af800640 1 -- 172.21.15.87:0/484927409 shutdown_connections 2024-05-27T06:30:12.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.740+0000 7f80af800640 1 -- 172.21.15.87:0/484927409 wait complete. 2024-05-27T06:30:12.756 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-05-27T06:30:12.601801+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":226896,"kb_used_data":6568,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747824,"statfs":{"total":773094113280,"available":772861771776,"internally_reserved":0,"allocated":6725632,"data_stored":3675280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12150,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-62,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001268"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":179,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-05-27T06:30:10.184567+0000","last_change":"2024-05-27T06:27:28.692457+0000","last_active":"2024-05-27T06:30:10.184567+0000","last_peered":"2024-05-27T06:30:10.184567+0000","last_clean":"2024-05-27T06:30:10.184567+0000","last_became_active":"2024-05-27T06:27:28.691290+0000","last_became_peered":"2024-05-27T06:27:28.691290+0000","last_unstale":"2024-05-27T06:30:10.184567+0000","last_undegraded":"2024-05-27T06:30:10.184567+0000","last_fullsized":"2024-05-27T06:30:10.184567+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_clean_scrub_stamp":"2024-05-27T06:27:26.991915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:45.563728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28276,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343564,"statfs":{"total":96636764160,"available":96607809536,"internally_reserved":0,"allocated":1286144,"data_stored":902186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":311818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":311818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":311818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":311818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":311818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":311818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1286144,"data_stored":902186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T06:30:12.757 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T06:30:12.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.904+0000 7f7e5cc00640 1 Processor -- start 2024-05-27T06:30:12.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.904+0000 7f7e5cc00640 1 -- start start 2024-05-27T06:30:12.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.904+0000 7f7e5cc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e580cbf90 0x7f7e5806cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:12.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.904+0000 7f7e5cc00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7e5806d500 0x7f7e5815cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:12.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.908+0000 7f7e5cc00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e5815d930 con 0x7f7e5815d520 2024-05-27T06:30:12.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.908+0000 7f7e5cc00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f7e5806d910 con 0x7f7e5806d500 2024-05-27T06:30:12.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.908+0000 7f7e5cc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7e5815dbb0 con 0x7f7e580cbf90 2024-05-27T06:30:12.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.908+0000 7f7e55e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e580cbf90 0x7f7e5806cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:12.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.908+0000 7f7e4fe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7e5806d500 0x7f7e5815cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:12.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.908+0000 7f7e55e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e580cbf90 0x7f7e5806cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.87:34972/0 (socket says 172.21.15.87:34972) 2024-05-27T06:30:12.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.908+0000 7f7e55e00640 1 -- 172.21.15.87:0/3585909623 learned_addr learned my addr 172.21.15.87:0/3585909623 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:12.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.908+0000 7f7e56800640 1 --1- 172.21.15.87:0/3585909623 >> v1:172.21.15.149:6789/0 conn(0x7f7e5815d520 0x7f7e580d1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.87:35314/0 (socket says 172.21.15.87:35314) 2024-05-27T06:30:12.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.908+0000 7f7e4fe00640 1 -- 172.21.15.87:0/3585909623 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e580cbf90 msgr2=0x7f7e5806cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:12.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.908+0000 7f7e4fe00640 1 --2- 172.21.15.87:0/3585909623 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e580cbf90 0x7f7e5806cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.908+0000 7f7e4fe00640 1 -- 172.21.15.87:0/3585909623 >> v1:172.21.15.149:6789/0 conn(0x7f7e5815d520 legacy=0x7f7e580d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:12.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.908+0000 7f7e4fe00640 1 -- 172.21.15.87:0/3585909623 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e5815de90 con 0x7f7e5806d500 2024-05-27T06:30:12.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.908+0000 7f7e55e00640 1 --2- 172.21.15.87:0/3585909623 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e580cbf90 0x7f7e5806cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:30:12.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.908+0000 7f7e4fe00640 1 --2- 172.21.15.87:0/3585909623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e5806d500 0x7f7e5815cfe0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7e400097c0 tx=0x7f7e4001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ad560d2723b181e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:12.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.912+0000 7f7e55400640 1 -- 172.21.15.87:0/3585909623 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e400b0070 con 0x7f7e5806d500 2024-05-27T06:30:12.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.912+0000 7f7e55400640 1 -- 172.21.15.87:0/3585909623 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e400ab600 con 0x7f7e5806d500 2024-05-27T06:30:12.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.912+0000 7f7e55400640 1 -- 172.21.15.87:0/3585909623 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e400ab9d0 con 0x7f7e5806d500 2024-05-27T06:30:12.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.912+0000 7f7e5cc00640 1 -- 172.21.15.87:0/3585909623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e5806d500 msgr2=0x7f7e5815cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:12.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.912+0000 7f7e5cc00640 1 --2- 172.21.15.87:0/3585909623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e5806d500 0x7f7e5815cfe0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7e400097c0 tx=0x7f7e4001c3c0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.912+0000 7f7e5cc00640 1 -- 172.21.15.87:0/3585909623 shutdown_connections 2024-05-27T06:30:12.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.912+0000 7f7e5cc00640 1 --2- 172.21.15.87:0/3585909623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e5806d500 0x7f7e5815cfe0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.912+0000 7f7e5cc00640 1 --2- 172.21.15.87:0/3585909623 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e580cbf90 0x7f7e5806cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.912+0000 7f7e5cc00640 1 -- 172.21.15.87:0/3585909623 >> 172.21.15.87:0/3585909623 conn(0x7f7e580b46b0 msgr2=0x7f7e580b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:12.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.912+0000 7f7e5cc00640 1 -- 172.21.15.87:0/3585909623 shutdown_connections 2024-05-27T06:30:12.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.912+0000 7f7e5cc00640 1 -- 172.21.15.87:0/3585909623 wait complete. 2024-05-27T06:30:12.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.912+0000 7f7e5cc00640 1 Processor -- start 2024-05-27T06:30:12.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.912+0000 7f7e5cc00640 1 -- start start 2024-05-27T06:30:12.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.916+0000 7f7e5cc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e5806d500 0x7f7e5816a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:12.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.916+0000 7f7e5cc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e580cbf90 0x7f7e5815a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:12.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.916+0000 7f7e5cc00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e5815d520 0x7f7e580cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:12.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.916+0000 7f7e5cc00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5815e170 con 0x7f7e5815d520 2024-05-27T06:30:12.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.916+0000 7f7e5cc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5806caa0 con 0x7f7e5806d500 2024-05-27T06:30:12.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.916+0000 7f7e5cc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7e580cc3a0 con 0x7f7e580cbf90 2024-05-27T06:30:12.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.916+0000 7f7e56800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e5815d520 0x7f7e580cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:12.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.916+0000 7f7e56800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e5815d520 0x7f7e580cd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42136/0 (socket says 172.21.15.87:42136) 2024-05-27T06:30:12.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.916+0000 7f7e56800640 1 -- 172.21.15.87:0/3731309941 learned_addr learned my addr 172.21.15.87:0/3731309941 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:12.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.916+0000 7f7e55e00640 1 --2- 172.21.15.87:0/3731309941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e5806d500 0x7f7e5816a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:12.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.916+0000 7f7e4fe00640 1 --2- 172.21.15.87:0/3731309941 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e580cbf90 0x7f7e5815a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:12.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.916+0000 7f7e56800640 1 -- 172.21.15.87:0/3731309941 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e580cbf90 msgr2=0x7f7e5815a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:12.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.916+0000 7f7e56800640 1 --2- 172.21.15.87:0/3731309941 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e580cbf90 0x7f7e5815a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.916+0000 7f7e56800640 1 -- 172.21.15.87:0/3731309941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e5806d500 msgr2=0x7f7e5816a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:12.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.916+0000 7f7e56800640 1 --2- 172.21.15.87:0/3731309941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e5806d500 0x7f7e5816a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:12.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.916+0000 7f7e56800640 1 -- 172.21.15.87:0/3731309941 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e580c7210 con 0x7f7e5815d520 2024-05-27T06:30:12.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.916+0000 7f7e4fe00640 1 --2- 172.21.15.87:0/3731309941 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e580cbf90 0x7f7e5815a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:30:12.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.916+0000 7f7e56800640 1 --2- 172.21.15.87:0/3731309941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e5815d520 0x7f7e580cd0f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7e50005820 tx=0x7f7e5000d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:12.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.916+0000 7f7e4e000640 1 -- 172.21.15.87:0/3731309941 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5001b070 con 0x7f7e5815d520 2024-05-27T06:30:12.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.916+0000 7f7e4e000640 1 -- 172.21.15.87:0/3731309941 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e5000db40 con 0x7f7e5815d520 2024-05-27T06:30:12.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.916+0000 7f7e5cc00640 1 -- 172.21.15.87:0/3731309941 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e5815ab20 con 0x7f7e5815d520 2024-05-27T06:30:12.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.916+0000 7f7e4e000640 1 -- 172.21.15.87:0/3731309941 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5000a0d0 con 0x7f7e5815d520 2024-05-27T06:30:12.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.916+0000 7f7e5cc00640 1 -- 172.21.15.87:0/3731309941 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e580c7960 con 0x7f7e5815d520 2024-05-27T06:30:12.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.916+0000 7f7e5cc00640 1 -- 172.21.15.87:0/3731309941 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e580c73e0 con 0x7f7e5815d520 2024-05-27T06:30:12.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.920+0000 7f7e4e000640 1 -- 172.21.15.87:0/3731309941 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7e5001e070 con 0x7f7e5815d520 2024-05-27T06:30:12.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.920+0000 7f7e4e000640 1 --2- 172.21.15.87:0/3731309941 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7e3406f400 0x7f7e34071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:12.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.920+0000 7f7e4e000640 1 -- 172.21.15.87:0/3731309941 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f7e50091ca0 con 0x7f7e5815d520 2024-05-27T06:30:12.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.920+0000 7f7e55e00640 1 --2- 172.21.15.87:0/3731309941 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7e3406f400 0x7f7e34071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:12.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.920+0000 7f7e55e00640 1 --2- 172.21.15.87:0/3731309941 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7e3406f400 0x7f7e34071910 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7e48006cb0 tx=0x7f7e48009240 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:12.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:12.924+0000 7f7e4e000640 1 -- 172.21.15.87:0/3731309941 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7e580c73e0 con 0x7f7e5815d520 2024-05-27T06:30:13.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:13.080+0000 7f7e5cc00640 1 -- 172.21.15.87:0/3731309941 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7e5806aa30 con 0x7f7e5815d520 2024-05-27T06:30:13.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:13.084+0000 7f7e4e000640 1 -- 172.21.15.87:0/3731309941 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+13281 (secure 0 0 0) 0x7f7e5815d930 con 0x7f7e5815d520 2024-05-27T06:30:13.081 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:30:13.081 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":57,"fsid":"0412686d-4f35-45cc-b082-ef9741c1aff5","created":"2024-05-27T06:27:13.417034+0000","modified":"2024-05-27T06:30:09.661923+0000","last_up_change":"2024-05-27T06:27:25.988592+0000","last_in_change":"2024-05-27T06:27:16.027009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T06:27:26.590191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1942691b-9f09-45e6-9661-e5537bda358d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6801","nonce":3674824716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6803","nonce":3674824716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6807","nonce":3674824716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3674824716},{"type":"v1","addr":"172.21.15.87:6805","nonce":3674824716}]},"public_addr":"172.21.15.87:6801/3674824716","cluster_addr":"172.21.15.87:6803/3674824716","heartbeat_back_addr":"172.21.15.87:6807/3674824716","heartbeat_front_addr":"172.21.15.87:6805/3674824716","state":["exists","up"]},{"osd":1,"uuid":"34ceb0c9-288b-4037-b12b-7cf8b62d050a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6809","nonce":2443981288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6811","nonce":2443981288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6815","nonce":2443981288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2443981288},{"type":"v1","addr":"172.21.15.87:6813","nonce":2443981288}]},"public_addr":"172.21.15.87:6809/2443981288","cluster_addr":"172.21.15.87:6811/2443981288","heartbeat_back_addr":"172.21.15.87:6815/2443981288","heartbeat_front_addr":"172.21.15.87:6813/2443981288","state":["exists","up"]},{"osd":2,"uuid":"cfcce718-4b57-41ae-850c-2aeb821a9d85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6819","nonce":1441249238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6823","nonce":1441249238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6831","nonce":1441249238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6825","nonce":1441249238},{"type":"v1","addr":"172.21.15.87:6827","nonce":1441249238}]},"public_addr":"172.21.15.87:6819/1441249238","cluster_addr":"172.21.15.87:6823/1441249238","heartbeat_back_addr":"172.21.15.87:6831/1441249238","heartbeat_front_addr":"172.21.15.87:6827/1441249238","state":["exists","up"]},{"osd":3,"uuid":"251dbcf6-28c4-42a5-9c5f-c2e460c367f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6818","nonce":1173805234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6822","nonce":1173805234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6829","nonce":1173805234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":1173805234},{"type":"v1","addr":"172.21.15.87:6826","nonce":1173805234}]},"public_addr":"172.21.15.87:6818/1173805234","cluster_addr":"172.21.15.87:6822/1173805234","heartbeat_back_addr":"172.21.15.87:6829/1173805234","heartbeat_front_addr":"172.21.15.87:6826/1173805234","state":["exists","up"]},{"osd":4,"uuid":"cc155182-8040-4288-ab2d-4879b3082a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6819","nonce":1551871079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6823","nonce":1551871079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6831","nonce":1551871079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":1551871079},{"type":"v1","addr":"172.21.15.149:6827","nonce":1551871079}]},"public_addr":"172.21.15.149:6819/1551871079","cluster_addr":"172.21.15.149:6823/1551871079","heartbeat_back_addr":"172.21.15.149:6831/1551871079","heartbeat_front_addr":"172.21.15.149:6827/1551871079","state":["exists","up"]},{"osd":5,"uuid":"fc0d13e6-0469-433b-95ec-faed22523759","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6818","nonce":582864816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6822","nonce":582864816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6830","nonce":582864816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":582864816},{"type":"v1","addr":"172.21.15.149:6826","nonce":582864816}]},"public_addr":"172.21.15.149:6818/582864816","cluster_addr":"172.21.15.149:6822/582864816","heartbeat_back_addr":"172.21.15.149:6830/582864816","heartbeat_front_addr":"172.21.15.149:6826/582864816","state":["exists","up"]},{"osd":6,"uuid":"565ee760-c17d-429b-a5d6-c343857f0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6801","nonce":531351314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6803","nonce":531351314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6807","nonce":531351314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":531351314},{"type":"v1","addr":"172.21.15.149:6805","nonce":531351314}]},"public_addr":"172.21.15.149:6801/531351314","cluster_addr":"172.21.15.149:6803/531351314","heartbeat_back_addr":"172.21.15.149:6807/531351314","heartbeat_front_addr":"172.21.15.149:6805/531351314","state":["exists","up"]},{"osd":7,"uuid":"f9a90f18-a438-4836-b4ca-398ab37cc465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6809","nonce":1171039913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6811","nonce":1171039913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6815","nonce":1171039913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1171039913},{"type":"v1","addr":"172.21.15.149:6813","nonce":1171039913}]},"public_addr":"172.21.15.149:6809/1171039913","cluster_addr":"172.21.15.149:6811/1171039913","heartbeat_back_addr":"172.21.15.149:6815/1171039913","heartbeat_front_addr":"172.21.15.149:6813/1171039913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.589776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.819787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.767566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.683842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.038885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:22.120319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.687007+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T06:27:21.812832+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:6837/3958980223":"2024-05-28T06:30:06.655599+0000","172.21.15.87:6836/3958980223":"2024-05-28T06:30:06.655599+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T06:30:13.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:13.084+0000 7f7e5cc00640 1 -- 172.21.15.87:0/3731309941 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7e3406f400 msgr2=0x7f7e34071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:13.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:13.084+0000 7f7e5cc00640 1 --2- 172.21.15.87:0/3731309941 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7e3406f400 0x7f7e34071910 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7e48006cb0 tx=0x7f7e48009240 comp rx=0 tx=0).stop 2024-05-27T06:30:13.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:13.084+0000 7f7e5cc00640 1 -- 172.21.15.87:0/3731309941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e5815d520 msgr2=0x7f7e580cd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:13.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:13.084+0000 7f7e5cc00640 1 --2- 172.21.15.87:0/3731309941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e5815d520 0x7f7e580cd0f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7e50005820 tx=0x7f7e5000d430 comp rx=0 tx=0).stop 2024-05-27T06:30:13.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:13.084+0000 7f7e5cc00640 1 -- 172.21.15.87:0/3731309941 shutdown_connections 2024-05-27T06:30:13.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:13.084+0000 7f7e5cc00640 1 --2- 172.21.15.87:0/3731309941 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f7e3406f400 0x7f7e34071910 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:13.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:13.084+0000 7f7e5cc00640 1 --2- 172.21.15.87:0/3731309941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e5815d520 0x7f7e580cd0f0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:13.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:13.084+0000 7f7e5cc00640 1 --2- 172.21.15.87:0/3731309941 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e580cbf90 0x7f7e5815a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:13.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:13.084+0000 7f7e5cc00640 1 --2- 172.21.15.87:0/3731309941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e5806d500 0x7f7e5816a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:13.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:13.084+0000 7f7e5cc00640 1 -- 172.21.15.87:0/3731309941 >> 172.21.15.87:0/3731309941 conn(0x7f7e580b46b0 msgr2=0x7f7e580ce220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:13.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:13.084+0000 7f7e5cc00640 1 -- 172.21.15.87:0/3731309941 shutdown_connections 2024-05-27T06:30:13.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:13.084+0000 7f7e5cc00640 1 -- 172.21.15.87:0/3731309941 wait complete. 2024-05-27T06:30:14.104 INFO:tasks.ceph:Scrubbing osd.0 2024-05-27T06:30:14.105 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-27T06:30:14.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.268+0000 7f5621600640 1 Processor -- start 2024-05-27T06:30:14.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.268+0000 7f5621600640 1 -- start start 2024-05-27T06:30:14.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.268+0000 7f5621600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f561c15d350 0x7f561c0cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:14.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.268+0000 7f5621600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f561c0ce220 0x7f561c06c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:14.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.268+0000 7f5621600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f561c06db10 con 0x7f561c15c3f0 2024-05-27T06:30:14.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.268+0000 7f5621600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f561c0ce630 con 0x7f561c0ce220 2024-05-27T06:30:14.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.268+0000 7f5621600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f561c15d760 con 0x7f561c15d350 2024-05-27T06:30:14.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.272+0000 7f561b400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f561c0ce220 0x7f561c06c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:14.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.272+0000 7f561a000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f561c15d350 0x7f561c0cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:14.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.272+0000 7f561b400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f561c0ce220 0x7f561c06c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:60714/0 (socket says 172.21.15.87:60714) 2024-05-27T06:30:14.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.272+0000 7f561b400640 1 -- 172.21.15.87:0/631597370 learned_addr learned my addr 172.21.15.87:0/631597370 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:14.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.272+0000 7f561aa00640 1 --1- 172.21.15.87:0/631597370 >> v1:172.21.15.149:6789/0 conn(0x7f561c15c3f0 0x7f561c160740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.87:35328/0 (socket says 172.21.15.87:35328) 2024-05-27T06:30:14.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.272+0000 7f561b400640 1 -- 172.21.15.87:0/631597370 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f561c15d350 msgr2=0x7f561c0cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:14.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.272+0000 7f561b400640 1 --2- 172.21.15.87:0/631597370 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f561c15d350 0x7f561c0cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:14.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.272+0000 7f561b400640 1 -- 172.21.15.87:0/631597370 >> v1:172.21.15.149:6789/0 conn(0x7f561c15c3f0 legacy=0x7f561c160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:14.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.272+0000 7f561b400640 1 -- 172.21.15.87:0/631597370 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f561c0cf2a0 con 0x7f561c0ce220 2024-05-27T06:30:14.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.272+0000 7f561b400640 1 --2- 172.21.15.87:0/631597370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f561c0ce220 0x7f561c06c720 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5614009870 tx=0x7f561401c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fee782f82711959 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:14.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.276+0000 7f5619600640 1 -- 172.21.15.87:0/631597370 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56140b0070 con 0x7f561c0ce220 2024-05-27T06:30:14.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.276+0000 7f5619600640 1 -- 172.21.15.87:0/631597370 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56140ab600 con 0x7f561c0ce220 2024-05-27T06:30:14.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.276+0000 7f5619600640 1 -- 172.21.15.87:0/631597370 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56140ab9d0 con 0x7f561c0ce220 2024-05-27T06:30:14.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.276+0000 7f5621600640 1 -- 172.21.15.87:0/631597370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f561c0ce220 msgr2=0x7f561c06c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:14.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.276+0000 7f5621600640 1 --2- 172.21.15.87:0/631597370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f561c0ce220 0x7f561c06c720 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5614009870 tx=0x7f561401c390 comp rx=0 tx=0).stop 2024-05-27T06:30:14.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.276+0000 7f5621600640 1 -- 172.21.15.87:0/631597370 shutdown_connections 2024-05-27T06:30:14.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.276+0000 7f5621600640 1 --2- 172.21.15.87:0/631597370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f561c0ce220 0x7f561c06c720 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:14.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.276+0000 7f5621600640 1 --2- 172.21.15.87:0/631597370 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f561c15d350 0x7f561c0cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:14.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.276+0000 7f5621600640 1 -- 172.21.15.87:0/631597370 >> 172.21.15.87:0/631597370 conn(0x7f561c0b46b0 msgr2=0x7f561c0b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:14.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.276+0000 7f5621600640 1 -- 172.21.15.87:0/631597370 shutdown_connections 2024-05-27T06:30:14.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.276+0000 7f5621600640 1 -- 172.21.15.87:0/631597370 wait complete. 2024-05-27T06:30:14.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.276+0000 7f5621600640 1 Processor -- start 2024-05-27T06:30:14.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.276+0000 7f5621600640 1 -- start start 2024-05-27T06:30:14.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.280+0000 7f5621600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f561c0ce220 0x7f561c09c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:14.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.280+0000 7f5621600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f561c15c3f0 0x7f561c153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:14.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.280+0000 7f5621600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f561c15d350 0x7f561c0af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:14.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.280+0000 7f5621600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f561c06d070 con 0x7f561c15c3f0 2024-05-27T06:30:14.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.280+0000 7f5621600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f561c0cf860 con 0x7f561c0ce220 2024-05-27T06:30:14.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.280+0000 7f5621600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f561c09cc30 con 0x7f561c15d350 2024-05-27T06:30:14.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.280+0000 7f561a000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f561c15c3f0 0x7f561c153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:14.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.280+0000 7f561a000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f561c15c3f0 0x7f561c153800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42144/0 (socket says 172.21.15.87:42144) 2024-05-27T06:30:14.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.280+0000 7f561a000640 1 -- 172.21.15.87:0/4128120236 learned_addr learned my addr 172.21.15.87:0/4128120236 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:14.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.280+0000 7f561aa00640 1 --2- 172.21.15.87:0/4128120236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f561c0ce220 0x7f561c09c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:14.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.280+0000 7f561b400640 1 --2- 172.21.15.87:0/4128120236 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f561c15d350 0x7f561c0af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:14.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.280+0000 7f561a000640 1 -- 172.21.15.87:0/4128120236 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f561c15d350 msgr2=0x7f561c0af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:14.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.280+0000 7f561a000640 1 --2- 172.21.15.87:0/4128120236 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f561c15d350 0x7f561c0af580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:14.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.280+0000 7f561a000640 1 -- 172.21.15.87:0/4128120236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f561c0ce220 msgr2=0x7f561c09c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:14.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.280+0000 7f561a000640 1 --2- 172.21.15.87:0/4128120236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f561c0ce220 0x7f561c09c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:14.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.280+0000 7f561a000640 1 -- 172.21.15.87:0/4128120236 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f561c073e20 con 0x7f561c15c3f0 2024-05-27T06:30:14.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.280+0000 7f561a000640 1 --2- 172.21.15.87:0/4128120236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f561c15c3f0 0x7f561c153800 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f560800e870 tx=0x7f560800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:14.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.280+0000 7f5612a00640 1 -- 172.21.15.87:0/4128120236 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5608017070 con 0x7f561c15c3f0 2024-05-27T06:30:14.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.280+0000 7f5612a00640 1 -- 172.21.15.87:0/4128120236 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f560800c940 con 0x7f561c15c3f0 2024-05-27T06:30:14.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.280+0000 7f5612a00640 1 -- 172.21.15.87:0/4128120236 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560800ccf0 con 0x7f561c15c3f0 2024-05-27T06:30:14.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.280+0000 7f5621600640 1 -- 172.21.15.87:0/4128120236 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f561c0b1e60 con 0x7f561c15c3f0 2024-05-27T06:30:14.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.280+0000 7f5621600640 1 -- 172.21.15.87:0/4128120236 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f561c153da0 con 0x7f561c15c3f0 2024-05-27T06:30:14.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.280+0000 7f5621600640 1 -- 172.21.15.87:0/4128120236 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f561c1549f0 con 0x7f561c15c3f0 2024-05-27T06:30:14.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.284+0000 7f5612a00640 1 -- 172.21.15.87:0/4128120236 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f560801a070 con 0x7f561c15c3f0 2024-05-27T06:30:14.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.284+0000 7f5612a00640 1 --2- 172.21.15.87:0/4128120236 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f55fc06f430 0x7f55fc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:14.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.284+0000 7f5612a00640 1 -- 172.21.15.87:0/4128120236 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f560808f6c0 con 0x7f561c15c3f0 2024-05-27T06:30:14.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.284+0000 7f561aa00640 1 --2- 172.21.15.87:0/4128120236 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f55fc06f430 0x7f55fc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:14.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.284+0000 7f5612a00640 1 --2- 172.21.15.87:0/4128120236 >> [v2:172.21.15.87:6800/3674824716,v1:172.21.15.87:6801/3674824716] conn(0x7f55fc075920 0x7f55fc077db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:14.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.284+0000 7f5612a00640 1 -- 172.21.15.87:0/4128120236 --> [v2:172.21.15.87:6800/3674824716,v1:172.21.15.87:6801/3674824716] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5608016ec0 con 0x7f55fc075920 2024-05-27T06:30:14.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.284+0000 7f5612a00640 1 -- 172.21.15.87:0/4128120236 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f560808fa70 con 0x7f561c15c3f0 2024-05-27T06:30:14.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.284+0000 7f561b400640 1 --2- 172.21.15.87:0/4128120236 >> [v2:172.21.15.87:6800/3674824716,v1:172.21.15.87:6801/3674824716] conn(0x7f55fc075920 0x7f55fc077db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:14.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.284+0000 7f561aa00640 1 --2- 172.21.15.87:0/4128120236 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f55fc06f430 0x7f55fc071940 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f560c0012f0 tx=0x7f560c0019c0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:14.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.284+0000 7f561b400640 1 --2- 172.21.15.87:0/4128120236 >> [v2:172.21.15.87:6800/3674824716,v1:172.21.15.87:6801/3674824716] conn(0x7f55fc075920 0x7f55fc077db0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:14.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.284+0000 7f5612a00640 1 -- 172.21.15.87:0/4128120236 <== osd.0 v2:172.21.15.87:6800/3674824716 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5608016ec0 con 0x7f55fc075920 2024-05-27T06:30:14.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.300+0000 7f5621600640 1 -- 172.21.15.87:0/4128120236 --> [v2:172.21.15.87:6800/3674824716,v1:172.21.15.87:6801/3674824716] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f561c06aa30 con 0x7f55fc075920 2024-05-27T06:30:14.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.300+0000 7f5612a00640 1 -- 172.21.15.87:0/4128120236 <== osd.0 v2:172.21.15.87:6800/3674824716 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f561c06aa30 con 0x7f55fc075920 2024-05-27T06:30:14.298 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-27T06:30:14.298 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-27T06:30:14.298 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-27T06:30:14.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.300+0000 7f5621600640 1 -- 172.21.15.87:0/4128120236 >> [v2:172.21.15.87:6800/3674824716,v1:172.21.15.87:6801/3674824716] conn(0x7f55fc075920 msgr2=0x7f55fc077db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:14.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.300+0000 7f5621600640 1 --2- 172.21.15.87:0/4128120236 >> [v2:172.21.15.87:6800/3674824716,v1:172.21.15.87:6801/3674824716] conn(0x7f55fc075920 0x7f55fc077db0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:14.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.300+0000 7f5621600640 1 -- 172.21.15.87:0/4128120236 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f55fc06f430 msgr2=0x7f55fc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:14.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.300+0000 7f5621600640 1 --2- 172.21.15.87:0/4128120236 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f55fc06f430 0x7f55fc071940 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f560c0012f0 tx=0x7f560c0019c0 comp rx=0 tx=0).stop 2024-05-27T06:30:14.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.300+0000 7f5621600640 1 -- 172.21.15.87:0/4128120236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f561c15c3f0 msgr2=0x7f561c153800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:14.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.300+0000 7f5621600640 1 --2- 172.21.15.87:0/4128120236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f561c15c3f0 0x7f561c153800 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f560800e870 tx=0x7f560800ec70 comp rx=0 tx=0).stop 2024-05-27T06:30:14.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.300+0000 7f561b400640 1 -- 172.21.15.87:0/4128120236 reap_dead start 2024-05-27T06:30:14.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.300+0000 7f5621600640 1 -- 172.21.15.87:0/4128120236 shutdown_connections 2024-05-27T06:30:14.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.300+0000 7f5621600640 1 -- 172.21.15.87:0/4128120236 >> 172.21.15.87:0/4128120236 conn(0x7f561c0b46b0 msgr2=0x7f561c15cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:14.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.300+0000 7f5621600640 1 -- 172.21.15.87:0/4128120236 shutdown_connections 2024-05-27T06:30:14.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.300+0000 7f5621600640 1 -- 172.21.15.87:0/4128120236 wait complete. 2024-05-27T06:30:14.316 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-27T06:30:14.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.464+0000 7f1899000640 1 Processor -- start 2024-05-27T06:30:14.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.464+0000 7f1899000640 1 -- start start 2024-05-27T06:30:14.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.468+0000 7f1899000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f189415cbc0 0x7f18940af540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:14.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.468+0000 7f1899000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f189406ebd0 0x7f189406efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:14.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.468+0000 7f1899000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18940afa80 con 0x7f1894074330 2024-05-27T06:30:14.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.468+0000 7f1899000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f189415cfd0 con 0x7f189406ebd0 2024-05-27T06:30:14.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.468+0000 7f1899000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f189406c9b0 con 0x7f189415cbc0 2024-05-27T06:30:14.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.468+0000 7f1891400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f1894074330 0x7f1894074740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43054/0 (socket says 172.21.15.87:43054) 2024-05-27T06:30:14.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.468+0000 7f1891400640 1 -- 172.21.15.87:0/1174000925 learned_addr learned my addr 172.21.15.87:0/1174000925 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:30:14.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.468+0000 7f1892800640 1 --2- 172.21.15.87:0/1174000925 >> v2:172.21.15.149:3300/0 conn(0x7f189406ebd0 0x7f189406efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:14.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.468+0000 7f1891e00640 1 --2- 172.21.15.87:0/1174000925 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f189415cbc0 0x7f18940af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:14.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.468+0000 7f1890a00640 1 -- 172.21.15.87:0/1174000925 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4141891393 0 0) 0x7f18940afa80 con 0x7f1894074330 2024-05-27T06:30:14.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.468+0000 7f1890a00640 1 -- 172.21.15.87:0/1174000925 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1878003530 con 0x7f1894074330 2024-05-27T06:30:14.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.468+0000 7f1892800640 1 -- 172.21.15.87:0/1174000925 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f189415cbc0 msgr2=0x7f18940af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:14.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.468+0000 7f1892800640 1 --2- 172.21.15.87:0/1174000925 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f189415cbc0 0x7f18940af540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:14.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.468+0000 7f1892800640 1 -- 172.21.15.87:0/1174000925 >> v1:172.21.15.87:6789/0 conn(0x7f1894074330 legacy=0x7f1894074740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:14.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.468+0000 7f1892800640 1 -- 172.21.15.87:0/1174000925 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18940afd40 con 0x7f189406ebd0 2024-05-27T06:30:14.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.472+0000 7f1892800640 1 --2- 172.21.15.87:0/1174000925 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f189406ebd0 0x7f189406efe0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f188c0097c0 tx=0x7f188c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e332969a8fbf9be server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:14.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.472+0000 7f1890a00640 1 -- 172.21.15.87:0/1174000925 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188c0b0070 con 0x7f189406ebd0 2024-05-27T06:30:14.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.472+0000 7f1890a00640 1 -- 172.21.15.87:0/1174000925 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f188c0ab600 con 0x7f189406ebd0 2024-05-27T06:30:14.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.472+0000 7f1890a00640 1 -- 172.21.15.87:0/1174000925 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188c0ab9d0 con 0x7f189406ebd0 2024-05-27T06:30:14.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.472+0000 7f1899000640 1 -- 172.21.15.87:0/1174000925 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f189406ebd0 msgr2=0x7f189406efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:14.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.472+0000 7f1899000640 1 --2- 172.21.15.87:0/1174000925 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f189406ebd0 0x7f189406efe0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f188c0097c0 tx=0x7f188c01c410 comp rx=0 tx=0).stop 2024-05-27T06:30:14.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.472+0000 7f1899000640 1 -- 172.21.15.87:0/1174000925 shutdown_connections 2024-05-27T06:30:14.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.472+0000 7f1899000640 1 --2- 172.21.15.87:0/1174000925 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f189406ebd0 0x7f189406efe0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:14.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.472+0000 7f1899000640 1 --2- 172.21.15.87:0/1174000925 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f189415cbc0 0x7f18940af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:14.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.472+0000 7f1899000640 1 -- 172.21.15.87:0/1174000925 >> 172.21.15.87:0/1174000925 conn(0x7f18940b2fb0 msgr2=0x7f18940b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:14.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.472+0000 7f1899000640 1 -- 172.21.15.87:0/1174000925 shutdown_connections 2024-05-27T06:30:14.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.472+0000 7f1899000640 1 -- 172.21.15.87:0/1174000925 wait complete. 2024-05-27T06:30:14.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.476+0000 7f1899000640 1 Processor -- start 2024-05-27T06:30:14.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.476+0000 7f1899000640 1 -- start start 2024-05-27T06:30:14.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.476+0000 7f1899000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f189406ebd0 0x7f18940cf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:14.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.476+0000 7f1899000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1894074330 0x7f18940ce000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:14.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.476+0000 7f1899000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f189415cbc0 0x7f18940ce540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:14.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.476+0000 7f1899000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1894169c00 con 0x7f189406ebd0 2024-05-27T06:30:14.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.476+0000 7f1899000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1894169a80 con 0x7f189415cbc0 2024-05-27T06:30:14.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.476+0000 7f1899000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1894169d80 con 0x7f1894074330 2024-05-27T06:30:14.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.476+0000 7f1891e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f189406ebd0 0x7f18940cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:14.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.476+0000 7f1891e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f189406ebd0 0x7f18940cf080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42148/0 (socket says 172.21.15.87:42148) 2024-05-27T06:30:14.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.476+0000 7f1891e00640 1 -- 172.21.15.87:0/1986585749 learned_addr learned my addr 172.21.15.87:0/1986585749 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:14.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.476+0000 7f1891400640 1 --2- 172.21.15.87:0/1986585749 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1894074330 0x7f18940ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:14.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.476+0000 7f1891e00640 1 -- 172.21.15.87:0/1986585749 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1894074330 msgr2=0x7f18940ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:14.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.476+0000 7f1891e00640 1 --2- 172.21.15.87:0/1986585749 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1894074330 0x7f18940ce000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:14.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.476+0000 7f1891e00640 1 -- 172.21.15.87:0/1986585749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f189415cbc0 msgr2=0x7f18940ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:14.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.476+0000 7f1891e00640 1 --2- 172.21.15.87:0/1986585749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f189415cbc0 0x7f18940ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:14.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.476+0000 7f1891e00640 1 -- 172.21.15.87:0/1986585749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18941488d0 con 0x7f189406ebd0 2024-05-27T06:30:14.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.476+0000 7f1891e00640 1 --2- 172.21.15.87:0/1986585749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f189406ebd0 0x7f18940cf080 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1884009cd0 tx=0x7f188400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:14.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.476+0000 7f188a000640 1 -- 172.21.15.87:0/1986585749 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1884018020 con 0x7f189406ebd0 2024-05-27T06:30:14.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.476+0000 7f188a000640 1 -- 172.21.15.87:0/1986585749 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1884014480 con 0x7f189406ebd0 2024-05-27T06:30:14.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.476+0000 7f188a000640 1 -- 172.21.15.87:0/1986585749 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1884014850 con 0x7f189406ebd0 2024-05-27T06:30:14.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.476+0000 7f1899000640 1 -- 172.21.15.87:0/1986585749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1894155400 con 0x7f189406ebd0 2024-05-27T06:30:14.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.480+0000 7f1899000640 1 -- 172.21.15.87:0/1986585749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18941559c0 con 0x7f189406ebd0 2024-05-27T06:30:14.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.480+0000 7f1899000640 1 -- 172.21.15.87:0/1986585749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f189406aa30 con 0x7f189406ebd0 2024-05-27T06:30:14.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.480+0000 7f188a000640 1 -- 172.21.15.87:0/1986585749 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f188401b020 con 0x7f189406ebd0 2024-05-27T06:30:14.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.480+0000 7f188a000640 1 --2- 172.21.15.87:0/1986585749 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f187406f400 0x7f1874071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:14.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.480+0000 7f188a000640 1 -- 172.21.15.87:0/1986585749 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f1884090210 con 0x7f189406ebd0 2024-05-27T06:30:14.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.480+0000 7f1891400640 1 --2- 172.21.15.87:0/1986585749 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f187406f400 0x7f1874071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:14.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.484+0000 7f1891400640 1 --2- 172.21.15.87:0/1986585749 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f187406f400 0x7f1874071910 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1880007a70 tx=0x7f1880009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:14.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.484+0000 7f188a000640 1 -- 172.21.15.87:0/1986585749 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f1884022030 con 0x7f189406ebd0 2024-05-27T06:30:14.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.640+0000 7f1899000640 1 -- 172.21.15.87:0/1986585749 --> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f18940b3ba0 con 0x7f187406f400 2024-05-27T06:30:14.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.640+0000 7f188a000640 1 -- 172.21.15.87:0/1986585749 <== mgr.4111 v2:172.21.15.87:6832/2724754260 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f18940b3ba0 con 0x7f187406f400 2024-05-27T06:30:14.641 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 0 to deep-scrub 2024-05-27T06:30:14.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.644+0000 7f1899000640 1 -- 172.21.15.87:0/1986585749 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f187406f400 msgr2=0x7f1874071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:14.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.644+0000 7f1899000640 1 --2- 172.21.15.87:0/1986585749 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f187406f400 0x7f1874071910 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1880007a70 tx=0x7f1880009040 comp rx=0 tx=0).stop 2024-05-27T06:30:14.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.644+0000 7f1899000640 1 -- 172.21.15.87:0/1986585749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f189406ebd0 msgr2=0x7f18940cf080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:14.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.644+0000 7f1899000640 1 --2- 172.21.15.87:0/1986585749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f189406ebd0 0x7f18940cf080 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1884009cd0 tx=0x7f188400c490 comp rx=0 tx=0).stop 2024-05-27T06:30:14.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.644+0000 7f1899000640 1 -- 172.21.15.87:0/1986585749 shutdown_connections 2024-05-27T06:30:14.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.644+0000 7f1899000640 1 --2- 172.21.15.87:0/1986585749 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f187406f400 0x7f1874071910 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:14.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.644+0000 7f1899000640 1 --2- 172.21.15.87:0/1986585749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f189415cbc0 0x7f18940ce540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:14.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.644+0000 7f1899000640 1 --2- 172.21.15.87:0/1986585749 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1894074330 0x7f18940ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:14.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.644+0000 7f1899000640 1 --2- 172.21.15.87:0/1986585749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f189406ebd0 0x7f18940cf080 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:14.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.644+0000 7f1899000640 1 -- 172.21.15.87:0/1986585749 >> 172.21.15.87:0/1986585749 conn(0x7f18940b2fb0 msgr2=0x7f1894167180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:14.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.644+0000 7f1899000640 1 -- 172.21.15.87:0/1986585749 shutdown_connections 2024-05-27T06:30:14.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.644+0000 7f1899000640 1 -- 172.21.15.87:0/1986585749 wait complete. 2024-05-27T06:30:14.662 INFO:tasks.ceph:Scrubbing osd.1 2024-05-27T06:30:14.662 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-27T06:30:14.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.816+0000 7fad82000640 1 Processor -- start 2024-05-27T06:30:14.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.816+0000 7fad82000640 1 -- start start 2024-05-27T06:30:14.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.816+0000 7fad82000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fad7c06eb20 0x7fad7c06ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:14.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.816+0000 7fad82000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad7c0d1130 con 0x7fad7c1610c0 2024-05-27T06:30:14.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.816+0000 7fad82000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad7c0d0e50 con 0x7fad7c0d1700 2024-05-27T06:30:14.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.816+0000 7fad82000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fad7c161a00 con 0x7fad7c06eb20 2024-05-27T06:30:14.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.816+0000 7fad7be00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fad7c06eb20 0x7fad7c06ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:14.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.816+0000 7fad7b400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fad7c1610c0 0x7fad7c0d02d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40334/0 (socket says 172.21.15.87:40334) 2024-05-27T06:30:14.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.816+0000 7fad7b400640 1 -- 172.21.15.87:0/3253842113 learned_addr learned my addr 172.21.15.87:0/3253842113 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:30:14.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.816+0000 7fad7be00640 1 -- 172.21.15.87:0/3253842113 >> v1:172.21.15.149:6789/0 conn(0x7fad7c0d1700 legacy=0x7fad7c0d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:14.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.816+0000 7fad7be00640 1 -- 172.21.15.87:0/3253842113 >> v1:172.21.15.87:6789/0 conn(0x7fad7c1610c0 legacy=0x7fad7c0d02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:14.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.816+0000 7fad7be00640 1 -- 172.21.15.87:0/3253842113 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad7c161ce0 con 0x7fad7c06eb20 2024-05-27T06:30:14.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.816+0000 7fad7a000640 1 -- 172.21.15.87:0/3253842113 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3674594241 0 0) 0x7fad7c0d1130 con 0x7fad7c1610c0 2024-05-27T06:30:14.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.820+0000 7fad7be00640 1 --2- 172.21.15.87:0/3253842113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad7c06eb20 0x7fad7c06ef30 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fad740097c0 tx=0x7fad7401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30132077af253da7 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:14.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.820+0000 7fad7a000640 1 -- 172.21.15.87:0/3253842113 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad740aa600 con 0x7fad7c06eb20 2024-05-27T06:30:14.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.820+0000 7fad7a000640 1 -- 172.21.15.87:0/3253842113 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad740af070 con 0x7fad7c06eb20 2024-05-27T06:30:14.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.820+0000 7fad7a000640 1 -- 172.21.15.87:0/3253842113 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad740aa9c0 con 0x7fad7c06eb20 2024-05-27T06:30:14.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.820+0000 7fad82000640 1 -- 172.21.15.87:0/3253842113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad7c06eb20 msgr2=0x7fad7c06ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:14.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.820+0000 7fad82000640 1 --2- 172.21.15.87:0/3253842113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad7c06eb20 0x7fad7c06ef30 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fad740097c0 tx=0x7fad7401c4a0 comp rx=0 tx=0).stop 2024-05-27T06:30:14.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.820+0000 7fad82000640 1 -- 172.21.15.87:0/3253842113 shutdown_connections 2024-05-27T06:30:14.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.820+0000 7fad82000640 1 --2- 172.21.15.87:0/3253842113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad7c06eb20 0x7fad7c06ef30 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:14.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.820+0000 7fad82000640 1 -- 172.21.15.87:0/3253842113 >> 172.21.15.87:0/3253842113 conn(0x7fad7c0b46b0 msgr2=0x7fad7c0b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:14.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.820+0000 7fad82000640 1 -- 172.21.15.87:0/3253842113 shutdown_connections 2024-05-27T06:30:14.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.820+0000 7fad82000640 1 -- 172.21.15.87:0/3253842113 wait complete. 2024-05-27T06:30:14.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.824+0000 7fad82000640 1 Processor -- start 2024-05-27T06:30:14.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.824+0000 7fad82000640 1 -- start start 2024-05-27T06:30:14.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.824+0000 7fad82000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad7c06eb20 0x7fad7c146dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:14.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.824+0000 7fad82000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad7c0d1700 0x7fad7c0b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:14.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.824+0000 7fad82000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad7c1610c0 0x7fad7c15d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:14.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.824+0000 7fad82000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fad7c161650 con 0x7fad7c0d1700 2024-05-27T06:30:14.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.824+0000 7fad82000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fad7c1614d0 con 0x7fad7c06eb20 2024-05-27T06:30:14.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.824+0000 7fad82000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fad7c0d09e0 con 0x7fad7c1610c0 2024-05-27T06:30:14.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.824+0000 7fad7aa00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad7c0d1700 0x7fad7c0b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:14.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.824+0000 7fad7aa00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad7c0d1700 0x7fad7c0b0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42128/0 (socket says 172.21.15.87:42128) 2024-05-27T06:30:14.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.824+0000 7fad7aa00640 1 -- 172.21.15.87:0/2453954113 learned_addr learned my addr 172.21.15.87:0/2453954113 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:14.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.824+0000 7fad7b400640 1 --2- 172.21.15.87:0/2453954113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad7c06eb20 0x7fad7c146dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:14.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.824+0000 7fad7be00640 1 --2- 172.21.15.87:0/2453954113 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad7c1610c0 0x7fad7c15d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:14.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.824+0000 7fad7aa00640 1 -- 172.21.15.87:0/2453954113 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad7c1610c0 msgr2=0x7fad7c15d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:14.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.824+0000 7fad7aa00640 1 --2- 172.21.15.87:0/2453954113 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad7c1610c0 0x7fad7c15d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:14.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.824+0000 7fad7aa00640 1 -- 172.21.15.87:0/2453954113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad7c06eb20 msgr2=0x7fad7c146dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:14.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.824+0000 7fad7aa00640 1 --2- 172.21.15.87:0/2453954113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad7c06eb20 0x7fad7c146dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:14.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.824+0000 7fad7aa00640 1 -- 172.21.15.87:0/2453954113 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad7c0af700 con 0x7fad7c0d1700 2024-05-27T06:30:14.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.828+0000 7fad7be00640 1 --2- 172.21.15.87:0/2453954113 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad7c1610c0 0x7fad7c15d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:30:14.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.828+0000 7fad7aa00640 1 --2- 172.21.15.87:0/2453954113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad7c0d1700 0x7fad7c0b0be0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fad6800c420 tx=0x7fad6800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:14.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.828+0000 7fad73400640 1 -- 172.21.15.87:0/2453954113 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad68017070 con 0x7fad7c0d1700 2024-05-27T06:30:14.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.828+0000 7fad73400640 1 -- 172.21.15.87:0/2453954113 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad680052d0 con 0x7fad7c0d1700 2024-05-27T06:30:14.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.828+0000 7fad82000640 1 -- 172.21.15.87:0/2453954113 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad7c0b3600 con 0x7fad7c0d1700 2024-05-27T06:30:14.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.828+0000 7fad73400640 1 -- 172.21.15.87:0/2453954113 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad68003820 con 0x7fad7c0d1700 2024-05-27T06:30:14.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.828+0000 7fad82000640 1 -- 172.21.15.87:0/2453954113 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad7c0b3bc0 con 0x7fad7c0d1700 2024-05-27T06:30:14.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.828+0000 7fad82000640 1 -- 172.21.15.87:0/2453954113 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fad7c06aa30 con 0x7fad7c0d1700 2024-05-27T06:30:14.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.828+0000 7fad73400640 1 -- 172.21.15.87:0/2453954113 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fad6801a070 con 0x7fad7c0d1700 2024-05-27T06:30:14.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.828+0000 7fad73400640 1 --2- 172.21.15.87:0/2453954113 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fad5c06f430 0x7fad5c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:14.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.828+0000 7fad73400640 1 -- 172.21.15.87:0/2453954113 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7fad6808eb30 con 0x7fad7c0d1700 2024-05-27T06:30:14.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.828+0000 7fad7b400640 1 --2- 172.21.15.87:0/2453954113 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fad5c06f430 0x7fad5c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:14.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.828+0000 7fad73400640 1 --2- 172.21.15.87:0/2453954113 >> [v2:172.21.15.87:6808/2443981288,v1:172.21.15.87:6809/2443981288] conn(0x7fad5c075920 0x7fad5c077db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:14.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.832+0000 7fad73400640 1 -- 172.21.15.87:0/2453954113 --> [v2:172.21.15.87:6808/2443981288,v1:172.21.15.87:6809/2443981288] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad68009e50 con 0x7fad5c075920 2024-05-27T06:30:14.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.832+0000 7fad73400640 1 -- 172.21.15.87:0/2453954113 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7fad6808efc0 con 0x7fad7c0d1700 2024-05-27T06:30:14.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.832+0000 7fad7be00640 1 --2- 172.21.15.87:0/2453954113 >> [v2:172.21.15.87:6808/2443981288,v1:172.21.15.87:6809/2443981288] conn(0x7fad5c075920 0x7fad5c077db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:14.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.832+0000 7fad7b400640 1 --2- 172.21.15.87:0/2453954113 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fad5c06f430 0x7fad5c071940 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fad6c005fd0 tx=0x7fad6c005c20 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:14.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.832+0000 7fad7be00640 1 --2- 172.21.15.87:0/2453954113 >> [v2:172.21.15.87:6808/2443981288,v1:172.21.15.87:6809/2443981288] conn(0x7fad5c075920 0x7fad5c077db0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:14.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.832+0000 7fad73400640 1 -- 172.21.15.87:0/2453954113 <== osd.1 v2:172.21.15.87:6808/2443981288 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fad68009e50 con 0x7fad5c075920 2024-05-27T06:30:14.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.844+0000 7fad82000640 1 -- 172.21.15.87:0/2453954113 --> [v2:172.21.15.87:6808/2443981288,v1:172.21.15.87:6809/2443981288] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fad7c0b33b0 con 0x7fad5c075920 2024-05-27T06:30:14.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.844+0000 7fad73400640 1 -- 172.21.15.87:0/2453954113 <== osd.1 v2:172.21.15.87:6808/2443981288 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fad7c0b33b0 con 0x7fad5c075920 2024-05-27T06:30:14.844 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-27T06:30:14.844 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-27T06:30:14.844 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-27T06:30:14.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.844+0000 7fad82000640 1 -- 172.21.15.87:0/2453954113 >> [v2:172.21.15.87:6808/2443981288,v1:172.21.15.87:6809/2443981288] conn(0x7fad5c075920 msgr2=0x7fad5c077db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:14.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.844+0000 7fad82000640 1 --2- 172.21.15.87:0/2453954113 >> [v2:172.21.15.87:6808/2443981288,v1:172.21.15.87:6809/2443981288] conn(0x7fad5c075920 0x7fad5c077db0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:14.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.844+0000 7fad82000640 1 -- 172.21.15.87:0/2453954113 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fad5c06f430 msgr2=0x7fad5c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:14.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.844+0000 7fad82000640 1 --2- 172.21.15.87:0/2453954113 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fad5c06f430 0x7fad5c071940 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fad6c005fd0 tx=0x7fad6c005c20 comp rx=0 tx=0).stop 2024-05-27T06:30:14.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.844+0000 7fad82000640 1 -- 172.21.15.87:0/2453954113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad7c0d1700 msgr2=0x7fad7c0b0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:14.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.844+0000 7fad82000640 1 --2- 172.21.15.87:0/2453954113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad7c0d1700 0x7fad7c0b0be0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fad6800c420 tx=0x7fad6800c8e0 comp rx=0 tx=0).stop 2024-05-27T06:30:14.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.844+0000 7fad7be00640 1 -- 172.21.15.87:0/2453954113 reap_dead start 2024-05-27T06:30:14.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.844+0000 7fad82000640 1 -- 172.21.15.87:0/2453954113 shutdown_connections 2024-05-27T06:30:14.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.844+0000 7fad82000640 1 -- 172.21.15.87:0/2453954113 >> 172.21.15.87:0/2453954113 conn(0x7fad7c0b46b0 msgr2=0x7fad7c160720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:14.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.844+0000 7fad82000640 1 -- 172.21.15.87:0/2453954113 shutdown_connections 2024-05-27T06:30:14.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:14.844+0000 7fad82000640 1 -- 172.21.15.87:0/2453954113 wait complete. 2024-05-27T06:30:14.864 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-27T06:30:15.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.012+0000 7ff38e600640 1 Processor -- start 2024-05-27T06:30:15.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.012+0000 7ff38e600640 1 -- start start 2024-05-27T06:30:15.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.012+0000 7ff38e600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff388160370 0x7ff388160780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:15.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.012+0000 7ff38e600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff38806fcf0 0x7ff388070100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:15.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.012+0000 7ff38e600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff388070640 con 0x7ff388073f30 2024-05-27T06:30:15.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.012+0000 7ff38e600640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7ff38815d720 con 0x7ff388160370 2024-05-27T06:30:15.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.012+0000 7ff38e600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7ff38815fee0 con 0x7ff38806fcf0 2024-05-27T06:30:15.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.016+0000 7ff37ea00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff388160370 0x7ff388160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:15.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.016+0000 7ff37ea00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff388160370 0x7ff388160780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42142/0 (socket says 172.21.15.87:42142) 2024-05-27T06:30:15.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.016+0000 7ff37ea00640 1 -- 172.21.15.87:0/618518363 learned_addr learned my addr 172.21.15.87:0/618518363 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:15.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.016+0000 7ff37ea00640 1 -- 172.21.15.87:0/618518363 >> v2:172.21.15.149:3300/0 conn(0x7ff38806fcf0 msgr2=0x7ff388070100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-27T06:30:15.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.016+0000 7ff37ea00640 1 --2- 172.21.15.87:0/618518363 >> v2:172.21.15.149:3300/0 conn(0x7ff38806fcf0 0x7ff388070100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.016+0000 7ff37ea00640 1 -- 172.21.15.87:0/618518363 >> v1:172.21.15.149:6789/0 conn(0x7ff388073f30 legacy=0x7ff388072a70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-27T06:30:15.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.016+0000 7ff37ea00640 1 -- 172.21.15.87:0/618518363 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff38815ce80 con 0x7ff388160370 2024-05-27T06:30:15.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.016+0000 7ff37ea00640 1 --2- 172.21.15.87:0/618518363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff388160370 0x7ff388160780 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff388070d10 tx=0x7ff37001c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b28c4e6268add44f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:15.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.016+0000 7ff386a00640 1 -- 172.21.15.87:0/618518363 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3700b0070 con 0x7ff388160370 2024-05-27T06:30:15.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.016+0000 7ff386a00640 1 -- 172.21.15.87:0/618518363 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3700ab600 con 0x7ff388160370 2024-05-27T06:30:15.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.016+0000 7ff386a00640 1 -- 172.21.15.87:0/618518363 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3700ab9d0 con 0x7ff388160370 2024-05-27T06:30:15.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.020+0000 7ff38e600640 1 -- 172.21.15.87:0/618518363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff388160370 msgr2=0x7ff388160780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:15.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.020+0000 7ff38e600640 1 --2- 172.21.15.87:0/618518363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff388160370 0x7ff388160780 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff388070d10 tx=0x7ff37001c2d0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.020+0000 7ff38e600640 1 -- 172.21.15.87:0/618518363 shutdown_connections 2024-05-27T06:30:15.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.020+0000 7ff38e600640 1 --2- 172.21.15.87:0/618518363 >> v2:172.21.15.149:3300/0 conn(0x7ff38806fcf0 0x7ff388070100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.020+0000 7ff38e600640 1 --2- 172.21.15.87:0/618518363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff388160370 0x7ff388160780 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.020+0000 7ff38e600640 1 -- 172.21.15.87:0/618518363 >> 172.21.15.87:0/618518363 conn(0x7ff3880b2fb0 msgr2=0x7ff3880b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:15.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.020+0000 7ff38e600640 1 -- 172.21.15.87:0/618518363 shutdown_connections 2024-05-27T06:30:15.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.020+0000 7ff38e600640 1 -- 172.21.15.87:0/618518363 wait complete. 2024-05-27T06:30:15.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.020+0000 7ff38e600640 1 Processor -- start 2024-05-27T06:30:15.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.020+0000 7ff38e600640 1 -- start start 2024-05-27T06:30:15.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.024+0000 7ff38e600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff38806fcf0 0x7ff388146e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:15.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.024+0000 7ff38e600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff388073f30 0x7ff3880ce820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:15.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.024+0000 7ff38e600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff388160370 0x7ff38814bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:15.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.024+0000 7ff38e600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff388073180 con 0x7ff388160370 2024-05-27T06:30:15.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.024+0000 7ff38e600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff388156a40 con 0x7ff38806fcf0 2024-05-27T06:30:15.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.024+0000 7ff38e600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff38814c8b0 con 0x7ff388073f30 2024-05-27T06:30:15.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.024+0000 7ff387e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff388160370 0x7ff38814bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:15.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.024+0000 7ff387e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff388160370 0x7ff38814bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42146/0 (socket says 172.21.15.87:42146) 2024-05-27T06:30:15.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.024+0000 7ff387e00640 1 -- 172.21.15.87:0/2612488781 learned_addr learned my addr 172.21.15.87:0/2612488781 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:15.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.024+0000 7ff37ea00640 1 --2- 172.21.15.87:0/2612488781 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff388073f30 0x7ff3880ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:15.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.024+0000 7ff387400640 1 --2- 172.21.15.87:0/2612488781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff38806fcf0 0x7ff388146e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:15.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.024+0000 7ff387e00640 1 -- 172.21.15.87:0/2612488781 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff388073f30 msgr2=0x7ff3880ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:15.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.024+0000 7ff387e00640 1 --2- 172.21.15.87:0/2612488781 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff388073f30 0x7ff3880ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.024+0000 7ff387e00640 1 -- 172.21.15.87:0/2612488781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff38806fcf0 msgr2=0x7ff388146e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:15.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.024+0000 7ff387e00640 1 --2- 172.21.15.87:0/2612488781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff38806fcf0 0x7ff388146e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.024+0000 7ff387e00640 1 -- 172.21.15.87:0/2612488781 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff388150840 con 0x7ff388160370 2024-05-27T06:30:15.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.024+0000 7ff387e00640 1 --2- 172.21.15.87:0/2612488781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff388160370 0x7ff38814bec0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff38000b9c0 tx=0x7ff38000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:15.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.024+0000 7ff37fe00640 1 -- 172.21.15.87:0/2612488781 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff380019070 con 0x7ff388160370 2024-05-27T06:30:15.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.024+0000 7ff37fe00640 1 -- 172.21.15.87:0/2612488781 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff38000cba0 con 0x7ff388160370 2024-05-27T06:30:15.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.024+0000 7ff37fe00640 1 -- 172.21.15.87:0/2612488781 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff380014440 con 0x7ff388160370 2024-05-27T06:30:15.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.024+0000 7ff38e600640 1 -- 172.21.15.87:0/2612488781 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3880cdd40 con 0x7ff388160370 2024-05-27T06:30:15.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.024+0000 7ff38e600640 1 -- 172.21.15.87:0/2612488781 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3880ce300 con 0x7ff388160370 2024-05-27T06:30:15.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.024+0000 7ff38e600640 1 -- 172.21.15.87:0/2612488781 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff38806aa30 con 0x7ff388160370 2024-05-27T06:30:15.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.028+0000 7ff37fe00640 1 -- 172.21.15.87:0/2612488781 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff380007370 con 0x7ff388160370 2024-05-27T06:30:15.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.028+0000 7ff37fe00640 1 --2- 172.21.15.87:0/2612488781 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff36406f430 0x7ff364071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:15.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.028+0000 7ff37fe00640 1 -- 172.21.15.87:0/2612488781 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7ff38008ecf0 con 0x7ff388160370 2024-05-27T06:30:15.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.028+0000 7ff387400640 1 --2- 172.21.15.87:0/2612488781 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff36406f430 0x7ff364071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:15.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.028+0000 7ff387400640 1 --2- 172.21.15.87:0/2612488781 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff36406f430 0x7ff364071940 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff388072290 tx=0x7ff378008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:15.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.032+0000 7ff37fe00640 1 -- 172.21.15.87:0/2612488781 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff38005b6f0 con 0x7ff388160370 2024-05-27T06:30:15.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.188+0000 7ff38e600640 1 -- 172.21.15.87:0/2612488781 --> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7ff3880b1f80 con 0x7ff36406f430 2024-05-27T06:30:15.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.192+0000 7ff37fe00640 1 -- 172.21.15.87:0/2612488781 <== mgr.4111 v2:172.21.15.87:6832/2724754260 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff3880b1f80 con 0x7ff36406f430 2024-05-27T06:30:15.192 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 1 to deep-scrub 2024-05-27T06:30:15.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.192+0000 7ff38e600640 1 -- 172.21.15.87:0/2612488781 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff36406f430 msgr2=0x7ff364071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:15.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.192+0000 7ff38e600640 1 --2- 172.21.15.87:0/2612488781 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff36406f430 0x7ff364071940 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff388072290 tx=0x7ff378008040 comp rx=0 tx=0).stop 2024-05-27T06:30:15.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.192+0000 7ff38e600640 1 -- 172.21.15.87:0/2612488781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff388160370 msgr2=0x7ff38814bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:15.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.192+0000 7ff38e600640 1 --2- 172.21.15.87:0/2612488781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff388160370 0x7ff38814bec0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff38000b9c0 tx=0x7ff38000be80 comp rx=0 tx=0).stop 2024-05-27T06:30:15.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.192+0000 7ff38e600640 1 -- 172.21.15.87:0/2612488781 shutdown_connections 2024-05-27T06:30:15.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.192+0000 7ff38e600640 1 --2- 172.21.15.87:0/2612488781 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7ff36406f430 0x7ff364071940 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.192+0000 7ff38e600640 1 --2- 172.21.15.87:0/2612488781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff388160370 0x7ff38814bec0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.192+0000 7ff38e600640 1 --2- 172.21.15.87:0/2612488781 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff388073f30 0x7ff3880ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.192+0000 7ff38e600640 1 --2- 172.21.15.87:0/2612488781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff38806fcf0 0x7ff388146e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.192+0000 7ff38e600640 1 -- 172.21.15.87:0/2612488781 >> 172.21.15.87:0/2612488781 conn(0x7ff3880b2fb0 msgr2=0x7ff388155c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:15.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.192+0000 7ff38e600640 1 -- 172.21.15.87:0/2612488781 shutdown_connections 2024-05-27T06:30:15.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.192+0000 7ff38e600640 1 -- 172.21.15.87:0/2612488781 wait complete. 2024-05-27T06:30:15.211 INFO:tasks.ceph:Scrubbing osd.2 2024-05-27T06:30:15.211 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-27T06:30:15.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.364+0000 7f3cd1c00640 1 Processor -- start 2024-05-27T06:30:15.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.364+0000 7f3cd1c00640 1 -- start start 2024-05-27T06:30:15.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.364+0000 7f3cd1c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3ccc1610c0 0x7f3ccc0d02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:15.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.364+0000 7f3cd1c00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3ccc0d1e10 0x7f3ccc06eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:15.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.364+0000 7f3cd1c00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ccc0d1130 con 0x7f3ccc0d0810 2024-05-27T06:30:15.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.364+0000 7f3cd1c00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f3ccc0d0c20 con 0x7f3ccc1610c0 2024-05-27T06:30:15.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.364+0000 7f3cd1c00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f3ccc0d0e50 con 0x7f3ccc0d1e10 2024-05-27T06:30:15.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.364+0000 7f3ccaa00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3ccc1610c0 0x7f3ccc0d02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:15.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.364+0000 7f3cc2000640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f3ccc0d0810 0x7f3ccc0d1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40340/0 (socket says 172.21.15.87:40340) 2024-05-27T06:30:15.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.364+0000 7f3ccaa00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3ccc1610c0 0x7f3ccc0d02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42150/0 (socket says 172.21.15.87:42150) 2024-05-27T06:30:15.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.364+0000 7f3cc2000640 1 -- 172.21.15.87:0/1544815977 learned_addr learned my addr 172.21.15.87:0/1544815977 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:30:15.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.364+0000 7f3ccaa00640 1 -- 172.21.15.87:0/1544815977 >> v2:172.21.15.149:3300/0 conn(0x7f3ccc0d1e10 msgr2=0x7f3ccc06eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:15.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.364+0000 7f3ccb400640 1 --2- 172.21.15.87:0/1544815977 >> v2:172.21.15.149:3300/0 conn(0x7f3ccc0d1e10 0x7f3ccc06eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:15.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.364+0000 7f3cca000640 1 -- 172.21.15.87:0/1544815977 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3567320445 0 0) 0x7f3ccc0d1130 con 0x7f3ccc0d0810 2024-05-27T06:30:15.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.364+0000 7f3ccaa00640 1 --2- 172.21.15.87:0/1544815977 >> v2:172.21.15.149:3300/0 conn(0x7f3ccc0d1e10 0x7f3ccc06eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.364+0000 7f3ccaa00640 1 -- 172.21.15.87:0/1544815977 >> v1:172.21.15.87:6789/0 conn(0x7f3ccc0d0810 legacy=0x7f3ccc0d1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:15.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.364+0000 7f3ccaa00640 1 -- 172.21.15.87:0/1544815977 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ccc161a00 con 0x7f3ccc1610c0 2024-05-27T06:30:15.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.364+0000 7f3ccb400640 1 --2- 172.21.15.87:0/1544815977 >> v2:172.21.15.149:3300/0 conn(0x7f3ccc0d1e10 0x7f3ccc06eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:30:15.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.368+0000 7f3ccaa00640 1 --2- 172.21.15.87:0/1544815977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ccc1610c0 0x7f3ccc0d02d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc0b4260 tx=0x7f3cbc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729edef2ee04890f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:15.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.368+0000 7f3cca000640 1 -- 172.21.15.87:0/1544815977 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc0ab680 con 0x7f3ccc1610c0 2024-05-27T06:30:15.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.368+0000 7f3cca000640 1 -- 172.21.15.87:0/1544815977 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cbc0b0070 con 0x7f3ccc1610c0 2024-05-27T06:30:15.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.368+0000 7f3cca000640 1 -- 172.21.15.87:0/1544815977 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc0aba40 con 0x7f3ccc1610c0 2024-05-27T06:30:15.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.368+0000 7f3cd1c00640 1 -- 172.21.15.87:0/1544815977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ccc1610c0 msgr2=0x7f3ccc0d02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:15.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.368+0000 7f3cd1c00640 1 --2- 172.21.15.87:0/1544815977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ccc1610c0 0x7f3ccc0d02d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc0b4260 tx=0x7f3cbc01c480 comp rx=0 tx=0).stop 2024-05-27T06:30:15.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.368+0000 7f3cd1c00640 1 -- 172.21.15.87:0/1544815977 shutdown_connections 2024-05-27T06:30:15.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.368+0000 7f3cd1c00640 1 --2- 172.21.15.87:0/1544815977 >> v2:172.21.15.149:3300/0 conn(0x7f3ccc0d1e10 0x7f3ccc06eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.368+0000 7f3cd1c00640 1 --2- 172.21.15.87:0/1544815977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ccc1610c0 0x7f3ccc0d02d0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.368+0000 7f3cd1c00640 1 -- 172.21.15.87:0/1544815977 >> 172.21.15.87:0/1544815977 conn(0x7f3ccc0b46b0 msgr2=0x7f3ccc0b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:15.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.368+0000 7f3cd1c00640 1 -- 172.21.15.87:0/1544815977 shutdown_connections 2024-05-27T06:30:15.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.368+0000 7f3cd1c00640 1 -- 172.21.15.87:0/1544815977 wait complete. 2024-05-27T06:30:15.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.372+0000 7f3cd1c00640 1 Processor -- start 2024-05-27T06:30:15.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.372+0000 7f3cd1c00640 1 -- start start 2024-05-27T06:30:15.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.372+0000 7f3cd1c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ccc0d0810 0x7f3ccc15ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:15.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.372+0000 7f3cd1c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ccc1610c0 0x7f3ccc09bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:15.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.372+0000 7f3cd1c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3ccc14b200 0x7f3ccc0b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:15.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.372+0000 7f3cd1c00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3ccc161650 con 0x7f3ccc0d0810 2024-05-27T06:30:15.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.372+0000 7f3cd1c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3ccc1614d0 con 0x7f3ccc1610c0 2024-05-27T06:30:15.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.372+0000 7f3cd1c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3ccc16ac70 con 0x7f3ccc14b200 2024-05-27T06:30:15.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.372+0000 7f3ccaa00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ccc0d0810 0x7f3ccc15ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:15.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.372+0000 7f3ccaa00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ccc0d0810 0x7f3ccc15ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42166/0 (socket says 172.21.15.87:42166) 2024-05-27T06:30:15.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.372+0000 7f3ccaa00640 1 -- 172.21.15.87:0/1549326773 learned_addr learned my addr 172.21.15.87:0/1549326773 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:15.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.372+0000 7f3ccaa00640 1 -- 172.21.15.87:0/1549326773 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3ccc14b200 msgr2=0x7f3ccc0b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:15.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.372+0000 7f3ccaa00640 1 --2- 172.21.15.87:0/1549326773 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3ccc14b200 0x7f3ccc0b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.372+0000 7f3ccaa00640 1 -- 172.21.15.87:0/1549326773 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ccc1610c0 msgr2=0x7f3ccc09bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:15.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.372+0000 7f3ccaa00640 1 --2- 172.21.15.87:0/1549326773 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ccc1610c0 0x7f3ccc09bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.372+0000 7f3ccaa00640 1 -- 172.21.15.87:0/1549326773 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ccc159d80 con 0x7f3ccc0d0810 2024-05-27T06:30:15.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.372+0000 7f3ccaa00640 1 --2- 172.21.15.87:0/1549326773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ccc0d0810 0x7f3ccc15ab40 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc019090 tx=0x7f3cbc01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:15.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.372+0000 7f3cc3400640 1 -- 172.21.15.87:0/1549326773 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc004220 con 0x7f3ccc0d0810 2024-05-27T06:30:15.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.372+0000 7f3cc3400640 1 -- 172.21.15.87:0/1549326773 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cbc0a7070 con 0x7f3ccc0d0810 2024-05-27T06:30:15.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.372+0000 7f3cc3400640 1 -- 172.21.15.87:0/1549326773 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc003620 con 0x7f3ccc0d0810 2024-05-27T06:30:15.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.372+0000 7f3cd1c00640 1 -- 172.21.15.87:0/1549326773 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ccc15a060 con 0x7f3ccc0d0810 2024-05-27T06:30:15.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.372+0000 7f3cd1c00640 1 -- 172.21.15.87:0/1549326773 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ccc15a620 con 0x7f3ccc0d0810 2024-05-27T06:30:15.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.376+0000 7f3cd1c00640 1 -- 172.21.15.87:0/1549326773 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3ccc06aa30 con 0x7f3ccc0d0810 2024-05-27T06:30:15.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.376+0000 7f3cc3400640 1 -- 172.21.15.87:0/1549326773 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3cbc0037c0 con 0x7f3ccc0d0810 2024-05-27T06:30:15.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.376+0000 7f3cc3400640 1 --2- 172.21.15.87:0/1549326773 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3ca806f400 0x7f3ca8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:15.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.376+0000 7f3cc3400640 1 -- 172.21.15.87:0/1549326773 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f3cbc12a200 con 0x7f3ccc0d0810 2024-05-27T06:30:15.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.376+0000 7f3cc2000640 1 --2- 172.21.15.87:0/1549326773 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3ca806f400 0x7f3ca8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:15.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.376+0000 7f3cc3400640 1 --2- 172.21.15.87:0/1549326773 >> [v2:172.21.15.87:6817/1441249238,v1:172.21.15.87:6819/1441249238] conn(0x7f3ca80758f0 0x7f3ca8077d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:15.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.376+0000 7f3cc3400640 1 -- 172.21.15.87:0/1549326773 --> [v2:172.21.15.87:6817/1441249238,v1:172.21.15.87:6819/1441249238] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3cbc009400 con 0x7f3ca80758f0 2024-05-27T06:30:15.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.376+0000 7f3cc3400640 1 -- 172.21.15.87:0/1549326773 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f3cbc12a5b0 con 0x7f3ccc0d0810 2024-05-27T06:30:15.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.376+0000 7f3ccb400640 1 --2- 172.21.15.87:0/1549326773 >> [v2:172.21.15.87:6817/1441249238,v1:172.21.15.87:6819/1441249238] conn(0x7f3ca80758f0 0x7f3ca8077d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:15.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.376+0000 7f3cc2000640 1 --2- 172.21.15.87:0/1549326773 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3ca806f400 0x7f3ca8071910 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc0b4060 tx=0x7f3cb4007970 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:15.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.376+0000 7f3ccb400640 1 --2- 172.21.15.87:0/1549326773 >> [v2:172.21.15.87:6817/1441249238,v1:172.21.15.87:6819/1441249238] conn(0x7f3ca80758f0 0x7f3ca8077d80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:15.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.380+0000 7f3cc3400640 1 -- 172.21.15.87:0/1549326773 <== osd.2 v2:172.21.15.87:6817/1441249238 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3cbc009400 con 0x7f3ca80758f0 2024-05-27T06:30:15.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.392+0000 7f3cd1c00640 1 -- 172.21.15.87:0/1549326773 --> [v2:172.21.15.87:6817/1441249238,v1:172.21.15.87:6819/1441249238] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3ccc070de0 con 0x7f3ca80758f0 2024-05-27T06:30:15.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.392+0000 7f3cc3400640 1 -- 172.21.15.87:0/1549326773 <== osd.2 v2:172.21.15.87:6817/1441249238 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3ccc070de0 con 0x7f3ca80758f0 2024-05-27T06:30:15.391 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-27T06:30:15.391 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-27T06:30:15.391 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-27T06:30:15.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.392+0000 7f3cd1c00640 1 -- 172.21.15.87:0/1549326773 >> [v2:172.21.15.87:6817/1441249238,v1:172.21.15.87:6819/1441249238] conn(0x7f3ca80758f0 msgr2=0x7f3ca8077d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:15.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.392+0000 7f3cd1c00640 1 --2- 172.21.15.87:0/1549326773 >> [v2:172.21.15.87:6817/1441249238,v1:172.21.15.87:6819/1441249238] conn(0x7f3ca80758f0 0x7f3ca8077d80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.392+0000 7f3cd1c00640 1 -- 172.21.15.87:0/1549326773 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3ca806f400 msgr2=0x7f3ca8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:15.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.392+0000 7f3cd1c00640 1 --2- 172.21.15.87:0/1549326773 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f3ca806f400 0x7f3ca8071910 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc0b4060 tx=0x7f3cb4007970 comp rx=0 tx=0).stop 2024-05-27T06:30:15.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.392+0000 7f3cd1c00640 1 -- 172.21.15.87:0/1549326773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ccc0d0810 msgr2=0x7f3ccc15ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:15.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.392+0000 7f3cd1c00640 1 --2- 172.21.15.87:0/1549326773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ccc0d0810 0x7f3ccc15ab40 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc019090 tx=0x7f3cbc01acc0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.392+0000 7f3ccb400640 1 -- 172.21.15.87:0/1549326773 reap_dead start 2024-05-27T06:30:15.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.392+0000 7f3cd1c00640 1 -- 172.21.15.87:0/1549326773 shutdown_connections 2024-05-27T06:30:15.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.392+0000 7f3cd1c00640 1 -- 172.21.15.87:0/1549326773 >> 172.21.15.87:0/1549326773 conn(0x7f3ccc0b46b0 msgr2=0x7f3ccc146f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:15.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.392+0000 7f3cd1c00640 1 -- 172.21.15.87:0/1549326773 shutdown_connections 2024-05-27T06:30:15.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.392+0000 7f3cd1c00640 1 -- 172.21.15.87:0/1549326773 wait complete. 2024-05-27T06:30:15.409 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-27T06:30:15.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.560+0000 7fe704000640 1 Processor -- start 2024-05-27T06:30:15.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.560+0000 7fe704000640 1 -- start start 2024-05-27T06:30:15.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.560+0000 7fe704000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe6fc0ce5e0 0x7fe6fc073bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:15.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.560+0000 7fe704000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6fc15e090 con 0x7fe6fc0ce9f0 2024-05-27T06:30:15.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.560+0000 7fe704000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6fc0cff20 con 0x7fe6fc0b1c10 2024-05-27T06:30:15.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.560+0000 7fe704000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fe6fc0d0200 con 0x7fe6fc0ce5e0 2024-05-27T06:30:15.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.560+0000 7fe700c00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe6fc0ce5e0 0x7fe6fc073bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:15.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.560+0000 7fe702000640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe6fc0ce9f0 0x7fe6fc161680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40352/0 (socket says 172.21.15.87:40352) 2024-05-27T06:30:15.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.560+0000 7fe702000640 1 -- 172.21.15.87:0/419121509 learned_addr learned my addr 172.21.15.87:0/419121509 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:30:15.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.560+0000 7fe700c00640 1 -- 172.21.15.87:0/419121509 >> v1:172.21.15.149:6789/0 conn(0x7fe6fc0b1c10 legacy=0x7fe6fc15eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:15.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.560+0000 7fe700c00640 1 -- 172.21.15.87:0/419121509 >> v1:172.21.15.87:6789/0 conn(0x7fe6fc0ce9f0 legacy=0x7fe6fc161680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:15.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.560+0000 7fe700c00640 1 -- 172.21.15.87:0/419121509 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6fc15e310 con 0x7fe6fc0ce5e0 2024-05-27T06:30:15.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.560+0000 7fe6fbe00640 1 -- 172.21.15.87:0/419121509 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 947657577 0 0) 0x7fe6f40014a0 con 0x7fe6fc0ce9f0 2024-05-27T06:30:15.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.564+0000 7fe700c00640 1 --2- 172.21.15.87:0/419121509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6fc0ce5e0 0x7fe6fc073bb0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80097c0 tx=0x7fe6e801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530536d82a93be31 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:15.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.564+0000 7fe6fbe00640 1 -- 172.21.15.87:0/419121509 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e80b1070 con 0x7fe6fc0ce5e0 2024-05-27T06:30:15.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.564+0000 7fe6fbe00640 1 -- 172.21.15.87:0/419121509 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e80ac410 con 0x7fe6fc0ce5e0 2024-05-27T06:30:15.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.564+0000 7fe6fbe00640 1 -- 172.21.15.87:0/419121509 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e80ac7e0 con 0x7fe6fc0ce5e0 2024-05-27T06:30:15.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.564+0000 7fe704000640 1 -- 172.21.15.87:0/419121509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6fc0ce5e0 msgr2=0x7fe6fc073bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:15.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.564+0000 7fe704000640 1 --2- 172.21.15.87:0/419121509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6fc0ce5e0 0x7fe6fc073bb0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80097c0 tx=0x7fe6e801c4a0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.564+0000 7fe704000640 1 -- 172.21.15.87:0/419121509 shutdown_connections 2024-05-27T06:30:15.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.564+0000 7fe704000640 1 --2- 172.21.15.87:0/419121509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6fc0ce5e0 0x7fe6fc073bb0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.564+0000 7fe704000640 1 -- 172.21.15.87:0/419121509 >> 172.21.15.87:0/419121509 conn(0x7fe6fc0d24a0 msgr2=0x7fe6fc0d28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:15.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.564+0000 7fe704000640 1 -- 172.21.15.87:0/419121509 shutdown_connections 2024-05-27T06:30:15.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.564+0000 7fe704000640 1 -- 172.21.15.87:0/419121509 wait complete. 2024-05-27T06:30:15.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.568+0000 7fe704000640 1 Processor -- start 2024-05-27T06:30:15.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.568+0000 7fe704000640 1 -- start start 2024-05-27T06:30:15.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.568+0000 7fe704000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6fc0b1c10 0x7fe6fc0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:15.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.568+0000 7fe704000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6fc0ce5e0 0x7fe6fc0cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:15.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.568+0000 7fe704000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6fc0ce9f0 0x7fe6fc0b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:15.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.568+0000 7fe704000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe6fc16c450 con 0x7fe6fc0ce9f0 2024-05-27T06:30:15.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.568+0000 7fe704000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe6fc074500 con 0x7fe6fc0b1c10 2024-05-27T06:30:15.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.568+0000 7fe704000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe6fc16c5d0 con 0x7fe6fc0ce5e0 2024-05-27T06:30:15.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.568+0000 7fe702000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6fc0ce9f0 0x7fe6fc0b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:15.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.568+0000 7fe702000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6fc0ce9f0 0x7fe6fc0b55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42192/0 (socket says 172.21.15.87:42192) 2024-05-27T06:30:15.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.568+0000 7fe702000640 1 -- 172.21.15.87:0/3393018917 learned_addr learned my addr 172.21.15.87:0/3393018917 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:15.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.568+0000 7fe701600640 1 --2- 172.21.15.87:0/3393018917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6fc0b1c10 0x7fe6fc0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:15.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.568+0000 7fe700c00640 1 --2- 172.21.15.87:0/3393018917 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6fc0ce5e0 0x7fe6fc0cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:15.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.568+0000 7fe702000640 1 -- 172.21.15.87:0/3393018917 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6fc0ce5e0 msgr2=0x7fe6fc0cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:15.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.568+0000 7fe702000640 1 --2- 172.21.15.87:0/3393018917 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6fc0ce5e0 0x7fe6fc0cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.568+0000 7fe702000640 1 -- 172.21.15.87:0/3393018917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6fc0b1c10 msgr2=0x7fe6fc0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:15.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.568+0000 7fe702000640 1 --2- 172.21.15.87:0/3393018917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6fc0b1c10 0x7fe6fc0cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.568+0000 7fe702000640 1 -- 172.21.15.87:0/3393018917 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6fc0b6910 con 0x7fe6fc0ce9f0 2024-05-27T06:30:15.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.568+0000 7fe702000640 1 --2- 172.21.15.87:0/3393018917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6fc0ce9f0 0x7fe6fc0b55d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe6f400cad0 tx=0x7fe6f400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:15.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.572+0000 7fe6f9600640 1 -- 172.21.15.87:0/3393018917 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f400ab70 con 0x7fe6fc0ce9f0 2024-05-27T06:30:15.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.572+0000 7fe6f9600640 1 -- 172.21.15.87:0/3393018917 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f400ad10 con 0x7fe6fc0ce9f0 2024-05-27T06:30:15.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.572+0000 7fe6f9600640 1 -- 172.21.15.87:0/3393018917 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4012640 con 0x7fe6fc0ce9f0 2024-05-27T06:30:15.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.572+0000 7fe704000640 1 -- 172.21.15.87:0/3393018917 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6fc15d280 con 0x7fe6fc0ce9f0 2024-05-27T06:30:15.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.572+0000 7fe704000640 1 -- 172.21.15.87:0/3393018917 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6fc15d520 con 0x7fe6fc0ce9f0 2024-05-27T06:30:15.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.572+0000 7fe704000640 1 -- 172.21.15.87:0/3393018917 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6fc06aa30 con 0x7fe6fc0ce9f0 2024-05-27T06:30:15.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.572+0000 7fe6f9600640 1 -- 172.21.15.87:0/3393018917 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe6f40127e0 con 0x7fe6fc0ce9f0 2024-05-27T06:30:15.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.576+0000 7fe6f9600640 1 --2- 172.21.15.87:0/3393018917 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe6dc06f430 0x7fe6dc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:15.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.576+0000 7fe6f9600640 1 -- 172.21.15.87:0/3393018917 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7fe6f40900e0 con 0x7fe6fc0ce9f0 2024-05-27T06:30:15.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.576+0000 7fe701600640 1 --2- 172.21.15.87:0/3393018917 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe6dc06f430 0x7fe6dc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:15.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.576+0000 7fe701600640 1 --2- 172.21.15.87:0/3393018917 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe6dc06f430 0x7fe6dc071940 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc070020 tx=0x7fe6f0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:15.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.576+0000 7fe6f9600640 1 -- 172.21.15.87:0/3393018917 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe6fc0b6910 con 0x7fe6fc0ce9f0 2024-05-27T06:30:15.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.736+0000 7fe704000640 1 -- 172.21.15.87:0/3393018917 --> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fe6fc06e090 con 0x7fe6dc06f430 2024-05-27T06:30:15.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.736+0000 7fe6f9600640 1 -- 172.21.15.87:0/3393018917 <== mgr.4111 v2:172.21.15.87:6832/2724754260 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe6fc06e090 con 0x7fe6dc06f430 2024-05-27T06:30:15.736 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 2 to deep-scrub 2024-05-27T06:30:15.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.740+0000 7fe704000640 1 -- 172.21.15.87:0/3393018917 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe6dc06f430 msgr2=0x7fe6dc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:15.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.740+0000 7fe704000640 1 --2- 172.21.15.87:0/3393018917 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe6dc06f430 0x7fe6dc071940 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc070020 tx=0x7fe6f0008040 comp rx=0 tx=0).stop 2024-05-27T06:30:15.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.740+0000 7fe704000640 1 -- 172.21.15.87:0/3393018917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6fc0ce9f0 msgr2=0x7fe6fc0b55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:15.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.740+0000 7fe704000640 1 --2- 172.21.15.87:0/3393018917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6fc0ce9f0 0x7fe6fc0b55d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe6f400cad0 tx=0x7fe6f400cf90 comp rx=0 tx=0).stop 2024-05-27T06:30:15.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.740+0000 7fe704000640 1 -- 172.21.15.87:0/3393018917 shutdown_connections 2024-05-27T06:30:15.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.740+0000 7fe704000640 1 --2- 172.21.15.87:0/3393018917 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fe6dc06f430 0x7fe6dc071940 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.740+0000 7fe704000640 1 --2- 172.21.15.87:0/3393018917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6fc0ce9f0 0x7fe6fc0b55d0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.740+0000 7fe704000640 1 --2- 172.21.15.87:0/3393018917 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6fc0ce5e0 0x7fe6fc0cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.740+0000 7fe704000640 1 --2- 172.21.15.87:0/3393018917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6fc0b1c10 0x7fe6fc0cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.740+0000 7fe704000640 1 -- 172.21.15.87:0/3393018917 >> 172.21.15.87:0/3393018917 conn(0x7fe6fc0d24a0 msgr2=0x7fe6fc0cee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:15.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.740+0000 7fe704000640 1 -- 172.21.15.87:0/3393018917 shutdown_connections 2024-05-27T06:30:15.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.740+0000 7fe704000640 1 -- 172.21.15.87:0/3393018917 wait complete. 2024-05-27T06:30:15.757 INFO:tasks.ceph:Scrubbing osd.3 2024-05-27T06:30:15.758 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-27T06:30:15.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.908+0000 7f70a1800640 1 Processor -- start 2024-05-27T06:30:15.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.908+0000 7f70a1800640 1 -- start start 2024-05-27T06:30:15.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.912+0000 7f70a1800640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f709c15d350 0x7f709c0cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:15.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.912+0000 7f70a1800640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f709c0ce220 0x7f709c06c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:15.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.912+0000 7f70a1800640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f709c06db10 con 0x7f709c15c3f0 2024-05-27T06:30:15.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.912+0000 7f70a1800640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f709c0ce630 con 0x7f709c0ce220 2024-05-27T06:30:15.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.912+0000 7f70a1800640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f709c15d760 con 0x7f709c15d350 2024-05-27T06:30:15.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.912+0000 7f709b400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f709c0ce220 0x7f709c06c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:15.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.912+0000 7f709b400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f709c0ce220 0x7f709c06c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42204/0 (socket says 172.21.15.87:42204) 2024-05-27T06:30:15.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.912+0000 7f709b400640 1 -- 172.21.15.87:0/2468106376 learned_addr learned my addr 172.21.15.87:0/2468106376 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:15.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.912+0000 7f7092000640 1 --2- 172.21.15.87:0/2468106376 >> v2:172.21.15.149:3300/0 conn(0x7f709c15d350 0x7f709c0cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:15.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.912+0000 7f709b400640 1 -- 172.21.15.87:0/2468106376 >> v2:172.21.15.149:3300/0 conn(0x7f709c15d350 msgr2=0x7f709c0cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:15.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.912+0000 7f709b400640 1 --2- 172.21.15.87:0/2468106376 >> v2:172.21.15.149:3300/0 conn(0x7f709c15d350 0x7f709c0cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.912+0000 7f709b400640 1 -- 172.21.15.87:0/2468106376 >> v1:172.21.15.87:6789/0 conn(0x7f709c15c3f0 legacy=0x7f709c160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:15.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.912+0000 7f709b400640 1 -- 172.21.15.87:0/2468106376 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709c0cf2a0 con 0x7f709c0ce220 2024-05-27T06:30:15.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.912+0000 7f709a000640 1 -- 172.21.15.87:0/2468106376 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1449359044 0 0) 0x7f708c001120 con 0x7f709c15c3f0 2024-05-27T06:30:15.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.912+0000 7f7092000640 1 --2- 172.21.15.87:0/2468106376 >> v2:172.21.15.149:3300/0 conn(0x7f709c15d350 0x7f709c0cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:30:15.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.916+0000 7f709b400640 1 --2- 172.21.15.87:0/2468106376 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f709c0ce220 0x7f709c06c720 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f709c070d40 tx=0x7f709401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9945903f66ee999e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:15.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.916+0000 7f709a000640 1 -- 172.21.15.87:0/2468106376 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70940a5720 con 0x7f709c0ce220 2024-05-27T06:30:15.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.916+0000 7f709a000640 1 -- 172.21.15.87:0/2468106376 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70940a58c0 con 0x7f709c0ce220 2024-05-27T06:30:15.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.916+0000 7f709a000640 1 -- 172.21.15.87:0/2468106376 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70940a5c90 con 0x7f709c0ce220 2024-05-27T06:30:15.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.916+0000 7f70a1800640 1 -- 172.21.15.87:0/2468106376 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f709c0ce220 msgr2=0x7f709c06c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:15.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.916+0000 7f70a1800640 1 --2- 172.21.15.87:0/2468106376 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f709c0ce220 0x7f709c06c720 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f709c070d40 tx=0x7f709401c9f0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.916+0000 7f70a1800640 1 -- 172.21.15.87:0/2468106376 shutdown_connections 2024-05-27T06:30:15.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.916+0000 7f70a1800640 1 --2- 172.21.15.87:0/2468106376 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f709c0ce220 0x7f709c06c720 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.916+0000 7f70a1800640 1 --2- 172.21.15.87:0/2468106376 >> v2:172.21.15.149:3300/0 conn(0x7f709c15d350 0x7f709c0cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.916+0000 7f70a1800640 1 -- 172.21.15.87:0/2468106376 >> 172.21.15.87:0/2468106376 conn(0x7f709c0b46b0 msgr2=0x7f709c0b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:15.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.916+0000 7f70a1800640 1 -- 172.21.15.87:0/2468106376 shutdown_connections 2024-05-27T06:30:15.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.916+0000 7f70a1800640 1 -- 172.21.15.87:0/2468106376 wait complete. 2024-05-27T06:30:15.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.920+0000 7f70a1800640 1 Processor -- start 2024-05-27T06:30:15.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.920+0000 7f70a1800640 1 -- start start 2024-05-27T06:30:15.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.920+0000 7f70a1800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f709c0ce220 0x7f709c147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:15.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.920+0000 7f70a1800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f709c15c3f0 0x7f709c0b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:15.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.920+0000 7f70a1800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f709c15d350 0x7f709c14fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:15.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.920+0000 7f70a1800640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f709c06d070 con 0x7f709c0ce220 2024-05-27T06:30:15.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.920+0000 7f70a1800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f709c0cf860 con 0x7f709c15d350 2024-05-27T06:30:15.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.920+0000 7f70a1800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f709c1509d0 con 0x7f709c15c3f0 2024-05-27T06:30:15.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.920+0000 7f709aa00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f709c0ce220 0x7f709c147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:15.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.920+0000 7f709aa00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f709c0ce220 0x7f709c147ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42216/0 (socket says 172.21.15.87:42216) 2024-05-27T06:30:15.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.920+0000 7f709aa00640 1 -- 172.21.15.87:0/1238714890 learned_addr learned my addr 172.21.15.87:0/1238714890 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:15.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.920+0000 7f709aa00640 1 -- 172.21.15.87:0/1238714890 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f709c15c3f0 msgr2=0x7f709c0b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:15.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.920+0000 7f709aa00640 1 --2- 172.21.15.87:0/1238714890 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f709c15c3f0 0x7f709c0b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.920+0000 7f709aa00640 1 -- 172.21.15.87:0/1238714890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f709c15d350 msgr2=0x7f709c14fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:15.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.920+0000 7f709aa00640 1 --2- 172.21.15.87:0/1238714890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f709c15d350 0x7f709c14fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.920+0000 7f709aa00640 1 -- 172.21.15.87:0/1238714890 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709c1f7b70 con 0x7f709c0ce220 2024-05-27T06:30:15.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.920+0000 7f709aa00640 1 --2- 172.21.15.87:0/1238714890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f709c0ce220 0x7f709c147ff0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f708c001ec0 tx=0x7f708c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:15.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.920+0000 7f7093400640 1 -- 172.21.15.87:0/1238714890 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c017070 con 0x7f709c0ce220 2024-05-27T06:30:15.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.920+0000 7f7093400640 1 -- 172.21.15.87:0/1238714890 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f708c003600 con 0x7f709c0ce220 2024-05-27T06:30:15.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.920+0000 7f70a1800640 1 -- 172.21.15.87:0/1238714890 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f709c1f7e50 con 0x7f709c0ce220 2024-05-27T06:30:15.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.920+0000 7f7093400640 1 -- 172.21.15.87:0/1238714890 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c0039f0 con 0x7f709c0ce220 2024-05-27T06:30:15.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.920+0000 7f70a1800640 1 -- 172.21.15.87:0/1238714890 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f709c1f8410 con 0x7f709c0ce220 2024-05-27T06:30:15.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.924+0000 7f70a1800640 1 -- 172.21.15.87:0/1238714890 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f709c06aa30 con 0x7f709c0ce220 2024-05-27T06:30:15.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.924+0000 7f7093400640 1 -- 172.21.15.87:0/1238714890 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f708c01a070 con 0x7f709c0ce220 2024-05-27T06:30:15.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.924+0000 7f7093400640 1 --2- 172.21.15.87:0/1238714890 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f707806f430 0x7f7078071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:15.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.924+0000 7f7093400640 1 -- 172.21.15.87:0/1238714890 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f708c08ebd0 con 0x7f709c0ce220 2024-05-27T06:30:15.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.924+0000 7f7092000640 1 --2- 172.21.15.87:0/1238714890 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f707806f430 0x7f7078071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:15.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.924+0000 7f7093400640 1 --2- 172.21.15.87:0/1238714890 >> [v2:172.21.15.87:6816/1173805234,v1:172.21.15.87:6818/1173805234] conn(0x7f7078075920 0x7f7078077db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:15.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.924+0000 7f7093400640 1 -- 172.21.15.87:0/1238714890 --> [v2:172.21.15.87:6816/1173805234,v1:172.21.15.87:6818/1173805234] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7078078480 con 0x7f7078075920 2024-05-27T06:30:15.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.924+0000 7f7093400640 1 -- 172.21.15.87:0/1238714890 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f708c08ef80 con 0x7f709c0ce220 2024-05-27T06:30:15.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.924+0000 7f709b400640 1 --2- 172.21.15.87:0/1238714890 >> [v2:172.21.15.87:6816/1173805234,v1:172.21.15.87:6818/1173805234] conn(0x7f7078075920 0x7f7078077db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:15.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.924+0000 7f7092000640 1 --2- 172.21.15.87:0/1238714890 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f707806f430 0x7f7078071940 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7084006f10 tx=0x7f7084008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:15.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.924+0000 7f709b400640 1 --2- 172.21.15.87:0/1238714890 >> [v2:172.21.15.87:6816/1173805234,v1:172.21.15.87:6818/1173805234] conn(0x7f7078075920 0x7f7078077db0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:15.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.928+0000 7f7093400640 1 -- 172.21.15.87:0/1238714890 <== osd.3 v2:172.21.15.87:6816/1173805234 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7078078480 con 0x7f7078075920 2024-05-27T06:30:15.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.940+0000 7f70a1800640 1 -- 172.21.15.87:0/1238714890 --> [v2:172.21.15.87:6816/1173805234,v1:172.21.15.87:6818/1173805234] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f709c150b50 con 0x7f7078075920 2024-05-27T06:30:15.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.940+0000 7f7093400640 1 -- 172.21.15.87:0/1238714890 <== osd.3 v2:172.21.15.87:6816/1173805234 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f709c150b50 con 0x7f7078075920 2024-05-27T06:30:15.939 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-27T06:30:15.939 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-27T06:30:15.939 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-27T06:30:15.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.940+0000 7f70a1800640 1 -- 172.21.15.87:0/1238714890 >> [v2:172.21.15.87:6816/1173805234,v1:172.21.15.87:6818/1173805234] conn(0x7f7078075920 msgr2=0x7f7078077db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:15.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.940+0000 7f70a1800640 1 --2- 172.21.15.87:0/1238714890 >> [v2:172.21.15.87:6816/1173805234,v1:172.21.15.87:6818/1173805234] conn(0x7f7078075920 0x7f7078077db0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:15.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.940+0000 7f70a1800640 1 -- 172.21.15.87:0/1238714890 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f707806f430 msgr2=0x7f7078071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:15.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.940+0000 7f70a1800640 1 --2- 172.21.15.87:0/1238714890 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f707806f430 0x7f7078071940 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7084006f10 tx=0x7f7084008040 comp rx=0 tx=0).stop 2024-05-27T06:30:15.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.940+0000 7f70a1800640 1 -- 172.21.15.87:0/1238714890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f709c0ce220 msgr2=0x7f709c147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:15.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.940+0000 7f70a1800640 1 --2- 172.21.15.87:0/1238714890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f709c0ce220 0x7f709c147ff0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f708c001ec0 tx=0x7f708c00c890 comp rx=0 tx=0).stop 2024-05-27T06:30:15.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.940+0000 7f709b400640 1 -- 172.21.15.87:0/1238714890 reap_dead start 2024-05-27T06:30:15.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.940+0000 7f70a1800640 1 -- 172.21.15.87:0/1238714890 shutdown_connections 2024-05-27T06:30:15.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.940+0000 7f70a1800640 1 -- 172.21.15.87:0/1238714890 >> 172.21.15.87:0/1238714890 conn(0x7f709c0b46b0 msgr2=0x7f709c15cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:15.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.940+0000 7f70a1800640 1 -- 172.21.15.87:0/1238714890 shutdown_connections 2024-05-27T06:30:15.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:15.940+0000 7f70a1800640 1 -- 172.21.15.87:0/1238714890 wait complete. 2024-05-27T06:30:15.957 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-27T06:30:16.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.104+0000 7f480fe00640 1 Processor -- start 2024-05-27T06:30:16.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.104+0000 7f480fe00640 1 -- start start 2024-05-27T06:30:16.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.108+0000 7f480fe00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f48100d0280 0x7f48100cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:16.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.108+0000 7f480fe00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48100d0690 con 0x7f481015faf0 2024-05-27T06:30:16.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.108+0000 7f480fe00640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48100d0910 con 0x7f48100cfe70 2024-05-27T06:30:16.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.108+0000 7f480fe00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f481006ea70 con 0x7f48100d0280 2024-05-27T06:30:16.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.108+0000 7f480ea00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f481015faf0 0x7f48100cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40380/0 (socket says 172.21.15.87:40380) 2024-05-27T06:30:16.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.108+0000 7f480ea00640 1 -- 172.21.15.87:0/2430807244 learned_addr learned my addr 172.21.15.87:0/2430807244 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:30:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.108+0000 7f480f400640 1 --2- 172.21.15.87:0/2430807244 >> v2:172.21.15.149:3300/0 conn(0x7f48100d0280 0x7f48100cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.108+0000 7f480e000640 1 -- 172.21.15.87:0/2430807244 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1857007060 0 0) 0x7f48000014a0 con 0x7f481015faf0 2024-05-27T06:30:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.108+0000 7f480e000640 1 -- 172.21.15.87:0/2430807244 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47f4003530 con 0x7f481015faf0 2024-05-27T06:30:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.108+0000 7f480f400640 1 -- 172.21.15.87:0/2430807244 >> v1:172.21.15.149:6789/0 conn(0x7f48100cfe70 legacy=0x7f48100cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:16.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.108+0000 7f480f400640 1 -- 172.21.15.87:0/2430807244 >> v1:172.21.15.87:6789/0 conn(0x7f481015faf0 legacy=0x7f48100cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:16.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.108+0000 7f480e000640 1 -- 172.21.15.87:0/2430807244 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1205387159 0 0) 0x7f47f4003530 con 0x7f481015faf0 2024-05-27T06:30:16.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.108+0000 7f480f400640 1 -- 172.21.15.87:0/2430807244 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48100d0bb0 con 0x7f48100d0280 2024-05-27T06:30:16.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.112+0000 7f480f400640 1 --2- 172.21.15.87:0/2430807244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48100d0280 0x7f48100cd130 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f48080097c0 tx=0x7f480801cd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0b01f58b2f61b82 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:16.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.112+0000 7f480e000640 1 -- 172.21.15.87:0/2430807244 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48080b0070 con 0x7f48100d0280 2024-05-27T06:30:16.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.112+0000 7f480e000640 1 -- 172.21.15.87:0/2430807244 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48080ab400 con 0x7f48100d0280 2024-05-27T06:30:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.112+0000 7f480e000640 1 -- 172.21.15.87:0/2430807244 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4800001c50 con 0x7f48100d0280 2024-05-27T06:30:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.112+0000 7f480fe00640 1 -- 172.21.15.87:0/2430807244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48100d0280 msgr2=0x7f48100cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.112+0000 7f480fe00640 1 --2- 172.21.15.87:0/2430807244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48100d0280 0x7f48100cd130 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f48080097c0 tx=0x7f480801cd90 comp rx=0 tx=0).stop 2024-05-27T06:30:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.112+0000 7f480fe00640 1 -- 172.21.15.87:0/2430807244 shutdown_connections 2024-05-27T06:30:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.112+0000 7f480fe00640 1 --2- 172.21.15.87:0/2430807244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48100d0280 0x7f48100cd130 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.112+0000 7f480fe00640 1 -- 172.21.15.87:0/2430807244 >> 172.21.15.87:0/2430807244 conn(0x7f48100ce610 msgr2=0x7f48100cea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.112+0000 7f480fe00640 1 -- 172.21.15.87:0/2430807244 shutdown_connections 2024-05-27T06:30:16.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.112+0000 7f480fe00640 1 -- 172.21.15.87:0/2430807244 wait complete. 2024-05-27T06:30:16.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.112+0000 7f480fe00640 1 Processor -- start 2024-05-27T06:30:16.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.112+0000 7f480fe00640 1 -- start start 2024-05-27T06:30:16.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.116+0000 7f480fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48100cfe70 0x7f48100b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:16.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.116+0000 7f480fe00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48100d0280 0x7f48100c4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:16.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.116+0000 7f480fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f481015faf0 0x7f4810156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:16.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.116+0000 7f480fe00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f481016db70 con 0x7f48100d0280 2024-05-27T06:30:16.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.116+0000 7f480fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f481016d9f0 con 0x7f48100cfe70 2024-05-27T06:30:16.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.116+0000 7f480fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f481016dcf0 con 0x7f481015faf0 2024-05-27T06:30:16.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.116+0000 7f4806000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48100d0280 0x7f48100c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:16.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.116+0000 7f4806000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48100d0280 0x7f48100c4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42224/0 (socket says 172.21.15.87:42224) 2024-05-27T06:30:16.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.116+0000 7f4806000640 1 -- 172.21.15.87:0/891048034 learned_addr learned my addr 172.21.15.87:0/891048034 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:16.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.116+0000 7f480f400640 1 --2- 172.21.15.87:0/891048034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f481015faf0 0x7f4810156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:16.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.116+0000 7f480ea00640 1 --2- 172.21.15.87:0/891048034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48100cfe70 0x7f48100b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:16.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.116+0000 7f4806000640 1 -- 172.21.15.87:0/891048034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f481015faf0 msgr2=0x7f4810156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:16.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.116+0000 7f4806000640 1 --2- 172.21.15.87:0/891048034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f481015faf0 0x7f4810156310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:16.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.116+0000 7f4806000640 1 -- 172.21.15.87:0/891048034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48100cfe70 msgr2=0x7f48100b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:16.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.116+0000 7f4806000640 1 --2- 172.21.15.87:0/891048034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48100cfe70 0x7f48100b6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:16.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.116+0000 7f4806000640 1 -- 172.21.15.87:0/891048034 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48100b7070 con 0x7f48100d0280 2024-05-27T06:30:16.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.116+0000 7f480f400640 1 --2- 172.21.15.87:0/891048034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f481015faf0 0x7f4810156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:30:16.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.116+0000 7f4806000640 1 --2- 172.21.15.87:0/891048034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48100d0280 0x7f48100c4970 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f47f800c450 tx=0x7f47f800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:16.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.116+0000 7f4807400640 1 -- 172.21.15.87:0/891048034 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f80052d0 con 0x7f48100d0280 2024-05-27T06:30:16.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.116+0000 7f4807400640 1 -- 172.21.15.87:0/891048034 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47f8005470 con 0x7f48100d0280 2024-05-27T06:30:16.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.116+0000 7f480fe00640 1 -- 172.21.15.87:0/891048034 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48100b4db0 con 0x7f48100d0280 2024-05-27T06:30:16.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.116+0000 7f4807400640 1 -- 172.21.15.87:0/891048034 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f8012850 con 0x7f48100d0280 2024-05-27T06:30:16.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.116+0000 7f480fe00640 1 -- 172.21.15.87:0/891048034 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48100b5370 con 0x7f48100d0280 2024-05-27T06:30:16.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.116+0000 7f480fe00640 1 -- 172.21.15.87:0/891048034 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48100508e0 con 0x7f48100d0280 2024-05-27T06:30:16.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.120+0000 7f4807400640 1 -- 172.21.15.87:0/891048034 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f47f80129f0 con 0x7f48100d0280 2024-05-27T06:30:16.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.120+0000 7f4807400640 1 --2- 172.21.15.87:0/891048034 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f47ec06f400 0x7f47ec071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:16.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.120+0000 7f4807400640 1 -- 172.21.15.87:0/891048034 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f47f808ecc0 con 0x7f48100d0280 2024-05-27T06:30:16.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.120+0000 7f480ea00640 1 --2- 172.21.15.87:0/891048034 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f47ec06f400 0x7f47ec071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:16.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.120+0000 7f480ea00640 1 --2- 172.21.15.87:0/891048034 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f47ec06f400 0x7f47ec071910 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4800001920 tx=0x7f4800009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:16.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.124+0000 7f4807400640 1 -- 172.21.15.87:0/891048034 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f47f805bdb0 con 0x7f48100d0280 2024-05-27T06:30:16.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.280+0000 7f480fe00640 1 -- 172.21.15.87:0/891048034 --> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f48100d1730 con 0x7f47ec06f400 2024-05-27T06:30:16.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.284+0000 7f4807400640 1 -- 172.21.15.87:0/891048034 <== mgr.4111 v2:172.21.15.87:6832/2724754260 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f48100d1730 con 0x7f47ec06f400 2024-05-27T06:30:16.281 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 3 to deep-scrub 2024-05-27T06:30:16.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.284+0000 7f480fe00640 1 -- 172.21.15.87:0/891048034 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f47ec06f400 msgr2=0x7f47ec071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:16.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.284+0000 7f480fe00640 1 --2- 172.21.15.87:0/891048034 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f47ec06f400 0x7f47ec071910 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4800001920 tx=0x7f4800009040 comp rx=0 tx=0).stop 2024-05-27T06:30:16.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.284+0000 7f480fe00640 1 -- 172.21.15.87:0/891048034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48100d0280 msgr2=0x7f48100c4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:16.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.284+0000 7f480fe00640 1 --2- 172.21.15.87:0/891048034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48100d0280 0x7f48100c4970 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f47f800c450 tx=0x7f47f800c910 comp rx=0 tx=0).stop 2024-05-27T06:30:16.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.284+0000 7f480fe00640 1 -- 172.21.15.87:0/891048034 shutdown_connections 2024-05-27T06:30:16.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.284+0000 7f480fe00640 1 --2- 172.21.15.87:0/891048034 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f47ec06f400 0x7f47ec071910 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:16.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.284+0000 7f480fe00640 1 --2- 172.21.15.87:0/891048034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f481015faf0 0x7f4810156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:16.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.284+0000 7f480fe00640 1 --2- 172.21.15.87:0/891048034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48100d0280 0x7f48100c4970 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:16.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.284+0000 7f480fe00640 1 --2- 172.21.15.87:0/891048034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48100cfe70 0x7f48100b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:16.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.284+0000 7f480fe00640 1 -- 172.21.15.87:0/891048034 >> 172.21.15.87:0/891048034 conn(0x7f48100ce610 msgr2=0x7f481015a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:16.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.284+0000 7f480fe00640 1 -- 172.21.15.87:0/891048034 shutdown_connections 2024-05-27T06:30:16.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.284+0000 7f480fe00640 1 -- 172.21.15.87:0/891048034 wait complete. 2024-05-27T06:30:16.302 INFO:tasks.ceph:Scrubbing osd.4 2024-05-27T06:30:16.302 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-27T06:30:16.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.452+0000 7f45a7200640 1 Processor -- start 2024-05-27T06:30:16.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.452+0000 7f45a7200640 1 -- start start 2024-05-27T06:30:16.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.456+0000 7f45a7200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f45a01610c0 0x7f45a00d02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:16.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.456+0000 7f45a7200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45a00d1e10 0x7f45a006eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:16.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.456+0000 7f45a7200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a00d1130 con 0x7f45a00d0810 2024-05-27T06:30:16.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.456+0000 7f45a7200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f45a00d0c20 con 0x7f45a01610c0 2024-05-27T06:30:16.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.456+0000 7f45a7200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f45a00d0e50 con 0x7f45a00d1e10 2024-05-27T06:30:16.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.456+0000 7f4597400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f45a00d0810 0x7f45a00d1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40396/0 (socket says 172.21.15.87:40396) 2024-05-27T06:30:16.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.456+0000 7f4597400640 1 -- 172.21.15.87:0/4276485982 learned_addr learned my addr 172.21.15.87:0/4276485982 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:30:16.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.456+0000 7f45a5200640 1 --2- 172.21.15.87:0/4276485982 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45a00d1e10 0x7f45a006eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:16.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.456+0000 7f459fe00640 1 --2- 172.21.15.87:0/4276485982 >> v2:172.21.15.149:3300/0 conn(0x7f45a01610c0 0x7f45a00d02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:16.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.456+0000 7f459f400640 1 -- 172.21.15.87:0/4276485982 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3991162543 0 0) 0x7f45a00d1130 con 0x7f45a00d0810 2024-05-27T06:30:16.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.456+0000 7f459f400640 1 -- 172.21.15.87:0/4276485982 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4584003530 con 0x7f45a00d0810 2024-05-27T06:30:16.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.456+0000 7f459fe00640 1 -- 172.21.15.87:0/4276485982 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45a00d1e10 msgr2=0x7f45a006eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:16.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.456+0000 7f459fe00640 1 --2- 172.21.15.87:0/4276485982 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45a00d1e10 0x7f45a006eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:16.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.456+0000 7f459fe00640 1 -- 172.21.15.87:0/4276485982 >> v1:172.21.15.87:6789/0 conn(0x7f45a00d0810 legacy=0x7f45a00d1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:16.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.456+0000 7f459f400640 1 -- 172.21.15.87:0/4276485982 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 52710806 0 0) 0x7f4584003530 con 0x7f45a00d0810 2024-05-27T06:30:16.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.456+0000 7f459fe00640 1 -- 172.21.15.87:0/4276485982 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a0161a00 con 0x7f45a01610c0 2024-05-27T06:30:16.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.460+0000 7f459fe00640 1 --2- 172.21.15.87:0/4276485982 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45a01610c0 0x7f45a00d02d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4590009d90 tx=0x7f459001c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cd5f6ae5314f92c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:16.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.460+0000 7f459f400640 1 -- 172.21.15.87:0/4276485982 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45900b2070 con 0x7f45a01610c0 2024-05-27T06:30:16.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.460+0000 7f459f400640 1 -- 172.21.15.87:0/4276485982 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45900a5690 con 0x7f45a01610c0 2024-05-27T06:30:16.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.460+0000 7f459f400640 1 -- 172.21.15.87:0/4276485982 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4588001700 con 0x7f45a01610c0 2024-05-27T06:30:16.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.460+0000 7f45a7200640 1 -- 172.21.15.87:0/4276485982 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45a01610c0 msgr2=0x7f45a00d02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:16.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.460+0000 7f45a7200640 1 --2- 172.21.15.87:0/4276485982 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45a01610c0 0x7f45a00d02d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4590009d90 tx=0x7f459001c890 comp rx=0 tx=0).stop 2024-05-27T06:30:16.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.460+0000 7f45a7200640 1 -- 172.21.15.87:0/4276485982 shutdown_connections 2024-05-27T06:30:16.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.460+0000 7f45a7200640 1 --2- 172.21.15.87:0/4276485982 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45a00d1e10 0x7f45a006eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:16.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.460+0000 7f45a7200640 1 --2- 172.21.15.87:0/4276485982 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45a01610c0 0x7f45a00d02d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:16.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.460+0000 7f45a7200640 1 -- 172.21.15.87:0/4276485982 >> 172.21.15.87:0/4276485982 conn(0x7f45a00b46b0 msgr2=0x7f45a00b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:16.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.460+0000 7f45a7200640 1 -- 172.21.15.87:0/4276485982 shutdown_connections 2024-05-27T06:30:16.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.460+0000 7f45a7200640 1 -- 172.21.15.87:0/4276485982 wait complete. 2024-05-27T06:30:16.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.464+0000 7f45a7200640 1 Processor -- start 2024-05-27T06:30:16.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.464+0000 7f45a7200640 1 -- start start 2024-05-27T06:30:16.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.464+0000 7f45a7200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45a00d0810 0x7f45a0146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:16.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.464+0000 7f45a7200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45a01610c0 0x7f45a009ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:16.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.464+0000 7f45a7200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45a0162a20 0x7f45a0165420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:16.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.464+0000 7f45a7200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f45a0161650 con 0x7f45a01610c0 2024-05-27T06:30:16.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.464+0000 7f45a7200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f45a01614d0 con 0x7f45a0162a20 2024-05-27T06:30:16.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.464+0000 7f45a7200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f45a016ac70 con 0x7f45a00d0810 2024-05-27T06:30:16.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.464+0000 7f4597400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45a01610c0 0x7f45a009ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:16.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.464+0000 7f4597400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45a01610c0 0x7f45a009ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42232/0 (socket says 172.21.15.87:42232) 2024-05-27T06:30:16.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.464+0000 7f4597400640 1 -- 172.21.15.87:0/481872151 learned_addr learned my addr 172.21.15.87:0/481872151 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:16.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.464+0000 7f459fe00640 1 --2- 172.21.15.87:0/481872151 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45a00d0810 0x7f45a0146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:16.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.464+0000 7f45a5200640 1 --2- 172.21.15.87:0/481872151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45a0162a20 0x7f45a0165420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:16.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.464+0000 7f4597400640 1 -- 172.21.15.87:0/481872151 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45a00d0810 msgr2=0x7f45a0146a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:16.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.464+0000 7f4597400640 1 --2- 172.21.15.87:0/481872151 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45a00d0810 0x7f45a0146a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:16.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.464+0000 7f4597400640 1 -- 172.21.15.87:0/481872151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45a0162a20 msgr2=0x7f45a0165420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:16.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.464+0000 7f4597400640 1 --2- 172.21.15.87:0/481872151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45a0162a20 0x7f45a0165420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:16.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.464+0000 7f4597400640 1 -- 172.21.15.87:0/481872151 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a009db90 con 0x7f45a01610c0 2024-05-27T06:30:16.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.464+0000 7f4597400640 1 --2- 172.21.15.87:0/481872151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45a01610c0 0x7f45a009ec30 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f458800c4e0 tx=0x7f458800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:16.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.464+0000 7f459cc00640 1 -- 172.21.15.87:0/481872151 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4588005cf0 con 0x7f45a01610c0 2024-05-27T06:30:16.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.464+0000 7f459cc00640 1 -- 172.21.15.87:0/481872151 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4588007070 con 0x7f45a01610c0 2024-05-27T06:30:16.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.464+0000 7f45a7200640 1 -- 172.21.15.87:0/481872151 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a009de70 con 0x7f45a01610c0 2024-05-27T06:30:16.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.464+0000 7f459cc00640 1 -- 172.21.15.87:0/481872151 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4588007460 con 0x7f45a01610c0 2024-05-27T06:30:16.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.464+0000 7f45a7200640 1 -- 172.21.15.87:0/481872151 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a009e430 con 0x7f45a01610c0 2024-05-27T06:30:16.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.468+0000 7f45a7200640 1 -- 172.21.15.87:0/481872151 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f45a0168620 con 0x7f45a01610c0 2024-05-27T06:30:16.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.468+0000 7f459cc00640 1 -- 172.21.15.87:0/481872151 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4588007600 con 0x7f45a01610c0 2024-05-27T06:30:16.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.468+0000 7f459cc00640 1 --2- 172.21.15.87:0/481872151 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f457c06f430 0x7f457c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:16.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.468+0000 7f459cc00640 1 -- 172.21.15.87:0/481872151 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f458808f760 con 0x7f45a01610c0 2024-05-27T06:30:16.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.468+0000 7f459fe00640 1 --2- 172.21.15.87:0/481872151 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f457c06f430 0x7f457c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:16.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.468+0000 7f459cc00640 1 --2- 172.21.15.87:0/481872151 >> [v2:172.21.15.149:6817/1551871079,v1:172.21.15.149:6819/1551871079] conn(0x7f457c075920 0x7f457c077db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:16.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.468+0000 7f459cc00640 1 -- 172.21.15.87:0/481872151 --> [v2:172.21.15.149:6817/1551871079,v1:172.21.15.149:6819/1551871079] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f457c078480 con 0x7f457c075920 2024-05-27T06:30:16.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.468+0000 7f459cc00640 1 -- 172.21.15.87:0/481872151 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f458808fbf0 con 0x7f45a01610c0 2024-05-27T06:30:16.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.468+0000 7f45a5200640 1 --2- 172.21.15.87:0/481872151 >> [v2:172.21.15.149:6817/1551871079,v1:172.21.15.149:6819/1551871079] conn(0x7f457c075920 0x7f457c077db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:16.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.468+0000 7f459fe00640 1 --2- 172.21.15.87:0/481872151 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f457c06f430 0x7f457c071940 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f45900af000 tx=0x7f45900a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:16.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.472+0000 7f45a5200640 1 --2- 172.21.15.87:0/481872151 >> [v2:172.21.15.149:6817/1551871079,v1:172.21.15.149:6819/1551871079] conn(0x7f457c075920 0x7f457c077db0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:16.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.472+0000 7f459cc00640 1 -- 172.21.15.87:0/481872151 <== osd.4 v2:172.21.15.149:6817/1551871079 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f457c078480 con 0x7f457c075920 2024-05-27T06:30:16.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.484+0000 7f45a7200640 1 -- 172.21.15.87:0/481872151 --> [v2:172.21.15.149:6817/1551871079,v1:172.21.15.149:6819/1551871079] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f45a006aa30 con 0x7f457c075920 2024-05-27T06:30:16.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.484+0000 7f459cc00640 1 -- 172.21.15.87:0/481872151 <== osd.4 v2:172.21.15.149:6817/1551871079 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f45a006aa30 con 0x7f457c075920 2024-05-27T06:30:16.484 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-27T06:30:16.484 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-27T06:30:16.484 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-27T06:30:16.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.484+0000 7f45a7200640 1 -- 172.21.15.87:0/481872151 >> [v2:172.21.15.149:6817/1551871079,v1:172.21.15.149:6819/1551871079] conn(0x7f457c075920 msgr2=0x7f457c077db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:16.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.484+0000 7f45a7200640 1 --2- 172.21.15.87:0/481872151 >> [v2:172.21.15.149:6817/1551871079,v1:172.21.15.149:6819/1551871079] conn(0x7f457c075920 0x7f457c077db0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:16.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.484+0000 7f45a7200640 1 -- 172.21.15.87:0/481872151 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f457c06f430 msgr2=0x7f457c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:16.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.484+0000 7f45a7200640 1 --2- 172.21.15.87:0/481872151 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f457c06f430 0x7f457c071940 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f45900af000 tx=0x7f45900a7070 comp rx=0 tx=0).stop 2024-05-27T06:30:16.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.484+0000 7f45a7200640 1 -- 172.21.15.87:0/481872151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45a01610c0 msgr2=0x7f45a009ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:16.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.484+0000 7f45a7200640 1 --2- 172.21.15.87:0/481872151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45a01610c0 0x7f45a009ec30 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f458800c4e0 tx=0x7f458800c9a0 comp rx=0 tx=0).stop 2024-05-27T06:30:16.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.484+0000 7f45a5200640 1 -- 172.21.15.87:0/481872151 reap_dead start 2024-05-27T06:30:16.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.484+0000 7f45a7200640 1 -- 172.21.15.87:0/481872151 shutdown_connections 2024-05-27T06:30:16.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.484+0000 7f45a7200640 1 -- 172.21.15.87:0/481872151 >> 172.21.15.87:0/481872151 conn(0x7f45a00b46b0 msgr2=0x7f45a00af4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:16.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.484+0000 7f45a7200640 1 -- 172.21.15.87:0/481872151 shutdown_connections 2024-05-27T06:30:16.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.484+0000 7f45a7200640 1 -- 172.21.15.87:0/481872151 wait complete. 2024-05-27T06:30:16.503 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-27T06:30:16.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.652+0000 7f9629000640 1 Processor -- start 2024-05-27T06:30:16.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.652+0000 7f9629000640 1 -- start start 2024-05-27T06:30:16.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.656+0000 7f9629000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9624074330 0x7f9624074740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:16.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.656+0000 7f9629000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9624074c80 con 0x7f962415cbc0 2024-05-27T06:30:16.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.656+0000 7f9629000640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96240afd40 con 0x7f962406ebd0 2024-05-27T06:30:16.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.656+0000 7f9629000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f962415cfd0 con 0x7f9624074330 2024-05-27T06:30:16.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.656+0000 7f9621400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9624074330 0x7f9624074740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:16.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.656+0000 7f9621400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9624074330 0x7f9624074740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42236/0 (socket says 172.21.15.87:42236) 2024-05-27T06:30:16.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.656+0000 7f9621e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f962415cbc0 0x7f96240af540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40402/0 (socket says 172.21.15.87:40402) 2024-05-27T06:30:16.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.656+0000 7f9621400640 1 -- 172.21.15.87:0/3070077683 learned_addr learned my addr 172.21.15.87:0/3070077683 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:16.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.656+0000 7f9621400640 1 -- 172.21.15.87:0/3070077683 >> v1:172.21.15.149:6789/0 conn(0x7f962406ebd0 legacy=0x7f962406efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:16.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.656+0000 7f9621400640 1 -- 172.21.15.87:0/3070077683 >> v1:172.21.15.87:6789/0 conn(0x7f962415cbc0 legacy=0x7f96240af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:16.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.656+0000 7f9621400640 1 -- 172.21.15.87:0/3070077683 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96240b0020 con 0x7f9624074330 2024-05-27T06:30:16.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.656+0000 7f9620a00640 1 -- 172.21.15.87:0/3070077683 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3713667965 0 0) 0x7f96140014a0 con 0x7f962415cbc0 2024-05-27T06:30:16.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.660+0000 7f9621400640 1 --2- 172.21.15.87:0/3070077683 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9624074330 0x7f9624074740 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9610009870 tx=0x7f961001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9a73336d9a5f08 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:16.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.660+0000 7f9620a00640 1 -- 172.21.15.87:0/3070077683 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96100b0070 con 0x7f9624074330 2024-05-27T06:30:16.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.660+0000 7f9620a00640 1 -- 172.21.15.87:0/3070077683 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96100ab600 con 0x7f9624074330 2024-05-27T06:30:16.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.660+0000 7f9620a00640 1 -- 172.21.15.87:0/3070077683 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962406ff00 con 0x7f9624074330 2024-05-27T06:30:16.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.660+0000 7f9629000640 1 -- 172.21.15.87:0/3070077683 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9624074330 msgr2=0x7f9624074740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:16.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.660+0000 7f9629000640 1 --2- 172.21.15.87:0/3070077683 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9624074330 0x7f9624074740 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9610009870 tx=0x7f961001c4d0 comp rx=0 tx=0).stop 2024-05-27T06:30:16.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.660+0000 7f9629000640 1 -- 172.21.15.87:0/3070077683 shutdown_connections 2024-05-27T06:30:16.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.660+0000 7f9629000640 1 --2- 172.21.15.87:0/3070077683 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9624074330 0x7f9624074740 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:16.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.660+0000 7f9629000640 1 -- 172.21.15.87:0/3070077683 >> 172.21.15.87:0/3070077683 conn(0x7f96240b2fb0 msgr2=0x7f96240b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:16.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.660+0000 7f9629000640 1 -- 172.21.15.87:0/3070077683 shutdown_connections 2024-05-27T06:30:16.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.660+0000 7f9629000640 1 -- 172.21.15.87:0/3070077683 wait complete. 2024-05-27T06:30:16.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.660+0000 7f9629000640 1 Processor -- start 2024-05-27T06:30:16.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.660+0000 7f9629000640 1 -- start start 2024-05-27T06:30:16.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.664+0000 7f9629000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f962406ebd0 0x7f962415b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:16.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.664+0000 7f9629000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9624074330 0x7f9624157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:16.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.664+0000 7f9629000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f962415cbc0 0x7f9624146340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:16.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.664+0000 7f9629000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f962416ae20 con 0x7f9624074330 2024-05-27T06:30:16.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.664+0000 7f9629000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f962416aca0 con 0x7f962406ebd0 2024-05-27T06:30:16.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.664+0000 7f9629000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f962416afa0 con 0x7f962415cbc0 2024-05-27T06:30:16.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.664+0000 7f9621400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9624074330 0x7f9624157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:16.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.664+0000 7f9621400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9624074330 0x7f9624157650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42248/0 (socket says 172.21.15.87:42248) 2024-05-27T06:30:16.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.664+0000 7f9621400640 1 -- 172.21.15.87:0/3254162598 learned_addr learned my addr 172.21.15.87:0/3254162598 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:16.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.664+0000 7f9622800640 1 --2- 172.21.15.87:0/3254162598 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f962415cbc0 0x7f9624146340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:16.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.664+0000 7f9621e00640 1 --2- 172.21.15.87:0/3254162598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f962406ebd0 0x7f962415b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:16.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.664+0000 7f9621400640 1 -- 172.21.15.87:0/3254162598 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f962415cbc0 msgr2=0x7f9624146340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:16.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.664+0000 7f9621400640 1 --2- 172.21.15.87:0/3254162598 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f962415cbc0 0x7f9624146340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:16.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.664+0000 7f9621400640 1 -- 172.21.15.87:0/3254162598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f962406ebd0 msgr2=0x7f962415b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:16.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.664+0000 7f9621400640 1 --2- 172.21.15.87:0/3254162598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f962406ebd0 0x7f962415b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:16.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.664+0000 7f9621400640 1 -- 172.21.15.87:0/3254162598 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f962415a560 con 0x7f9624074330 2024-05-27T06:30:16.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.664+0000 7f9621e00640 1 --2- 172.21.15.87:0/3254162598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f962406ebd0 0x7f962415b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:30:16.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.664+0000 7f9621400640 1 --2- 172.21.15.87:0/3254162598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9624074330 0x7f9624157650 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f96100ae040 tx=0x7f961001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:16.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.664+0000 7f961a000640 1 -- 172.21.15.87:0/3254162598 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96100b0040 con 0x7f9624074330 2024-05-27T06:30:16.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.664+0000 7f961a000640 1 -- 172.21.15.87:0/3254162598 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96100bc070 con 0x7f9624074330 2024-05-27T06:30:16.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.664+0000 7f9629000640 1 -- 172.21.15.87:0/3254162598 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f962415a840 con 0x7f9624074330 2024-05-27T06:30:16.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.664+0000 7f961a000640 1 -- 172.21.15.87:0/3254162598 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96100b6880 con 0x7f9624074330 2024-05-27T06:30:16.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.664+0000 7f9629000640 1 -- 172.21.15.87:0/3254162598 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f962409ba20 con 0x7f9624074330 2024-05-27T06:30:16.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.664+0000 7f9629000640 1 -- 172.21.15.87:0/3254162598 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96241598c0 con 0x7f9624074330 2024-05-27T06:30:16.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.668+0000 7f961a000640 1 -- 172.21.15.87:0/3254162598 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f96100b6a20 con 0x7f9624074330 2024-05-27T06:30:16.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.668+0000 7f961a000640 1 --2- 172.21.15.87:0/3254162598 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f960406f430 0x7f9604071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:16.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.668+0000 7f961a000640 1 -- 172.21.15.87:0/3254162598 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f9610129680 con 0x7f9624074330 2024-05-27T06:30:16.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.668+0000 7f9621e00640 1 --2- 172.21.15.87:0/3254162598 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f960406f430 0x7f9604071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:16.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.668+0000 7f9621e00640 1 --2- 172.21.15.87:0/3254162598 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f960406f430 0x7f9604071940 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f96140012f0 tx=0x7f9614005c60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:16.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.672+0000 7f961a000640 1 -- 172.21.15.87:0/3254162598 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f9610016150 con 0x7f9624074330 2024-05-27T06:30:16.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.832+0000 7f9629000640 1 -- 172.21.15.87:0/3254162598 --> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f962409bd20 con 0x7f960406f430 2024-05-27T06:30:16.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.832+0000 7f961a000640 1 -- 172.21.15.87:0/3254162598 <== mgr.4111 v2:172.21.15.87:6832/2724754260 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f962409bd20 con 0x7f960406f430 2024-05-27T06:30:16.830 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 4 to deep-scrub 2024-05-27T06:30:16.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.832+0000 7f9629000640 1 -- 172.21.15.87:0/3254162598 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f960406f430 msgr2=0x7f9604071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:16.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.832+0000 7f9629000640 1 --2- 172.21.15.87:0/3254162598 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f960406f430 0x7f9604071940 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f96140012f0 tx=0x7f9614005c60 comp rx=0 tx=0).stop 2024-05-27T06:30:16.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.832+0000 7f9629000640 1 -- 172.21.15.87:0/3254162598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9624074330 msgr2=0x7f9624157650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:16.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.832+0000 7f9629000640 1 --2- 172.21.15.87:0/3254162598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9624074330 0x7f9624157650 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f96100ae040 tx=0x7f961001ad10 comp rx=0 tx=0).stop 2024-05-27T06:30:16.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.832+0000 7f9629000640 1 -- 172.21.15.87:0/3254162598 shutdown_connections 2024-05-27T06:30:16.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.832+0000 7f9629000640 1 --2- 172.21.15.87:0/3254162598 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f960406f430 0x7f9604071940 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:16.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.832+0000 7f9629000640 1 --2- 172.21.15.87:0/3254162598 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f962415cbc0 0x7f9624146340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:16.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.832+0000 7f9629000640 1 --2- 172.21.15.87:0/3254162598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9624074330 0x7f9624157650 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:16.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.832+0000 7f9629000640 1 --2- 172.21.15.87:0/3254162598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f962406ebd0 0x7f962415b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:16.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.832+0000 7f9629000640 1 -- 172.21.15.87:0/3254162598 >> 172.21.15.87:0/3254162598 conn(0x7f96240b2fb0 msgr2=0x7f9624158090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:16.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.832+0000 7f9629000640 1 -- 172.21.15.87:0/3254162598 shutdown_connections 2024-05-27T06:30:16.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:16.832+0000 7f9629000640 1 -- 172.21.15.87:0/3254162598 wait complete. 2024-05-27T06:30:16.851 INFO:tasks.ceph:Scrubbing osd.5 2024-05-27T06:30:16.851 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-27T06:30:17.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.004+0000 7fa1d8400640 1 Processor -- start 2024-05-27T06:30:17.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.004+0000 7fa1d8400640 1 -- start start 2024-05-27T06:30:17.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.004+0000 7fa1d8400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa1d015c3f0 0x7fa1d015d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:17.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.004+0000 7fa1d8400640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1d006db10 con 0x7fa1d0160740 2024-05-27T06:30:17.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.004+0000 7fa1d8400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1d00cf2a0 con 0x7fa1d00ce3f0 2024-05-27T06:30:17.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.004+0000 7fa1d8400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fa1d00cf580 con 0x7fa1d015c3f0 2024-05-27T06:30:17.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.004+0000 7fa1d5a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa1d015c3f0 0x7fa1d015d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:17.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.004+0000 7fa1d5000640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fa1d0160740 0x7fa1d00cdce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40414/0 (socket says 172.21.15.87:40414) 2024-05-27T06:30:17.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.004+0000 7fa1d5000640 1 -- 172.21.15.87:0/4108391256 learned_addr learned my addr 172.21.15.87:0/4108391256 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:30:17.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.004+0000 7fa1d5a00640 1 -- 172.21.15.87:0/4108391256 >> v1:172.21.15.149:6789/0 conn(0x7fa1d00ce3f0 legacy=0x7fa1d006c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:17.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.004+0000 7fa1d5a00640 1 -- 172.21.15.87:0/4108391256 >> v1:172.21.15.87:6789/0 conn(0x7fa1d0160740 legacy=0x7fa1d00cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:17.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.004+0000 7fa1d5a00640 1 -- 172.21.15.87:0/4108391256 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d015ff40 con 0x7fa1d015c3f0 2024-05-27T06:30:17.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.004+0000 7fa1cfe00640 1 -- 172.21.15.87:0/4108391256 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1534082118 0 0) 0x7fa1bc001120 con 0x7fa1d0160740 2024-05-27T06:30:17.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.008+0000 7fa1d5a00640 1 --2- 172.21.15.87:0/4108391256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1d015c3f0 0x7fa1d015d350 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4009d90 tx=0x7fa1c401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe89ac3a071262b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:17.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.008+0000 7fa1cfe00640 1 -- 172.21.15.87:0/4108391256 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c40b2070 con 0x7fa1d015c3f0 2024-05-27T06:30:17.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.008+0000 7fa1cfe00640 1 -- 172.21.15.87:0/4108391256 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c40a57b0 con 0x7fa1d015c3f0 2024-05-27T06:30:17.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.008+0000 7fa1cfe00640 1 -- 172.21.15.87:0/4108391256 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c40a5b80 con 0x7fa1d015c3f0 2024-05-27T06:30:17.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.008+0000 7fa1d8400640 1 -- 172.21.15.87:0/4108391256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1d015c3f0 msgr2=0x7fa1d015d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:17.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.008+0000 7fa1d8400640 1 --2- 172.21.15.87:0/4108391256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1d015c3f0 0x7fa1d015d350 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4009d90 tx=0x7fa1c401c970 comp rx=0 tx=0).stop 2024-05-27T06:30:17.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.008+0000 7fa1d8400640 1 -- 172.21.15.87:0/4108391256 shutdown_connections 2024-05-27T06:30:17.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.008+0000 7fa1d8400640 1 --2- 172.21.15.87:0/4108391256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1d015c3f0 0x7fa1d015d350 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.008+0000 7fa1d8400640 1 -- 172.21.15.87:0/4108391256 >> 172.21.15.87:0/4108391256 conn(0x7fa1d00b46b0 msgr2=0x7fa1d00b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:17.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.008+0000 7fa1d8400640 1 -- 172.21.15.87:0/4108391256 shutdown_connections 2024-05-27T06:30:17.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.008+0000 7fa1d8400640 1 -- 172.21.15.87:0/4108391256 wait complete. 2024-05-27T06:30:17.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.012+0000 7fa1d8400640 1 Processor -- start 2024-05-27T06:30:17.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.012+0000 7fa1d8400640 1 -- start start 2024-05-27T06:30:17.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.012+0000 7fa1d8400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1d015c3f0 0x7fa1d01567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:17.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.012+0000 7fa1d8400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1d0160740 0x7fa1d0141850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:17.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.012+0000 7fa1d8400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1d01fabf0 0x7fa1d01fb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:17.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.012+0000 7fa1d8400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d016a050 con 0x7fa1d015c3f0 2024-05-27T06:30:17.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.012+0000 7fa1d8400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d0160d60 con 0x7fa1d01fabf0 2024-05-27T06:30:17.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.012+0000 7fa1d8400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa1d016a1d0 con 0x7fa1d0160740 2024-05-27T06:30:17.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.012+0000 7fa1d5a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1d015c3f0 0x7fa1d01567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:17.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.012+0000 7fa1d5a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1d015c3f0 0x7fa1d01567f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42272/0 (socket says 172.21.15.87:42272) 2024-05-27T06:30:17.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.012+0000 7fa1d5a00640 1 -- 172.21.15.87:0/294385695 learned_addr learned my addr 172.21.15.87:0/294385695 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:17.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.012+0000 7fa1d5000640 1 --2- 172.21.15.87:0/294385695 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1d0160740 0x7fa1d0141850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:17.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.012+0000 7fa1d6400640 1 --2- 172.21.15.87:0/294385695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1d01fabf0 0x7fa1d01fb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:17.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.012+0000 7fa1d5a00640 1 -- 172.21.15.87:0/294385695 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1d0160740 msgr2=0x7fa1d0141850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:17.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.012+0000 7fa1d5a00640 1 --2- 172.21.15.87:0/294385695 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1d0160740 0x7fa1d0141850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.012+0000 7fa1d5a00640 1 -- 172.21.15.87:0/294385695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1d01fabf0 msgr2=0x7fa1d01fb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:17.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.012+0000 7fa1d5a00640 1 --2- 172.21.15.87:0/294385695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa1d01fabf0 0x7fa1d01fb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.012+0000 7fa1d5a00640 1 -- 172.21.15.87:0/294385695 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d01fb540 con 0x7fa1d015c3f0 2024-05-27T06:30:17.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.012+0000 7fa1d5a00640 1 --2- 172.21.15.87:0/294385695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1d015c3f0 0x7fa1d01567f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4009d90 tx=0x7fa1c4019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:17.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.016+0000 7fa1cd600640 1 -- 172.21.15.87:0/294385695 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c40b2040 con 0x7fa1d015c3f0 2024-05-27T06:30:17.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.016+0000 7fa1cd600640 1 -- 172.21.15.87:0/294385695 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c40bf070 con 0x7fa1d015c3f0 2024-05-27T06:30:17.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.016+0000 7fa1cd600640 1 -- 172.21.15.87:0/294385695 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c40b8870 con 0x7fa1d015c3f0 2024-05-27T06:30:17.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.016+0000 7fa1d8400640 1 -- 172.21.15.87:0/294385695 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d0142410 con 0x7fa1d015c3f0 2024-05-27T06:30:17.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.016+0000 7fa1d8400640 1 -- 172.21.15.87:0/294385695 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d013f810 con 0x7fa1d015c3f0 2024-05-27T06:30:17.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.016+0000 7fa1d8400640 1 -- 172.21.15.87:0/294385695 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa1d006aa30 con 0x7fa1d015c3f0 2024-05-27T06:30:17.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.016+0000 7fa1cd600640 1 -- 172.21.15.87:0/294385695 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa1c40a5630 con 0x7fa1d015c3f0 2024-05-27T06:30:17.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.016+0000 7fa1cd600640 1 --2- 172.21.15.87:0/294385695 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa1b006f400 0x7fa1b0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:17.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.016+0000 7fa1cd600640 1 -- 172.21.15.87:0/294385695 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7fa1c412acb0 con 0x7fa1d015c3f0 2024-05-27T06:30:17.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.016+0000 7fa1d5000640 1 --2- 172.21.15.87:0/294385695 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa1b006f400 0x7fa1b0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:17.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.016+0000 7fa1cd600640 1 --2- 172.21.15.87:0/294385695 >> [v2:172.21.15.149:6816/582864816,v1:172.21.15.149:6818/582864816] conn(0x7fa1b00758f0 0x7fa1b0077d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:17.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.016+0000 7fa1cd600640 1 -- 172.21.15.87:0/294385695 --> [v2:172.21.15.149:6816/582864816,v1:172.21.15.149:6818/582864816] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa1c4009a50 con 0x7fa1b00758f0 2024-05-27T06:30:17.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.016+0000 7fa1cd600640 1 -- 172.21.15.87:0/294385695 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7fa1c412b140 con 0x7fa1d015c3f0 2024-05-27T06:30:17.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.020+0000 7fa1d5000640 1 --2- 172.21.15.87:0/294385695 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa1b006f400 0x7fa1b0071910 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa1d015f6c0 tx=0x7fa1bc007c10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:17.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.020+0000 7fa1d6400640 1 --2- 172.21.15.87:0/294385695 >> [v2:172.21.15.149:6816/582864816,v1:172.21.15.149:6818/582864816] conn(0x7fa1b00758f0 0x7fa1b0077d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:17.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.020+0000 7fa1d6400640 1 --2- 172.21.15.87:0/294385695 >> [v2:172.21.15.149:6816/582864816,v1:172.21.15.149:6818/582864816] conn(0x7fa1b00758f0 0x7fa1b0077d80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:17.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.020+0000 7fa1cd600640 1 -- 172.21.15.87:0/294385695 <== osd.5 v2:172.21.15.149:6816/582864816 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa1c4009a50 con 0x7fa1b00758f0 2024-05-27T06:30:17.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.032+0000 7fa1d8400640 1 -- 172.21.15.87:0/294385695 --> [v2:172.21.15.149:6816/582864816,v1:172.21.15.149:6818/582864816] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa1d00cfea0 con 0x7fa1b00758f0 2024-05-27T06:30:17.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.032+0000 7fa1cd600640 1 -- 172.21.15.87:0/294385695 <== osd.5 v2:172.21.15.149:6816/582864816 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa1d00cfea0 con 0x7fa1b00758f0 2024-05-27T06:30:17.035 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-27T06:30:17.035 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-27T06:30:17.035 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-27T06:30:17.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.032+0000 7fa1d8400640 1 -- 172.21.15.87:0/294385695 >> [v2:172.21.15.149:6816/582864816,v1:172.21.15.149:6818/582864816] conn(0x7fa1b00758f0 msgr2=0x7fa1b0077d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:17.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.032+0000 7fa1d8400640 1 --2- 172.21.15.87:0/294385695 >> [v2:172.21.15.149:6816/582864816,v1:172.21.15.149:6818/582864816] conn(0x7fa1b00758f0 0x7fa1b0077d80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.032+0000 7fa1d8400640 1 -- 172.21.15.87:0/294385695 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa1b006f400 msgr2=0x7fa1b0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:17.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.032+0000 7fa1d8400640 1 --2- 172.21.15.87:0/294385695 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa1b006f400 0x7fa1b0071910 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa1d015f6c0 tx=0x7fa1bc007c10 comp rx=0 tx=0).stop 2024-05-27T06:30:17.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.032+0000 7fa1d8400640 1 -- 172.21.15.87:0/294385695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1d015c3f0 msgr2=0x7fa1d01567f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:17.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.032+0000 7fa1d8400640 1 --2- 172.21.15.87:0/294385695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1d015c3f0 0x7fa1d01567f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4009d90 tx=0x7fa1c4019710 comp rx=0 tx=0).stop 2024-05-27T06:30:17.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.032+0000 7fa1d6400640 1 -- 172.21.15.87:0/294385695 reap_dead start 2024-05-27T06:30:17.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.032+0000 7fa1d8400640 1 -- 172.21.15.87:0/294385695 shutdown_connections 2024-05-27T06:30:17.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.032+0000 7fa1d8400640 1 -- 172.21.15.87:0/294385695 >> 172.21.15.87:0/294385695 conn(0x7fa1d00b46b0 msgr2=0x7fa1d00ae190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:17.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.032+0000 7fa1d8400640 1 -- 172.21.15.87:0/294385695 shutdown_connections 2024-05-27T06:30:17.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.036+0000 7fa1d8400640 1 -- 172.21.15.87:0/294385695 wait complete. 2024-05-27T06:30:17.051 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-27T06:30:17.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.200+0000 7fb2dd200640 1 Processor -- start 2024-05-27T06:30:17.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.200+0000 7fb2dd200640 1 -- start start 2024-05-27T06:30:17.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.200+0000 7fb2dd200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2d80d0bd0 0x7fb2d81635b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:17.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.200+0000 7fb2dd200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb2d8163af0 0x7fb2d815ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:17.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.200+0000 7fb2dd200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d80d0fe0 con 0x7fb2d8160500 2024-05-27T06:30:17.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.200+0000 7fb2dd200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fb2d8163f00 con 0x7fb2d8163af0 2024-05-27T06:30:17.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.200+0000 7fb2dd200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb2d80cf710 con 0x7fb2d80d0bd0 2024-05-27T06:30:17.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.200+0000 7fb2d7e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb2d8160500 0x7fb2d8160910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40426/0 (socket says 172.21.15.87:40426) 2024-05-27T06:30:17.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.200+0000 7fb2d7e00640 1 -- 172.21.15.87:0/4033024095 learned_addr learned my addr 172.21.15.87:0/4033024095 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:30:17.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.204+0000 7fb2cea00640 1 --2- 172.21.15.87:0/4033024095 >> v2:172.21.15.149:3300/0 conn(0x7fb2d8163af0 0x7fb2d815ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:17.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.204+0000 7fb2d7400640 1 --2- 172.21.15.87:0/4033024095 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2d80d0bd0 0x7fb2d81635b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:17.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.204+0000 7fb2d6a00640 1 -- 172.21.15.87:0/4033024095 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3731620428 0 0) 0x7fb2d80d0fe0 con 0x7fb2d8160500 2024-05-27T06:30:17.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.204+0000 7fb2d6a00640 1 -- 172.21.15.87:0/4033024095 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2bc003530 con 0x7fb2d8160500 2024-05-27T06:30:17.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.204+0000 7fb2d6a00640 1 -- 172.21.15.87:0/4033024095 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4147541795 0 0) 0x7fb2bc003530 con 0x7fb2d8160500 2024-05-27T06:30:17.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.204+0000 7fb2cea00640 1 -- 172.21.15.87:0/4033024095 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2d80d0bd0 msgr2=0x7fb2d81635b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:17.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.204+0000 7fb2cea00640 1 --2- 172.21.15.87:0/4033024095 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2d80d0bd0 0x7fb2d81635b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.204+0000 7fb2cea00640 1 -- 172.21.15.87:0/4033024095 >> v1:172.21.15.87:6789/0 conn(0x7fb2d8160500 legacy=0x7fb2d8160910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:17.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.204+0000 7fb2cea00640 1 -- 172.21.15.87:0/4033024095 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d80cf9f0 con 0x7fb2d8163af0 2024-05-27T06:30:17.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.204+0000 7fb2d7400640 1 --2- 172.21.15.87:0/4033024095 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2d80d0bd0 0x7fb2d81635b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:30:17.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.204+0000 7fb2cea00640 1 --2- 172.21.15.87:0/4033024095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2d8163af0 0x7fb2d815ffc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00097c0 tx=0x7fb2c001c300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74754112aa33068c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:17.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.208+0000 7fb2d6a00640 1 -- 172.21.15.87:0/4033024095 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c00b0070 con 0x7fb2d8163af0 2024-05-27T06:30:17.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.208+0000 7fb2d6a00640 1 -- 172.21.15.87:0/4033024095 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2c00ab400 con 0x7fb2d8163af0 2024-05-27T06:30:17.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.208+0000 7fb2d6a00640 1 -- 172.21.15.87:0/4033024095 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0001a80 con 0x7fb2d8163af0 2024-05-27T06:30:17.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.208+0000 7fb2dd200640 1 -- 172.21.15.87:0/4033024095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2d8163af0 msgr2=0x7fb2d815ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:17.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.208+0000 7fb2dd200640 1 --2- 172.21.15.87:0/4033024095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2d8163af0 0x7fb2d815ffc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00097c0 tx=0x7fb2c001c300 comp rx=0 tx=0).stop 2024-05-27T06:30:17.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.208+0000 7fb2dd200640 1 -- 172.21.15.87:0/4033024095 shutdown_connections 2024-05-27T06:30:17.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.208+0000 7fb2dd200640 1 --2- 172.21.15.87:0/4033024095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2d8163af0 0x7fb2d815ffc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.208+0000 7fb2dd200640 1 --2- 172.21.15.87:0/4033024095 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2d80d0bd0 0x7fb2d81635b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.208+0000 7fb2dd200640 1 -- 172.21.15.87:0/4033024095 >> 172.21.15.87:0/4033024095 conn(0x7fb2d80712e0 msgr2=0x7fb2d80716f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:17.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.208+0000 7fb2dd200640 1 -- 172.21.15.87:0/4033024095 shutdown_connections 2024-05-27T06:30:17.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.208+0000 7fb2dd200640 1 -- 172.21.15.87:0/4033024095 wait complete. 2024-05-27T06:30:17.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.208+0000 7fb2dd200640 1 Processor -- start 2024-05-27T06:30:17.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.208+0000 7fb2dd200640 1 -- start start 2024-05-27T06:30:17.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.212+0000 7fb2dd200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2d80d0bd0 0x7fb2d81544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:17.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.212+0000 7fb2dd200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2d8160500 0x7fb2d815c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:17.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.212+0000 7fb2dd200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2d8163af0 0x7fb2d815cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:17.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.212+0000 7fb2dd200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d80cf360 con 0x7fb2d8160500 2024-05-27T06:30:17.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.212+0000 7fb2dd200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d815d930 con 0x7fb2d80d0bd0 2024-05-27T06:30:17.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.212+0000 7fb2dd200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb2d815b120 con 0x7fb2d8163af0 2024-05-27T06:30:17.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.212+0000 7fb2cea00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2d8160500 0x7fb2d815c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:17.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.212+0000 7fb2cea00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2d8160500 0x7fb2d815c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42288/0 (socket says 172.21.15.87:42288) 2024-05-27T06:30:17.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.212+0000 7fb2cea00640 1 -- 172.21.15.87:0/3555252447 learned_addr learned my addr 172.21.15.87:0/3555252447 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:17.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.212+0000 7fb2d7400640 1 --2- 172.21.15.87:0/3555252447 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2d80d0bd0 0x7fb2d81544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:17.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.212+0000 7fb2d7e00640 1 --2- 172.21.15.87:0/3555252447 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2d8163af0 0x7fb2d815cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:17.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.212+0000 7fb2cea00640 1 -- 172.21.15.87:0/3555252447 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2d8163af0 msgr2=0x7fb2d815cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:17.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.212+0000 7fb2cea00640 1 --2- 172.21.15.87:0/3555252447 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2d8163af0 0x7fb2d815cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.212+0000 7fb2cea00640 1 -- 172.21.15.87:0/3555252447 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2d80d0bd0 msgr2=0x7fb2d81544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:17.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.212+0000 7fb2cea00640 1 --2- 172.21.15.87:0/3555252447 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2d80d0bd0 0x7fb2d81544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.212+0000 7fb2cea00640 1 -- 172.21.15.87:0/3555252447 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d806cfb0 con 0x7fb2d8160500 2024-05-27T06:30:17.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.212+0000 7fb2cea00640 1 --2- 172.21.15.87:0/3555252447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2d8160500 0x7fb2d815c630 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00ae040 tx=0x7fb2c00190a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:17.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.212+0000 7fb2cfe00640 1 -- 172.21.15.87:0/3555252447 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c00bb070 con 0x7fb2d8160500 2024-05-27T06:30:17.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.212+0000 7fb2cfe00640 1 -- 172.21.15.87:0/3555252447 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2c0004020 con 0x7fb2d8160500 2024-05-27T06:30:17.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.212+0000 7fb2dd200640 1 -- 172.21.15.87:0/3555252447 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d8157270 con 0x7fb2d8160500 2024-05-27T06:30:17.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.212+0000 7fb2cfe00640 1 -- 172.21.15.87:0/3555252447 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c00b0040 con 0x7fb2d8160500 2024-05-27T06:30:17.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.212+0000 7fb2dd200640 1 -- 172.21.15.87:0/3555252447 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d80af900 con 0x7fb2d8160500 2024-05-27T06:30:17.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.212+0000 7fb2dd200640 1 -- 172.21.15.87:0/3555252447 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2d80508e0 con 0x7fb2d8160500 2024-05-27T06:30:17.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.216+0000 7fb2cfe00640 1 -- 172.21.15.87:0/3555252447 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb2c00b3040 con 0x7fb2d8160500 2024-05-27T06:30:17.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.216+0000 7fb2cfe00640 1 --2- 172.21.15.87:0/3555252447 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb2b406f400 0x7fb2b4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:17.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.216+0000 7fb2cfe00640 1 -- 172.21.15.87:0/3555252447 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7fb2c01291e0 con 0x7fb2d8160500 2024-05-27T06:30:17.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.216+0000 7fb2d7400640 1 --2- 172.21.15.87:0/3555252447 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb2b406f400 0x7fb2b4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:17.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.216+0000 7fb2d7400640 1 --2- 172.21.15.87:0/3555252447 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb2b406f400 0x7fb2b4071910 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009510 tx=0x7fb2c8006f90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:17.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.220+0000 7fb2cfe00640 1 -- 172.21.15.87:0/3555252447 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb2c0015fb0 con 0x7fb2d8160500 2024-05-27T06:30:17.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.376+0000 7fb2dd200640 1 -- 172.21.15.87:0/3555252447 --> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fb2d81602e0 con 0x7fb2b406f400 2024-05-27T06:30:17.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.376+0000 7fb2cfe00640 1 -- 172.21.15.87:0/3555252447 <== mgr.4111 v2:172.21.15.87:6832/2724754260 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb2d81602e0 con 0x7fb2b406f400 2024-05-27T06:30:17.376 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 5 to deep-scrub 2024-05-27T06:30:17.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.380+0000 7fb2dd200640 1 -- 172.21.15.87:0/3555252447 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb2b406f400 msgr2=0x7fb2b4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:17.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.380+0000 7fb2dd200640 1 --2- 172.21.15.87:0/3555252447 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb2b406f400 0x7fb2b4071910 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009510 tx=0x7fb2c8006f90 comp rx=0 tx=0).stop 2024-05-27T06:30:17.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.380+0000 7fb2dd200640 1 -- 172.21.15.87:0/3555252447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2d8160500 msgr2=0x7fb2d815c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:17.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.380+0000 7fb2dd200640 1 --2- 172.21.15.87:0/3555252447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2d8160500 0x7fb2d815c630 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00ae040 tx=0x7fb2c00190a0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.380+0000 7fb2dd200640 1 -- 172.21.15.87:0/3555252447 shutdown_connections 2024-05-27T06:30:17.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.380+0000 7fb2dd200640 1 --2- 172.21.15.87:0/3555252447 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fb2b406f400 0x7fb2b4071910 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.380+0000 7fb2dd200640 1 --2- 172.21.15.87:0/3555252447 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2d8163af0 0x7fb2d815cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.380+0000 7fb2dd200640 1 --2- 172.21.15.87:0/3555252447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2d8160500 0x7fb2d815c630 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.380+0000 7fb2dd200640 1 --2- 172.21.15.87:0/3555252447 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2d80d0bd0 0x7fb2d81544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.380+0000 7fb2dd200640 1 -- 172.21.15.87:0/3555252447 >> 172.21.15.87:0/3555252447 conn(0x7fb2d80712e0 msgr2=0x7fb2d80d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:17.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.380+0000 7fb2dd200640 1 -- 172.21.15.87:0/3555252447 shutdown_connections 2024-05-27T06:30:17.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.380+0000 7fb2dd200640 1 -- 172.21.15.87:0/3555252447 wait complete. 2024-05-27T06:30:17.397 INFO:tasks.ceph:Scrubbing osd.6 2024-05-27T06:30:17.398 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-27T06:30:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.548+0000 7f792e000640 1 Processor -- start 2024-05-27T06:30:17.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.548+0000 7f792e000640 1 -- start start 2024-05-27T06:30:17.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.552+0000 7f792e000640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7928157310 0x7f792815dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:17.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.552+0000 7f792e000640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f79280d1700 0x7f79280d1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:17.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.552+0000 7f792e000640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f792815e110 con 0x7f792806c940 2024-05-27T06:30:17.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.552+0000 7f792e000640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f79280d0140 con 0x7f7928157310 2024-05-27T06:30:17.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.552+0000 7f792e000640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f79280d2050 con 0x7f79280d1700 2024-05-27T06:30:17.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.552+0000 7f7927400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7928157310 0x7f792815dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.552+0000 7f7927e00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f792806c940 0x7f792806cd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40432/0 (socket says 172.21.15.87:40432) 2024-05-27T06:30:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.552+0000 7f7927e00640 1 -- 172.21.15.87:0/2985477826 learned_addr learned my addr 172.21.15.87:0/2985477826 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:30:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.552+0000 7f791fe00640 1 --2- 172.21.15.87:0/2985477826 >> v2:172.21.15.149:3300/0 conn(0x7f79280d1700 0x7f79280d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.552+0000 7f7927400640 1 -- 172.21.15.87:0/2985477826 >> v2:172.21.15.149:3300/0 conn(0x7f79280d1700 msgr2=0x7f79280d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.552+0000 7f7927400640 1 --2- 172.21.15.87:0/2985477826 >> v2:172.21.15.149:3300/0 conn(0x7f79280d1700 0x7f79280d1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.552+0000 7f7927400640 1 -- 172.21.15.87:0/2985477826 >> v1:172.21.15.87:6789/0 conn(0x7f792806c940 legacy=0x7f792806cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.552+0000 7f7927400640 1 -- 172.21.15.87:0/2985477826 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79280cf530 con 0x7f7928157310 2024-05-27T06:30:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.552+0000 7f7926a00640 1 -- 172.21.15.87:0/2985477826 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1544696999 0 0) 0x7f79200014a0 con 0x7f792806c940 2024-05-27T06:30:17.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.556+0000 7f7927400640 1 --2- 172.21.15.87:0/2985477826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7928157310 0x7f792815dbd0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f79180097c0 tx=0x7f791801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132b3a1ca93bb70d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:17.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.556+0000 7f7926a00640 1 -- 172.21.15.87:0/2985477826 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79180b0070 con 0x7f7928157310 2024-05-27T06:30:17.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.556+0000 7f7926a00640 1 -- 172.21.15.87:0/2985477826 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79180ab600 con 0x7f7928157310 2024-05-27T06:30:17.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.556+0000 7f7926a00640 1 -- 172.21.15.87:0/2985477826 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79180ab9d0 con 0x7f7928157310 2024-05-27T06:30:17.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.556+0000 7f792e000640 1 -- 172.21.15.87:0/2985477826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7928157310 msgr2=0x7f792815dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:17.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.556+0000 7f792e000640 1 --2- 172.21.15.87:0/2985477826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7928157310 0x7f792815dbd0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f79180097c0 tx=0x7f791801c3d0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.556+0000 7f792e000640 1 -- 172.21.15.87:0/2985477826 shutdown_connections 2024-05-27T06:30:17.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.556+0000 7f792e000640 1 --2- 172.21.15.87:0/2985477826 >> v2:172.21.15.149:3300/0 conn(0x7f79280d1700 0x7f79280d1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.556+0000 7f792e000640 1 --2- 172.21.15.87:0/2985477826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7928157310 0x7f792815dbd0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.556+0000 7f792e000640 1 -- 172.21.15.87:0/2985477826 >> 172.21.15.87:0/2985477826 conn(0x7f79280b46b0 msgr2=0x7f79280b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:17.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.556+0000 7f792e000640 1 -- 172.21.15.87:0/2985477826 shutdown_connections 2024-05-27T06:30:17.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.556+0000 7f792e000640 1 -- 172.21.15.87:0/2985477826 wait complete. 2024-05-27T06:30:17.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.556+0000 7f792e000640 1 Processor -- start 2024-05-27T06:30:17.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.556+0000 7f792e000640 1 -- start start 2024-05-27T06:30:17.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.560+0000 7f792e000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f792806c940 0x7f7928156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:17.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.560+0000 7f792e000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79280d1700 0x7f792814e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:17.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.560+0000 7f792e000640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7928157310 0x7f792814e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:17.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.560+0000 7f792e000640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7928070660 con 0x7f7928157310 2024-05-27T06:30:17.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.560+0000 7f792e000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f79280cf200 con 0x7f79280d1700 2024-05-27T06:30:17.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.560+0000 7f792e000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f79280707e0 con 0x7f792806c940 2024-05-27T06:30:17.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.560+0000 7f7927e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7928157310 0x7f792814e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:17.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.560+0000 7f7927e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7928157310 0x7f792814e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42314/0 (socket says 172.21.15.87:42314) 2024-05-27T06:30:17.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.560+0000 7f7927e00640 1 -- 172.21.15.87:0/2811483023 learned_addr learned my addr 172.21.15.87:0/2811483023 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:17.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.560+0000 7f791fe00640 1 --2- 172.21.15.87:0/2811483023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79280d1700 0x7f792814e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:17.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.560+0000 7f7927400640 1 --2- 172.21.15.87:0/2811483023 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f792806c940 0x7f7928156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:17.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.560+0000 7f7927e00640 1 -- 172.21.15.87:0/2811483023 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f792806c940 msgr2=0x7f7928156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:17.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.560+0000 7f7927e00640 1 --2- 172.21.15.87:0/2811483023 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f792806c940 0x7f7928156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.560+0000 7f7927e00640 1 -- 172.21.15.87:0/2811483023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79280d1700 msgr2=0x7f792814e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:17.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.560+0000 7f7927e00640 1 --2- 172.21.15.87:0/2811483023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79280d1700 0x7f792814e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.560+0000 7f7927e00640 1 -- 172.21.15.87:0/2811483023 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79280cdf50 con 0x7f7928157310 2024-05-27T06:30:17.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.560+0000 7f791fe00640 1 --2- 172.21.15.87:0/2811483023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f79280d1700 0x7f792814e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:30:17.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.560+0000 7f7927e00640 1 --2- 172.21.15.87:0/2811483023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7928157310 0x7f792814e8f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f792000c6b0 tx=0x7f792000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:17.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.560+0000 7f791f400640 1 -- 172.21.15.87:0/2811483023 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7920018070 con 0x7f7928157310 2024-05-27T06:30:17.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.560+0000 7f791f400640 1 -- 172.21.15.87:0/2811483023 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7920004db0 con 0x7f7928157310 2024-05-27T06:30:17.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.560+0000 7f792e000640 1 -- 172.21.15.87:0/2811483023 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79280ce230 con 0x7f7928157310 2024-05-27T06:30:17.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.560+0000 7f791f400640 1 -- 172.21.15.87:0/2811483023 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792000a880 con 0x7f7928157310 2024-05-27T06:30:17.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.560+0000 7f792e000640 1 -- 172.21.15.87:0/2811483023 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79280ce7f0 con 0x7f7928157310 2024-05-27T06:30:17.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.560+0000 7f792e000640 1 -- 172.21.15.87:0/2811483023 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f792806aa30 con 0x7f7928157310 2024-05-27T06:30:17.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.564+0000 7f791f400640 1 -- 172.21.15.87:0/2811483023 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f792001b070 con 0x7f7928157310 2024-05-27T06:30:17.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.564+0000 7f791f400640 1 --2- 172.21.15.87:0/2811483023 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f790406f430 0x7f7904071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:17.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.564+0000 7f791f400640 1 -- 172.21.15.87:0/2811483023 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f792008e860 con 0x7f7928157310 2024-05-27T06:30:17.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.564+0000 7f7927400640 1 --2- 172.21.15.87:0/2811483023 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f790406f430 0x7f7904071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:17.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.564+0000 7f791f400640 1 --2- 172.21.15.87:0/2811483023 >> [v2:172.21.15.149:6800/531351314,v1:172.21.15.149:6801/531351314] conn(0x7f7904075920 0x7f7904077db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:17.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.564+0000 7f791f400640 1 -- 172.21.15.87:0/2811483023 --> [v2:172.21.15.149:6800/531351314,v1:172.21.15.149:6801/531351314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7904078480 con 0x7f7904075920 2024-05-27T06:30:17.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.564+0000 7f791f400640 1 -- 172.21.15.87:0/2811483023 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f79200932a0 con 0x7f7928157310 2024-05-27T06:30:17.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.564+0000 7f791fe00640 1 --2- 172.21.15.87:0/2811483023 >> [v2:172.21.15.149:6800/531351314,v1:172.21.15.149:6801/531351314] conn(0x7f7904075920 0x7f7904077db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:17.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.564+0000 7f7927400640 1 --2- 172.21.15.87:0/2811483023 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f790406f430 0x7f7904071940 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f79180ad000 tx=0x7f79180a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:17.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.564+0000 7f791fe00640 1 --2- 172.21.15.87:0/2811483023 >> [v2:172.21.15.149:6800/531351314,v1:172.21.15.149:6801/531351314] conn(0x7f7904075920 0x7f7904077db0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:17.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.564+0000 7f791f400640 1 -- 172.21.15.87:0/2811483023 <== osd.6 v2:172.21.15.149:6800/531351314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7904078480 con 0x7f7904075920 2024-05-27T06:30:17.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.580+0000 7f792e000640 1 -- 172.21.15.87:0/2811483023 --> [v2:172.21.15.149:6800/531351314,v1:172.21.15.149:6801/531351314] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7928154a40 con 0x7f7904075920 2024-05-27T06:30:17.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.580+0000 7f791f400640 1 -- 172.21.15.87:0/2811483023 <== osd.6 v2:172.21.15.149:6800/531351314 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7928154a40 con 0x7f7904075920 2024-05-27T06:30:17.578 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-27T06:30:17.578 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-27T06:30:17.578 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-27T06:30:17.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.580+0000 7f792e000640 1 -- 172.21.15.87:0/2811483023 >> [v2:172.21.15.149:6800/531351314,v1:172.21.15.149:6801/531351314] conn(0x7f7904075920 msgr2=0x7f7904077db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:17.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.580+0000 7f792e000640 1 --2- 172.21.15.87:0/2811483023 >> [v2:172.21.15.149:6800/531351314,v1:172.21.15.149:6801/531351314] conn(0x7f7904075920 0x7f7904077db0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.580+0000 7f792e000640 1 -- 172.21.15.87:0/2811483023 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f790406f430 msgr2=0x7f7904071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:17.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.580+0000 7f792e000640 1 --2- 172.21.15.87:0/2811483023 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f790406f430 0x7f7904071940 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f79180ad000 tx=0x7f79180a6000 comp rx=0 tx=0).stop 2024-05-27T06:30:17.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.580+0000 7f792e000640 1 -- 172.21.15.87:0/2811483023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7928157310 msgr2=0x7f792814e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:17.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.580+0000 7f792e000640 1 --2- 172.21.15.87:0/2811483023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7928157310 0x7f792814e8f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f792000c6b0 tx=0x7f792000cb70 comp rx=0 tx=0).stop 2024-05-27T06:30:17.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.580+0000 7f7927e00640 1 -- 172.21.15.87:0/2811483023 reap_dead start 2024-05-27T06:30:17.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.580+0000 7f792e000640 1 -- 172.21.15.87:0/2811483023 shutdown_connections 2024-05-27T06:30:17.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.580+0000 7f792e000640 1 -- 172.21.15.87:0/2811483023 >> 172.21.15.87:0/2811483023 conn(0x7f79280b46b0 msgr2=0x7f7928166f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:17.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.580+0000 7f792e000640 1 -- 172.21.15.87:0/2811483023 shutdown_connections 2024-05-27T06:30:17.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.580+0000 7f792e000640 1 -- 172.21.15.87:0/2811483023 wait complete. 2024-05-27T06:30:17.597 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-27T06:30:17.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23e8400640 1 Processor -- start 2024-05-27T06:30:17.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23e8400640 1 -- start start 2024-05-27T06:30:17.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23e8400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23e006fbe0 0x7f23e0167a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:17.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23e8400640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23e00afd40 con 0x7f23e015cbc0 2024-05-27T06:30:17.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23e8400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23e00b0020 con 0x7f23e0074330 2024-05-27T06:30:17.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23e8400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f23e015cfd0 con 0x7f23e006fbe0 2024-05-27T06:30:17.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23e5a00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f23e015cbc0 0x7f23e00af540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40438/0 (socket says 172.21.15.87:40438) 2024-05-27T06:30:17.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23e5a00640 1 -- 172.21.15.87:0/1942010946 learned_addr learned my addr 172.21.15.87:0/1942010946 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:30:17.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23e6400640 1 --2- 172.21.15.87:0/1942010946 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23e006fbe0 0x7f23e0167a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:17.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23dfe00640 1 -- 172.21.15.87:0/1942010946 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1440879487 0 0) 0x7f23e00afd40 con 0x7f23e015cbc0 2024-05-27T06:30:17.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23dfe00640 1 -- 172.21.15.87:0/1942010946 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23c8003530 con 0x7f23e015cbc0 2024-05-27T06:30:17.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23dfe00640 1 -- 172.21.15.87:0/1942010946 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1007784557 0 0) 0x7f23e00b0020 con 0x7f23e0074330 2024-05-27T06:30:17.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23dfe00640 1 -- 172.21.15.87:0/1942010946 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23e00afd40 con 0x7f23e0074330 2024-05-27T06:30:17.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23dfe00640 1 -- 172.21.15.87:0/1942010946 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3427487408 0 0) 0x7f23c8003530 con 0x7f23e015cbc0 2024-05-27T06:30:17.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23dfe00640 1 -- 172.21.15.87:0/1942010946 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23e006fbe0 msgr2=0x7f23e0167a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:17.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23dfe00640 1 --2- 172.21.15.87:0/1942010946 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23e006fbe0 0x7f23e0167a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23dfe00640 1 -- 172.21.15.87:0/1942010946 >> v1:172.21.15.149:6789/0 conn(0x7f23e0074330 legacy=0x7f23e0074740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:17.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23dfe00640 1 -- 172.21.15.87:0/1942010946 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e00b0300 con 0x7f23e015cbc0 2024-05-27T06:30:17.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23dfe00640 1 -- 172.21.15.87:0/1942010946 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7f23d4001700 con 0x7f23e015cbc0 2024-05-27T06:30:17.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23dfe00640 1 -- 172.21.15.87:0/1942010946 >> v1:172.21.15.87:6789/0 conn(0x7f23e015cbc0 legacy=0x7f23e00af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:17.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23dfe00640 1 --2- 172.21.15.87:0/1942010946 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23c8003c20 0x7f23c8004070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:17.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23dfe00640 1 --2- 172.21.15.87:0/1942010946 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23e006fbe0 0x7f23c8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:17.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23dfe00640 1 --2- 172.21.15.87:0/1942010946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23c8004da0 0x7f23c8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:17.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23dfe00640 1 -- 172.21.15.87:0/1942010946 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f23c800bc40 con 0x7f23c8003c20 2024-05-27T06:30:17.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23dfe00640 1 -- 172.21.15.87:0/1942010946 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f23c800bdf0 con 0x7f23c8004da0 2024-05-27T06:30:17.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23dfe00640 1 -- 172.21.15.87:0/1942010946 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f23c800e200 con 0x7f23e006fbe0 2024-05-27T06:30:17.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23e5a00640 1 --2- 172.21.15.87:0/1942010946 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23c8003c20 0x7f23c8004070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:17.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23e6400640 1 --2- 172.21.15.87:0/1942010946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23c8004da0 0x7f23c8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:17.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.748+0000 7f23e5000640 1 --2- 172.21.15.87:0/1942010946 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23e006fbe0 0x7f23c8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:17.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.752+0000 7f23e5a00640 1 -- 172.21.15.87:0/1942010946 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23e006fbe0 msgr2=0x7f23c8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:17.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.752+0000 7f23e5a00640 1 --2- 172.21.15.87:0/1942010946 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23e006fbe0 0x7f23c8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.752+0000 7f23e5a00640 1 -- 172.21.15.87:0/1942010946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23c8004da0 msgr2=0x7f23c8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:17.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.752+0000 7f23e5a00640 1 --2- 172.21.15.87:0/1942010946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23c8004da0 0x7f23c8005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.752+0000 7f23e5a00640 1 -- 172.21.15.87:0/1942010946 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c8003530 con 0x7f23c8003c20 2024-05-27T06:30:17.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.752+0000 7f23e5000640 1 --2- 172.21.15.87:0/1942010946 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23e006fbe0 0x7f23c8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:30:17.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.752+0000 7f23e5a00640 1 --2- 172.21.15.87:0/1942010946 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23c8003c20 0x7f23c8004070 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f23d400c160 tx=0x7f23d401cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c130b72545d03659 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:17.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.752+0000 7f23dfe00640 1 -- 172.21.15.87:0/1942010946 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d4007cd0 con 0x7f23c8003c20 2024-05-27T06:30:17.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.752+0000 7f23dfe00640 1 -- 172.21.15.87:0/1942010946 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d40a9070 con 0x7f23c8003c20 2024-05-27T06:30:17.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.752+0000 7f23dfe00640 1 -- 172.21.15.87:0/1942010946 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d4005d20 con 0x7f23c8003c20 2024-05-27T06:30:17.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.756+0000 7f23e8400640 1 -- 172.21.15.87:0/1942010946 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23c8003c20 msgr2=0x7f23c8004070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:17.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.756+0000 7f23e8400640 1 --2- 172.21.15.87:0/1942010946 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23c8003c20 0x7f23c8004070 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f23d400c160 tx=0x7f23d401cb40 comp rx=0 tx=0).stop 2024-05-27T06:30:17.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.756+0000 7f23e6400640 1 -- 172.21.15.87:0/1942010946 reap_dead start 2024-05-27T06:30:17.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.756+0000 7f23e8400640 1 -- 172.21.15.87:0/1942010946 shutdown_connections 2024-05-27T06:30:17.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.756+0000 7f23e8400640 1 -- 172.21.15.87:0/1942010946 >> 172.21.15.87:0/1942010946 conn(0x7f23e00b2fb0 msgr2=0x7f23e00b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:17.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.756+0000 7f23e8400640 1 -- 172.21.15.87:0/1942010946 shutdown_connections 2024-05-27T06:30:17.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.756+0000 7f23e8400640 1 -- 172.21.15.87:0/1942010946 wait complete. 2024-05-27T06:30:17.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.756+0000 7f23e8400640 1 Processor -- start 2024-05-27T06:30:17.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.756+0000 7f23e8400640 1 -- start start 2024-05-27T06:30:17.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.760+0000 7f23e8400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23c8003c20 0x7f23e01f8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:17.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.760+0000 7f23e8400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23e00ce340 0x7f23e014ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:17.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.760+0000 7f23e8400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23e0160b00 0x7f23e0160f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:17.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.760+0000 7f23e8400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f23e006db50 con 0x7f23e0160b00 2024-05-27T06:30:17.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.760+0000 7f23e8400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f23e006d9d0 con 0x7f23c8003c20 2024-05-27T06:30:17.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.760+0000 7f23e8400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f23e006dcd0 con 0x7f23e00ce340 2024-05-27T06:30:17.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.760+0000 7f23e6400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23e0160b00 0x7f23e0160f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:17.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.760+0000 7f23e6400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23e0160b00 0x7f23e0160f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42334/0 (socket says 172.21.15.87:42334) 2024-05-27T06:30:17.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.760+0000 7f23e6400640 1 -- 172.21.15.87:0/2629661248 learned_addr learned my addr 172.21.15.87:0/2629661248 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:17.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.760+0000 7f23e6400640 1 -- 172.21.15.87:0/2629661248 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23e00ce340 msgr2=0x7f23e014ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:17.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.760+0000 7f23e6400640 1 --2- 172.21.15.87:0/2629661248 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23e00ce340 0x7f23e014ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.760+0000 7f23e6400640 1 -- 172.21.15.87:0/2629661248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23c8003c20 msgr2=0x7f23e01f8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:17.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.760+0000 7f23e6400640 1 --2- 172.21.15.87:0/2629661248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23c8003c20 0x7f23e01f8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.760+0000 7f23e6400640 1 -- 172.21.15.87:0/2629661248 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e0161450 con 0x7f23e0160b00 2024-05-27T06:30:17.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.760+0000 7f23e6400640 1 --2- 172.21.15.87:0/2629661248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23e0160b00 0x7f23e0160f10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f23e00b4360 tx=0x7f23d800f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:17.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.760+0000 7f23dd600640 1 -- 172.21.15.87:0/2629661248 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d800fce0 con 0x7f23e0160b00 2024-05-27T06:30:17.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.760+0000 7f23dd600640 1 -- 172.21.15.87:0/2629661248 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d800fe80 con 0x7f23e0160b00 2024-05-27T06:30:17.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.760+0000 7f23e8400640 1 -- 172.21.15.87:0/2629661248 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e014ff90 con 0x7f23e0160b00 2024-05-27T06:30:17.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.760+0000 7f23dd600640 1 -- 172.21.15.87:0/2629661248 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d8015670 con 0x7f23e0160b00 2024-05-27T06:30:17.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.760+0000 7f23e8400640 1 -- 172.21.15.87:0/2629661248 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e0150490 con 0x7f23e0160b00 2024-05-27T06:30:17.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.760+0000 7f23e8400640 1 -- 172.21.15.87:0/2629661248 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23e006aa30 con 0x7f23e0160b00 2024-05-27T06:30:17.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.760+0000 7f23dd600640 1 -- 172.21.15.87:0/2629661248 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f23d8015810 con 0x7f23e0160b00 2024-05-27T06:30:17.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.764+0000 7f23dd600640 1 --2- 172.21.15.87:0/2629661248 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f23c006f430 0x7f23c0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:17.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.764+0000 7f23dd600640 1 -- 172.21.15.87:0/2629661248 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f23d808ff30 con 0x7f23e0160b00 2024-05-27T06:30:17.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.764+0000 7f23e5a00640 1 --2- 172.21.15.87:0/2629661248 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f23c006f430 0x7f23c0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:17.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.764+0000 7f23e5a00640 1 --2- 172.21.15.87:0/2629661248 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f23c006f430 0x7f23c0071940 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f23d40ab000 tx=0x7f23e00aff10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:17.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.768+0000 7f23dd600640 1 -- 172.21.15.87:0/2629661248 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f23e0161450 con 0x7f23e0160b00 2024-05-27T06:30:17.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.924+0000 7f23e8400640 1 -- 172.21.15.87:0/2629661248 --> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f23e0150770 con 0x7f23c006f430 2024-05-27T06:30:17.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.924+0000 7f23dd600640 1 -- 172.21.15.87:0/2629661248 <== mgr.4111 v2:172.21.15.87:6832/2724754260 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f23d40a9070 con 0x7f23c006f430 2024-05-27T06:30:17.923 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 6 to deep-scrub 2024-05-27T06:30:17.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.924+0000 7f23e8400640 1 -- 172.21.15.87:0/2629661248 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f23c006f430 msgr2=0x7f23c0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:17.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.924+0000 7f23e8400640 1 --2- 172.21.15.87:0/2629661248 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f23c006f430 0x7f23c0071940 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f23d40ab000 tx=0x7f23e00aff10 comp rx=0 tx=0).stop 2024-05-27T06:30:17.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.924+0000 7f23e8400640 1 -- 172.21.15.87:0/2629661248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23e0160b00 msgr2=0x7f23e0160f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:17.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.924+0000 7f23e8400640 1 --2- 172.21.15.87:0/2629661248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23e0160b00 0x7f23e0160f10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f23e00b4360 tx=0x7f23d800f1b0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.924+0000 7f23e8400640 1 -- 172.21.15.87:0/2629661248 shutdown_connections 2024-05-27T06:30:17.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.924+0000 7f23e8400640 1 --2- 172.21.15.87:0/2629661248 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f23c006f430 0x7f23c0071940 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.924+0000 7f23e8400640 1 --2- 172.21.15.87:0/2629661248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23e0160b00 0x7f23e0160f10 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.924+0000 7f23e8400640 1 --2- 172.21.15.87:0/2629661248 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23e00ce340 0x7f23e014ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.924+0000 7f23e8400640 1 --2- 172.21.15.87:0/2629661248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23c8003c20 0x7f23e01f8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:17.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.924+0000 7f23e8400640 1 -- 172.21.15.87:0/2629661248 >> 172.21.15.87:0/2629661248 conn(0x7f23e00b2fb0 msgr2=0x7f23e00b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:17.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.928+0000 7f23e8400640 1 -- 172.21.15.87:0/2629661248 shutdown_connections 2024-05-27T06:30:17.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:17.928+0000 7f23e8400640 1 -- 172.21.15.87:0/2629661248 wait complete. 2024-05-27T06:30:17.945 INFO:tasks.ceph:Scrubbing osd.7 2024-05-27T06:30:17.945 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-27T06:30:18.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.096+0000 7f66d7600640 1 Processor -- start 2024-05-27T06:30:18.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.096+0000 7f66d7600640 1 -- start start 2024-05-27T06:30:18.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.100+0000 7f66d7600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66d015d350 0x7f66d00cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:18.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.100+0000 7f66d7600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f66d00ce220 0x7f66d006c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:18.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.100+0000 7f66d7600640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66d006db10 con 0x7f66d015c3f0 2024-05-27T06:30:18.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.100+0000 7f66d7600640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f66d00ce630 con 0x7f66d00ce220 2024-05-27T06:30:18.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.100+0000 7f66d7600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f66d015d760 con 0x7f66d015d350 2024-05-27T06:30:18.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.100+0000 7f66d5600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f66d00ce220 0x7f66d006c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:18.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.100+0000 7f66c7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66d015d350 0x7f66d00cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:18.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.100+0000 7f66d5600640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f66d00ce220 0x7f66d006c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:35534/0 (socket says 172.21.15.87:35534) 2024-05-27T06:30:18.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.100+0000 7f66d5600640 1 -- 172.21.15.87:0/1003272786 learned_addr learned my addr 172.21.15.87:0/1003272786 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:18.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.100+0000 7f66d4c00640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f66d015c3f0 0x7f66d0160740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.87:37442/0 (socket says 172.21.15.87:37442) 2024-05-27T06:30:18.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.100+0000 7f66c7e00640 1 -- 172.21.15.87:0/1003272786 >> v2:172.21.15.149:3300/0 conn(0x7f66d00ce220 msgr2=0x7f66d006c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:18.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.100+0000 7f66c7e00640 1 --2- 172.21.15.87:0/1003272786 >> v2:172.21.15.149:3300/0 conn(0x7f66d00ce220 0x7f66d006c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:18.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.100+0000 7f66c7e00640 1 -- 172.21.15.87:0/1003272786 >> v1:172.21.15.149:6789/0 conn(0x7f66d015c3f0 legacy=0x7f66d0160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:18.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.100+0000 7f66c7e00640 1 -- 172.21.15.87:0/1003272786 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d00cf2a0 con 0x7f66d015d350 2024-05-27T06:30:18.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.100+0000 7f66d5600640 1 --2- 172.21.15.87:0/1003272786 >> v2:172.21.15.149:3300/0 conn(0x7f66d00ce220 0x7f66d006c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T06:30:18.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.100+0000 7f66cfe00640 1 -- 172.21.15.87:0/1003272786 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1128753971 0 0) 0x7f66c0001120 con 0x7f66d015c3f0 2024-05-27T06:30:18.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.104+0000 7f66c7e00640 1 --2- 172.21.15.87:0/1003272786 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66d015d350 0x7f66d00cdce0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f66b800ba60 tx=0x7f66b801eb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=293dada5fbb0d196 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:18.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.104+0000 7f66cfe00640 1 -- 172.21.15.87:0/1003272786 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b80b4070 con 0x7f66d015d350 2024-05-27T06:30:18.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.104+0000 7f66cfe00640 1 -- 172.21.15.87:0/1003272786 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66b80a7ab0 con 0x7f66d015d350 2024-05-27T06:30:18.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.104+0000 7f66cfe00640 1 -- 172.21.15.87:0/1003272786 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b80af440 con 0x7f66d015d350 2024-05-27T06:30:18.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.104+0000 7f66d7600640 1 -- 172.21.15.87:0/1003272786 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66d015d350 msgr2=0x7f66d00cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:18.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.104+0000 7f66d7600640 1 --2- 172.21.15.87:0/1003272786 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66d015d350 0x7f66d00cdce0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f66b800ba60 tx=0x7f66b801eb70 comp rx=0 tx=0).stop 2024-05-27T06:30:18.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.104+0000 7f66d7600640 1 -- 172.21.15.87:0/1003272786 shutdown_connections 2024-05-27T06:30:18.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.104+0000 7f66d7600640 1 --2- 172.21.15.87:0/1003272786 >> v2:172.21.15.149:3300/0 conn(0x7f66d00ce220 0x7f66d006c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:18.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.104+0000 7f66d7600640 1 --2- 172.21.15.87:0/1003272786 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66d015d350 0x7f66d00cdce0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:18.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.104+0000 7f66d7600640 1 -- 172.21.15.87:0/1003272786 >> 172.21.15.87:0/1003272786 conn(0x7f66d00b46b0 msgr2=0x7f66d00b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:18.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.104+0000 7f66d7600640 1 -- 172.21.15.87:0/1003272786 shutdown_connections 2024-05-27T06:30:18.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.104+0000 7f66d7600640 1 -- 172.21.15.87:0/1003272786 wait complete. 2024-05-27T06:30:18.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.108+0000 7f66d7600640 1 Processor -- start 2024-05-27T06:30:18.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.108+0000 7f66d7600640 1 -- start start 2024-05-27T06:30:18.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.108+0000 7f66d7600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66d00ce220 0x7f66d01f9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:18.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.108+0000 7f66d7600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66d015c3f0 0x7f66d01fd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:18.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.108+0000 7f66d7600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d015d350 0x7f66d00b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:18.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.108+0000 7f66d7600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f66d006d070 con 0x7f66d015d350 2024-05-27T06:30:18.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.108+0000 7f66d7600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f66d00cf860 con 0x7f66d00ce220 2024-05-27T06:30:18.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.108+0000 7f66d7600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f66d00b1bf0 con 0x7f66d015c3f0 2024-05-27T06:30:18.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.108+0000 7f66d5600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d015d350 0x7f66d00b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:18.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.108+0000 7f66d5600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d015d350 0x7f66d00b3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42336/0 (socket says 172.21.15.87:42336) 2024-05-27T06:30:18.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.108+0000 7f66d5600640 1 -- 172.21.15.87:0/389567898 learned_addr learned my addr 172.21.15.87:0/389567898 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:18.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.108+0000 7f66c7e00640 1 --2- 172.21.15.87:0/389567898 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66d015c3f0 0x7f66d01fd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:18.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.108+0000 7f66d4c00640 1 --2- 172.21.15.87:0/389567898 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66d00ce220 0x7f66d01f9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:18.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.108+0000 7f66d5600640 1 -- 172.21.15.87:0/389567898 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66d015c3f0 msgr2=0x7f66d01fd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:18.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.108+0000 7f66d5600640 1 --2- 172.21.15.87:0/389567898 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66d015c3f0 0x7f66d01fd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:18.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.108+0000 7f66d5600640 1 -- 172.21.15.87:0/389567898 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66d00ce220 msgr2=0x7f66d01f9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:18.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.108+0000 7f66d5600640 1 --2- 172.21.15.87:0/389567898 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66d00ce220 0x7f66d01f9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:18.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.108+0000 7f66d5600640 1 -- 172.21.15.87:0/389567898 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d01fdb00 con 0x7f66d015d350 2024-05-27T06:30:18.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.108+0000 7f66d5600640 1 --2- 172.21.15.87:0/389567898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d015d350 0x7f66d00b3640 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f66c800ef90 tx=0x7f66c800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:18.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.108+0000 7f66cd600640 1 -- 172.21.15.87:0/389567898 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c800cbe0 con 0x7f66d015d350 2024-05-27T06:30:18.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.108+0000 7f66cd600640 1 -- 172.21.15.87:0/389567898 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66c800cd80 con 0x7f66d015d350 2024-05-27T06:30:18.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.108+0000 7f66d7600640 1 -- 172.21.15.87:0/389567898 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66d01fa010 con 0x7f66d015d350 2024-05-27T06:30:18.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.108+0000 7f66cd600640 1 -- 172.21.15.87:0/389567898 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c8003be0 con 0x7f66d015d350 2024-05-27T06:30:18.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.108+0000 7f66d7600640 1 -- 172.21.15.87:0/389567898 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66d01fcdc0 con 0x7f66d015d350 2024-05-27T06:30:18.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.112+0000 7f66d7600640 1 -- 172.21.15.87:0/389567898 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f66d01fa530 con 0x7f66d015d350 2024-05-27T06:30:18.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.112+0000 7f66cd600640 1 -- 172.21.15.87:0/389567898 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f66c801b030 con 0x7f66d015d350 2024-05-27T06:30:18.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.112+0000 7f66cd600640 1 --2- 172.21.15.87:0/389567898 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f66ac06f400 0x7f66ac071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:18.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.112+0000 7f66cd600640 1 -- 172.21.15.87:0/389567898 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f66c8090090 con 0x7f66d015d350 2024-05-27T06:30:18.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.112+0000 7f66d4c00640 1 --2- 172.21.15.87:0/389567898 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f66ac06f400 0x7f66ac071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:18.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.112+0000 7f66cd600640 1 --2- 172.21.15.87:0/389567898 >> [v2:172.21.15.149:6808/1171039913,v1:172.21.15.149:6809/1171039913] conn(0x7f66ac0758f0 0x7f66ac077d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:18.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.112+0000 7f66cd600640 1 -- 172.21.15.87:0/389567898 --> [v2:172.21.15.149:6808/1171039913,v1:172.21.15.149:6809/1171039913] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f66c8008e50 con 0x7f66ac0758f0 2024-05-27T06:30:18.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.112+0000 7f66cd600640 1 -- 172.21.15.87:0/389567898 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f66c8090520 con 0x7f66d015d350 2024-05-27T06:30:18.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.112+0000 7f66c7e00640 1 --2- 172.21.15.87:0/389567898 >> [v2:172.21.15.149:6808/1171039913,v1:172.21.15.149:6809/1171039913] conn(0x7f66ac0758f0 0x7f66ac077d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:18.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.112+0000 7f66d4c00640 1 --2- 172.21.15.87:0/389567898 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f66ac06f400 0x7f66ac071910 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f66c0000f70 tx=0x7f66c0007df0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:18.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.116+0000 7f66c7e00640 1 --2- 172.21.15.87:0/389567898 >> [v2:172.21.15.149:6808/1171039913,v1:172.21.15.149:6809/1171039913] conn(0x7f66ac0758f0 0x7f66ac077d80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:18.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.116+0000 7f66cd600640 1 -- 172.21.15.87:0/389567898 <== osd.7 v2:172.21.15.149:6808/1171039913 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f66c8008e50 con 0x7f66ac0758f0 2024-05-27T06:30:18.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.128+0000 7f66d7600640 1 -- 172.21.15.87:0/389567898 --> [v2:172.21.15.149:6808/1171039913,v1:172.21.15.149:6809/1171039913] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f66d01f9dc0 con 0x7f66ac0758f0 2024-05-27T06:30:18.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.128+0000 7f66cd600640 1 -- 172.21.15.87:0/389567898 <== osd.7 v2:172.21.15.149:6808/1171039913 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f66d01f9dc0 con 0x7f66ac0758f0 2024-05-27T06:30:18.128 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-27T06:30:18.128 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-27T06:30:18.128 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-27T06:30:18.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.128+0000 7f66d7600640 1 -- 172.21.15.87:0/389567898 >> [v2:172.21.15.149:6808/1171039913,v1:172.21.15.149:6809/1171039913] conn(0x7f66ac0758f0 msgr2=0x7f66ac077d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:18.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.128+0000 7f66d7600640 1 --2- 172.21.15.87:0/389567898 >> [v2:172.21.15.149:6808/1171039913,v1:172.21.15.149:6809/1171039913] conn(0x7f66ac0758f0 0x7f66ac077d80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:18.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.128+0000 7f66d7600640 1 -- 172.21.15.87:0/389567898 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f66ac06f400 msgr2=0x7f66ac071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:18.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.128+0000 7f66d7600640 1 --2- 172.21.15.87:0/389567898 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f66ac06f400 0x7f66ac071910 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f66c0000f70 tx=0x7f66c0007df0 comp rx=0 tx=0).stop 2024-05-27T06:30:18.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.128+0000 7f66d7600640 1 -- 172.21.15.87:0/389567898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d015d350 msgr2=0x7f66d00b3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:18.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.128+0000 7f66d7600640 1 --2- 172.21.15.87:0/389567898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d015d350 0x7f66d00b3640 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f66c800ef90 tx=0x7f66c800c490 comp rx=0 tx=0).stop 2024-05-27T06:30:18.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.128+0000 7f66d5600640 1 -- 172.21.15.87:0/389567898 reap_dead start 2024-05-27T06:30:18.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.128+0000 7f66d7600640 1 -- 172.21.15.87:0/389567898 shutdown_connections 2024-05-27T06:30:18.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.128+0000 7f66d7600640 1 -- 172.21.15.87:0/389567898 >> 172.21.15.87:0/389567898 conn(0x7f66d00b46b0 msgr2=0x7f66d015ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:18.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.128+0000 7f66d7600640 1 -- 172.21.15.87:0/389567898 shutdown_connections 2024-05-27T06:30:18.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.128+0000 7f66d7600640 1 -- 172.21.15.87:0/389567898 wait complete. 2024-05-27T06:30:18.147 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-27T06:30:18.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.296+0000 7eff60400640 1 Processor -- start 2024-05-27T06:30:18.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.296+0000 7eff60400640 1 -- start start 2024-05-27T06:30:18.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.300+0000 7eff60400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff5815cbc0 0x7eff580af540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:18.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.300+0000 7eff60400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7eff5806ebd0 0x7eff5806efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:18.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.300+0000 7eff60400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff580afa80 con 0x7eff58074330 2024-05-27T06:30:18.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.300+0000 7eff60400640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7eff5815cfd0 con 0x7eff5806ebd0 2024-05-27T06:30:18.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.300+0000 7eff60400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7eff5806c9b0 con 0x7eff5815cbc0 2024-05-27T06:30:18.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.300+0000 7eff5e400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7eff5806ebd0 0x7eff5806efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:18.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.300+0000 7eff5da00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff5815cbc0 0x7eff580af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:18.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.300+0000 7eff5e400640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7eff5806ebd0 0x7eff5806efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.87:35548/0 (socket says 172.21.15.87:35548) 2024-05-27T06:30:18.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.300+0000 7eff5d000640 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7eff58074330 0x7eff58074740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.87:37454/0 (socket says 172.21.15.87:37454) 2024-05-27T06:30:18.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.300+0000 7eff5e400640 1 -- 172.21.15.87:0/853582728 learned_addr learned my addr 172.21.15.87:0/853582728 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:18.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.300+0000 7eff5e400640 1 -- 172.21.15.87:0/853582728 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff5815cbc0 msgr2=0x7eff580af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:18.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.300+0000 7eff5e400640 1 --2- 172.21.15.87:0/853582728 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff5815cbc0 0x7eff580af540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:18.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.300+0000 7eff5e400640 1 -- 172.21.15.87:0/853582728 >> v1:172.21.15.149:6789/0 conn(0x7eff58074330 legacy=0x7eff58074740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:18.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.300+0000 7eff5e400640 1 -- 172.21.15.87:0/853582728 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff580afd40 con 0x7eff5806ebd0 2024-05-27T06:30:18.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.300+0000 7eff57e00640 1 -- 172.21.15.87:0/853582728 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3054415460 0 0) 0x7eff580afa80 con 0x7eff58074330 2024-05-27T06:30:18.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.304+0000 7eff5e400640 1 --2- 172.21.15.87:0/853582728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff5806ebd0 0x7eff5806efe0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7eff5000d150 tx=0x7eff5001ebc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dea67d4d0e4255c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:18.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.304+0000 7eff57e00640 1 -- 172.21.15.87:0/853582728 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5000b2d0 con 0x7eff5806ebd0 2024-05-27T06:30:18.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.304+0000 7eff57e00640 1 -- 172.21.15.87:0/853582728 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff5000b470 con 0x7eff5806ebd0 2024-05-27T06:30:18.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.304+0000 7eff57e00640 1 -- 172.21.15.87:0/853582728 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff500a7ba0 con 0x7eff5806ebd0 2024-05-27T06:30:18.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.304+0000 7eff60400640 1 -- 172.21.15.87:0/853582728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff5806ebd0 msgr2=0x7eff5806efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:18.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.304+0000 7eff60400640 1 --2- 172.21.15.87:0/853582728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff5806ebd0 0x7eff5806efe0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7eff5000d150 tx=0x7eff5001ebc0 comp rx=0 tx=0).stop 2024-05-27T06:30:18.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.304+0000 7eff60400640 1 -- 172.21.15.87:0/853582728 shutdown_connections 2024-05-27T06:30:18.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.304+0000 7eff60400640 1 --2- 172.21.15.87:0/853582728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff5806ebd0 0x7eff5806efe0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:18.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.304+0000 7eff60400640 1 --2- 172.21.15.87:0/853582728 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff5815cbc0 0x7eff580af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:18.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.304+0000 7eff60400640 1 -- 172.21.15.87:0/853582728 >> 172.21.15.87:0/853582728 conn(0x7eff580b2fb0 msgr2=0x7eff580b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:18.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.304+0000 7eff60400640 1 -- 172.21.15.87:0/853582728 shutdown_connections 2024-05-27T06:30:18.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.304+0000 7eff60400640 1 -- 172.21.15.87:0/853582728 wait complete. 2024-05-27T06:30:18.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.304+0000 7eff60400640 1 Processor -- start 2024-05-27T06:30:18.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.304+0000 7eff60400640 1 -- start start 2024-05-27T06:30:18.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.308+0000 7eff60400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff5806ebd0 0x7eff5815e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:18.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.308+0000 7eff60400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff58074330 0x7eff580cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:18.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.308+0000 7eff60400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff5815cbc0 0x7eff580ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:18.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.308+0000 7eff60400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7eff5806d130 con 0x7eff5806ebd0 2024-05-27T06:30:18.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.308+0000 7eff60400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7eff5806cfb0 con 0x7eff58074330 2024-05-27T06:30:18.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.308+0000 7eff60400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7eff5806d2b0 con 0x7eff5815cbc0 2024-05-27T06:30:18.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.308+0000 7eff5da00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff5806ebd0 0x7eff5815e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:18.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.308+0000 7eff5da00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff5806ebd0 0x7eff5815e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42352/0 (socket says 172.21.15.87:42352) 2024-05-27T06:30:18.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.308+0000 7eff5da00640 1 -- 172.21.15.87:0/1357383404 learned_addr learned my addr 172.21.15.87:0/1357383404 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:18.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.308+0000 7eff5e400640 1 --2- 172.21.15.87:0/1357383404 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff5815cbc0 0x7eff580ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:18.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.308+0000 7eff5d000640 1 --2- 172.21.15.87:0/1357383404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff58074330 0x7eff580cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:18.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.308+0000 7eff5da00640 1 -- 172.21.15.87:0/1357383404 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff5815cbc0 msgr2=0x7eff580ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:18.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.308+0000 7eff5da00640 1 --2- 172.21.15.87:0/1357383404 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff5815cbc0 0x7eff580ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:18.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.308+0000 7eff5da00640 1 -- 172.21.15.87:0/1357383404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff58074330 msgr2=0x7eff580cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:18.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.308+0000 7eff5da00640 1 --2- 172.21.15.87:0/1357383404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff58074330 0x7eff580cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:18.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.308+0000 7eff5da00640 1 -- 172.21.15.87:0/1357383404 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff580d0040 con 0x7eff5806ebd0 2024-05-27T06:30:18.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.308+0000 7eff5da00640 1 --2- 172.21.15.87:0/1357383404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff5806ebd0 0x7eff5815e1b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00e840 tx=0x7eff4c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:18.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.308+0000 7eff55600640 1 -- 172.21.15.87:0/1357383404 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4c017070 con 0x7eff5806ebd0 2024-05-27T06:30:18.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.308+0000 7eff55600640 1 -- 172.21.15.87:0/1357383404 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff4c00ee90 con 0x7eff5806ebd0 2024-05-27T06:30:18.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.308+0000 7eff60400640 1 -- 172.21.15.87:0/1357383404 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff5815eb90 con 0x7eff5806ebd0 2024-05-27T06:30:18.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.308+0000 7eff55600640 1 -- 172.21.15.87:0/1357383404 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4c00cb60 con 0x7eff5806ebd0 2024-05-27T06:30:18.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.308+0000 7eff60400640 1 -- 172.21.15.87:0/1357383404 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff5815a8c0 con 0x7eff5806ebd0 2024-05-27T06:30:18.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.308+0000 7eff60400640 1 -- 172.21.15.87:0/1357383404 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff5806aa30 con 0x7eff5806ebd0 2024-05-27T06:30:18.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.312+0000 7eff55600640 1 -- 172.21.15.87:0/1357383404 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7eff4c01a070 con 0x7eff5806ebd0 2024-05-27T06:30:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.312+0000 7eff55600640 1 --2- 172.21.15.87:0/1357383404 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7eff3806f400 0x7eff38071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.312+0000 7eff55600640 1 -- 172.21.15.87:0/1357383404 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7eff4c08f320 con 0x7eff5806ebd0 2024-05-27T06:30:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.312+0000 7eff5d000640 1 --2- 172.21.15.87:0/1357383404 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7eff3806f400 0x7eff38071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.312+0000 7eff5d000640 1 --2- 172.21.15.87:0/1357383404 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7eff3806f400 0x7eff38071910 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7eff58158540 tx=0x7eff44007df0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:18.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.316+0000 7eff55600640 1 -- 172.21.15.87:0/1357383404 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7eff4c05bd20 con 0x7eff5806ebd0 2024-05-27T06:30:18.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.480+0000 7eff60400640 1 -- 172.21.15.87:0/1357383404 --> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7eff580b3ba0 con 0x7eff3806f400 2024-05-27T06:30:18.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.480+0000 7eff55600640 1 -- 172.21.15.87:0/1357383404 <== mgr.4111 v2:172.21.15.87:6832/2724754260 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7eff580b3ba0 con 0x7eff3806f400 2024-05-27T06:30:18.481 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 7 to deep-scrub 2024-05-27T06:30:18.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.484+0000 7eff60400640 1 -- 172.21.15.87:0/1357383404 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7eff3806f400 msgr2=0x7eff38071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:18.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.484+0000 7eff60400640 1 --2- 172.21.15.87:0/1357383404 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7eff3806f400 0x7eff38071910 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7eff58158540 tx=0x7eff44007df0 comp rx=0 tx=0).stop 2024-05-27T06:30:18.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.484+0000 7eff60400640 1 -- 172.21.15.87:0/1357383404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff5806ebd0 msgr2=0x7eff5815e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:18.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.484+0000 7eff60400640 1 --2- 172.21.15.87:0/1357383404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff5806ebd0 0x7eff5815e1b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00e840 tx=0x7eff4c00ec40 comp rx=0 tx=0).stop 2024-05-27T06:30:18.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.484+0000 7eff60400640 1 -- 172.21.15.87:0/1357383404 shutdown_connections 2024-05-27T06:30:18.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.484+0000 7eff60400640 1 --2- 172.21.15.87:0/1357383404 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7eff3806f400 0x7eff38071910 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:18.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.484+0000 7eff60400640 1 --2- 172.21.15.87:0/1357383404 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff5815cbc0 0x7eff580ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:18.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.484+0000 7eff60400640 1 --2- 172.21.15.87:0/1357383404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff58074330 0x7eff580cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:18.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.484+0000 7eff60400640 1 --2- 172.21.15.87:0/1357383404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff5806ebd0 0x7eff5815e1b0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:18.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.484+0000 7eff60400640 1 -- 172.21.15.87:0/1357383404 >> 172.21.15.87:0/1357383404 conn(0x7eff580b2fb0 msgr2=0x7eff58074740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:18.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.484+0000 7eff60400640 1 -- 172.21.15.87:0/1357383404 shutdown_connections 2024-05-27T06:30:18.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.484+0000 7eff60400640 1 -- 172.21.15.87:0/1357383404 wait complete. 2024-05-27T06:30:18.503 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T06:30:18.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.652+0000 7fd885400640 1 Processor -- start 2024-05-27T06:30:18.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.652+0000 7fd885400640 1 -- start start 2024-05-27T06:30:18.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.652+0000 7fd885400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd88015cfe0 0x7fd88015d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:18.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.652+0000 7fd885400640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd88015d930 con 0x7fd8800d1740 2024-05-27T06:30:18.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.652+0000 7fd885400640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd88015dbb0 con 0x7fd8800cbf90 2024-05-27T06:30:18.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.652+0000 7fd885400640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fd88015de90 con 0x7fd88015cfe0 2024-05-27T06:30:18.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.652+0000 7fd875e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd88015cfe0 0x7fd88015d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.652+0000 7fd87f200640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd8800d1740 0x7fd8800d1b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40448/0 (socket says 172.21.15.87:40448) 2024-05-27T06:30:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.656+0000 7fd87f200640 1 -- 172.21.15.87:0/3023594141 learned_addr learned my addr 172.21.15.87:0/3023594141 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:30:18.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.656+0000 7fd875e00640 1 -- 172.21.15.87:0/3023594141 >> v1:172.21.15.149:6789/0 conn(0x7fd8800cbf90 legacy=0x7fd88006cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:18.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.656+0000 7fd875e00640 1 -- 172.21.15.87:0/3023594141 >> v1:172.21.15.87:6789/0 conn(0x7fd8800d1740 legacy=0x7fd8800d1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:18.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.656+0000 7fd875e00640 1 -- 172.21.15.87:0/3023594141 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd88006c7c0 con 0x7fd88015cfe0 2024-05-27T06:30:18.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.656+0000 7fd875e00640 1 --2- 172.21.15.87:0/3023594141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd88015cfe0 0x7fd88015d3f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd8680097c0 tx=0x7fd86801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd4e003822df12f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:18.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.656+0000 7fd87de00640 1 -- 172.21.15.87:0/3023594141 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8680b5070 con 0x7fd88015cfe0 2024-05-27T06:30:18.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.656+0000 7fd87de00640 1 -- 172.21.15.87:0/3023594141 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8680a8990 con 0x7fd88015cfe0 2024-05-27T06:30:18.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.656+0000 7fd87de00640 1 -- 172.21.15.87:0/3023594141 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8680a8d60 con 0x7fd88015cfe0 2024-05-27T06:30:18.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.660+0000 7fd885400640 1 -- 172.21.15.87:0/3023594141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd88015cfe0 msgr2=0x7fd88015d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:18.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.660+0000 7fd885400640 1 --2- 172.21.15.87:0/3023594141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd88015cfe0 0x7fd88015d3f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd8680097c0 tx=0x7fd86801ec90 comp rx=0 tx=0).stop 2024-05-27T06:30:18.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.660+0000 7fd885400640 1 -- 172.21.15.87:0/3023594141 shutdown_connections 2024-05-27T06:30:18.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.660+0000 7fd885400640 1 --2- 172.21.15.87:0/3023594141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd88015cfe0 0x7fd88015d3f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:18.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.660+0000 7fd885400640 1 -- 172.21.15.87:0/3023594141 >> 172.21.15.87:0/3023594141 conn(0x7fd8800b46b0 msgr2=0x7fd8800b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:18.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.660+0000 7fd885400640 1 -- 172.21.15.87:0/3023594141 shutdown_connections 2024-05-27T06:30:18.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.660+0000 7fd885400640 1 -- 172.21.15.87:0/3023594141 wait complete. 2024-05-27T06:30:18.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.660+0000 7fd885400640 1 Processor -- start 2024-05-27T06:30:18.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.660+0000 7fd885400640 1 -- start start 2024-05-27T06:30:18.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.664+0000 7fd885400640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8800cbf90 0x7fd8801f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:18.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.664+0000 7fd885400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8800d1740 0x7fd8800c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:18.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.664+0000 7fd885400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd88015cfe0 0x7fd8800c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:18.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.664+0000 7fd885400640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd8800cc3a0 con 0x7fd8800cbf90 2024-05-27T06:30:18.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.664+0000 7fd885400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd88015e170 con 0x7fd8800d1740 2024-05-27T06:30:18.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.664+0000 7fd885400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd88006ec50 con 0x7fd88015cfe0 2024-05-27T06:30:18.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.664+0000 7fd87e800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8800cbf90 0x7fd8801f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:18.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.664+0000 7fd87e800640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8800cbf90 0x7fd8801f6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42364/0 (socket says 172.21.15.87:42364) 2024-05-27T06:30:18.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.664+0000 7fd87e800640 1 -- 172.21.15.87:0/1639045193 learned_addr learned my addr 172.21.15.87:0/1639045193 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:18.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.664+0000 7fd875e00640 1 --2- 172.21.15.87:0/1639045193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8800d1740 0x7fd8800c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:18.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.664+0000 7fd87f200640 1 --2- 172.21.15.87:0/1639045193 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd88015cfe0 0x7fd8800c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:18.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.664+0000 7fd87e800640 1 -- 172.21.15.87:0/1639045193 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd88015cfe0 msgr2=0x7fd8800c9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:18.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.664+0000 7fd87e800640 1 --2- 172.21.15.87:0/1639045193 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd88015cfe0 0x7fd8800c9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:18.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.664+0000 7fd87e800640 1 -- 172.21.15.87:0/1639045193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8800d1740 msgr2=0x7fd8800c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:18.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.664+0000 7fd87e800640 1 --2- 172.21.15.87:0/1639045193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8800d1740 0x7fd8800c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:18.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.664+0000 7fd87e800640 1 -- 172.21.15.87:0/1639045193 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8800c77a0 con 0x7fd8800cbf90 2024-05-27T06:30:18.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.664+0000 7fd87e800640 1 --2- 172.21.15.87:0/1639045193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8800cbf90 0x7fd8801f6080 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd87000c420 tx=0x7fd87000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:18.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.664+0000 7fd877400640 1 -- 172.21.15.87:0/1639045193 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd870017070 con 0x7fd8800cbf90 2024-05-27T06:30:18.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.664+0000 7fd877400640 1 -- 172.21.15.87:0/1639045193 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8700052d0 con 0x7fd8800cbf90 2024-05-27T06:30:18.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.664+0000 7fd885400640 1 -- 172.21.15.87:0/1639045193 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8800c7a80 con 0x7fd8800cbf90 2024-05-27T06:30:18.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.664+0000 7fd877400640 1 -- 172.21.15.87:0/1639045193 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd870003820 con 0x7fd8800cbf90 2024-05-27T06:30:18.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.664+0000 7fd885400640 1 -- 172.21.15.87:0/1639045193 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8800c97d0 con 0x7fd8800cbf90 2024-05-27T06:30:18.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.664+0000 7fd885400640 1 -- 172.21.15.87:0/1639045193 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd88006aa30 con 0x7fd8800cbf90 2024-05-27T06:30:18.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.664+0000 7fd877400640 1 -- 172.21.15.87:0/1639045193 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd87001a070 con 0x7fd8800cbf90 2024-05-27T06:30:18.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.668+0000 7fd877400640 1 --2- 172.21.15.87:0/1639045193 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd85c06f430 0x7fd85c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:18.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.668+0000 7fd877400640 1 -- 172.21.15.87:0/1639045193 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7fd87008e390 con 0x7fd8800cbf90 2024-05-27T06:30:18.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.668+0000 7fd875e00640 1 --2- 172.21.15.87:0/1639045193 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd85c06f430 0x7fd85c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:18.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.668+0000 7fd875e00640 1 --2- 172.21.15.87:0/1639045193 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd85c06f430 0x7fd85c071940 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd8680b2000 tx=0x7fd868008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:18.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.672+0000 7fd877400640 1 -- 172.21.15.87:0/1639045193 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fd870005480 con 0x7fd8800cbf90 2024-05-27T06:30:18.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.828+0000 7fd885400640 1 -- 172.21.15.87:0/1639045193 --> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd8800c7c50 con 0x7fd85c06f430 2024-05-27T06:30:18.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.828+0000 7fd877400640 1 -- 172.21.15.87:0/1639045193 <== mgr.4111 v2:172.21.15.87:6832/2724754260 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13339 (secure 0 0 0) 0x7fd8680c3430 con 0x7fd85c06f430 2024-05-27T06:30:18.827 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:30:18.828 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-27T06:30:18.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.832+0000 7fd885400640 1 -- 172.21.15.87:0/1639045193 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd85c06f430 msgr2=0x7fd85c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:18.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.832+0000 7fd885400640 1 --2- 172.21.15.87:0/1639045193 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd85c06f430 0x7fd85c071940 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd8680b2000 tx=0x7fd868008040 comp rx=0 tx=0).stop 2024-05-27T06:30:18.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.832+0000 7fd885400640 1 -- 172.21.15.87:0/1639045193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8800cbf90 msgr2=0x7fd8801f6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:18.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.832+0000 7fd885400640 1 --2- 172.21.15.87:0/1639045193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8800cbf90 0x7fd8801f6080 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd87000c420 tx=0x7fd87000c8e0 comp rx=0 tx=0).stop 2024-05-27T06:30:18.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.832+0000 7fd885400640 1 -- 172.21.15.87:0/1639045193 shutdown_connections 2024-05-27T06:30:18.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.832+0000 7fd885400640 1 --2- 172.21.15.87:0/1639045193 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fd85c06f430 0x7fd85c071940 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:18.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.832+0000 7fd885400640 1 --2- 172.21.15.87:0/1639045193 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd88015cfe0 0x7fd8800c9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:18.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.832+0000 7fd885400640 1 --2- 172.21.15.87:0/1639045193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8800d1740 0x7fd8800c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:18.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.832+0000 7fd885400640 1 --2- 172.21.15.87:0/1639045193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8800cbf90 0x7fd8801f6080 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:18.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.832+0000 7fd885400640 1 -- 172.21.15.87:0/1639045193 >> 172.21.15.87:0/1639045193 conn(0x7fd8800b46b0 msgr2=0x7fd88006f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:18.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.832+0000 7fd885400640 1 -- 172.21.15.87:0/1639045193 shutdown_connections 2024-05-27T06:30:18.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:18.832+0000 7fd885400640 1 -- 172.21.15.87:0/1639045193 wait complete. 2024-05-27T06:30:18.849 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2024-05-27T06:30:18.602787+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":226896,"kb_used_data":6568,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747824,"statfs":{"total":773094113280,"available":772861771776,"internally_reserved":0,"allocated":6725632,"data_stored":3675280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.940672"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":179,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-05-27T06:30:10.184567+0000","last_change":"2024-05-27T06:27:28.692457+0000","last_active":"2024-05-27T06:30:10.184567+0000","last_peered":"2024-05-27T06:30:10.184567+0000","last_clean":"2024-05-27T06:30:10.184567+0000","last_became_active":"2024-05-27T06:27:28.691290+0000","last_became_peered":"2024-05-27T06:27:28.691290+0000","last_unstale":"2024-05-27T06:30:10.184567+0000","last_undegraded":"2024-05-27T06:30:10.184567+0000","last_fullsized":"2024-05-27T06:30:10.184567+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T06:27:26.991915+0000","last_clean_scrub_stamp":"2024-05-27T06:27:26.991915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:31:45.563728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28276,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343564,"statfs":{"total":96636764160,"available":96607809536,"internally_reserved":0,"allocated":1286144,"data_stored":902186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":311818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":311818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":311818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":311818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":311818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":311818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1286144,"data_stored":902186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T06:30:18.852 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-27T06:27:26.991915+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=27, tm_hour=6, tm_min=27, tm_sec=26, tm_wday=0, tm_yday=148, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=27, tm_hour=6, tm_min=30, tm_sec=13, tm_wday=0, tm_yday=148, tm_isdst=0) 2024-05-27T06:30:18.852 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-27T06:30:36.662 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T06:30:36.667 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T06:30:38.854 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T06:30:39.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.015+0000 7f780a200640 1 Processor -- start 2024-05-27T06:30:39.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.015+0000 7f780a200640 1 -- start start 2024-05-27T06:30:39.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.015+0000 7f780a200640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f78040b6d00 0x7f780406e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:39.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.015+0000 7f780a200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f780406eee0 con 0x7f780406ead0 2024-05-27T06:30:39.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.015+0000 7f780a200640 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f780406fbb0 con 0x7f78040b1700 2024-05-27T06:30:39.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.015+0000 7f780a200640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f78040b1ca0 con 0x7f78040b6d00 2024-05-27T06:30:39.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.015+0000 7f7809800640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f780406ead0 0x7f7804156500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:35176/0 (socket says 172.21.15.87:35176) 2024-05-27T06:30:39.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.015+0000 7f7809800640 1 -- 172.21.15.87:0/3356948834 learned_addr learned my addr 172.21.15.87:0/3356948834 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:30:39.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.015+0000 7f7803e00640 1 --2- 172.21.15.87:0/3356948834 >> v2:172.21.15.149:3300/0 conn(0x7f78040b6d00 0x7f780406e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:39.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.015+0000 7f7803400640 1 -- 172.21.15.87:0/3356948834 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2912296492 0 0) 0x7f77fc0014a0 con 0x7f780406ead0 2024-05-27T06:30:39.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.015+0000 7f7803400640 1 -- 172.21.15.87:0/3356948834 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77ec003530 con 0x7f780406ead0 2024-05-27T06:30:39.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.015+0000 7f7803400640 1 -- 172.21.15.87:0/3356948834 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1949392270 0 0) 0x7f77ec003530 con 0x7f780406ead0 2024-05-27T06:30:39.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.015+0000 7f7803e00640 1 -- 172.21.15.87:0/3356948834 >> v1:172.21.15.149:6789/0 conn(0x7f78040b1700 legacy=0x7f780415d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:39.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.015+0000 7f7803e00640 1 -- 172.21.15.87:0/3356948834 >> v1:172.21.15.87:6789/0 conn(0x7f780406ead0 legacy=0x7f7804156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:39.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.015+0000 7f7803e00640 1 -- 172.21.15.87:0/3356948834 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f780406fe90 con 0x7f78040b6d00 2024-05-27T06:30:39.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.019+0000 7f7803e00640 1 --2- 172.21.15.87:0/3356948834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78040b6d00 0x7f780406e590 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f77f00097c0 tx=0x7f77f001be90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=648b2b734778179e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:39.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.019+0000 7f7803400640 1 -- 172.21.15.87:0/3356948834 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77fc001c50 con 0x7f78040b6d00 2024-05-27T06:30:39.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.019+0000 7f7803400640 1 -- 172.21.15.87:0/3356948834 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f00a8430 con 0x7f78040b6d00 2024-05-27T06:30:39.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.019+0000 7f7803400640 1 -- 172.21.15.87:0/3356948834 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f00a8800 con 0x7f78040b6d00 2024-05-27T06:30:39.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.019+0000 7f780a200640 1 -- 172.21.15.87:0/3356948834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78040b6d00 msgr2=0x7f780406e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:39.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.019+0000 7f780a200640 1 --2- 172.21.15.87:0/3356948834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78040b6d00 0x7f780406e590 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f77f00097c0 tx=0x7f77f001be90 comp rx=0 tx=0).stop 2024-05-27T06:30:39.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.019+0000 7f780a200640 1 -- 172.21.15.87:0/3356948834 shutdown_connections 2024-05-27T06:30:39.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.019+0000 7f780a200640 1 --2- 172.21.15.87:0/3356948834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78040b6d00 0x7f780406e590 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.019+0000 7f780a200640 1 -- 172.21.15.87:0/3356948834 >> 172.21.15.87:0/3356948834 conn(0x7f7804071060 msgr2=0x7f7804071470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:39.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.019+0000 7f780a200640 1 -- 172.21.15.87:0/3356948834 shutdown_connections 2024-05-27T06:30:39.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.019+0000 7f780a200640 1 -- 172.21.15.87:0/3356948834 wait complete. 2024-05-27T06:30:39.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.023+0000 7f780a200640 1 Processor -- start 2024-05-27T06:30:39.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.023+0000 7f780a200640 1 -- start start 2024-05-27T06:30:39.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.023+0000 7f780a200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f780406ead0 0x7f7804157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:39.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.023+0000 7f780a200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78040b1700 0x7f78041556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:39.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.023+0000 7f780a200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78040b6d00 0x7f780414cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:39.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.023+0000 7f780a200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f780416bb10 con 0x7f78040b1700 2024-05-27T06:30:39.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.023+0000 7f780a200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f780416b990 con 0x7f780406ead0 2024-05-27T06:30:39.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.023+0000 7f780a200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f780416bc90 con 0x7f78040b6d00 2024-05-27T06:30:39.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.023+0000 7f7803e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78040b1700 0x7f78041556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:39.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.023+0000 7f7803e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78040b1700 0x7f78041556f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60748/0 (socket says 172.21.15.87:60748) 2024-05-27T06:30:39.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.023+0000 7f7803e00640 1 -- 172.21.15.87:0/2088924519 learned_addr learned my addr 172.21.15.87:0/2088924519 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:39.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.023+0000 7f7808e00640 1 --2- 172.21.15.87:0/2088924519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f780406ead0 0x7f7804157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:39.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.023+0000 7f7809800640 1 --2- 172.21.15.87:0/2088924519 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78040b6d00 0x7f780414cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:39.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.027+0000 7f7803e00640 1 -- 172.21.15.87:0/2088924519 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78040b6d00 msgr2=0x7f780414cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:39.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.027+0000 7f7803e00640 1 --2- 172.21.15.87:0/2088924519 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78040b6d00 0x7f780414cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.027+0000 7f7803e00640 1 -- 172.21.15.87:0/2088924519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f780406ead0 msgr2=0x7f7804157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:39.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.027+0000 7f7803e00640 1 --2- 172.21.15.87:0/2088924519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f780406ead0 0x7f7804157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.027+0000 7f7803e00640 1 -- 172.21.15.87:0/2088924519 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7804155c30 con 0x7f78040b1700 2024-05-27T06:30:39.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.027+0000 7f7803e00640 1 --2- 172.21.15.87:0/2088924519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78040b1700 0x7f78041556f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f77f00097c0 tx=0x7f77f0018f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:39.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.027+0000 7f7800c00640 1 -- 172.21.15.87:0/2088924519 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f00a8dc0 con 0x7f78040b1700 2024-05-27T06:30:39.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.027+0000 7f7800c00640 1 -- 172.21.15.87:0/2088924519 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f0004020 con 0x7f78040b1700 2024-05-27T06:30:39.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.027+0000 7f780a200640 1 -- 172.21.15.87:0/2088924519 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78040af260 con 0x7f78040b1700 2024-05-27T06:30:39.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.027+0000 7f7800c00640 1 -- 172.21.15.87:0/2088924519 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f00043f0 con 0x7f78040b1700 2024-05-27T06:30:39.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.027+0000 7f780a200640 1 -- 172.21.15.87:0/2088924519 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78040af820 con 0x7f78040b1700 2024-05-27T06:30:39.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.027+0000 7f780a200640 1 -- 172.21.15.87:0/2088924519 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f780406aa30 con 0x7f78040b1700 2024-05-27T06:30:39.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.027+0000 7f7800c00640 1 -- 172.21.15.87:0/2088924519 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f77f00c2060 con 0x7f78040b1700 2024-05-27T06:30:39.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.027+0000 7f7800c00640 1 --2- 172.21.15.87:0/2088924519 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f77e406f400 0x7f77e4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:39.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.031+0000 7f7800c00640 1 -- 172.21.15.87:0/2088924519 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f77f01284d0 con 0x7f78040b1700 2024-05-27T06:30:39.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.031+0000 7f7808e00640 1 --2- 172.21.15.87:0/2088924519 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f77e406f400 0x7f77e4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:39.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.031+0000 7f7808e00640 1 --2- 172.21.15.87:0/2088924519 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f77e406f400 0x7f77e4071910 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f77f8007fd0 tx=0x7f77f8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:39.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.035+0000 7f7800c00640 1 -- 172.21.15.87:0/2088924519 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f77f00ac020 con 0x7f78040b1700 2024-05-27T06:30:39.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.191+0000 7f780a200640 1 -- 172.21.15.87:0/2088924519 --> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f78040aeff0 con 0x7f77e406f400 2024-05-27T06:30:39.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.191+0000 7f7800c00640 1 -- 172.21.15.87:0/2088924519 <== mgr.4111 v2:172.21.15.87:6832/2724754260 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13344 (secure 0 0 0) 0x7f78040aeff0 con 0x7f77e406f400 2024-05-27T06:30:39.192 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:30:39.194 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-27T06:30:39.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.195+0000 7f780a200640 1 -- 172.21.15.87:0/2088924519 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f77e406f400 msgr2=0x7f77e4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:39.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.195+0000 7f780a200640 1 --2- 172.21.15.87:0/2088924519 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f77e406f400 0x7f77e4071910 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f77f8007fd0 tx=0x7f77f8009040 comp rx=0 tx=0).stop 2024-05-27T06:30:39.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.195+0000 7f780a200640 1 -- 172.21.15.87:0/2088924519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78040b1700 msgr2=0x7f78041556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:39.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.195+0000 7f780a200640 1 --2- 172.21.15.87:0/2088924519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78040b1700 0x7f78041556f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f77f00097c0 tx=0x7f77f0018f80 comp rx=0 tx=0).stop 2024-05-27T06:30:39.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.195+0000 7f780a200640 1 -- 172.21.15.87:0/2088924519 shutdown_connections 2024-05-27T06:30:39.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.195+0000 7f780a200640 1 --2- 172.21.15.87:0/2088924519 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f77e406f400 0x7f77e4071910 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.195+0000 7f780a200640 1 --2- 172.21.15.87:0/2088924519 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78040b6d00 0x7f780414cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.195+0000 7f780a200640 1 --2- 172.21.15.87:0/2088924519 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78040b1700 0x7f78041556f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.195+0000 7f780a200640 1 --2- 172.21.15.87:0/2088924519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f780406ead0 0x7f7804157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.195+0000 7f780a200640 1 -- 172.21.15.87:0/2088924519 >> 172.21.15.87:0/2088924519 conn(0x7f7804071060 msgr2=0x7f780406dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:39.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.195+0000 7f780a200640 1 -- 172.21.15.87:0/2088924519 shutdown_connections 2024-05-27T06:30:39.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.195+0000 7f780a200640 1 -- 172.21.15.87:0/2088924519 wait complete. 2024-05-27T06:30:39.211 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2024-05-27T06:30:38.607733+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":226888,"kb_used_data":6568,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747832,"statfs":{"total":773094113280,"available":772861779968,"internally_reserved":0,"allocated":6725632,"data_stored":3675280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003246"},"pg_stats":[{"pgid":"1.0","version":"57'74","reported_seq":190,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-05-27T06:30:19.308281+0000","last_change":"2024-05-27T06:30:19.308330+0000","last_active":"2024-05-27T06:30:19.308281+0000","last_peered":"2024-05-27T06:30:19.308281+0000","last_clean":"2024-05-27T06:30:19.308281+0000","last_became_active":"2024-05-27T06:27:28.691290+0000","last_became_peered":"2024-05-27T06:27:28.691290+0000","last_unstale":"2024-05-27T06:30:19.308281+0000","last_undegraded":"2024-05-27T06:30:19.308281+0000","last_fullsized":"2024-05-27T06:30:19.308281+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'74","last_scrub_stamp":"2024-05-27T06:30:19.308168+0000","last_deep_scrub":"57'74","last_deep_scrub_stamp":"2024-05-27T06:30:19.308168+0000","last_clean_scrub_stamp":"2024-05-27T06:30:19.308168+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T11:01:55.876914+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28272,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343568,"statfs":{"total":96636764160,"available":96607813632,"internally_reserved":0,"allocated":1286144,"data_stored":902186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":311818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":311818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":311818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":311818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":311818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":311818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1286144,"data_stored":902186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T06:30:39.212 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-27T06:30:39.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.359+0000 7fa575e00640 1 Processor -- start 2024-05-27T06:30:39.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.359+0000 7fa575e00640 1 -- start start 2024-05-27T06:30:39.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.359+0000 7fa575e00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa5700d1700 0x7fa5700d1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:39.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.359+0000 7fa575e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa57006c940 0x7fa57006cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:39.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.359+0000 7fa575e00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5700d2050 con 0x7fa570157310 2024-05-27T06:30:39.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.359+0000 7fa575e00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fa5700d0140 con 0x7fa57006c940 2024-05-27T06:30:39.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.359+0000 7fa575e00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7fa5700cf530 con 0x7fa5700d1700 2024-05-27T06:30:39.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.359+0000 7fa56f400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa57006c940 0x7fa57006cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:39.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.359+0000 7fa56ea00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fa570157310 0x7fa57015dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:35180/0 (socket says 172.21.15.87:35180) 2024-05-27T06:30:39.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.359+0000 7fa56f400640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa57006c940 0x7fa57006cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60752/0 (socket says 172.21.15.87:60752) 2024-05-27T06:30:39.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.359+0000 7fa56ea00640 1 -- 172.21.15.87:0/1891076751 learned_addr learned my addr 172.21.15.87:0/1891076751 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:30:39.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.359+0000 7fa56e000640 1 --2- 172.21.15.87:0/1891076751 >> v2:172.21.15.149:3300/0 conn(0x7fa5700d1700 0x7fa5700d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:39.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.359+0000 7fa56f400640 1 -- 172.21.15.87:0/1891076751 >> v2:172.21.15.149:3300/0 conn(0x7fa5700d1700 msgr2=0x7fa5700d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:39.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.359+0000 7fa56f400640 1 --2- 172.21.15.87:0/1891076751 >> v2:172.21.15.149:3300/0 conn(0x7fa5700d1700 0x7fa5700d1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.359+0000 7fa56f400640 1 -- 172.21.15.87:0/1891076751 >> v1:172.21.15.87:6789/0 conn(0x7fa570157310 legacy=0x7fa57015dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:39.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.359+0000 7fa56f400640 1 -- 172.21.15.87:0/1891076751 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5700cf810 con 0x7fa57006c940 2024-05-27T06:30:39.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.359+0000 7fa56d600640 1 -- 172.21.15.87:0/1891076751 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 293871075 0 0) 0x7fa560001120 con 0x7fa570157310 2024-05-27T06:30:39.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.363+0000 7fa56f400640 1 --2- 172.21.15.87:0/1891076751 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa57006c940 0x7fa57006cd50 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa568009d90 tx=0x7fa56801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d944f6471902b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:39.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.363+0000 7fa56d600640 1 -- 172.21.15.87:0/1891076751 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5680b2070 con 0x7fa57006c940 2024-05-27T06:30:39.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.363+0000 7fa56d600640 1 -- 172.21.15.87:0/1891076751 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5680a5850 con 0x7fa57006c940 2024-05-27T06:30:39.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.363+0000 7fa56d600640 1 -- 172.21.15.87:0/1891076751 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5680a5c20 con 0x7fa57006c940 2024-05-27T06:30:39.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.363+0000 7fa575e00640 1 -- 172.21.15.87:0/1891076751 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa57006c940 msgr2=0x7fa57006cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:39.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.363+0000 7fa575e00640 1 --2- 172.21.15.87:0/1891076751 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa57006c940 0x7fa57006cd50 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa568009d90 tx=0x7fa56801c8a0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.363+0000 7fa575e00640 1 -- 172.21.15.87:0/1891076751 shutdown_connections 2024-05-27T06:30:39.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.363+0000 7fa575e00640 1 --2- 172.21.15.87:0/1891076751 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa57006c940 0x7fa57006cd50 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.363+0000 7fa575e00640 1 --2- 172.21.15.87:0/1891076751 >> v2:172.21.15.149:3300/0 conn(0x7fa5700d1700 0x7fa5700d1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.363+0000 7fa575e00640 1 -- 172.21.15.87:0/1891076751 >> 172.21.15.87:0/1891076751 conn(0x7fa5700b46b0 msgr2=0x7fa5700b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:39.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.363+0000 7fa575e00640 1 -- 172.21.15.87:0/1891076751 shutdown_connections 2024-05-27T06:30:39.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.363+0000 7fa575e00640 1 -- 172.21.15.87:0/1891076751 wait complete. 2024-05-27T06:30:39.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.367+0000 7fa575e00640 1 Processor -- start 2024-05-27T06:30:39.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.367+0000 7fa575e00640 1 -- start start 2024-05-27T06:30:39.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.367+0000 7fa575e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa57006c940 0x7fa5701fd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:39.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.367+0000 7fa575e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5700d1700 0x7fa570166220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:39.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.367+0000 7fa575e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa570157310 0x7fa57015f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:39.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.367+0000 7fa575e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa570070660 con 0x7fa57006c940 2024-05-27T06:30:39.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.367+0000 7fa575e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa57006d6a0 con 0x7fa570157310 2024-05-27T06:30:39.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.367+0000 7fa575e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa5700707e0 con 0x7fa5700d1700 2024-05-27T06:30:39.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.367+0000 7fa56ea00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa57006c940 0x7fa5701fd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:39.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.367+0000 7fa56ea00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa57006c940 0x7fa5701fd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60768/0 (socket says 172.21.15.87:60768) 2024-05-27T06:30:39.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.367+0000 7fa56ea00640 1 -- 172.21.15.87:0/4106036915 learned_addr learned my addr 172.21.15.87:0/4106036915 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:39.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.367+0000 7fa56e000640 1 --2- 172.21.15.87:0/4106036915 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5700d1700 0x7fa570166220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:39.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.367+0000 7fa56f400640 1 --2- 172.21.15.87:0/4106036915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa570157310 0x7fa57015f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:39.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.367+0000 7fa56ea00640 1 -- 172.21.15.87:0/4106036915 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5700d1700 msgr2=0x7fa570166220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:39.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.367+0000 7fa56ea00640 1 --2- 172.21.15.87:0/4106036915 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5700d1700 0x7fa570166220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.367+0000 7fa56ea00640 1 -- 172.21.15.87:0/4106036915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa570157310 msgr2=0x7fa57015f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:39.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.367+0000 7fa56ea00640 1 --2- 172.21.15.87:0/4106036915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa570157310 0x7fa57015f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.367+0000 7fa56ea00640 1 -- 172.21.15.87:0/4106036915 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa57015fe10 con 0x7fa57006c940 2024-05-27T06:30:39.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.367+0000 7fa56e000640 1 --2- 172.21.15.87:0/4106036915 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5700d1700 0x7fa570166220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T06:30:39.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.371+0000 7fa56ea00640 1 --2- 172.21.15.87:0/4106036915 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa57006c940 0x7fa5701fd610 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa56000c390 tx=0x7fa56000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:39.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.371+0000 7fa567400640 1 -- 172.21.15.87:0/4106036915 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5600074e0 con 0x7fa57006c940 2024-05-27T06:30:39.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.371+0000 7fa567400640 1 -- 172.21.15.87:0/4106036915 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5600047f0 con 0x7fa57006c940 2024-05-27T06:30:39.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.371+0000 7fa575e00640 1 -- 172.21.15.87:0/4106036915 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5701600f0 con 0x7fa57006c940 2024-05-27T06:30:39.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.371+0000 7fa567400640 1 -- 172.21.15.87:0/4106036915 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560004be0 con 0x7fa57006c940 2024-05-27T06:30:39.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.371+0000 7fa575e00640 1 -- 172.21.15.87:0/4106036915 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5701fce10 con 0x7fa57006c940 2024-05-27T06:30:39.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.371+0000 7fa575e00640 1 -- 172.21.15.87:0/4106036915 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa57006aa30 con 0x7fa57006c940 2024-05-27T06:30:39.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.371+0000 7fa567400640 1 -- 172.21.15.87:0/4106036915 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa560011070 con 0x7fa57006c940 2024-05-27T06:30:39.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.375+0000 7fa567400640 1 --2- 172.21.15.87:0/4106036915 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa55006f430 0x7fa550071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:39.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.375+0000 7fa567400640 1 -- 172.21.15.87:0/4106036915 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7fa56008ecc0 con 0x7fa57006c940 2024-05-27T06:30:39.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.375+0000 7fa56e000640 1 --2- 172.21.15.87:0/4106036915 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa55006f430 0x7fa550071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:39.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.375+0000 7fa56e000640 1 --2- 172.21.15.87:0/4106036915 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa55006f430 0x7fa550071940 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa570156320 tx=0x7fa55c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:39.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.379+0000 7fa567400640 1 -- 172.21.15.87:0/4106036915 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa560095080 con 0x7fa57006c940 2024-05-27T06:30:39.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.535+0000 7fa575e00640 1 -- 172.21.15.87:0/4106036915 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fa570160710 con 0x7fa57006c940 2024-05-27T06:30:39.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.539+0000 7fa567400640 1 -- 172.21.15.87:0/4106036915 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) ==== 123+0+0 (secure 0 0 0) 0x7fa5700d2050 con 0x7fa57006c940 2024-05-27T06:30:39.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.543+0000 7fa567400640 1 -- 172.21.15.87:0/4106036915 <== mon.0 v2:172.21.15.87:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa56005b120 con 0x7fa57006c940 2024-05-27T06:30:39.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.543+0000 7fa575e00640 1 -- 172.21.15.87:0/4106036915 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa55006f430 msgr2=0x7fa550071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:39.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.543+0000 7fa575e00640 1 --2- 172.21.15.87:0/4106036915 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa55006f430 0x7fa550071940 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa570156320 tx=0x7fa55c008040 comp rx=0 tx=0).stop 2024-05-27T06:30:39.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.543+0000 7fa575e00640 1 -- 172.21.15.87:0/4106036915 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa57006c940 msgr2=0x7fa5701fd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:39.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.543+0000 7fa575e00640 1 --2- 172.21.15.87:0/4106036915 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa57006c940 0x7fa5701fd610 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa56000c390 tx=0x7fa56000c850 comp rx=0 tx=0).stop 2024-05-27T06:30:39.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.543+0000 7fa575e00640 1 -- 172.21.15.87:0/4106036915 shutdown_connections 2024-05-27T06:30:39.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.543+0000 7fa575e00640 1 --2- 172.21.15.87:0/4106036915 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7fa55006f430 0x7fa550071940 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.543+0000 7fa575e00640 1 --2- 172.21.15.87:0/4106036915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa570157310 0x7fa57015f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.543+0000 7fa575e00640 1 --2- 172.21.15.87:0/4106036915 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5700d1700 0x7fa570166220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.543+0000 7fa575e00640 1 --2- 172.21.15.87:0/4106036915 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa57006c940 0x7fa5701fd610 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.543+0000 7fa575e00640 1 -- 172.21.15.87:0/4106036915 >> 172.21.15.87:0/4106036915 conn(0x7fa5700b46b0 msgr2=0x7fa570160f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:39.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.543+0000 7fa575e00640 1 -- 172.21.15.87:0/4106036915 shutdown_connections 2024-05-27T06:30:39.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.543+0000 7fa575e00640 1 -- 172.21.15.87:0/4106036915 wait complete. 2024-05-27T06:30:39.564 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-27T06:30:39.564 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T06:30:39.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.711+0000 7f967bc00640 1 Processor -- start 2024-05-27T06:30:39.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.711+0000 7f967bc00640 1 -- start start 2024-05-27T06:30:39.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.711+0000 7f967bc00640 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f96740cbf90 0x7f967406cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:39.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.711+0000 7f967bc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f967406d500 0x7f967415cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:39.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f967bc00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f967415d930 con 0x7f967415d520 2024-05-27T06:30:39.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f967bc00640 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 -- 0x7f967406d910 con 0x7f96740cbf90 2024-05-27T06:30:39.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f967bc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f967415dbb0 con 0x7f967406d500 2024-05-27T06:30:39.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9679c00640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f967415d520 0x7f96740d1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:35184/0 (socket says 172.21.15.87:35184) 2024-05-27T06:30:39.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9679c00640 1 -- 172.21.15.87:0/3933391768 learned_addr learned my addr 172.21.15.87:0/3933391768 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-27T06:30:39.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f966be00640 1 --2- 172.21.15.87:0/3933391768 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f967406d500 0x7f967415cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:39.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9673e00640 1 -- 172.21.15.87:0/3933391768 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1387189071 0 0) 0x7f966c0014a0 con 0x7f967415d520 2024-05-27T06:30:39.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9673e00640 1 -- 172.21.15.87:0/3933391768 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9658003530 con 0x7f967415d520 2024-05-27T06:30:39.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9679200640 1 --2- 172.21.15.87:0/3933391768 >> v2:172.21.15.149:3300/0 conn(0x7f96740cbf90 0x7f967406cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:39.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9673e00640 1 -- 172.21.15.87:0/3933391768 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2734465583 0 0) 0x7f9658003530 con 0x7f967415d520 2024-05-27T06:30:39.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9673e00640 1 -- 172.21.15.87:0/3933391768 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f967406d500 msgr2=0x7f967415cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:39.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9673e00640 1 --2- 172.21.15.87:0/3933391768 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f967406d500 0x7f967415cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9673e00640 1 -- 172.21.15.87:0/3933391768 >> v2:172.21.15.149:3300/0 conn(0x7f96740cbf90 msgr2=0x7f967406cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:39.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9673e00640 1 --2- 172.21.15.87:0/3933391768 >> v2:172.21.15.149:3300/0 conn(0x7f96740cbf90 0x7f967406cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9673e00640 1 -- 172.21.15.87:0/3933391768 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f967415de90 con 0x7f967415d520 2024-05-27T06:30:39.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9673e00640 1 -- 172.21.15.87:0/3933391768 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2728924015 0 0) 0x7f966c001c50 con 0x7f967415d520 2024-05-27T06:30:39.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9679200640 1 --2- 172.21.15.87:0/3933391768 >> v2:172.21.15.149:3300/0 conn(0x7f96740cbf90 0x7f967406cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:30:39.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9673e00640 1 -- 172.21.15.87:0/3933391768 >> v1:172.21.15.87:6789/0 conn(0x7f967415d520 legacy=0x7f96740d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:39.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9673e00640 1 --2- 172.21.15.87:0/3933391768 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9658003a80 0x7f9658003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:39.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9673e00640 1 --2- 172.21.15.87:0/3933391768 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f967406d500 0x7f9658004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:39.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9673e00640 1 --2- 172.21.15.87:0/3933391768 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9658004da0 0x7f9658005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:39.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9673e00640 1 -- 172.21.15.87:0/3933391768 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f967406d910 con 0x7f9658003a80 2024-05-27T06:30:39.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9673e00640 1 -- 172.21.15.87:0/3933391768 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f967415dbb0 con 0x7f9658004da0 2024-05-27T06:30:39.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9673e00640 1 -- 172.21.15.87:0/3933391768 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f965800bce0 con 0x7f967406d500 2024-05-27T06:30:39.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9679200640 1 --2- 172.21.15.87:0/3933391768 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9658003a80 0x7f9658003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:39.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f966be00640 1 --2- 172.21.15.87:0/3933391768 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f967406d500 0x7f9658004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:39.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9679200640 1 -- 172.21.15.87:0/3933391768 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f967406d500 msgr2=0x7f9658004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:39.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9679200640 1 --2- 172.21.15.87:0/3933391768 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f967406d500 0x7f9658004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9679200640 1 -- 172.21.15.87:0/3933391768 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9658004da0 msgr2=0x7f9658005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T06:30:39.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9679c00640 1 --2- 172.21.15.87:0/3933391768 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9658004da0 0x7f9658005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:39.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9679200640 1 --2- 172.21.15.87:0/3933391768 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9658004da0 0x7f9658005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9679200640 1 -- 172.21.15.87:0/3933391768 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9658003530 con 0x7f9658003a80 2024-05-27T06:30:39.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.715+0000 7f9679c00640 1 --2- 172.21.15.87:0/3933391768 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9658004da0 0x7f9658005270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T06:30:39.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.719+0000 7f9679200640 1 --2- 172.21.15.87:0/3933391768 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9658003a80 0x7f9658003ef0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f966400aaa0 tx=0x7f966401c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1a80bb2d899aab server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:39.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.719+0000 7f9673e00640 1 -- 172.21.15.87:0/3933391768 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966400a670 con 0x7f9658003a80 2024-05-27T06:30:39.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.719+0000 7f9673e00640 1 -- 172.21.15.87:0/3933391768 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f96640af070 con 0x7f9658003a80 2024-05-27T06:30:39.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.719+0000 7f9673e00640 1 -- 172.21.15.87:0/3933391768 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96640aa8b0 con 0x7f9658003a80 2024-05-27T06:30:39.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.719+0000 7f967bc00640 1 -- 172.21.15.87:0/3933391768 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9658003a80 msgr2=0x7f9658003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:39.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.719+0000 7f967bc00640 1 --2- 172.21.15.87:0/3933391768 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9658003a80 0x7f9658003ef0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f966400aaa0 tx=0x7f966401c6b0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.719+0000 7f9679c00640 1 -- 172.21.15.87:0/3933391768 reap_dead start 2024-05-27T06:30:39.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.719+0000 7f967bc00640 1 -- 172.21.15.87:0/3933391768 shutdown_connections 2024-05-27T06:30:39.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.719+0000 7f967bc00640 1 -- 172.21.15.87:0/3933391768 >> 172.21.15.87:0/3933391768 conn(0x7f96740b46b0 msgr2=0x7f96740b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:39.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.719+0000 7f967bc00640 1 -- 172.21.15.87:0/3933391768 shutdown_connections 2024-05-27T06:30:39.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.719+0000 7f967bc00640 1 -- 172.21.15.87:0/3933391768 wait complete. 2024-05-27T06:30:39.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.723+0000 7f967bc00640 1 Processor -- start 2024-05-27T06:30:39.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.723+0000 7f967bc00640 1 -- start start 2024-05-27T06:30:39.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.723+0000 7f967bc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9658003a80 0x7f96740b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:39.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.723+0000 7f967bc00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96740cafa0 0x7f96740c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:39.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.723+0000 7f967bc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96740c72b0 0x7f96740c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:39.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.723+0000 7f967bc00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f967415e170 con 0x7f96740cafa0 2024-05-27T06:30:39.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.723+0000 7f967bc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f967406caa0 con 0x7f96740c72b0 2024-05-27T06:30:39.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.723+0000 7f967bc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f96740cc3a0 con 0x7f9658003a80 2024-05-27T06:30:39.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.723+0000 7f966be00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96740cafa0 0x7f96740c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:39.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.723+0000 7f966be00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96740cafa0 0x7f96740c6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60796/0 (socket says 172.21.15.87:60796) 2024-05-27T06:30:39.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.723+0000 7f966be00640 1 -- 172.21.15.87:0/1910603604 learned_addr learned my addr 172.21.15.87:0/1910603604 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-27T06:30:39.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.723+0000 7f9679200640 1 --2- 172.21.15.87:0/1910603604 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9658003a80 0x7f96740b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:39.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.723+0000 7f9679c00640 1 --2- 172.21.15.87:0/1910603604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96740c72b0 0x7f96740c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:39.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.723+0000 7f966be00640 1 -- 172.21.15.87:0/1910603604 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9658003a80 msgr2=0x7f96740b0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:39.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.723+0000 7f966be00640 1 --2- 172.21.15.87:0/1910603604 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9658003a80 0x7f96740b0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.723+0000 7f966be00640 1 -- 172.21.15.87:0/1910603604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96740c72b0 msgr2=0x7f96740c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:39.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.723+0000 7f966be00640 1 --2- 172.21.15.87:0/1910603604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96740c72b0 0x7f96740c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.723+0000 7f966be00640 1 -- 172.21.15.87:0/1910603604 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96740cec00 con 0x7f96740cafa0 2024-05-27T06:30:39.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.723+0000 7f966be00640 1 --2- 172.21.15.87:0/1910603604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96740cafa0 0x7f96740c6d70 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f965c011a00 tx=0x7f965c011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:39.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.723+0000 7f9671600640 1 -- 172.21.15.87:0/1910603604 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c00faf0 con 0x7f96740cafa0 2024-05-27T06:30:39.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.723+0000 7f9671600640 1 -- 172.21.15.87:0/1910603604 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f965c00fc90 con 0x7f96740cafa0 2024-05-27T06:30:39.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.723+0000 7f9671600640 1 -- 172.21.15.87:0/1910603604 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c014440 con 0x7f96740cafa0 2024-05-27T06:30:39.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.723+0000 7f967bc00640 1 -- 172.21.15.87:0/1910603604 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96740c5fb0 con 0x7f96740cafa0 2024-05-27T06:30:39.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.723+0000 7f967bc00640 1 -- 172.21.15.87:0/1910603604 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96740c6570 con 0x7f96740cafa0 2024-05-27T06:30:39.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.727+0000 7f967bc00640 1 -- 172.21.15.87:0/1910603604 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f967406aa30 con 0x7f96740cafa0 2024-05-27T06:30:39.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.727+0000 7f9671600640 1 -- 172.21.15.87:0/1910603604 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f965c012040 con 0x7f96740cafa0 2024-05-27T06:30:39.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.727+0000 7f9671600640 1 --2- 172.21.15.87:0/1910603604 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f965006f430 0x7f9650071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T06:30:39.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.727+0000 7f9671600640 1 -- 172.21.15.87:0/1910603604 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f965c08f720 con 0x7f96740cafa0 2024-05-27T06:30:39.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.727+0000 7f9679200640 1 --2- 172.21.15.87:0/1910603604 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f965006f430 0x7f9650071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T06:30:39.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.727+0000 7f9679200640 1 --2- 172.21.15.87:0/1910603604 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f965006f430 0x7f9650071940 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f96640ae000 tx=0x7f96640046d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T06:30:39.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.731+0000 7f9671600640 1 -- 172.21.15.87:0/1910603604 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f965c019030 con 0x7f96740cafa0 2024-05-27T06:30:39.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.923+0000 7f967bc00640 1 -- 172.21.15.87:0/1910603604 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f967415c810 con 0x7f96740cafa0 2024-05-27T06:30:39.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.923+0000 7f9671600640 1 -- 172.21.15.87:0/1910603604 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+3875 (secure 0 0 0) 0x7f965c05c6e0 con 0x7f96740cafa0 2024-05-27T06:30:39.922 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-27T06:30:39.922 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":29,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5254,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/1883124200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1883124200},{"type":"v1","addr":"172.21.15.149:6834","nonce":1883124200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3525413342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6833","nonce":3525413342},{"type":"v1","addr":"172.21.15.149:6835","nonce":3525413342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5373,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1517601928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1517601928},{"type":"v1","addr":"172.21.15.87:6835","nonce":1517601928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/3256453332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":3256453332},{"type":"v1","addr":"172.21.15.87:6837","nonce":3256453332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[]} 2024-05-27T06:30:39.922 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 29 2024-05-27T06:30:39.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.923+0000 7f967bc00640 1 -- 172.21.15.87:0/1910603604 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f965006f430 msgr2=0x7f9650071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:39.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.923+0000 7f967bc00640 1 --2- 172.21.15.87:0/1910603604 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f965006f430 0x7f9650071940 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f96640ae000 tx=0x7f96640046d0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.923+0000 7f967bc00640 1 -- 172.21.15.87:0/1910603604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96740cafa0 msgr2=0x7f96740c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T06:30:39.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.923+0000 7f967bc00640 1 --2- 172.21.15.87:0/1910603604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96740cafa0 0x7f96740c6d70 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f965c011a00 tx=0x7f965c011ec0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.923+0000 7f967bc00640 1 -- 172.21.15.87:0/1910603604 shutdown_connections 2024-05-27T06:30:39.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.923+0000 7f967bc00640 1 --2- 172.21.15.87:0/1910603604 >> [v2:172.21.15.87:6832/2724754260,v1:172.21.15.87:6833/2724754260] conn(0x7f965006f430 0x7f9650071940 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.923+0000 7f967bc00640 1 --2- 172.21.15.87:0/1910603604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96740c72b0 0x7f96740c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.923+0000 7f967bc00640 1 --2- 172.21.15.87:0/1910603604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96740cafa0 0x7f96740c6d70 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.923+0000 7f967bc00640 1 --2- 172.21.15.87:0/1910603604 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9658003a80 0x7f96740b0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T06:30:39.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.923+0000 7f967bc00640 1 -- 172.21.15.87:0/1910603604 >> 172.21.15.87:0/1910603604 conn(0x7f96740b46b0 msgr2=0x7f96740cddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T06:30:39.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.923+0000 7f967bc00640 1 -- 172.21.15.87:0/1910603604 shutdown_connections 2024-05-27T06:30:39.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-27T06:30:39.923+0000 7f967bc00640 1 -- 172.21.15.87:0/1910603604 wait complete. 2024-05-27T06:30:39.943 DEBUG:tasks.cephfs.filesystem:already dead... 2024-05-27T06:30:39.943 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-27T06:30:39.944 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-27T06:30:39.944 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:30:39.964 INFO:tasks.ceph.mds.a:Stopped 2024-05-27T06:30:39.964 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-27T06:30:39.964 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:30:40.024 INFO:tasks.ceph.mds.c:Stopped 2024-05-27T06:30:40.025 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-27T06:30:40.025 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:30:40.039 INFO:tasks.ceph.mds.b:Stopped 2024-05-27T06:30:40.039 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-27T06:30:40.040 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:30:40.094 INFO:tasks.ceph.mds.d:Stopped 2024-05-27T06:30:40.095 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-27T06:30:40.095 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-27T06:30:40.095 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:30:40.183 INFO:tasks.ceph.osd.0:Stopped 2024-05-27T06:30:40.184 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-27T06:30:40.184 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:30:40.267 INFO:tasks.ceph.osd.1:Stopped 2024-05-27T06:30:40.267 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-27T06:30:40.267 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:30:43.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-05-27T06:30:46.369 INFO:tasks.ceph.osd.2:Stopped 2024-05-27T06:30:46.370 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-27T06:30:46.370 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:30:46.434 INFO:tasks.ceph.osd.3:Stopped 2024-05-27T06:30:46.434 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-27T06:30:46.434 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:30:46.522 INFO:tasks.ceph.osd.4:Stopped 2024-05-27T06:30:46.522 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-27T06:30:46.522 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:30:49.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-05-27T06:30:49.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-05-27T06:30:52.624 INFO:tasks.ceph.osd.5:Stopped 2024-05-27T06:30:52.624 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-27T06:30:52.625 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:30:52.692 INFO:tasks.ceph.osd.6:Stopped 2024-05-27T06:30:52.693 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-27T06:30:52.693 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:30:52.772 INFO:tasks.ceph.osd.7:Stopped 2024-05-27T06:30:52.772 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-27T06:30:52.772 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-27T06:30:52.772 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:30:52.832 INFO:tasks.ceph.mgr.y:Stopped 2024-05-27T06:30:52.833 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-27T06:30:52.833 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:30:52.887 INFO:tasks.ceph.mgr.x:Stopped 2024-05-27T06:30:52.888 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-27T06:30:52.888 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-27T06:30:52.888 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:30:52.907 INFO:tasks.ceph.mon.a:Stopped 2024-05-27T06:30:52.907 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-27T06:30:52.908 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:30:52.924 INFO:tasks.ceph.mon.b:Stopped 2024-05-27T06:30:52.924 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-27T06:30:52.924 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T06:30:52.983 INFO:tasks.ceph.mon.c:Stopped 2024-05-27T06:30:52.983 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-27T06:30:52.984 DEBUG:teuthology.orchestra.run.smithi087:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-05-27T06:30:53.017 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi087.front.sepia.ceph.com 2024-05-27T06:30:53.018 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-27T06:30:53.291 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi087.front.sepia.ceph.com 2024-05-27T06:30:53.292 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-27T06:30:53.445 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi087.front.sepia.ceph.com 2024-05-27T06:30:53.446 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-27T06:30:53.585 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi087.front.sepia.ceph.com 2024-05-27T06:30:53.586 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-27T06:30:53.737 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi149.front.sepia.ceph.com 2024-05-27T06:30:53.737 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-27T06:30:53.975 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi149.front.sepia.ceph.com 2024-05-27T06:30:53.976 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-27T06:30:54.028 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-05-27T06:30:54.183 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi149.front.sepia.ceph.com 2024-05-27T06:30:54.184 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-27T06:30:54.351 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi149.front.sepia.ceph.com 2024-05-27T06:30:54.352 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-27T06:30:54.535 INFO:tasks.ceph:Archiving mon data... 2024-05-27T06:30:54.537 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-05-27_05:52:49-fs-wip-vshankar-testing-20240521.063558-debug-testing-default-smithi/7727605/data/mon.a.tgz 2024-05-27T06:30:54.537 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2024-05-27T06:30:54.546 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.RAJx4Xi2gn 2024-05-27T06:30:54.547 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.RAJx4Xi2gn 2024-05-27T06:30:54.677 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.RAJx4Xi2gn 2024-05-27T06:30:54.756 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.RAJx4Xi2gn is 355KB 2024-05-27T06:30:54.822 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.RAJx4Xi2gn 2024-05-27T06:30:54.831 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-05-27_05:52:49-fs-wip-vshankar-testing-20240521.063558-debug-testing-default-smithi/7727605/data/mon.b.tgz 2024-05-27T06:30:54.831 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2024-05-27T06:30:54.839 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.uUFtVmQytz 2024-05-27T06:30:54.839 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.uUFtVmQytz 2024-05-27T06:30:54.990 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.uUFtVmQytz 2024-05-27T06:30:55.068 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.uUFtVmQytz is 468KB 2024-05-27T06:30:55.170 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.uUFtVmQytz 2024-05-27T06:30:55.178 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-05-27_05:52:49-fs-wip-vshankar-testing-20240521.063558-debug-testing-default-smithi/7727605/data/mon.c.tgz 2024-05-27T06:30:55.178 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2024-05-27T06:30:55.227 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.LNJ7fKawFa 2024-05-27T06:30:55.227 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.LNJ7fKawFa 2024-05-27T06:30:55.376 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.LNJ7fKawFa 2024-05-27T06:30:55.447 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.LNJ7fKawFa is 468KB 2024-05-27T06:30:55.510 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.LNJ7fKawFa 2024-05-27T06:30:55.518 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-27T06:30:55.518 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-27T06:30:55.521 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-27T06:30:55.588 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-27T06:30:55.631 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-27T06:30:55.631 INFO:tasks.ceph:Archiving crash dumps... 2024-05-27T06:30:55.633 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-05-27_05:52:49-fs-wip-vshankar-testing-20240521.063558-debug-testing-default-smithi/7727605/remote/smithi087/crash 2024-05-27T06:30:55.634 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-27T06:30:55.655 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-05-27_05:52:49-fs-wip-vshankar-testing-20240521.063558-debug-testing-default-smithi/7727605/remote/smithi149/crash 2024-05-27T06:30:55.656 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-27T06:30:55.693 INFO:tasks.ceph:Shutting down logrotate 2024-05-27T06:30:55.694 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T06:30:55.702 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T06:30:55.783 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-27T06:30:55.804 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-27T06:30:55.846 INFO:tasks.ceph:Compressing logs... 2024-05-27T06:30:55.847 DEBUG:teuthology.orchestra.run.smithi087:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-27T06:30:55.855 DEBUG:teuthology.orchestra.run.smithi149:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-27T06:30:55.878 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36996.log 2024-05-27T06:30:55.879 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34402.log 2024-05-27T06:30:55.880 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35314.log 2024-05-27T06:30:55.880 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36996.log.gz 2024-05-27T06:30:55.881 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34402.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-27T06:30:55.881 INFO:teuthology.orchestra.run.smithi087.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34402.log.gz 2024-05-27T06:30:55.882 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37687.log 2024-05-27T06:30:55.882 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35314.log.gz 2024-05-27T06:30:55.882 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36366.log 2024-05-27T06:30:55.883 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34552.log 2024-05-27T06:30:55.884 INFO:teuthology.orchestra.run.smithi087.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37687.log.gz 2024-05-27T06:30:55.884 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34976.log 2024-05-27T06:30:55.884 INFO:teuthology.orchestra.run.smithi087.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36366.log.gz 2024-05-27T06:30:55.885 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33402.log 2024-05-27T06:30:55.885 INFO:teuthology.orchestra.run.smithi087.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34552.log.gz 2024-05-27T06:30:55.886 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34959.log 2024-05-27T06:30:55.886 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34976.log.gz 2024-05-27T06:30:55.887 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35340.log 2024-05-27T06:30:55.887 INFO:teuthology.orchestra.run.smithi087.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33402.log.gz 2024-05-27T06:30:55.888 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35208.log 2024-05-27T06:30:55.888 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34959.log.gz 2024-05-27T06:30:55.889 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34480.log 2024-05-27T06:30:55.889 INFO:teuthology.orchestra.run.smithi087.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.35340.log.gz 2024-05-27T06:30:55.890 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40423.log 2024-05-27T06:30:55.890 INFO:teuthology.orchestra.run.smithi087.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35208.log.gz 2024-05-27T06:30:55.891 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40397.log 2024-05-27T06:30:55.891 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34480.log.gz 2024-05-27T06:30:55.892 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40423.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-27T06:30:55.892 INFO:teuthology.orchestra.run.smithi087.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40423.log.gz 2024-05-27T06:30:55.892 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37230.log 2024-05-27T06:30:55.892 INFO:teuthology.orchestra.run.smithi087.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40397.log.gz 2024-05-27T06:30:55.894 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33771.log 2024-05-27T06:30:55.894 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38277.log 2024-05-27T06:30:55.894 INFO:teuthology.orchestra.run.smithi087.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.37230.log.gz 2024-05-27T06:30:55.895 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33771.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33771.log.gz 2024-05-27T06:30:55.895 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34768.log 2024-05-27T06:30:55.897 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39025.log 2024-05-27T06:30:55.897 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38277.log.gz 2024-05-27T06:30:55.897 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35526.log 2024-05-27T06:30:55.897 INFO:teuthology.orchestra.run.smithi087.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34768.log.gz 2024-05-27T06:30:55.898 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34975.log 2024-05-27T06:30:55.898 INFO:teuthology.orchestra.run.smithi087.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39025.log.gz 2024-05-27T06:30:55.899 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.35526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34350.log 2024-05-27T06:30:55.899 INFO:teuthology.orchestra.run.smithi087.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.0.35526.log.gz 2024-05-27T06:30:55.900 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34975.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34975.log.gz 2024-05-27T06:30:55.900 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40163.log 2024-05-27T06:30:55.900 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36641.log 2024-05-27T06:30:55.901 INFO:teuthology.orchestra.run.smithi087.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34350.log.gz 2024-05-27T06:30:55.902 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35930.log 2024-05-27T06:30:55.902 INFO:teuthology.orchestra.run.smithi087.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40163.log.gz 2024-05-27T06:30:55.903 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33875.log 2024-05-27T06:30:55.903 INFO:teuthology.orchestra.run.smithi087.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36641.log.gz 2024-05-27T06:30:55.903 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39397.log 2024-05-27T06:30:55.904 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35930.log.gz 2024-05-27T06:30:55.904 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39651.log 2024-05-27T06:30:55.904 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33875.log.gz 2024-05-27T06:30:55.905 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40475.log 2024-05-27T06:30:55.905 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39397.log.gz 2024-05-27T06:30:55.906 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36693.log 2024-05-27T06:30:55.906 INFO:teuthology.orchestra.run.smithi087.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39651.log.gz 2024-05-27T06:30:55.907 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38303.log 2024-05-27T06:30:55.907 INFO:teuthology.orchestra.run.smithi087.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40475.log.gz 2024-05-27T06:30:55.908 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38440.log 2024-05-27T06:30:55.908 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36693.log.gz 2024-05-27T06:30:55.909 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36184.log 2024-05-27T06:30:55.909 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38303.log.gz 2024-05-27T06:30:55.910 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38076.log 2024-05-27T06:30:55.910 INFO:teuthology.orchestra.run.smithi087.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38440.log.gz 2024-05-27T06:30:55.911 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35182.log 2024-05-27T06:30:55.911 INFO:teuthology.orchestra.run.smithi087.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36184.log.gz 2024-05-27T06:30:55.912 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38199.log 2024-05-27T06:30:55.912 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38076.log.gz 2024-05-27T06:30:55.912 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37022.log 2024-05-27T06:30:55.913 INFO:teuthology.orchestra.run.smithi087.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35182.log.gz 2024-05-27T06:30:55.913 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36411.log 2024-05-27T06:30:55.914 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38199.log.gz 2024-05-27T06:30:55.914 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28124.log 2024-05-27T06:30:55.915 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34960.log 2024-05-27T06:30:55.915 INFO:teuthology.orchestra.run.smithi087.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37022.log.gz 2024-05-27T06:30:55.916 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36411.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-27T06:30:55.916 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36411.log.gz 2024-05-27T06:30:55.917 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38999.log 2024-05-27T06:30:55.918 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34960.log.gz 2024-05-27T06:30:55.918 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38050.log 2024-05-27T06:30:55.919 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-27T06:30:55.919 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.28124.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-27T06:30:55.919 INFO:teuthology.orchestra.run.smithi149.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.28124.log.gz 2024-05-27T06:30:55.919 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28172.log 2024-05-27T06:30:55.919 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28100.log 2024-05-27T06:30:55.920 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.28172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28244.log 2024-05-27T06:30:55.920 INFO:teuthology.orchestra.run.smithi149.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.28172.log.gz 2024-05-27T06:30:55.920 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.28100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33772.log 2024-05-27T06:30:55.920 INFO:teuthology.orchestra.run.smithi149.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28100.log.gz 2024-05-27T06:30:55.922 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.28244.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-27T06:30:55.922 INFO:teuthology.orchestra.run.smithi149.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.28244.log.gz 2024-05-27T06:30:55.922 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.33772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28148.log 2024-05-27T06:30:55.922 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.5.log: 88.7% -- replaced with /var/log/ceph/ceph-client.1.33772.log.gz 2024-05-27T06:30:55.922 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28196.log 2024-05-27T06:30:55.930 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-27T06:30:55.931 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.28148.log: /var/log/ceph/ceph-client.admin.28196.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.28148.log.gz 2024-05-27T06:30:55.931 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-27T06:30:55.931 INFO:teuthology.orchestra.run.smithi149.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28196.log.gz 2024-05-27T06:30:55.931 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28220.log 2024-05-27T06:30:55.931 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-27T06:30:55.931 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.28220.log: 92.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-27T06:30:55.931 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28076.log 2024-05-27T06:30:55.931 INFO:teuthology.orchestra.run.smithi149.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.28220.log.gz 2024-05-27T06:30:55.932 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-27T06:30:55.932 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.28076.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-27T06:30:55.932 INFO:teuthology.orchestra.run.smithi149.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.28076.log.gz 2024-05-27T06:30:55.932 INFO:teuthology.orchestra.run.smithi149.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-27T06:30:55.932 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33891.log 2024-05-27T06:30:55.935 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-27T06:30:55.935 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.3.33891.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-27T06:30:55.936 INFO:teuthology.orchestra.run.smithi149.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-27T06:30:55.936 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-27T06:30:55.936 INFO:teuthology.orchestra.run.smithi149.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.3.33891.log.gz 2024-05-27T06:30:55.936 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-27T06:30:55.936 INFO:teuthology.orchestra.run.smithi149.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-27T06:30:55.937 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38999.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38999.log.gz 2024-05-27T06:30:55.938 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33823.log 2024-05-27T06:30:55.938 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33901.log 2024-05-27T06:30:55.938 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38050.log.gz 2024-05-27T06:30:55.938 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35156.log 2024-05-27T06:30:55.938 INFO:teuthology.orchestra.run.smithi087.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33823.log.gz 2024-05-27T06:30:55.938 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39932.log 2024-05-27T06:30:55.938 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33901.log.gz 2024-05-27T06:30:55.938 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36340.log/var/log/ceph/ceph-client.admin.35156.log: 2024-05-27T06:30:55.939 INFO:teuthology.orchestra.run.smithi087.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35156.log.gz 2024-05-27T06:30:55.939 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34549.log 2024-05-27T06:30:55.939 INFO:teuthology.orchestra.run.smithi087.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39932.log.gz 2024-05-27T06:30:55.939 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36340.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36340.log.gz 2024-05-27T06:30:55.939 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40241.log 2024-05-27T06:30:55.939 INFO:teuthology.orchestra.run.smithi087.stderr:gzip/var/log/ceph/ceph-client.admin.34549.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40293.log 2024-05-27T06:30:55.939 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40241.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34549.log.gz 2024-05-27T06:30:55.939 INFO:teuthology.orchestra.run.smithi087.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-27T06:30:55.940 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37464.log 2024-05-27T06:30:55.940 INFO:teuthology.orchestra.run.smithi087.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40241.log.gz 2024-05-27T06:30:55.940 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33953.log 2024-05-27T06:30:55.940 INFO:teuthology.orchestra.run.smithi087.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40293.log.gz 2024-05-27T06:30:55.940 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34556.log 2024-05-27T06:30:55.940 INFO:teuthology.orchestra.run.smithi087.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37464.log.gz 2024-05-27T06:30:55.940 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36560.log 2024-05-27T06:30:55.941 INFO:teuthology.orchestra.run.smithi087.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.33953.log.gz 2024-05-27T06:30:55.941 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34556.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-27T06:30:55.941 INFO:teuthology.orchestra.run.smithi087.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34556.log.gz 2024-05-27T06:30:55.941 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39677.log 2024-05-27T06:30:55.941 INFO:teuthology.orchestra.run.smithi087.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36560.log.gz 2024-05-27T06:30:55.941 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36210.log 2024-05-27T06:30:55.941 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39157.log 2024-05-27T06:30:55.941 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39677.log.gz 2024-05-27T06:30:55.941 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34246.log 2024-05-27T06:30:55.942 INFO:teuthology.orchestra.run.smithi087.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36210.log.gz 2024-05-27T06:30:55.942 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.39157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34767.log 2024-05-27T06:30:55.942 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36158.log 2024-05-27T06:30:55.942 INFO:teuthology.orchestra.run.smithi087.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34246.log.gz 2024-05-27T06:30:55.945 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39620.log 2024-05-27T06:30:55.945 INFO:teuthology.orchestra.run.smithi087.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.39157.log.gz 2024-05-27T06:30:55.945 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34767.log.gz 2024-05-27T06:30:55.945 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40371.log 2024-05-27T06:30:55.945 INFO:teuthology.orchestra.run.smithi087.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36158.log.gz 2024-05-27T06:30:55.945 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34974.log 2024-05-27T06:30:55.946 INFO:teuthology.orchestra.run.smithi087.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39620.log.gz 2024-05-27T06:30:55.946 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35800.log 2024-05-27T06:30:55.946 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34974.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40371.log.gz 2024-05-27T06:30:55.946 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38707.log 2024-05-27T06:30:55.946 INFO:teuthology.orchestra.run.smithi087.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34974.log.gz 2024-05-27T06:30:55.946 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38329.log 87.7% 2024-05-27T06:30:55.946 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35800.log.gz 2024-05-27T06:30:55.947 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37178.log 2024-05-27T06:30:55.947 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38707.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38707.log.gz 2024-05-27T06:30:55.948 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38407.log 2024-05-27T06:30:55.948 INFO:teuthology.orchestra.run.smithi087.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38329.log.gz 2024-05-27T06:30:55.948 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40345.log 2024-05-27T06:30:55.949 INFO:teuthology.orchestra.run.smithi087.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37178.log.gz 2024-05-27T06:30:55.949 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34743.log 2024-05-27T06:30:55.949 INFO:teuthology.orchestra.run.smithi087.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38407.log.gz 2024-05-27T06:30:55.950 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35262.log 2024-05-27T06:30:55.950 INFO:teuthology.orchestra.run.smithi087.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40345.log.gz 2024-05-27T06:30:55.950 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37048.log 2024-05-27T06:30:55.950 INFO:teuthology.orchestra.run.smithi087.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34743.log.gz 2024-05-27T06:30:55.951 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33650.log 2024-05-27T06:30:55.951 INFO:teuthology.orchestra.run.smithi087.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35262.log.gz 2024-05-27T06:30:55.952 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37048.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37048.log.gz 2024-05-27T06:30:55.952 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37908.log 2024-05-27T06:30:55.952 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36970.log 2024-05-27T06:30:55.954 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33650.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33650.log.gz 2024-05-27T06:30:55.954 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37152.log 2024-05-27T06:30:55.954 INFO:teuthology.orchestra.run.smithi087.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37908.log.gz 2024-05-27T06:30:55.955 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36437.log 2024-05-27T06:30:55.955 INFO:teuthology.orchestra.run.smithi087.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36970.log.gz 2024-05-27T06:30:55.955 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39835.log 2024-05-27T06:30:55.956 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36437.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37152.log.gz 2024-05-27T06:30:55.956 INFO:teuthology.orchestra.run.smithi087.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36437.log.gz 2024-05-27T06:30:55.957 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33797.log 2024-05-27T06:30:55.957 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37828.log 2024-05-27T06:30:55.958 INFO:teuthology.orchestra.run.smithi087.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39835.log.gz 2024-05-27T06:30:55.959 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40189.log 2024-05-27T06:30:55.959 INFO:teuthology.orchestra.run.smithi087.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33797.log.gz 2024-05-27T06:30:55.960 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.37828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38128.log 2024-05-27T06:30:55.961 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38867.log 91.2% 2024-05-27T06:30:55.961 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.0.37828.log.gz 2024-05-27T06:30:55.961 INFO:teuthology.orchestra.run.smithi087.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40189.log.gz 2024-05-27T06:30:55.962 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34428.log 2024-05-27T06:30:55.962 INFO:teuthology.orchestra.run.smithi087.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38128.log.gz 2024-05-27T06:30:55.963 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39755.log 2024-05-27T06:30:55.963 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38867.log.gz 2024-05-27T06:30:55.964 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36132.log 2024-05-27T06:30:55.964 INFO:teuthology.orchestra.run.smithi087.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34428.log.gz 2024-05-27T06:30:55.965 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35774.log 2024-05-27T06:30:55.965 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36132.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39755.log.gz 2024-05-27T06:30:55.966 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36132.log.gz 2024-05-27T06:30:55.966 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40267.log 2024-05-27T06:30:55.967 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35774.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-27T06:30:55.967 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40267.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35774.log.gz 2024-05-27T06:30:55.968 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40267.log.gz 2024-05-27T06:30:55.968 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34958.log 2024-05-27T06:30:55.969 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33469.log 2024-05-27T06:30:55.970 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.34958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33678.log 2024-05-27T06:30:55.970 INFO:teuthology.orchestra.run.smithi087.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34958.log.gz 2024-05-27T06:30:55.971 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34765.log 2024-05-27T06:30:55.971 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33469.log.gz 2024-05-27T06:30:55.972 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34003.log 2024-05-27T06:30:55.972 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33678.log.gz 2024-05-27T06:30:55.973 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33594.log 2024-05-27T06:30:55.973 INFO:teuthology.orchestra.run.smithi087.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34765.log.gz 2024-05-27T06:30:55.974 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38381.log 2024-05-27T06:30:55.974 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34003.log.gz 2024-05-27T06:30:55.975 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40136.log 2024-05-27T06:30:55.975 INFO:teuthology.orchestra.run.smithi087.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33594.log.gz 2024-05-27T06:30:55.977 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40606.log 2024-05-27T06:30:55.977 INFO:teuthology.orchestra.run.smithi087.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38381.log.gz 2024-05-27T06:30:55.978 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36463.log 2024-05-27T06:30:55.978 INFO:teuthology.orchestra.run.smithi087.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40136.log.gz 2024-05-27T06:30:55.979 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36745.log 2024-05-27T06:30:55.979 INFO:teuthology.orchestra.run.smithi087.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40606.log.gz 2024-05-27T06:30:55.979 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35990.log 2024-05-27T06:30:55.980 INFO:teuthology.orchestra.run.smithi087.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36463.log.gz 2024-05-27T06:30:55.981 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35570.log 2024-05-27T06:30:55.981 INFO:teuthology.orchestra.run.smithi087.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36745.log.gz 2024-05-27T06:30:55.982 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35878.log 2024-05-27T06:30:55.982 INFO:teuthology.orchestra.run.smithi087.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35990.log.gz 2024-05-27T06:30:55.983 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40006.log 2024-05-27T06:30:55.983 INFO:teuthology.orchestra.run.smithi087.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35570.log.gz 2024-05-27T06:30:55.984 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34376.log 2024-05-27T06:30:55.984 INFO:teuthology.orchestra.run.smithi087.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35878.log.gz 2024-05-27T06:30:55.985 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40501.log 2024-05-27T06:30:55.985 INFO:teuthology.orchestra.run.smithi087.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40006.log.gz 2024-05-27T06:30:55.986 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36102.log 2024-05-27T06:30:55.986 INFO:teuthology.orchestra.run.smithi087.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34376.log.gz 2024-05-27T06:30:55.987 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37548.log 2024-05-27T06:30:55.987 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40501.log.gz 2024-05-27T06:30:55.988 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40110.log 2024-05-27T06:30:55.989 INFO:teuthology.orchestra.run.smithi087.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36102.log.gz 2024-05-27T06:30:55.990 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39424.log 2024-05-27T06:30:55.990 INFO:teuthology.orchestra.run.smithi087.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37548.log.gz 2024-05-27T06:30:55.991 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.40110.log: /var/log/ceph/ceph-client.admin.38563.log 2024-05-27T06:30:55.991 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40110.log.gz 2024-05-27T06:30:55.991 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39424.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39424.log.gz 2024-05-27T06:30:55.992 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38355.log 2024-05-27T06:30:55.993 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36862.log 2024-05-27T06:30:55.994 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38563.log.gz 2024-05-27T06:30:55.994 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34506.log 2024-05-27T06:30:55.994 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38355.log.gz 2024-05-27T06:30:55.995 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34542.log 2024-05-27T06:30:55.995 INFO:teuthology.orchestra.run.smithi087.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36862.log.gz 2024-05-27T06:30:55.996 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34506.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-27T06:30:55.996 INFO:teuthology.orchestra.run.smithi087.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34506.log.gz 2024-05-27T06:30:55.996 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39451.log 2024-05-27T06:30:55.997 INFO:teuthology.orchestra.run.smithi087.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34542.log.gz 2024-05-27T06:30:55.997 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36314.log 2024-05-27T06:30:55.999 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39906.log 2024-05-27T06:30:55.999 INFO:teuthology.orchestra.run.smithi087.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39451.log.gz 2024-05-27T06:30:56.000 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36314.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36314.log.gz 2024-05-27T06:30:56.001 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39906.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39906.log.gz 2024-05-27T06:30:56.002 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34559.log 2024-05-27T06:30:56.003 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37074.log 2024-05-27T06:30:56.005 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37579.log 2024-05-27T06:30:56.005 INFO:teuthology.orchestra.run.smithi087.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34559.log.gz 2024-05-27T06:30:56.005 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37074.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37074.log.gz 2024-05-27T06:30:56.007 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37579.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37579.log.gz 2024-05-27T06:30:56.007 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33849.log 2024-05-27T06:30:56.008 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37635.log 2024-05-27T06:30:56.010 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35401.log 2024-05-27T06:30:56.010 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33849.log.gz 2024-05-27T06:30:56.013 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.37635.log: /var/log/ceph/ceph-client.admin.35401.log: 90.8% -- replaced with /var/log/ceph/ceph-client.0.37635.log.gz 2024-05-27T06:30:56.013 INFO:teuthology.orchestra.run.smithi087.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35401.log.gz 2024-05-27T06:30:56.013 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40084.log 2024-05-27T06:30:56.014 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37100.log 2024-05-27T06:30:56.015 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28153.log 2024-05-27T06:30:56.015 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40084.log.gz 2024-05-27T06:30:56.017 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37100.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37100.log.gz 2024-05-27T06:30:56.017 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.28153.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.28153.log.gz 2024-05-27T06:30:56.018 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38789.log 2024-05-27T06:30:56.019 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39587.log 2024-05-27T06:30:56.020 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40032.log 2024-05-27T06:30:56.020 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38789.log.gz 2024-05-27T06:30:56.021 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-27T06:30:56.022 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39587.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39587.log.gz 2024-05-27T06:30:56.023 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40032.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40032.log.gz 2024-05-27T06:30:56.024 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36614.log 2024-05-27T06:30:56.024 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34752.log 2024-05-27T06:30:56.026 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39781.log 2024-05-27T06:30:56.026 INFO:teuthology.orchestra.run.smithi087.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36614.log.gz 2024-05-27T06:30:56.027 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34752.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34752.log.gz 2024-05-27T06:30:56.028 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39781.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39781.log.gz 2024-05-27T06:30:56.029 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40215.log 2024-05-27T06:30:56.030 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38225.log 2024-05-27T06:30:56.031 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33502.log 2024-05-27T06:30:56.031 INFO:teuthology.orchestra.run.smithi087.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40215.log.gz 2024-05-27T06:30:56.032 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38225.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38225.log.gz 2024-05-27T06:30:56.033 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33502.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33502.log.gz 2024-05-27T06:30:56.034 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38733.log 2024-05-27T06:30:56.035 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35715.log 2024-05-27T06:30:56.036 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38841.log 2024-05-27T06:30:56.037 INFO:teuthology.orchestra.run.smithi087.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38733.log.gz 2024-05-27T06:30:56.038 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35715.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35715.log.gz 2024-05-27T06:30:56.038 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38841.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38841.log.gz 2024-05-27T06:30:56.039 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35963.log 2024-05-27T06:30:56.040 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39051.log 2024-05-27T06:30:56.041 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39729.log 2024-05-27T06:30:56.041 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35963.log.gz 2024-05-27T06:30:56.042 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39051.log: /var/log/ceph/ceph-client.admin.39729.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.39051.log.gz 2024-05-27T06:30:56.043 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39729.log.gz 2024-05-27T06:30:56.043 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35826.log 2024-05-27T06:30:56.044 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34545.log 2024-05-27T06:30:56.046 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35826.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-27T06:30:56.046 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35826.log.gz 2024-05-27T06:30:56.047 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34545.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34545.log.gz 2024-05-27T06:30:56.048 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40449.log 2024-05-27T06:30:56.049 INFO:teuthology.orchestra.run.smithi087.stderr: 85.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-27T06:30:56.050 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34272.log 2024-05-27T06:30:56.051 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37714.log 2024-05-27T06:30:56.051 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40449.log.gz 2024-05-27T06:30:56.052 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34272.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34272.log.gz 2024-05-27T06:30:56.053 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37714.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37714.log.gz 2024-05-27T06:30:56.053 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40556.log 2024-05-27T06:30:56.055 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34131.log 2024-05-27T06:30:56.056 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39261.log 2024-05-27T06:30:56.056 INFO:teuthology.orchestra.run.smithi087.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40556.log.gz 2024-05-27T06:30:56.059 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34131.log: /var/log/ceph/ceph-client.admin.39261.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39261.log.gz 2024-05-27T06:30:56.059 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38947.log 2024-05-27T06:30:56.059 INFO:teuthology.orchestra.run.smithi087.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.34131.log.gz 2024-05-27T06:30:56.059 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36771.log 2024-05-27T06:30:56.060 INFO:teuthology.orchestra.run.smithi149.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-27T06:30:56.061 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38947.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38947.log.gz 2024-05-27T06:30:56.062 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36771.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36771.log.gz 2024-05-27T06:30:56.063 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36075.log 2024-05-27T06:30:56.064 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37336.log 2024-05-27T06:30:56.065 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34189.log 2024-05-27T06:30:56.065 INFO:teuthology.orchestra.run.smithi087.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36075.log.gz 2024-05-27T06:30:56.067 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.37336.log: /var/log/ceph/ceph-client.admin.34189.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34189.log.gz 2024-05-27T06:30:56.068 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36021.log 2024-05-27T06:30:56.068 INFO:teuthology.orchestra.run.smithi087.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.37336.log.gz 2024-05-27T06:30:56.069 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34764.log 2024-05-27T06:30:56.070 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39101.log 2024-05-27T06:30:56.070 INFO:teuthology.orchestra.run.smithi087.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36021.log.gz 2024-05-27T06:30:56.071 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34764.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34764.log.gz 2024-05-27T06:30:56.073 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39101.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39101.log.gz 2024-05-27T06:30:56.073 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37494.log 2024-05-27T06:30:56.074 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38024.log 2024-05-27T06:30:56.076 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38102.log 2024-05-27T06:30:56.076 INFO:teuthology.orchestra.run.smithi087.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37494.log.gz 2024-05-27T06:30:56.077 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38024.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38024.log.gz 2024-05-27T06:30:56.078 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38102.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38102.log.gz 2024-05-27T06:30:56.078 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37881.log 2024-05-27T06:30:56.079 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38895.log 2024-05-27T06:30:56.081 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27933.log 2024-05-27T06:30:56.081 INFO:teuthology.orchestra.run.smithi087.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37881.log.gz 2024-05-27T06:30:56.082 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38895.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38895.log.gz 2024-05-27T06:30:56.083 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.27933.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.27933.log.gz 2024-05-27T06:30:56.083 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34298.log 2024-05-27T06:30:56.084 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38763.log 2024-05-27T06:30:56.086 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38251.log 2024-05-27T06:30:56.086 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34298.log.gz 2024-05-27T06:30:56.087 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38763.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38763.log.gz 2024-05-27T06:30:56.088 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38251.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38251.log.gz 2024-05-27T06:30:56.088 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39207.log 2024-05-27T06:30:56.089 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35236.log 2024-05-27T06:30:56.091 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34560.log 2024-05-27T06:30:56.092 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39207.log.gz 2024-05-27T06:30:56.092 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35236.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35236.log.gz 2024-05-27T06:30:56.093 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34560.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34560.log.gz 2024-05-27T06:30:56.093 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37746.log 2024-05-27T06:30:56.094 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38681.log 2024-05-27T06:30:56.096 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34558.log 2024-05-27T06:30:56.096 INFO:teuthology.orchestra.run.smithi087.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37746.log.gz 2024-05-27T06:30:56.097 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38681.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38681.log.gz 2024-05-27T06:30:56.098 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34558.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34558.log.gz 2024-05-27T06:30:56.098 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37521.log 2024-05-27T06:30:56.099 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38589.log 2024-05-27T06:30:56.101 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36495.log 2024-05-27T06:30:56.101 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37521.log.gz 2024-05-27T06:30:56.102 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38589.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38589.log.gz 2024-05-27T06:30:56.103 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36495.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36495.log.gz 2024-05-27T06:30:56.103 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40527.log 2024-05-27T06:30:56.104 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38973.log 2024-05-27T06:30:56.106 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37412.log 2024-05-27T06:30:56.106 INFO:teuthology.orchestra.run.smithi087.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40527.log.gz 2024-05-27T06:30:56.107 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38973.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38973.log.gz 2024-05-27T06:30:56.108 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37412.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37412.log.gz 2024-05-27T06:30:56.109 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-27T06:30:56.109 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34454.log 2024-05-27T06:30:56.112 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-27T06:30:56.112 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34454.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34454.log.gz 2024-05-27T06:30:56.113 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39958.log 2024-05-27T06:30:56.113 INFO:teuthology.orchestra.run.smithi087.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-27T06:30:56.114 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34971.log 2024-05-27T06:30:56.115 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39958.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39958.log.gz 2024-05-27T06:30:56.116 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34971.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34971.log.gz 2024-05-27T06:30:56.116 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-27T06:30:56.117 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35288.log 2024-05-27T06:30:56.120 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38815.log 2024-05-27T06:30:56.120 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35288.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35288.log.gz 2024-05-27T06:30:56.121 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35852.log 2024-05-27T06:30:56.122 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38815.log.gz 2024-05-27T06:30:56.124 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39291.log 2024-05-27T06:30:56.127 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39291.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39291.log.gz 2024-05-27T06:30:56.128 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37204.log 2024-05-27T06:30:56.131 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37204.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37204.log.gz 2024-05-27T06:30:56.131 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35852.log.gz 2024-05-27T06:30:56.131 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39234.log 2024-05-27T06:30:56.134 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39234.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39234.log.gz 2024-05-27T06:30:56.134 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37939.log 2024-05-27T06:30:56.137 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37939.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37939.log.gz 2024-05-27T06:30:56.137 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36667.log 2024-05-27T06:30:56.140 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36667.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36667.log.gz 2024-05-27T06:30:56.140 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36799.log 2024-05-27T06:30:56.143 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37384.log 2024-05-27T06:30:56.143 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36799.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36799.log.gz 2024-05-27T06:30:56.144 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36888.log 2024-05-27T06:30:56.146 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37384.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37384.log.gz 2024-05-27T06:30:56.147 INFO:teuthology.orchestra.run.smithi087.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-27T06:30:56.148 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37772.log 2024-05-27T06:30:56.149 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36888.log.gz 2024-05-27T06:30:56.149 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33568.log 2024-05-27T06:30:56.151 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37772.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37772.log.gz 2024-05-27T06:30:56.152 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33568.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33568.log.gz 2024-05-27T06:30:56.152 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39703.log 2024-05-27T06:30:56.153 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28054.log 2024-05-27T06:30:56.155 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39703.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39703.log.gz 2024-05-27T06:30:56.156 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.28054.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.28054.log.gz 2024-05-27T06:30:56.156 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36288.log 2024-05-27T06:30:56.158 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39537.log 2024-05-27T06:30:56.159 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36288.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36288.log.gz 2024-05-27T06:30:56.161 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.39537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34948.log 2024-05-27T06:30:56.162 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37280.log 2024-05-27T06:30:56.163 INFO:teuthology.orchestra.run.smithi087.stderr: 90.1%/var/log/ceph/ceph-client.admin.34948.log: -- replaced with /var/log/ceph/ceph-client.0.39537.log.gz 2024-05-27T06:30:56.163 INFO:teuthology.orchestra.run.smithi087.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34948.log.gz 2024-05-27T06:30:56.164 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40319.log 2024-05-27T06:30:56.166 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37280.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37280.log.gz 2024-05-27T06:30:56.166 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36586.log 2024-05-27T06:30:56.167 INFO:teuthology.orchestra.run.smithi087.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40319.log.gz 2024-05-27T06:30:56.168 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36236.log 2024-05-27T06:30:56.169 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36586.log.gz 2024-05-27T06:30:56.171 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33713.log 2024-05-27T06:30:56.171 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36236.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36236.log.gz 2024-05-27T06:30:56.172 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33713.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33713.log.gz 2024-05-27T06:30:56.172 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35742.log 2024-05-27T06:30:56.174 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38154.log 2024-05-27T06:30:56.175 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35742.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35742.log.gz 2024-05-27T06:30:56.176 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38154.log: 90.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-27T06:30:56.176 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38154.log.gz 2024-05-27T06:30:56.177 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39807.log 2024-05-27T06:30:56.178 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38537.log 2024-05-27T06:30:56.179 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34324.log 2024-05-27T06:30:56.179 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39807.log.gz 2024-05-27T06:30:56.180 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38537.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38537.log.gz 2024-05-27T06:30:56.180 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33739.log 2024-05-27T06:30:56.182 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34324.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34324.log.gz 2024-05-27T06:30:56.183 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33620.log 2024-05-27T06:30:56.183 INFO:teuthology.orchestra.run.smithi087.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33739.log.gz 2024-05-27T06:30:56.184 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35665.log 2024-05-27T06:30:56.186 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36047.log 2024-05-27T06:30:56.186 INFO:teuthology.orchestra.run.smithi087.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33620.log.gz 2024-05-27T06:30:56.187 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.2.35665.log: /var/log/ceph/ceph-client.admin.36047.log: 89.8% -- replaced with /var/log/ceph/ceph-client.2.35665.log.gz 2024-05-27T06:30:56.187 INFO:teuthology.orchestra.run.smithi087.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36047.log.gz 2024-05-27T06:30:56.188 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38618.log 2024-05-27T06:30:56.189 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37126.log 2024-05-27T06:30:56.190 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36914.log 2024-05-27T06:30:56.190 INFO:teuthology.orchestra.run.smithi087.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38618.log.gz 2024-05-27T06:30:56.191 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37126.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37126.log.gz 2024-05-27T06:30:56.192 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36914.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36914.log.gz 2024-05-27T06:30:56.193 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39880.log 2024-05-27T06:30:56.194 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38646.log 2024-05-27T06:30:56.196 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37438.log 2024-05-27T06:30:56.196 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39880.log.gz 2024-05-27T06:30:56.196 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38646.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38646.log.gz 2024-05-27T06:30:56.197 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37438.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37438.log.gz 2024-05-27T06:30:56.198 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38921.log 2024-05-27T06:30:56.199 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39347.log 2024-05-27T06:30:56.200 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33927.log 2024-05-27T06:30:56.201 INFO:teuthology.orchestra.run.smithi087.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38921.log.gz 2024-05-27T06:30:56.203 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.39347.log: /var/log/ceph/ceph-client.admin.33927.log: 89.6% -- replaced with /var/log/ceph/ceph-client.0.39347.log.gz 2024-05-27T06:30:56.203 INFO:teuthology.orchestra.run.smithi087.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33927.log.gz 2024-05-27T06:30:56.203 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40580.log 2024-05-27T06:30:56.205 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.23124.log 2024-05-27T06:30:56.206 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40058.log 2024-05-27T06:30:56.207 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40580.log.gz 2024-05-27T06:30:56.208 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph.tmp-client.admin.23124.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.23124.log.gz 2024-05-27T06:30:56.208 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40058.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40058.log.gz 2024-05-27T06:30:56.209 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36827.log 2024-05-27T06:30:56.210 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34749.log 2024-05-27T06:30:56.212 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36719.log 2024-05-27T06:30:56.212 INFO:teuthology.orchestra.run.smithi087.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36827.log.gz 2024-05-27T06:30:56.213 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34749.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34749.log.gz 2024-05-27T06:30:56.214 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36719.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36719.log.gz 2024-05-27T06:30:56.214 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34751.log 2024-05-27T06:30:56.215 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37998.log 2024-05-27T06:30:56.216 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36262.log 2024-05-27T06:30:56.217 INFO:teuthology.orchestra.run.smithi087.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34751.log.gz 2024-05-27T06:30:56.217 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37998.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37998.log.gz 2024-05-27T06:30:56.218 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36262.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36262.log.gz 2024-05-27T06:30:56.219 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35904.log 2024-05-27T06:30:56.220 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39481.log 2024-05-27T06:30:56.222 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38472.log 2024-05-27T06:30:56.222 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35904.log.gz 2024-05-27T06:30:56.222 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39481.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39481.log.gz 2024-05-27T06:30:56.224 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38472.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38472.log.gz 2024-05-27T06:30:56.224 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34216.log 2024-05-27T06:30:56.225 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36944.log 2024-05-27T06:30:56.227 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37972.log 2024-05-27T06:30:56.227 INFO:teuthology.orchestra.run.smithi087.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34216.log.gz 2024-05-27T06:30:56.228 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36944.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36944.log.gz 2024-05-27T06:30:56.229 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37972.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37972.log.gz 2024-05-27T06:30:56.269 INFO:teuthology.orchestra.run.smithi087.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-27T06:30:56.628 INFO:teuthology.orchestra.run.smithi087.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-27T06:30:56.639 INFO:teuthology.orchestra.run.smithi149.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-27T06:30:56.642 INFO:teuthology.orchestra.run.smithi149.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-27T06:30:56.691 INFO:teuthology.orchestra.run.smithi087.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-27T06:30:56.710 INFO:teuthology.orchestra.run.smithi149.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-27T06:30:56.741 INFO:teuthology.orchestra.run.smithi087.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-27T06:30:56.761 INFO:teuthology.orchestra.run.smithi149.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-27T06:30:56.763 INFO:teuthology.orchestra.run.smithi149.stderr: 2024-05-27T06:30:56.763 INFO:teuthology.orchestra.run.smithi149.stderr:real 0m0.865s 2024-05-27T06:30:56.763 INFO:teuthology.orchestra.run.smithi149.stderr:user 0m3.064s 2024-05-27T06:30:56.764 INFO:teuthology.orchestra.run.smithi149.stderr:sys 0m0.301s 2024-05-27T06:30:56.805 INFO:teuthology.orchestra.run.smithi087.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-27T06:30:56.807 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-05-27T06:30:56.807 INFO:teuthology.orchestra.run.smithi087.stderr:real 0m0.948s 2024-05-27T06:30:56.807 INFO:teuthology.orchestra.run.smithi087.stderr:user 0m3.621s 2024-05-27T06:30:56.807 INFO:teuthology.orchestra.run.smithi087.stderr:sys 0m0.649s 2024-05-27T06:30:56.808 INFO:tasks.ceph:Archiving logs... 2024-05-27T06:30:56.808 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-27_05:52:49-fs-wip-vshankar-testing-20240521.063558-debug-testing-default-smithi/7727605/remote/smithi087/log 2024-05-27T06:30:56.809 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-27T06:30:57.492 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-27_05:52:49-fs-wip-vshankar-testing-20240521.063558-debug-testing-default-smithi/7727605/remote/smithi149/log 2024-05-27T06:30:57.493 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-27T06:30:57.894 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-27T06:30:57.904 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-27T06:30:57.904 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-27T06:30:57.908 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-27T06:30:57.996 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-27T06:30:58.010 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-27T06:30:58.011 DEBUG:teuthology.orchestra.run.smithi087:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-27T06:30:58.014 DEBUG:teuthology.orchestra.run.smithi149:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-27T06:30:58.027 INFO:teuthology.orchestra.run.smithi087.stdout: remote refid st t when poll reach delay offset jitter 2024-05-27T06:30:58.027 INFO:teuthology.orchestra.run.smithi087.stdout:============================================================================== 2024-05-27T06:30:58.027 INFO:teuthology.orchestra.run.smithi087.stdout:+hv01.front.sepi 67.205.162.81 3 u 42 64 177 0.069 -1.607 1.040 2024-05-27T06:30:58.027 INFO:teuthology.orchestra.run.smithi087.stdout:+hv02.front.sepi 63.231.80.2 3 u 42 64 177 0.160 -0.595 0.947 2024-05-27T06:30:58.028 INFO:teuthology.orchestra.run.smithi087.stdout:*hv03.front.sepi 74.6.168.72 3 u 48 64 177 0.073 -0.334 1.078 2024-05-27T06:30:58.028 INFO:teuthology.orchestra.run.smithi087.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-27T06:30:58.030 INFO:teuthology.orchestra.run.smithi149.stdout: remote refid st t when poll reach delay offset jitter 2024-05-27T06:30:58.031 INFO:teuthology.orchestra.run.smithi149.stdout:============================================================================== 2024-05-27T06:30:58.031 INFO:teuthology.orchestra.run.smithi149.stdout:+hv01.front.sepi 67.205.162.81 3 u 48 64 177 0.142 -1.536 0.398 2024-05-27T06:30:58.031 INFO:teuthology.orchestra.run.smithi149.stdout:+hv02.front.sepi 63.231.80.2 3 u 44 64 177 0.127 -0.507 0.657 2024-05-27T06:30:58.031 INFO:teuthology.orchestra.run.smithi149.stdout:*hv03.front.sepi 74.6.168.72 3 u 47 64 177 0.096 -0.292 0.442 2024-05-27T06:30:58.032 INFO:teuthology.orchestra.run.smithi149.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-27T06:30:58.032 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-27T06:30:58.048 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-27T06:30:58.048 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-27T06:30:58.081 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-27T06:30:58.105 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-27T06:30:58.150 INFO:teuthology.task.internal:Duration was 909.624690 seconds 2024-05-27T06:30:58.151 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-27T06:30:58.161 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-27T06:30:58.162 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-27T06:30:58.165 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-27T06:30:58.283 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-27T06:30:58.283 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi087.front.sepia.ceph.com 2024-05-27T06:30:58.283 DEBUG:teuthology.orchestra.run.smithi087:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-27T06:30:58.303 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi149.front.sepia.ceph.com 2024-05-27T06:30:58.303 DEBUG:teuthology.orchestra.run.smithi149:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-27T06:30:58.323 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-27T06:30:58.324 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-27T06:30:58.351 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-27T06:30:58.404 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-27T06:30:58.404 DEBUG:teuthology.orchestra.run.smithi087:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-27T06:30:58.436 DEBUG:teuthology.orchestra.run.smithi149:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-27T06:30:58.515 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-27T06:30:58.525 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-27T06:30:58.526 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-27T06:30:58.545 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-27T06:30:58.565 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-27T06:30:58.576 DEBUG:teuthology.orchestra.run.smithi087:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-27T06:30:58.591 DEBUG:teuthology.orchestra.run.smithi149:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-27T06:30:58.605 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = core 2024-05-27T06:30:58.628 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = core 2024-05-27T06:30:58.646 DEBUG:teuthology.orchestra.run.smithi087:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-27T06:30:58.670 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T06:30:58.671 DEBUG:teuthology.orchestra.run.smithi149:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-27T06:30:58.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T06:30:58.694 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-27T06:30:58.704 INFO:teuthology.task.internal:Transferring archived files... 2024-05-27T06:30:58.705 DEBUG:teuthology.misc:Transferring archived files from smithi087:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-27_05:52:49-fs-wip-vshankar-testing-20240521.063558-debug-testing-default-smithi/7727605/remote/smithi087 2024-05-27T06:30:58.705 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-27T06:30:58.738 DEBUG:teuthology.misc:Transferring archived files from smithi149:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-27_05:52:49-fs-wip-vshankar-testing-20240521.063558-debug-testing-default-smithi/7727605/remote/smithi149 2024-05-27T06:30:58.738 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-27T06:30:58.763 INFO:teuthology.task.internal:Removing archive directory... 2024-05-27T06:30:58.764 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-27T06:30:58.778 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-27T06:30:58.812 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-27T06:30:58.823 INFO:teuthology.task.internal:Not uploading archives. 2024-05-27T06:30:58.823 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-27T06:30:58.836 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-27T06:30:58.836 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-27T06:30:58.840 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-27T06:30:58.846 INFO:teuthology.orchestra.run.smithi087.stdout: 655441 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 27 06:30 /home/ubuntu/cephtest 2024-05-27T06:30:58.867 INFO:teuthology.orchestra.run.smithi149.stdout: 655427 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 27 06:30 /home/ubuntu/cephtest 2024-05-27T06:30:58.869 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-27T06:30:58.880 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-27T06:30:59.004 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/pool-perm} duration: 909.6246898174286 failure_reason: 'Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm)' flavor: default mon.a-kernel-sha1: b9459a26b0888785d05c47deb35abc9d0354ab93 mon.b-kernel-sha1: b9459a26b0888785d05c47deb35abc9d0354ab93 owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=1ac8abedd9f84009a7d211f00e293f94 status: fail success: false 2024-05-27T06:30:59.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-27T06:30:59.088 INFO:teuthology.run:FAIL